hoshi-hiyouga
|
e83e36e475
|
Merge pull request #4781 from hzhaoy/fix-dockerfile-cuda
Fix cuda Dockerfile
Former-commit-id: 5da54deb50
|
2024-07-13 22:25:32 +08:00 |
|
hiyouga
|
3baf1d1f7e
|
fix #4792
Former-commit-id: 6b48308ef9
|
2024-07-13 22:07:58 +08:00 |
|
hzhaoy
|
955e01c038
|
tiny fix
Former-commit-id: 8bab99c582
|
2024-07-12 00:28:44 +08:00 |
|
hoshi-hiyouga
|
f85187b4dd
|
Merge pull request #4700 from marko1616/patch-1
Fix Windows command preview
Former-commit-id: 555194e150
|
2024-07-10 13:51:50 +08:00 |
|
hoshi-hiyouga
|
4edd7c3529
|
Update callbacks.py
Former-commit-id: 39cd89ce17
|
2024-07-10 13:32:20 +08:00 |
|
-.-
|
973aac3203
|
fix src/llamafactory/train/callbacks.py
Former-commit-id: cff89a2e89
|
2024-07-10 12:05:51 +08:00 |
|
hiyouga
|
a9ce54d143
|
fix #4731
Former-commit-id: 51942acee8
|
2024-07-10 11:32:36 +08:00 |
|
hiyouga
|
d7130ec635
|
fix ppo trainer
Former-commit-id: fb0c400116
|
2024-07-10 11:05:45 +08:00 |
|
hiyouga
|
aa15ca1719
|
fix #4742
Former-commit-id: 2f09520c0d
|
2024-07-09 23:24:24 +08:00 |
|
hoshi-hiyouga
|
7483e187c6
|
Update packages.py
Former-commit-id: f84b007ebb
|
2024-07-07 15:48:29 +08:00 |
|
Lian Junhong
|
7ca84e0a09
|
chore: Update vllm_engine.py to support vllm version >= 0.5.1
Former-commit-id: 322663bf90
|
2024-07-07 15:08:12 +08:00 |
|
hiyouga
|
f3c105f088
|
fix #4705
Former-commit-id: a15782cb9f
|
2024-07-07 13:10:06 +08:00 |
|
marko1616
|
c8205c5163
|
Update utils.py
In windows mutiline command should like
command --arg1 xxx `
--arg2 xxx `
Former-commit-id: e0562521bb
|
2024-07-06 20:40:13 +08:00 |
|
hiyouga
|
7fcffb860d
|
add codegeex4, internlm2.5
Former-commit-id: 53b1002fb7
|
2024-07-06 16:16:47 +08:00 |
|
hiyouga
|
8379a39776
|
fix processors
Former-commit-id: 9f33f1edf5
|
2024-07-05 08:33:22 +08:00 |
|
hiyouga
|
9aa3403687
|
fix #4683
Former-commit-id: e43809bced
|
2024-07-05 00:58:05 +08:00 |
|
hiyouga
|
956e555310
|
fix #4674
Former-commit-id: ed232311e8
|
2024-07-05 00:41:03 +08:00 |
|
hiyouga
|
c1262dbf94
|
Merge branch 'main' of https://github.com/hiyouga/LLaMA-Factory
Former-commit-id: 226a9e563f
|
2024-07-04 14:23:37 +08:00 |
|
hiyouga
|
e17f12fcad
|
fix #4677
Former-commit-id: 1e27e8c776
|
2024-07-04 14:22:07 +08:00 |
|
hzhaoy
|
6d892dbc23
|
tiny fix
Former-commit-id: 738df47748
|
2024-07-04 10:20:28 +08:00 |
|
hiyouga
|
d7657d772d
|
tiny fix
Former-commit-id: 0c699de39d
|
2024-07-04 03:47:05 +08:00 |
|
hiyouga
|
cbb93a2b47
|
tiny fix
Former-commit-id: 44747cebd2
|
2024-07-04 03:02:23 +08:00 |
|
hiyouga
|
4987aa32ba
|
fix data map for packing
Former-commit-id: b5d101e1bf
|
2024-07-04 03:01:31 +08:00 |
|
hiyouga
|
7b3c1f29ff
|
fix packing for eager/sdpa attn
Former-commit-id: 6fd6aa4530
|
2024-07-04 01:52:43 +08:00 |
|
hoshi-hiyouga
|
a38ff842d0
|
Merge pull request #4224 from chuan298/main
Implement efficient packing without cross-contamination attention
Former-commit-id: 87d9b2d005
|
2024-07-04 01:18:54 +08:00 |
|
hiyouga
|
bfdaadcc40
|
update packing
Former-commit-id: cce7083024
|
2024-07-04 01:10:55 +08:00 |
|
hoshi-hiyouga
|
51c75985b8
|
Update packing.py
Former-commit-id: a36e8f2dd5
|
2024-07-03 23:36:01 +08:00 |
|
hiyouga
|
13cec0cc2f
|
update func name
Former-commit-id: c346f79f99
|
2024-07-03 23:29:33 +08:00 |
|
hiyouga
|
e671ed520b
|
update arg name
Former-commit-id: 8a6a7b9c8a
|
2024-07-03 23:23:24 +08:00 |
|
hiyouga
|
ff6fc666c1
|
update hparams
Former-commit-id: 575a02a23d
|
2024-07-03 23:18:58 +08:00 |
|
hiyouga
|
b254df2d34
|
update ui
Former-commit-id: 7f770f6895
|
2024-07-03 23:13:49 +08:00 |
|
hiyouga
|
3595d98b4c
|
fix #4609
unwrap_model_for_generation(reward_model) is necessary for zero3 training
Former-commit-id: 8845e94f91
|
2024-07-03 19:45:51 +08:00 |
|
hiyouga
|
104151d558
|
tiny fix
Former-commit-id: 8b1172b910
|
2024-07-03 02:31:50 +08:00 |
|
hiyouga
|
c9e9beee4e
|
tiny fix
Former-commit-id: 71cdf8956e
|
2024-07-02 23:06:13 +08:00 |
|
hiyouga
|
ea2d3f6c18
|
remove rlhf support for chatglm2&3
Former-commit-id: 821bb6660e
|
2024-07-02 23:03:17 +08:00 |
|
hiyouga
|
4828bed837
|
upcast logits
Former-commit-id: c13ae2df19
|
2024-07-02 22:32:05 +08:00 |
|
hiyouga
|
cc31014002
|
improve rlhf
Former-commit-id: c47ab6c072
|
2024-07-02 22:23:08 +08:00 |
|
ancv
|
7f42932957
|
move efficient_packing from data_args to model_args
Former-commit-id: e8e13b0942
|
2024-07-02 18:37:55 +07:00 |
|
hoshi-hiyouga
|
773d857eb8
|
Merge pull request #4651 from hzhaoy/add-telechat-1b
Add TeleChat-1B
Former-commit-id: 4e4b3cc905
|
2024-07-02 17:56:43 +08:00 |
|
hzhaoy
|
28e787116b
|
add TeleChat-1B
Former-commit-id: 57b7c00430
|
2024-07-02 17:49:04 +08:00 |
|
hiyouga
|
08296f4092
|
fix ppo callbacks
Former-commit-id: 4c296001c4
|
2024-07-02 17:34:56 +08:00 |
|
hoshi-hiyouga
|
2452f57cd7
|
Merge branch 'main' into main
Former-commit-id: e8e6af2651
|
2024-07-01 21:01:09 +08:00 |
|
hiyouga
|
2cf03017a0
|
tiny fix
Former-commit-id: 73280b7dc7
|
2024-07-01 05:43:17 +08:00 |
|
hiyouga
|
de4de5b5ab
|
tiny fix
Former-commit-id: 8c41a0aa6d
|
2024-07-01 03:55:20 +08:00 |
|
hiyouga
|
54e786346e
|
add eval acc
Former-commit-id: 1856a08e87
|
2024-07-01 03:51:20 +08:00 |
|
hiyouga
|
ca7b65439d
|
fix #4402 #4617
Deprecate reserved_label_len arg
Former-commit-id: 1771251ce3
|
2024-07-01 01:19:27 +08:00 |
|
hiyouga
|
bbc37b2880
|
fix #4398 #4592
Former-commit-id: d74244d568
|
2024-06-30 21:28:51 +08:00 |
|
hiyouga
|
2b006beab1
|
loose gemma2 attention
Former-commit-id: 2f4b89ace1
|
2024-06-29 01:42:14 +08:00 |
|
hiyouga
|
87e60f8bac
|
bf16 by default, gemma2 attns
Gemma2 finetuning cannot work until merging https://github.com/huggingface/transformers/pull/31674
Former-commit-id: 4d35e218b1
|
2024-06-28 06:00:26 +08:00 |
|
hiyouga
|
b0acd27114
|
increase pissa_iter for stability
Former-commit-id: 64f4337dac
|
2024-06-28 03:18:54 +08:00 |
|