hiyouga
|
c0c387e4db
|
release v0.8.0
Former-commit-id: 004db680b9e3996ec511ee818df6c0c02bf13603
v0.8.0
|
2024-06-08 05:20:54 +08:00 |
|
hiyouga
|
ae60ea15da
|
add ultrafeedback and fineweb #4085 #4132
Former-commit-id: 968e4992e2f2a3ccba73e8668f1654ddc6eb0034
|
2024-06-08 02:42:34 +08:00 |
|
hiyouga
|
72cd1123a8
|
fix ci
Former-commit-id: 3f4d293fd861d765edb2040f80d16f99a5e1e3c6
|
2024-06-08 02:00:44 +08:00 |
|
hiyouga
|
1364190a66
|
fix ci
Former-commit-id: 95aceebd61d195be5c980a919c12c59b56722898
|
2024-06-08 01:57:36 +08:00 |
|
hiyouga
|
6d17c59090
|
add ci
Former-commit-id: 3ea3acdadaa54abe33d93538580196cfdd91ee56
|
2024-06-08 01:48:30 +08:00 |
|
hiyouga
|
e0f2c0b5dc
|
init unittest
Former-commit-id: 1c6f21cb8878ced043fe0b27c72cad2ef6ee990e
|
2024-06-08 01:35:58 +08:00 |
|
hiyouga
|
073e34855d
|
Delete .readthedocs.yaml
Former-commit-id: dd3ee514216a9a329519c58d79208040adcad126
|
2024-06-08 00:58:10 +08:00 |
|
hiyouga
|
ff9ba70bb8
|
reorganize adapter code
Former-commit-id: b26c2df9d97f4efffccbf7d28de13619b43f10dd
|
2024-06-08 00:47:23 +08:00 |
|
hoshi-hiyouga
|
adbebb0e3f
|
fix #4139
Former-commit-id: c025a4d74f293c14c2705e68af20a82a84608520
|
2024-06-08 00:45:02 +08:00 |
|
hiyouga
|
3f6b3eed98
|
add resume args in webui
Former-commit-id: 1d86ad768b1f36e54b4c2a9f18f6ea5a7df04c90
|
2024-06-08 00:22:16 +08:00 |
|
hiyouga
|
f45e81e186
|
fix #4137
Former-commit-id: cdc0d6f5a2e5040e145c82c4801f37bd76529047
|
2024-06-07 19:16:06 +08:00 |
|
hiyouga
|
ba648fd003
|
tiny fix
Former-commit-id: 0621bcad1dfbe8ce2464f741d4256c5df2a8d1b6
|
2024-06-07 05:19:21 +08:00 |
|
hiyouga
|
b0e5a76f4c
|
fix ppo trainer save zero3 model
accelerator.get_state_dict(ds_model) should be called at all ranks
Former-commit-id: 3a0f60f0aa072531e4ae5819ec00c8fa42aa0913
|
2024-06-07 05:14:19 +08:00 |
|
hiyouga
|
8692796c9b
|
fix ppo in trl 0.8.6
Former-commit-id: 5e0d66a0d80b4bd4a8506e2317209d8fb9d25ff6
|
2024-06-07 04:48:29 +08:00 |
|
hiyouga
|
d0edcde4ea
|
fix #4120
Former-commit-id: 2a44da678a5e360a9c0f9056397ac9e801329321
|
2024-06-07 04:18:05 +08:00 |
|
hiyouga
|
8c4c2e580c
|
update data processors
Former-commit-id: 04b138cbcb8b9a72e4bbda6c65843bb459e525e7
|
2024-06-07 04:15:40 +08:00 |
|
hoshi-hiyouga
|
07f33e7641
|
Merge pull request #4009 from AlongWY/main
supervised packing with greedy knapsack algorithm
Former-commit-id: 5ded166b39a75a98ded5733678f5a1eab7d4cc71
|
2024-06-07 03:48:46 +08:00 |
|
hoshi-hiyouga
|
1998c641af
|
Update supervised.py
Former-commit-id: 04b6c2a754e602e0b698cfe6c255c2f2486d8865
|
2024-06-07 03:42:08 +08:00 |
|
hoshi-hiyouga
|
be1e5f9d62
|
Update supervised.py
Former-commit-id: 49993c4f4e1f871a22ff0196afe60026b668a4dc
|
2024-06-07 03:38:23 +08:00 |
|
hoshi-hiyouga
|
fdeec6db52
|
Update supervised.py
Former-commit-id: 67625b5278a839c12a3e4245f9e90af67d8b11b4
|
2024-06-07 03:38:04 +08:00 |
|
hiyouga
|
a4d335b42f
|
add qwen2 models
Former-commit-id: 49cb694d02c876e3740a003a8b332349f4310ad3
|
2024-06-07 00:22:57 +08:00 |
|
hiyouga
|
fcb134e144
|
rename files
Former-commit-id: e1a8431770fc36c0c9ee7fed4abbc3d7fdcc5efd
|
2024-06-07 00:09:06 +08:00 |
|
hiyouga
|
a47e24222a
|
add DISABLE_TORCHRUN option
Former-commit-id: bcc574b479c2101438723aadead42743d4378776
|
2024-06-06 23:44:58 +08:00 |
|
hoshi-hiyouga
|
b96b995620
|
Merge pull request #4082 from MengqingCao/bugfix
Fix #4077
Former-commit-id: 288028c3fb6bb1b58d1b7f4e8b90108c9bbf27d1
|
2024-06-06 23:38:40 +08:00 |
|
hoshi-hiyouga
|
c231706aa5
|
Update cli.py
Former-commit-id: 32190507534adf5f505858b3af2b592ca6568ac7
|
2024-06-06 23:38:09 +08:00 |
|
hiyouga
|
35b5117a59
|
fix ppo+zero3 #3108
Former-commit-id: 33a93cc29e3e57bf001515000c0a70c112573dea
|
2024-06-06 23:30:07 +08:00 |
|
hiyouga
|
80f716bc10
|
fix torch gc
Former-commit-id: e173799d057598e5692a407601c30d8ce1513461
|
2024-06-06 20:30:25 +08:00 |
|
hiyouga
|
ca95e98ca0
|
fix ppo dataset bug #4012
Former-commit-id: 7fc51b2e93698ae5e012566af8481f4d861c873d
|
2024-06-06 19:03:20 +08:00 |
|
hiyouga
|
d5559461c1
|
update trainers
Former-commit-id: b7f6c4a171293cf4f3e88f15a811f847342f84ee
|
2024-06-06 18:45:49 +08:00 |
|
hiyouga
|
f4acd81e2f
|
fix base64 image read #4061
Former-commit-id: 66ccb2a27a04296b4600f2c85f428071bf14eeb0
|
2024-06-06 17:29:19 +08:00 |
|
hiyouga
|
31feb6e26c
|
update readme
Former-commit-id: cc331fa2d28afe081937c50ea83d63add21d4e3a
|
2024-06-06 16:59:18 +08:00 |
|
hiyouga
|
7d5c0a069c
|
update readme
Former-commit-id: fb1f709af5199976e63d7188e088e33c75d19bfe
|
2024-06-06 16:25:42 +08:00 |
|
hiyouga
|
937f49ec3d
|
lora modules: all by default
Former-commit-id: 52c4ae87c7f4312704c31ef26b079b2c5b95ea5f
|
2024-06-06 03:53:28 +08:00 |
|
hiyouga
|
abc2a73a33
|
add codestral 22B
Former-commit-id: b011c7f527a57cb1d21c4e2c9631c2fb62bb835e
|
2024-06-06 03:42:50 +08:00 |
|
hiyouga
|
5e1bf7572c
|
lint
Former-commit-id: 9030501eaef97ea249347198272adf0d709503ec
|
2024-06-06 03:33:44 +08:00 |
|
hoshi-hiyouga
|
8fdb32d0a3
|
Merge pull request #4066 from injet-zhou/main
add throughput entry to training log
Former-commit-id: d2816f343f405f3fab09f2a8eade774b886e8f92
|
2024-06-06 03:32:04 +08:00 |
|
hoshi-hiyouga
|
c709d5f7db
|
Merge pull request #4080 from MengqingCao/npu
Add npu option for model exporting
Former-commit-id: 07fc67193ef6bcb8e8a392aff0c57a2eb36832bf
|
2024-06-06 03:15:44 +08:00 |
|
hoshi-hiyouga
|
f5b2749ec2
|
Update export.py
Former-commit-id: 694833c1104d13929d4f181f014a121f25955dc5
|
2024-06-06 03:14:46 +08:00 |
|
hoshi-hiyouga
|
ee5853c565
|
Update model_args.py
Former-commit-id: 09c0afd94a8a5f5b45a61b32c983d50e1b9e2941
|
2024-06-06 03:14:23 +08:00 |
|
hoshi-hiyouga
|
6ec6df8a5f
|
Merge pull request #4053 from hzhaoy/feature/add_select_config_file
Support selecting saved configuration files
Former-commit-id: 568ef3cf2a793f268cbe01c39dec418a13e61ecd
|
2024-06-06 03:06:03 +08:00 |
|
hiyouga
|
fc95800840
|
add vllm_dtype arg #3387 #3717
Former-commit-id: a0dd3a6351bb78541d40fec1d2fc457d803c86a4
|
2024-06-06 02:53:27 +08:00 |
|
hiyouga
|
765715af21
|
support train from scratch #4033 #4075
Former-commit-id: 1290b9d01077e62f8de7a23637daa2586cc82bfa
|
2024-06-06 02:43:19 +08:00 |
|
hiyouga
|
639a7f6796
|
support image input in api #3971 #4061
Former-commit-id: c70aaf763ef22fb83ce3635e8ffd5ec4c89c1cb0
|
2024-06-06 02:29:55 +08:00 |
|
hiyouga
|
35379c7c0e
|
update train hparams
Former-commit-id: 1ca9fce55b55bf209f4b76152b586731932a3f39
|
2024-06-06 01:49:20 +08:00 |
|
hiyouga
|
d992f5353f
|
fix setup
Former-commit-id: b2b80d434fcc0c3838d229098e1c21d26632204c
|
2024-06-06 01:39:02 +08:00 |
|
hiyouga
|
875eef45f3
|
add llamafactory-cli env
Former-commit-id: 1df077184845ff5f394b9324d46f8c382869e590
|
2024-06-06 01:28:14 +08:00 |
|
hiyouga
|
556a4aa972
|
fix #4090
Former-commit-id: d9f15f30a8f4bc64778a5c96baeb6801700d7a2c
|
2024-06-06 00:50:32 +08:00 |
|
MengqingCao
|
8dc1969111
|
modify export_device option
Former-commit-id: b2fc4a5499e21a5b9622c2285402efef6e27a74d
|
2024-06-05 09:37:36 +00:00 |
|
hiyouga
|
b74c229498
|
fix #4079
Former-commit-id: fda732d7f4616373844c97beff416880260f49db
|
2024-06-05 16:56:54 +08:00 |
|
hiyouga
|
3dbca466fd
|
update readme
Former-commit-id: 02d34db29a7a35c25711d49e98fd3167a2f4dfe7
|
2024-06-05 16:32:32 +08:00 |
|