1665 Commits

Author SHA1 Message Date
Alfredo Luque
fb20b8dcc8 add manifest so requirements.txt in sdist
Former-commit-id: 5f7b3b3ff6a0965bb5036868f7ca5612780d6766
2024-06-11 00:07:06 +00:00
hiyouga
e3baa5aa08 tiny fix
Former-commit-id: 3f24337a8a995b145b1e8075bc23878eaa363844
2024-06-11 01:04:16 +08:00
hiyouga
d6632fefc9 set dev version
Former-commit-id: 91e62a098fd997d0d1d12baef64d089aabc01fba
2024-06-11 00:50:53 +08:00
hiyouga
75e1bbf128 release v0.8.1
Former-commit-id: 2b6ebd6b51133cf114d6f0e8605ad2bb26aa6d65
v0.8.1
2024-06-11 00:44:26 +08:00
hiyouga
2f164c2c41 fix #4160
The split heads should be concatenated in dim=2


Former-commit-id: a793e8456b664ea0b48f0ba162999f18d06b4c2f
2024-06-11 00:37:17 +08:00
hiyouga
d984776d35 fix #4145
Fix the docker image


Former-commit-id: 949e9908ad634874cf5449ee9904745c7acda611
2024-06-11 00:19:17 +08:00
hiyouga
144544cd37 update evaluator
Former-commit-id: 0012762b04d4082a3a7d98889cc3024adc92fc44
2024-06-10 23:56:00 +08:00
hiyouga
3b244a69dc fix #2666
Former-commit-id: c907d816670975daa900898660d3503708b7fc37
2024-06-10 21:24:15 +08:00
hoshi-hiyouga
55b40b3d62 Merge pull request #4167 from yzoaim/branch
fix README

Former-commit-id: ef4afdaf0e718ef7c316bbee4c618a1f92dadaa6
2024-06-10 16:24:33 +08:00
-.-
b187450340 fix README
Former-commit-id: 483cdd9b6ad42bc43a97df8ce867e3a9ef9bf5bc
2024-06-08 23:51:56 +08:00
hiyouga
e4b9c80104 add pr ci
Former-commit-id: b61d25cd705db821664f87adf37d2ed56c68130f
2024-06-08 21:25:35 +08:00
hiyouga
0c44309e15 Update tests.yml
Former-commit-id: 25c635ef2849fd173617b6a8d8d3f5d4f800a893
2024-06-08 21:15:36 +08:00
hiyouga
1c31809652 update git workflows
Former-commit-id: 4c4f950f3936edbce84796c9a5e11b61ea07864e
2024-06-08 21:11:32 +08:00
hiyouga
1a261add61 fix llamafactory-cli env
Former-commit-id: 972ec9c668de1a9b6d872187dbc0c1d94f6fec6b
2024-06-08 07:15:45 +08:00
hiyouga
de3400a521 set dev version
Former-commit-id: 3ac11e77cccf686e0da499bd152997133b49a265
2024-06-08 06:46:09 +08:00
hiyouga
ce40d12692 release v0.8.0
Former-commit-id: 5aa4ce47567146cd97c61623018153b41d7c1278
v0.8.0
2024-06-08 05:20:54 +08:00
hiyouga
3547a26f86 add ultrafeedback and fineweb #4085 #4132
Former-commit-id: 12d79f89c5082eb29842b501e1cb88433a248ba3
2024-06-08 02:42:34 +08:00
hiyouga
de9e773764 fix ci
Former-commit-id: 42d9b26fc81d66cb0485a2ae148c3e719df59b7d
2024-06-08 02:00:44 +08:00
hiyouga
d3eb985bb6 fix ci
Former-commit-id: 7f20e4722ae6ac907b36a3219dcd09d2ff5d071a
2024-06-08 01:57:36 +08:00
hiyouga
6a5e3816cf add ci
Former-commit-id: aa2578bea072354656dbdb62b970e16a8b86f16b
2024-06-08 01:48:30 +08:00
hiyouga
4f3e680b57 init unittest
Former-commit-id: 1c7f0ab51906b20190f8d4db932623cff76efc01
2024-06-08 01:35:58 +08:00
hiyouga
64cf35cccc Delete .readthedocs.yaml
Former-commit-id: 4b55f35662c9f424f07196ada7f94746f78f95e7
2024-06-08 00:58:10 +08:00
hiyouga
4f0ce9be4e reorganize adapter code
Former-commit-id: 54cd743ebfbd296ae9eaf10c33f59e127f451785
2024-06-08 00:47:23 +08:00
hoshi-hiyouga
bad35d1730 fix #4139
Former-commit-id: cfd62283a9772fc854b852d2a1b71699f79a0048
2024-06-08 00:45:02 +08:00
hiyouga
a8318723a4 add resume args in webui
Former-commit-id: 06e5d136a4916413d1c116e341ba7d5136d7748a
2024-06-08 00:22:16 +08:00
hiyouga
d79222894c fix #4137
Former-commit-id: 8bf9da659cc789dbdd909930f79ac59539b51127
2024-06-07 19:16:06 +08:00
hiyouga
4b72592594 Update wechat.jpg
Former-commit-id: cce0fad91c0ef1758b021a94c02e9fdd97b73183
2024-06-07 19:04:16 +08:00
hiyouga
ca9468ff04 tiny fix
Former-commit-id: f8d8690bf4c2981f3151b4ccf07daeb4f3cd38a9
2024-06-07 05:19:21 +08:00
hiyouga
4f3c89a6eb fix ppo trainer save zero3 model
accelerator.get_state_dict(ds_model) should be called at all ranks


Former-commit-id: 4489d73ac75c8dbc002fc16c854148994d432c3a
2024-06-07 05:14:19 +08:00
hiyouga
f76d427332 fix ppo in trl 0.8.6
Former-commit-id: 2702d7e952523b584d67c8901888b492d4a79b14
2024-06-07 04:48:29 +08:00
hiyouga
d3196318be fix #4120
Former-commit-id: f9e818d79cf686cb34789327add7ed1f749966c6
2024-06-07 04:18:05 +08:00
hiyouga
c6f5f69644 update data processors
Former-commit-id: ccc8b64cc21417cfd88d9b5e9bd62e15c1e834a1
2024-06-07 04:15:40 +08:00
hoshi-hiyouga
4953ded639 Merge pull request #4009 from AlongWY/main
supervised packing with greedy knapsack algorithm

Former-commit-id: 181dbb0d05655c6b46a3859cb47cfa3f86ef8abd
2024-06-07 03:48:46 +08:00
hoshi-hiyouga
e3ef239bc0 Update supervised.py
Former-commit-id: c09ad8bab38bc2f151da3a924eba225111af2481
2024-06-07 03:42:08 +08:00
hoshi-hiyouga
fd7bd911a6 Update supervised.py
Former-commit-id: 788e8232fc4ed58ab2439a9bc2e38f64e12c6eb3
2024-06-07 03:38:23 +08:00
hoshi-hiyouga
21df5f0bd0 Update supervised.py
Former-commit-id: 8cecade7082a52f413517ea20b1c5dd812db8e53
2024-06-07 03:38:04 +08:00
hiyouga
8a0263551d add qwen2 models
Former-commit-id: 8e95648850fdd5075724359ffdb22beb48b75952
2024-06-07 00:22:57 +08:00
hiyouga
8da149ba40 rename files
Former-commit-id: 74f96efef9bcd63f65d0190c901ff9be54ccd350
2024-06-07 00:09:06 +08:00
hiyouga
fd2c64315b add DISABLE_TORCHRUN option
Former-commit-id: 45d8be8f93188e6e9d1e0841c2736dce0c1ef7d2
2024-06-06 23:44:58 +08:00
hoshi-hiyouga
77b70664e5 Merge pull request #4082 from MengqingCao/bugfix
Fix #4077

Former-commit-id: 55c18c49b00a9c13ad42c1b09cd5844253876267
2024-06-06 23:38:40 +08:00
hoshi-hiyouga
9bebdeabda Update cli.py
Former-commit-id: 751dd77bc076af3a13884a609ec71c089c516f1f
2024-06-06 23:38:09 +08:00
hiyouga
368695483d fix ppo+zero3 #3108
Former-commit-id: 76c61905b20f69fac5c7a6c4ea9450bf33d3b1f2
2024-06-06 23:30:07 +08:00
hiyouga
6cbc66a602 fix torch gc
Former-commit-id: 451b6693c0cb86cc9ac03d1a9389cf1fd2b918ec
2024-06-06 20:30:25 +08:00
hiyouga
e0aadd4b34 fix ppo dataset bug #4012
Former-commit-id: 149610c636bbb974e546d13fa302884ea65a6d38
2024-06-06 19:03:20 +08:00
hiyouga
e898d8bbc4 update trainers
Former-commit-id: fad2591e314093335ef1c301d0a70f0cbe935728
2024-06-06 18:45:49 +08:00
hiyouga
f2edacb02d fix base64 image read #4061
Former-commit-id: 67aa78cde0d89e9f4b5640bce5fc506ef73ff7b6
2024-06-06 17:29:19 +08:00
hiyouga
2f0a333e9c update readme
Former-commit-id: 53eb2de75e2df372b87801cea4ccafd6e73e59df
2024-06-06 16:59:18 +08:00
hiyouga
8cc6bb961b update readme
Former-commit-id: 87a7822b98ef204a7a36fa4caf4e09a092f6a2da
2024-06-06 16:25:42 +08:00
hiyouga
cceff9f520 lora modules: all by default
Former-commit-id: cae47379079ff811aa385c297481a27020a8da6b
2024-06-06 03:53:28 +08:00
hiyouga
679810a3d2 add codestral 22B
Former-commit-id: c23cc63d3d3c4fd8edd6c3b3ca1a2a32ec328d7d
2024-06-06 03:42:50 +08:00