hiyouga
|
ce40d12692
|
release v0.8.0
Former-commit-id: 5aa4ce47567146cd97c61623018153b41d7c1278
v0.8.0
|
2024-06-08 05:20:54 +08:00 |
|
hiyouga
|
3547a26f86
|
add ultrafeedback and fineweb #4085 #4132
Former-commit-id: 12d79f89c5082eb29842b501e1cb88433a248ba3
|
2024-06-08 02:42:34 +08:00 |
|
hiyouga
|
de9e773764
|
fix ci
Former-commit-id: 42d9b26fc81d66cb0485a2ae148c3e719df59b7d
|
2024-06-08 02:00:44 +08:00 |
|
hiyouga
|
d3eb985bb6
|
fix ci
Former-commit-id: 7f20e4722ae6ac907b36a3219dcd09d2ff5d071a
|
2024-06-08 01:57:36 +08:00 |
|
hiyouga
|
6a5e3816cf
|
add ci
Former-commit-id: aa2578bea072354656dbdb62b970e16a8b86f16b
|
2024-06-08 01:48:30 +08:00 |
|
hiyouga
|
4f3e680b57
|
init unittest
Former-commit-id: 1c7f0ab51906b20190f8d4db932623cff76efc01
|
2024-06-08 01:35:58 +08:00 |
|
hiyouga
|
64cf35cccc
|
Delete .readthedocs.yaml
Former-commit-id: 4b55f35662c9f424f07196ada7f94746f78f95e7
|
2024-06-08 00:58:10 +08:00 |
|
hiyouga
|
4f0ce9be4e
|
reorganize adapter code
Former-commit-id: 54cd743ebfbd296ae9eaf10c33f59e127f451785
|
2024-06-08 00:47:23 +08:00 |
|
hoshi-hiyouga
|
bad35d1730
|
fix #4139
Former-commit-id: cfd62283a9772fc854b852d2a1b71699f79a0048
|
2024-06-08 00:45:02 +08:00 |
|
hiyouga
|
a8318723a4
|
add resume args in webui
Former-commit-id: 06e5d136a4916413d1c116e341ba7d5136d7748a
|
2024-06-08 00:22:16 +08:00 |
|
hiyouga
|
d79222894c
|
fix #4137
Former-commit-id: 8bf9da659cc789dbdd909930f79ac59539b51127
|
2024-06-07 19:16:06 +08:00 |
|
hiyouga
|
4b72592594
|
Update wechat.jpg
Former-commit-id: cce0fad91c0ef1758b021a94c02e9fdd97b73183
|
2024-06-07 19:04:16 +08:00 |
|
hiyouga
|
ca9468ff04
|
tiny fix
Former-commit-id: f8d8690bf4c2981f3151b4ccf07daeb4f3cd38a9
|
2024-06-07 05:19:21 +08:00 |
|
hiyouga
|
4f3c89a6eb
|
fix ppo trainer save zero3 model
accelerator.get_state_dict(ds_model) should be called at all ranks
Former-commit-id: 4489d73ac75c8dbc002fc16c854148994d432c3a
|
2024-06-07 05:14:19 +08:00 |
|
hiyouga
|
f76d427332
|
fix ppo in trl 0.8.6
Former-commit-id: 2702d7e952523b584d67c8901888b492d4a79b14
|
2024-06-07 04:48:29 +08:00 |
|
hiyouga
|
d3196318be
|
fix #4120
Former-commit-id: f9e818d79cf686cb34789327add7ed1f749966c6
|
2024-06-07 04:18:05 +08:00 |
|
hiyouga
|
c6f5f69644
|
update data processors
Former-commit-id: ccc8b64cc21417cfd88d9b5e9bd62e15c1e834a1
|
2024-06-07 04:15:40 +08:00 |
|
hoshi-hiyouga
|
4953ded639
|
Merge pull request #4009 from AlongWY/main
supervised packing with greedy knapsack algorithm
Former-commit-id: 181dbb0d05655c6b46a3859cb47cfa3f86ef8abd
|
2024-06-07 03:48:46 +08:00 |
|
hoshi-hiyouga
|
e3ef239bc0
|
Update supervised.py
Former-commit-id: c09ad8bab38bc2f151da3a924eba225111af2481
|
2024-06-07 03:42:08 +08:00 |
|
hoshi-hiyouga
|
fd7bd911a6
|
Update supervised.py
Former-commit-id: 788e8232fc4ed58ab2439a9bc2e38f64e12c6eb3
|
2024-06-07 03:38:23 +08:00 |
|
hoshi-hiyouga
|
21df5f0bd0
|
Update supervised.py
Former-commit-id: 8cecade7082a52f413517ea20b1c5dd812db8e53
|
2024-06-07 03:38:04 +08:00 |
|
hiyouga
|
8a0263551d
|
add qwen2 models
Former-commit-id: 8e95648850fdd5075724359ffdb22beb48b75952
|
2024-06-07 00:22:57 +08:00 |
|
hiyouga
|
8da149ba40
|
rename files
Former-commit-id: 74f96efef9bcd63f65d0190c901ff9be54ccd350
|
2024-06-07 00:09:06 +08:00 |
|
hiyouga
|
fd2c64315b
|
add DISABLE_TORCHRUN option
Former-commit-id: 45d8be8f93188e6e9d1e0841c2736dce0c1ef7d2
|
2024-06-06 23:44:58 +08:00 |
|
hoshi-hiyouga
|
77b70664e5
|
Merge pull request #4082 from MengqingCao/bugfix
Fix #4077
Former-commit-id: 55c18c49b00a9c13ad42c1b09cd5844253876267
|
2024-06-06 23:38:40 +08:00 |
|
hoshi-hiyouga
|
9bebdeabda
|
Update cli.py
Former-commit-id: 751dd77bc076af3a13884a609ec71c089c516f1f
|
2024-06-06 23:38:09 +08:00 |
|
hiyouga
|
368695483d
|
fix ppo+zero3 #3108
Former-commit-id: 76c61905b20f69fac5c7a6c4ea9450bf33d3b1f2
|
2024-06-06 23:30:07 +08:00 |
|
hiyouga
|
6cbc66a602
|
fix torch gc
Former-commit-id: 451b6693c0cb86cc9ac03d1a9389cf1fd2b918ec
|
2024-06-06 20:30:25 +08:00 |
|
hiyouga
|
e0aadd4b34
|
fix ppo dataset bug #4012
Former-commit-id: 149610c636bbb974e546d13fa302884ea65a6d38
|
2024-06-06 19:03:20 +08:00 |
|
hiyouga
|
e898d8bbc4
|
update trainers
Former-commit-id: fad2591e314093335ef1c301d0a70f0cbe935728
|
2024-06-06 18:45:49 +08:00 |
|
hiyouga
|
f2edacb02d
|
fix base64 image read #4061
Former-commit-id: 67aa78cde0d89e9f4b5640bce5fc506ef73ff7b6
|
2024-06-06 17:29:19 +08:00 |
|
hiyouga
|
2f0a333e9c
|
update readme
Former-commit-id: 53eb2de75e2df372b87801cea4ccafd6e73e59df
|
2024-06-06 16:59:18 +08:00 |
|
hiyouga
|
8cc6bb961b
|
update readme
Former-commit-id: 87a7822b98ef204a7a36fa4caf4e09a092f6a2da
|
2024-06-06 16:25:42 +08:00 |
|
hiyouga
|
cceff9f520
|
lora modules: all by default
Former-commit-id: cae47379079ff811aa385c297481a27020a8da6b
|
2024-06-06 03:53:28 +08:00 |
|
hiyouga
|
679810a3d2
|
add codestral 22B
Former-commit-id: c23cc63d3d3c4fd8edd6c3b3ca1a2a32ec328d7d
|
2024-06-06 03:42:50 +08:00 |
|
hiyouga
|
8f25af89b6
|
lint
Former-commit-id: 7daf8366db0e161d46993fd87cf983a27a0ce2a3
|
2024-06-06 03:33:44 +08:00 |
|
hoshi-hiyouga
|
229794a148
|
Merge pull request #4066 from injet-zhou/main
add throughput entry to training log
Former-commit-id: f2580ad403cd0ae91aa0954c0a15363c46452438
|
2024-06-06 03:32:04 +08:00 |
|
hoshi-hiyouga
|
d31c9c73c7
|
Merge pull request #4080 from MengqingCao/npu
Add npu option for model exporting
Former-commit-id: ca459f67eb319c262d5bab882e9cb3535a76eb69
|
2024-06-06 03:15:44 +08:00 |
|
hoshi-hiyouga
|
0b7cf306f7
|
Update export.py
Former-commit-id: feaee36c4642558c6c4e069b0fd42c20691e3ff4
|
2024-06-06 03:14:46 +08:00 |
|
hoshi-hiyouga
|
d9a372658a
|
Update model_args.py
Former-commit-id: af2c3cbee4372724cf00379d8494f5000dc8a3df
|
2024-06-06 03:14:23 +08:00 |
|
hoshi-hiyouga
|
896a3b8311
|
Merge pull request #4053 from hzhaoy/feature/add_select_config_file
Support selecting saved configuration files
Former-commit-id: 0e740aa463bdd649eaf1cc2d5366216e0c709261
|
2024-06-06 03:06:03 +08:00 |
|
hiyouga
|
c439c959f7
|
add vllm_dtype arg #3387 #3717
Former-commit-id: 8fcc79e1e66a4e952710ac8c98685437d924361a
|
2024-06-06 02:53:27 +08:00 |
|
hiyouga
|
3fcb678d00
|
support train from scratch #4033 #4075
Former-commit-id: a12a506c3d2ba85975a5990c46d2e055cdfe0f2e
|
2024-06-06 02:43:19 +08:00 |
|
hiyouga
|
cafbb79d3a
|
support image input in api #3971 #4061
Former-commit-id: 946f60113630d659e7048bffbb3aa7132ac3ecd1
|
2024-06-06 02:29:55 +08:00 |
|
hiyouga
|
00b3fb4d14
|
update train hparams
Former-commit-id: dc4a00dd63769dc02d898c8bad2c158e4e5c0447
|
2024-06-06 01:49:20 +08:00 |
|
hiyouga
|
8f3b8ade45
|
fix setup
Former-commit-id: 4dc0632145f555ac564b0d6b560d28cbcb3ddded
|
2024-06-06 01:39:02 +08:00 |
|
hiyouga
|
0398338a0f
|
add llamafactory-cli env
Former-commit-id: d4908d57085bbcfcd29e0a8d4ee6425318ee4285
|
2024-06-06 01:28:14 +08:00 |
|
hiyouga
|
a16786d8ba
|
fix #4090
Former-commit-id: 67fe822324a9f830175e44f89acdd9d759b38852
|
2024-06-06 00:50:32 +08:00 |
|
MengqingCao
|
71b9b87d88
|
modify export_device option
Former-commit-id: 2c0305266291fdb163c4445db227d4c77529f3b5
|
2024-06-05 09:37:36 +00:00 |
|
hiyouga
|
ecd06d0110
|
fix #4079
Former-commit-id: 83a005e3d404f5a8ccb7b8ac17c50db75df4e8d4
|
2024-06-05 16:56:54 +08:00 |
|