hiyouga
|
81ed4d8abf
|
fix #4209
DeepSpeed ZeRO3 has inflight param error when calling model.eval()
Former-commit-id: cf9f2d6c42b5a37038c9eededbb767eae6a3f67d
|
2024-06-13 02:25:50 +08:00 |
|
hiyouga
|
ca9468ff04
|
tiny fix
Former-commit-id: f8d8690bf4c2981f3151b4ccf07daeb4f3cd38a9
|
2024-06-07 05:19:21 +08:00 |
|
hiyouga
|
4f3c89a6eb
|
fix ppo trainer save zero3 model
accelerator.get_state_dict(ds_model) should be called at all ranks
Former-commit-id: 4489d73ac75c8dbc002fc16c854148994d432c3a
|
2024-06-07 05:14:19 +08:00 |
|
hiyouga
|
f76d427332
|
fix ppo in trl 0.8.6
Former-commit-id: 2702d7e952523b584d67c8901888b492d4a79b14
|
2024-06-07 04:48:29 +08:00 |
|
hiyouga
|
8da149ba40
|
rename files
Former-commit-id: 74f96efef9bcd63f65d0190c901ff9be54ccd350
|
2024-06-07 00:09:06 +08:00 |
|
hiyouga
|
368695483d
|
fix ppo+zero3 #3108
Former-commit-id: 76c61905b20f69fac5c7a6c4ea9450bf33d3b1f2
|
2024-06-06 23:30:07 +08:00 |
|
hiyouga
|
e0aadd4b34
|
fix ppo dataset bug #4012
Former-commit-id: 149610c636bbb974e546d13fa302884ea65a6d38
|
2024-06-06 19:03:20 +08:00 |
|
hiyouga
|
e898d8bbc4
|
update trainers
Former-commit-id: fad2591e314093335ef1c301d0a70f0cbe935728
|
2024-06-06 18:45:49 +08:00 |
|
hiyouga
|
468d0e7ed1
|
10x generate in ppo w/ zero3
https://github.com/huggingface/trl/pull/1483
Former-commit-id: 65cd8bdbdbe1b19250ecd813aeb72c8e00ef2f9c
|
2024-05-29 00:23:23 +08:00 |
|
hiyouga
|
13d7b48efe
|
improve KTO impl., replace datasets
Former-commit-id: c450ee87a35ff9235f9b695b0de2e042b2971178
|
2024-05-18 03:44:56 +08:00 |
|
hiyouga
|
cae823ddf0
|
rename package
Former-commit-id: 308edbc4260d45907b4a9d3a45ec21d83e48aacb
|
2024-05-16 18:39:08 +08:00 |
|