Commit Graph

59 Commits

Author SHA1 Message Date
hiyouga
65cd8bdbdb 10x generate in ppo w/ zero3
https://github.com/huggingface/trl/pull/1483
2024-05-29 00:23:23 +08:00
hiyouga
7c8e01bb74 update dpo, kto trainer 2024-05-29 00:14:29 +08:00
hiyouga
900e1ea622 clean kto trainer 2024-05-28 21:43:26 +08:00
hiyouga
cb63b32986 support SimPO #3900 2024-05-26 23:46:33 +08:00
hiyouga
3a023bca2a refactor data preprocessing, fix mllm rlhf 2024-05-24 04:08:25 +08:00
hiyouga
a851056229 improve data process logger 2024-05-18 22:02:42 +08:00
hiyouga
c450ee87a3 improve KTO impl., replace datasets 2024-05-18 03:44:56 +08:00
enji.zhou
db1d5a4f51 add kto 2024-05-17 13:09:17 +08:00
hiyouga
308edbc426 rename package 2024-05-16 18:39:08 +08:00