Commit Graph

6 Commits

Author SHA1 Message Date
hiyouga
900e1ea622 clean kto trainer 2024-05-28 21:43:26 +08:00
hiyouga
cb63b32986 support SimPO #3900 2024-05-26 23:46:33 +08:00
hiyouga
3a023bca2a refactor data preprocessing, fix mllm rlhf 2024-05-24 04:08:25 +08:00
hiyouga
a851056229 improve data process logger 2024-05-18 22:02:42 +08:00
hiyouga
c450ee87a3 improve KTO impl., replace datasets 2024-05-18 03:44:56 +08:00
enji.zhou
db1d5a4f51 add kto 2024-05-17 13:09:17 +08:00