Commit Graph

10 Commits

Author SHA1 Message Date
hiyouga
f9e818d79c fix #4120 2024-06-07 04:18:05 +08:00
hiyouga
74f96efef9 rename files 2024-06-07 00:09:06 +08:00
hiyouga
fad2591e31 update trainers 2024-06-06 18:45:49 +08:00
hiyouga
67fe822324 fix #4090 2024-06-06 00:50:32 +08:00
hiyouga
f9a206509e remove gc warnings in DPO&KTO 2024-06-03 22:53:54 +08:00
hiyouga
7c8e01bb74 update dpo, kto trainer 2024-05-29 00:14:29 +08:00
hiyouga
cb63b32986 support SimPO #3900 2024-05-26 23:46:33 +08:00
hiyouga
3a023bca2a refactor data preprocessing, fix mllm rlhf 2024-05-24 04:08:25 +08:00
hiyouga
c450ee87a3 improve KTO impl., replace datasets 2024-05-18 03:44:56 +08:00
hiyouga
308edbc426 rename package 2024-05-16 18:39:08 +08:00