10 Commits

Author	SHA1	Message	Date
hiyouga	d0edcde4ea	fix #4120 ... Former-commit-id: 2a44da678a5e360a9c0f9056397ac9e801329321	2024-06-07 04:18:05 +08:00
hiyouga	fcb134e144	rename files ... Former-commit-id: e1a8431770fc36c0c9ee7fed4abbc3d7fdcc5efd	2024-06-07 00:09:06 +08:00
hiyouga	d5559461c1	update trainers ... Former-commit-id: b7f6c4a171293cf4f3e88f15a811f847342f84ee	2024-06-06 18:45:49 +08:00
hiyouga	556a4aa972	fix #4090 ... Former-commit-id: d9f15f30a8f4bc64778a5c96baeb6801700d7a2c	2024-06-06 00:50:32 +08:00
hiyouga	4c1f015eca	remove gc warnings in DPO&KTO ... Former-commit-id: b649bdcbafb464a638387429b770fe258b41f8af	2024-06-03 22:53:54 +08:00
hiyouga	9b551309de	update dpo, kto trainer ... Former-commit-id: 4a6cc3c7046f8b27d05ea53ef216bab6fa7ebfaf	2024-05-29 00:14:29 +08:00
hiyouga	b0d9966663	support SimPO #3900 ... Former-commit-id: 6b954ce60155cf8334150b795cfc4bb63ca74c8b	2024-05-26 23:46:33 +08:00
hiyouga	bf59383783	refactor data preprocessing, fix mllm rlhf ... Former-commit-id: 53ff2dd24f9121ea30c95063bb72e49a9b31e980	2024-05-24 04:08:25 +08:00
hiyouga	2bff90719b	improve KTO impl., replace datasets ... Former-commit-id: e56a57ddcf061de6e4acc8679f7dbf0b68364986	2024-05-18 03:44:56 +08:00
hiyouga	dfa686b617	rename package ... Former-commit-id: a07ff0c083558cfe6f474d13027642d3052fee08	2024-05-16 18:39:08 +08:00