9 Commits

Author	SHA1	Message	Date
hiyouga	0b1f4a34f8	rename files ... Former-commit-id: e1a8431770fc36c0c9ee7fed4abbc3d7fdcc5efd	2024-06-07 00:09:06 +08:00
hiyouga	67246f52f2	update trainers ... Former-commit-id: b7f6c4a171293cf4f3e88f15a811f847342f84ee	2024-06-06 18:45:49 +08:00
hiyouga	fc053cf81f	fix #4090 ... Former-commit-id: d9f15f30a8f4bc64778a5c96baeb6801700d7a2c	2024-06-06 00:50:32 +08:00
hiyouga	2dc5743fba	remove gc warnings in DPO&KTO ... Former-commit-id: b649bdcbafb464a638387429b770fe258b41f8af	2024-06-03 22:53:54 +08:00
hiyouga	0de2ab5d16	update dpo, kto trainer ... Former-commit-id: 4a6cc3c7046f8b27d05ea53ef216bab6fa7ebfaf	2024-05-29 00:14:29 +08:00
hiyouga	ed2601a909	support SimPO #3900 ... Former-commit-id: 6b954ce60155cf8334150b795cfc4bb63ca74c8b	2024-05-26 23:46:33 +08:00
hiyouga	664cba05e3	refactor data preprocessing, fix mllm rlhf ... Former-commit-id: 53ff2dd24f9121ea30c95063bb72e49a9b31e980	2024-05-24 04:08:25 +08:00
hiyouga	d24969bb7e	improve KTO impl., replace datasets ... Former-commit-id: e56a57ddcf061de6e4acc8679f7dbf0b68364986	2024-05-18 03:44:56 +08:00
hiyouga	ee759aa0d8	rename package ... Former-commit-id: a07ff0c083558cfe6f474d13027642d3052fee08	2024-05-16 18:39:08 +08:00