59 Commits

Author	SHA1	Message	Date
hiyouga	65cd8bdbdb	10x generate in ppo w/ zero3 ... https://github.com/huggingface/trl/pull/1483	2024-05-29 00:23:23 +08:00
hiyouga	7c8e01bb74	update dpo, kto trainer	2024-05-29 00:14:29 +08:00
hiyouga	900e1ea622	clean kto trainer	2024-05-28 21:43:26 +08:00
hiyouga	cb63b32986	support SimPO #3900	2024-05-26 23:46:33 +08:00
hiyouga	3a023bca2a	refactor data preprocessing, fix mllm rlhf	2024-05-24 04:08:25 +08:00
hiyouga	a851056229	improve data process logger	2024-05-18 22:02:42 +08:00
hiyouga	c450ee87a3	improve KTO impl., replace datasets	2024-05-18 03:44:56 +08:00
enji.zhou	db1d5a4f51	add kto	2024-05-17 13:09:17 +08:00
hiyouga	308edbc426	rename package	2024-05-16 18:39:08 +08:00