14 Commits

Author	SHA1	Message	Date
seanzhang-zhichen	27cb51f7f8	Merge branch 'main' into add_dataset_sample_num	2024-05-24 15:57:47 +08:00
hiyouga	3a023bca2a	refactor data preprocessing, fix mllm rlhf	2024-05-24 04:08:25 +08:00
hiyouga	de0e67aff1	fix paligemma sft ... requires transformers>=4.41.1	2024-05-24 00:23:40 +08:00
hiyouga	7134fb02bb	fix paligemma sft	2024-05-21 20:03:09 +08:00
hiyouga	e55c85ac72	fix paligemma data preprocess	2024-05-20 23:51:32 +08:00
hiyouga	542229abb3	fix paligemma inference	2024-05-20 23:36:43 +08:00
zhangzc	d956041640	fix conflict	2024-05-20 17:10:01 +08:00
hiyouga	d52fae2fa8	fix chat engines ... do not use pop(key, default) since api assigns None to dict values	2024-05-20 00:36:43 +08:00
hiyouga	10573e1639	fix jinja template	2024-05-19 23:38:30 +08:00
hiyouga	a851056229	improve data process logger	2024-05-18 22:02:42 +08:00
hiyouga	0edc16769f	fix #3803	2024-05-18 16:13:14 +08:00
hiyouga	c450ee87a3	improve KTO impl., replace datasets	2024-05-18 03:44:56 +08:00
enji.zhou	db1d5a4f51	add kto	2024-05-17 13:09:17 +08:00
hiyouga	308edbc426	rename package	2024-05-16 18:39:08 +08:00