22 Commits

Author	SHA1	Message	Date
hiyouga	47ea97fb1b	lazy image load	2024-09-04 02:27:08 +08:00
hiyouga	c87023d539	follow #5115	2024-08-09 18:03:00 +08:00
“Wzw”	2fa1e0b2ad	mask_history args verify valid	2024-08-08 10:12:01 +08:00
hoshi-hiyouga	a5b809516e	Update loader.py	2024-07-15 00:50:06 +08:00
codingma	76f3bbcfc0	1. add custom eval dataset support ... 2. merge load dataset and split dataset function	2024-07-05 15:52:10 +08:00
hoshi-hiyouga	dddfd516ee	Update loader.py	2024-06-24 23:06:18 +08:00
hiyouga	d87108daa6	add license	2024-06-15 17:54:33 +08:00
hiyouga	6baafd4eb3	fix #4221	2024-06-13 02:48:21 +08:00
hiyouga	74f96efef9	rename files	2024-06-07 00:09:06 +08:00
hiyouga	149610c636	fix ppo dataset bug #4012	2024-06-06 19:03:20 +08:00
hiyouga	5a13b3baa6	tiny fix	2024-06-04 00:31:10 +08:00
hiyouga	a18acf2abe	fix #3992	2024-06-04 00:17:36 +08:00
hiyouga	49b1e88e3d	fix data loader hint	2024-06-03 18:28:27 +08:00
hoshi-hiyouga	ca5dd7c6c1	Update loader.py	2024-05-30 00:20:20 +08:00
hoshi-hiyouga	f9a88b89ca	Update loader.py	2024-05-30 00:17:21 +08:00
hoshi-hiyouga	b55fb611c5	Update loader.py	2024-05-30 00:12:12 +08:00
seanzhang-zhichen	27cb51f7f8	Merge branch 'main' into add_dataset_sample_num	2024-05-24 15:57:47 +08:00
hiyouga	3a023bca2a	refactor data preprocessing, fix mllm rlhf	2024-05-24 04:08:25 +08:00
zhangzc	d956041640	fix conflict	2024-05-20 17:10:01 +08:00
hiyouga	c450ee87a3	improve KTO impl., replace datasets	2024-05-18 03:44:56 +08:00
enji.zhou	db1d5a4f51	add kto	2024-05-17 13:09:17 +08:00
hiyouga	308edbc426	rename package	2024-05-16 18:39:08 +08:00