27 Commits

Author	SHA1	Message	Date
hiyouga	eb3e147d19	fix scripts	2024-12-05 03:47:32 +00:00
hiyouga	dbb9e5b70e	fix vlm zero3 training	2024-12-04 09:40:39 +00:00
hiyouga	598c22e43f	fix mllama cross_mask	2024-11-26 15:56:58 +00:00
hiyouga	446441fdb0	fix inputs	2024-11-23 18:26:02 +00:00
hoshi-hiyouga	f745c4b28f	Update collator.py	2024-10-29 22:03:42 +08:00
Kingsley	67f59579d7	Merge branch 'hiyouga:main' into pixtral-patch	2024-10-29 21:01:25 +08:00
hiyouga	21db8ed2f4	use pre-commit	2024-10-29 09:07:46 +00:00
KUANGDD	9d6143e36a	modify style & little change	2024-10-23 15:24:07 +08:00
hiyouga	76f2e59504	tiny fix	2024-09-05 23:41:16 +08:00
hiyouga	8cafc7b055	video datasets	2024-09-05 02:04:17 +08:00
hiyouga	47ea97fb1b	lazy image load	2024-09-04 02:27:08 +08:00
hiyouga	8e49940746	add rlhf-v dataset	2024-09-01 22:57:41 +08:00
hiyouga	64cb947c60	fix bug	2024-09-01 21:07:49 +08:00
hiyouga	9967ccb3ae	fix mixed mm inputs and rlhf-v	2024-09-01 20:52:47 +08:00
hiyouga	bee1bd43b9	tiny fix	2024-08-30 03:21:50 +08:00
hiyouga	3382317e32	refactor mm training	2024-08-30 02:14:31 +08:00
simonJJJ	aeb85f200b	initial-commit	2024-08-28 16:51:35 +08:00
hiyouga	2f6af73da2	fix gemma2 attention	2024-07-13 23:33:45 +08:00
hzhaoy	738df47748	tiny fix	2024-07-04 10:20:28 +08:00
hiyouga	6fd6aa4530	fix packing for eager/sdpa attn	2024-07-04 01:52:43 +08:00
hiyouga	cce7083024	update packing	2024-07-04 01:10:55 +08:00
hiyouga	575a02a23d	update hparams	2024-07-03 23:18:58 +08:00
hiyouga	d87108daa6	add license	2024-06-15 17:54:33 +08:00
hiyouga	3a023bca2a	refactor data preprocessing, fix mllm rlhf	2024-05-24 04:08:25 +08:00
hiyouga	c450ee87a3	improve KTO impl., replace datasets	2024-05-18 03:44:56 +08:00
enji.zhou	db1d5a4f51	add kto	2024-05-17 13:09:17 +08:00
hiyouga	308edbc426	rename package	2024-05-16 18:39:08 +08:00