84 Commits

Author	SHA1	Message	Date
BUAADreamer	6642cd501d	add llava-next/llava-next-video/video-llava	2024-09-28 00:57:03 +08:00
Zhangchi Feng	900631755b	Merge branch 'hiyouga:main' into main	2024-09-27 18:14:39 +08:00
Billy Cao	7a2958a44f	Add qwen_vl to liger kernel supported list	2024-09-14 19:28:20 +08:00
BUAADreamer	7b4ba0efb6	try to past test	2024-09-10 13:12:51 +08:00
BUAADreamer	96decf82b8	resolve confilct	2024-09-10 12:39:17 +08:00
BUAADreamer	31259e7e0c	support llava-next(video)	2024-09-10 12:31:53 +08:00
hiyouga	c93795ae14	fix qwen2vl preprocess	2024-09-09 22:33:33 +08:00
hiyouga	c9b3870adb	tiny fix	2024-09-08 23:18:08 +08:00
hiyouga	b332908ab4	fix test case	2024-09-08 01:50:51 +08:00
hiyouga	52a06efaf8	add test case	2024-09-08 01:40:49 +08:00
hiyouga	fb72a3adb0	support activation offloading via unsloth gc	2024-09-08 01:22:19 +08:00
hiyouga	76f2e59504	tiny fix	2024-09-05 23:41:16 +08:00
hiyouga	94d5b1bd8f	add e2e tests	2024-09-05 21:52:28 +08:00
hiyouga	8cafc7b055	video datasets	2024-09-05 02:04:17 +08:00
hiyouga	a61c8c4890	fix #5324	2024-09-02 23:56:21 +08:00
hiyouga	8e49940746	add rlhf-v dataset	2024-09-01 22:57:41 +08:00
hiyouga	9967ccb3ae	fix mixed mm inputs and rlhf-v	2024-09-01 20:52:47 +08:00
hiyouga	a2a8c0b92c	add test mm plugin	2024-08-31 01:53:38 +08:00
hiyouga	a025c3df61	remove visual_inputs, fix qlora	2024-08-31 00:24:51 +08:00
hiyouga	3382317e32	refactor mm training	2024-08-30 02:14:31 +08:00
hoshi-hiyouga	727e184840	Merge pull request #5290 from simonJJJ/qwen2_vl ... support qwen2-vl	2024-08-30 02:10:36 +08:00
hiyouga	a7dd7d325e	update liger kernel	2024-08-29 20:46:08 +08:00
simonJJJ	aeb85f200b	initial-commit	2024-08-28 16:51:35 +08:00
hiyouga	72bc8f0111	support liger kernel	2024-08-27 11:20:14 +08:00
hiyouga	b7ca6c8dc1	fix #5048	2024-08-05 23:48:19 +08:00
hiyouga	5665062ca0	tiny fix	2024-07-22 21:10:15 +08:00
hoshi-hiyouga	26082fc6c9	fix #4917	2024-07-22 11:28:31 +08:00
hiyouga	29ebcd75d5	fix up	2024-07-15 01:04:56 +08:00
hiyouga	d3c01552e0	tiny fix	2024-07-14 10:56:45 +08:00
hiyouga	2f6af73da2	fix gemma2 attention	2024-07-13 23:33:45 +08:00
hiyouga	0c699de39d	tiny fix	2024-07-04 03:47:05 +08:00
hiyouga	6fd6aa4530	fix packing for eager/sdpa attn	2024-07-04 01:52:43 +08:00
hoshi-hiyouga	87d9b2d005	Merge pull request #4224 from chuan298/main ... Implement efficient packing without cross-contamination attention	2024-07-04 01:18:54 +08:00
hiyouga	cce7083024	update packing	2024-07-04 01:10:55 +08:00
hoshi-hiyouga	a36e8f2dd5	Update packing.py	2024-07-03 23:36:01 +08:00
hiyouga	c346f79f99	update func name	2024-07-03 23:29:33 +08:00
hiyouga	8a6a7b9c8a	update arg name	2024-07-03 23:23:24 +08:00
hiyouga	8b1172b910	tiny fix	2024-07-03 02:31:50 +08:00
ancv	e8e13b0942	move efficient_packing from data_args to model_args	2024-07-02 18:37:55 +07:00
hoshi-hiyouga	e8e6af2651	Merge branch 'main' into main	2024-07-01 21:01:09 +08:00
hiyouga	8c41a0aa6d	tiny fix	2024-07-01 03:55:20 +08:00
hiyouga	d74244d568	fix #4398 #4592	2024-06-30 21:28:51 +08:00
hiyouga	2f4b89ace1	loose gemma2 attention	2024-06-29 01:42:14 +08:00
hiyouga	4d35e218b1	bf16 by default, gemma2 attns ... Gemma2 finetuning cannot work until merging https://github.com/huggingface/transformers/pull/31674	2024-06-28 06:00:26 +08:00
hiyouga	96a5044394	add quant checks	2024-06-27 01:12:25 +08:00
hiyouga	ad144c2265	support HQQ/EETQ #4113	2024-06-27 00:29:42 +08:00
hiyouga	addca926de	improve autogptq integration	2024-06-26 22:11:44 +08:00
hiyouga	1e9d0aa1e4	fix #4432	2024-06-25 02:34:04 +08:00
hiyouga	fca893d73c	fix #4410	2024-06-24 22:34:31 +08:00
stceum	3ed063f281	Bug Fix: off is parsed as False in yaml file, changed to disabled to avoid this.	2024-06-24 20:39:31 +08:00