30 Commits

Author	SHA1	Message	Date
hiyouga	0c699de39d	tiny fix	2024-07-04 03:47:05 +08:00
hiyouga	6fd6aa4530	fix packing for eager/sdpa attn	2024-07-04 01:52:43 +08:00
hoshi-hiyouga	87d9b2d005	Merge pull request #4224 from chuan298/main ... Implement efficient packing without cross-contamination attention	2024-07-04 01:18:54 +08:00
hiyouga	cce7083024	update packing	2024-07-04 01:10:55 +08:00
hoshi-hiyouga	a36e8f2dd5	Update packing.py	2024-07-03 23:36:01 +08:00
hiyouga	c346f79f99	update func name	2024-07-03 23:29:33 +08:00
hiyouga	8a6a7b9c8a	update arg name	2024-07-03 23:23:24 +08:00
hiyouga	8b1172b910	tiny fix	2024-07-03 02:31:50 +08:00
hoshi-hiyouga	e8e6af2651	Merge branch 'main' into main	2024-07-01 21:01:09 +08:00
hiyouga	8c41a0aa6d	tiny fix	2024-07-01 03:55:20 +08:00
hiyouga	2f4b89ace1	loose gemma2 attention	2024-06-29 01:42:14 +08:00
hiyouga	4d35e218b1	bf16 by default, gemma2 attns ... Gemma2 finetuning cannot work until merging https://github.com/huggingface/transformers/pull/31674	2024-06-28 06:00:26 +08:00
hiyouga	96a5044394	add quant checks	2024-06-27 01:12:25 +08:00
hiyouga	ad144c2265	support HQQ/EETQ #4113	2024-06-27 00:29:42 +08:00
hiyouga	addca926de	improve autogptq integration	2024-06-26 22:11:44 +08:00
stceum	3ed063f281	Bug Fix: off is parsed as False in yaml file, changed to disabled to avoid this.	2024-06-24 20:39:31 +08:00
ancv	770f75dc83	move configure_packing to llamafactory.model.patcher and fix constants	2024-06-21 00:45:06 +07:00
hiyouga	3b040e8e0f	update patcher	2024-06-19 21:27:00 +08:00
hiyouga	4bd77d8563	fix #4357	2024-06-18 22:42:45 +08:00
hiyouga	e2665e71c7	fix #4326	2024-06-17 18:17:48 +08:00
ancv	238f5c3d99	update packing with sdpa and eager attention mode	2024-06-16 02:25:47 +07:00
hiyouga	38b6b0f52e	tiny fix	2024-06-16 01:06:41 +08:00
ancv	04315c3d92	remove some unused params	2024-06-15 23:00:55 +07:00
hiyouga	d87108daa6	add license	2024-06-15 17:54:33 +08:00
hiyouga	2ed8270112	clean code	2024-06-13 01:58:16 +08:00
ancv	b2c367bc61	implement efficient packing without cross-contamination attention	2024-06-12 11:56:01 +07:00
hiyouga	cca6f35108	fix deepspeed version	2024-06-11 16:52:36 +08:00
hiyouga	3f24337a8a	tiny fix	2024-06-11 01:04:16 +08:00
hiyouga	a793e8456b	fix #4160 ... The split heads should be concatenated in dim=2	2024-06-11 00:37:17 +08:00
hiyouga	74f96efef9	rename files	2024-06-07 00:09:06 +08:00