39 Commits

Author	SHA1	Message	Date
hiyouga	bbc37b2880	fix #4398 #4592 ... Former-commit-id: d74244d568	2024-06-30 21:28:51 +08:00
hiyouga	2b006beab1	loose gemma2 attention ... Former-commit-id: 2f4b89ace1	2024-06-29 01:42:14 +08:00
hiyouga	87e60f8bac	bf16 by default, gemma2 attns ... Gemma2 finetuning cannot work until merging https://github.com/huggingface/transformers/pull/31674 Former-commit-id: 4d35e218b1	2024-06-28 06:00:26 +08:00
hiyouga	58607ec1b0	add quant checks ... Former-commit-id: 96a5044394	2024-06-27 01:12:25 +08:00
hiyouga	d2d9fa4abb	support HQQ/EETQ #4113 ... Former-commit-id: ad144c2265	2024-06-27 00:29:42 +08:00
hiyouga	6b2733ce12	improve autogptq integration ... Former-commit-id: addca926de	2024-06-26 22:11:44 +08:00
hiyouga	0ae1302e41	fix #4432 ... Former-commit-id: 1e9d0aa1e4	2024-06-25 02:34:04 +08:00
hiyouga	47651a94a3	fix #4410 ... Former-commit-id: fca893d73c	2024-06-24 22:34:31 +08:00
stceum	9aa640f27b	Bug Fix: off is parsed as False in yaml file, changed to disabled to avoid this. ... Former-commit-id: 3ed063f281	2024-06-24 20:39:31 +08:00
hiyouga	0844750bb9	tiny fix ... Former-commit-id: 8d4f5093cf	2024-06-20 22:56:05 +08:00
hiyouga	030b4811c7	update patcher ... Former-commit-id: 3b040e8e0f	2024-06-19 21:27:00 +08:00
hiyouga	5156114981	fix #4357 ... Former-commit-id: 4bd77d8563	2024-06-18 22:42:45 +08:00
hiyouga	7ef169ed39	fix #4326 ... Former-commit-id: e2665e71c7	2024-06-17 18:17:48 +08:00
hiyouga	f25b8626bf	support pissa ... Former-commit-id: 8c1046d78a	2024-06-16 01:08:12 +08:00
hiyouga	c0c6b8075a	tiny fix ... Former-commit-id: 38b6b0f52e	2024-06-16 01:06:41 +08:00
hiyouga	2946153cea	add license ... Former-commit-id: d87108daa6	2024-06-15 17:54:33 +08:00
hiyouga	a3f4925c2c	add test cases ... Former-commit-id: b27269bd2b	2024-06-15 04:05:54 +08:00
hiyouga	833aa324c2	clean code ... Former-commit-id: 2ed8270112	2024-06-13 01:58:16 +08:00
hiyouga	8c574eb3cb	fix deepspeed version ... Former-commit-id: cca6f35108	2024-06-11 16:52:36 +08:00
hiyouga	5834651c4a	fix #4198 ... Former-commit-id: 89f2bd8c8c	2024-06-11 15:38:38 +08:00
hiyouga	e3baa5aa08	tiny fix ... Former-commit-id: 3f24337a8a	2024-06-11 01:04:16 +08:00
hiyouga	2f164c2c41	fix #4160 ... The split heads should be concatenated in dim=2 Former-commit-id: a793e8456b	2024-06-11 00:37:17 +08:00
hiyouga	3b244a69dc	fix #2666 ... Former-commit-id: c907d81667	2024-06-10 21:24:15 +08:00
hiyouga	4f0ce9be4e	reorganize adapter code ... Former-commit-id: 54cd743ebf	2024-06-08 00:47:23 +08:00
hoshi-hiyouga	bad35d1730	fix #4139 ... Former-commit-id: cfd62283a9	2024-06-08 00:45:02 +08:00
hiyouga	a8318723a4	add resume args in webui ... Former-commit-id: 06e5d136a4	2024-06-08 00:22:16 +08:00
hiyouga	8da149ba40	rename files ... Former-commit-id: 74f96efef9	2024-06-07 00:09:06 +08:00
hiyouga	6cbc66a602	fix torch gc ... Former-commit-id: 451b6693c0	2024-06-06 20:30:25 +08:00
hiyouga	3fcb678d00	support train from scratch #4033 #4075 ... Former-commit-id: a12a506c3d	2024-06-06 02:43:19 +08:00
hiyouga	b88ecd71fd	fix full/freeze tuning for mllm ... Former-commit-id: 08564838bd	2024-05-27 20:37:57 +08:00
BUAADreamer	606240aec0	add regex of only tune lm and mm_proj ... Former-commit-id: 57eb13b75d	2024-05-27 18:59:00 +08:00
BUAADreamer	3eaf371a22	Merge branch 'hiyouga:main' into main ... Former-commit-id: 60170a1da4	2024-05-25 14:18:49 +08:00
hiyouga	e5d2ef4434	fix #3853 ... Former-commit-id: 063f91cc80	2024-05-24 23:29:45 +08:00
BUAADreamer	071d674065	support pretraining of llava ... Former-commit-id: 29a6d5bdb8	2024-05-21 08:57:14 +08:00
hiyouga	8d4a5ebf6e	fix zero2 high ram usage ... Former-commit-id: 31a0564d4f	2024-05-19 21:53:54 +08:00
hiyouga	df4aec7e72	fix #3807 ... Former-commit-id: 1ebc890a5f	2024-05-19 17:07:57 +08:00
hiyouga	7130efff54	fix jetmoe z3 block ... Former-commit-id: d43822fcc2	2024-05-18 22:28:45 +08:00
hiyouga	780a1f5a4e	better dtype handle in loading ... Former-commit-id: d9f190ff1e	2024-05-17 02:14:56 +08:00
hiyouga	cae823ddf0	rename package ... Former-commit-id: 308edbc426	2024-05-16 18:39:08 +08:00