35 Commits

Author	SHA1	Message	Date
Marco	4fb7e046b3	fix small typo	2024-04-18 20:33:29 +02:00
Marco	620add7b9f	Added Mixture of Depths	2024-04-18 20:31:24 +02:00
hiyouga	c00f0771a5	Update parser.py	2024-04-16 18:09:31 +08:00
hoshi-hiyouga	4660703674	Update parser.py	2024-04-16 17:27:25 +08:00
hoshi-hiyouga	5b59ff4212	Update parser.py	2024-04-16 17:27:02 +08:00
Jonery	06c8908d3f	Feature BAdam	2024-04-15 23:15:27 +08:00
hiyouga	cce52351b5	update examples	2024-04-15 22:14:34 +08:00
hiyouga	efc345c4b0	fix #3273	2024-04-15 15:32:58 +08:00
hiyouga	232642a621	fix #3238	2024-04-12 14:28:11 +08:00
hiyouga	ce77d98872	fix #3116	2024-04-03 14:47:59 +08:00
hiyouga	8d603f8820	fix #2982	2024-03-28 20:22:31 +08:00
hiyouga	98a42cbdaa	tiny fix	2024-03-25 23:28:52 +08:00
hiyouga	1484f76a95	add arg check	2024-03-25 22:42:58 +08:00
hiyouga	19ef482649	support QDoRA	2024-03-12 22:12:42 +08:00
hiyouga	07f9b754a7	fix #2782 #2798	2024-03-12 15:53:29 +08:00
hiyouga	be99799413	update parser	2024-03-10 13:35:20 +08:00
hiyouga	bdb496644c	allow non-packing pretraining	2024-03-09 22:21:46 +08:00
hiyouga	393c2de27c	update hardware requirements	2024-03-09 03:58:18 +08:00
hiyouga	33a4c24a8a	fix galore	2024-03-08 00:44:51 +08:00
hiyouga	28f7862188	support galore	2024-03-07 22:41:36 +08:00
hiyouga	d07ad5cc1c	support vllm	2024-03-07 20:26:31 +08:00
hiyouga	f74f804a71	fix #2735	2024-03-07 16:15:53 +08:00
hiyouga	3016e65657	fix version checking	2024-03-06 14:51:51 +08:00
hiyouga	259af60d28	improve aqlm optim	2024-03-05 20:49:50 +08:00
hiyouga	4e5fae2fac	fix #2649	2024-03-01 13:02:41 +08:00
hiyouga	fa5ab21ebc	release v0.5.3	2024-02-29 00:34:19 +08:00
hiyouga	cfefacaa37	support DoRA, AWQ, AQLM #2512	2024-02-28 19:53:28 +08:00
hiyouga	7924ffc55d	support llama pro #2338 , add rslora	2024-02-15 02:27:36 +08:00
hiyouga	91d09a01ac	add option to disable version check	2024-02-10 22:31:23 +08:00
hiyouga	7d2dc83c5e	improve aligner	2024-02-10 16:39:19 +08:00
hiyouga	901faa16cc	support minicpm #2404	2024-02-03 22:36:46 +08:00
hiyouga	b2fb0eca56	fix #2282 and update tool prompt	2024-01-22 22:27:30 +08:00
hiyouga	638234ceee	format style	2024-01-20 20:15:56 +08:00
hiyouga	5edf7cce0e	fix rm dataset	2024-01-18 14:45:37 +08:00
hiyouga	d9f1cae351	support function calling	2024-01-18 09:54:23 +08:00