116 Commits

Author	SHA1	Message	Date
hiyouga	19ef482649	support QDoRA	2024-03-12 22:12:42 +08:00
hiyouga	8d8956bad5	fix #2802	2024-03-12 17:08:34 +08:00
hiyouga	07f9b754a7	fix #2782 #2798	2024-03-12 15:53:29 +08:00
hiyouga	be99799413	update parser	2024-03-10 13:35:20 +08:00
hiyouga	8664262cde	support layerwise galore	2024-03-10 00:24:11 +08:00
hiyouga	bdb496644c	allow non-packing pretraining	2024-03-09 22:21:46 +08:00
hiyouga	393c2de27c	update hardware requirements	2024-03-09 03:58:18 +08:00
hiyouga	5d956e2a51	fix chat engine, update webui	2024-03-08 03:01:53 +08:00
hiyouga	0ac6b40a47	update galore args	2024-03-08 01:17:32 +08:00
hiyouga	33a4c24a8a	fix galore	2024-03-08 00:44:51 +08:00
hiyouga	28f7862188	support galore	2024-03-07 22:41:36 +08:00
hiyouga	d07ad5cc1c	support vllm	2024-03-07 20:26:31 +08:00
hiyouga	f74f804a71	fix #2735	2024-03-07 16:15:53 +08:00
hiyouga	3016e65657	fix version checking	2024-03-06 14:51:51 +08:00
hiyouga	259af60d28	improve aqlm optim	2024-03-05 20:49:50 +08:00
hiyouga	4e5fae2fac	fix #2649	2024-03-01 13:02:41 +08:00
hiyouga	fa5ab21ebc	release v0.5.3	2024-02-29 00:34:19 +08:00
hiyouga	cfefacaa37	support DoRA, AWQ, AQLM #2512	2024-02-28 19:53:28 +08:00
hiyouga	3cc10a01a7	fix #2532	2024-02-21 21:55:14 +08:00
hiyouga	9aeb404a94	support lora for llama pro	2024-02-21 02:17:22 +08:00
hiyouga	ba998c67ab	update webui	2024-02-19 16:49:58 +08:00
hiyouga	7924ffc55d	support llama pro #2338 , add rslora	2024-02-15 02:27:36 +08:00
hiyouga	91d09a01ac	add option to disable version check	2024-02-10 22:31:23 +08:00
hiyouga	7d2dc83c5e	improve aligner	2024-02-10 16:39:19 +08:00
hiyouga	88a1bc9773	lint	2024-02-07 01:10:04 +08:00
hiyouga	db0ab4d601	fix reserved label len	2024-02-04 17:54:26 +08:00
hiyouga	6545c02790	add hint for freeze #2412	2024-02-03 23:38:56 +08:00
hiyouga	901faa16cc	support minicpm #2404	2024-02-03 22:36:46 +08:00
hiyouga	b2fb0eca56	fix #2282 and update tool prompt	2024-01-22 22:27:30 +08:00
hiyouga	71cfdc2658	release v0.5.0	2024-01-20 20:21:39 +08:00
hiyouga	638234ceee	format style	2024-01-20 20:15:56 +08:00
hiyouga	8cbe4e9609	add upcast_lmhead option	2024-01-19 23:54:25 +08:00
hiyouga	b6ec112beb	add bf16 lora option	2024-01-19 16:29:03 +08:00
hiyouga	5edf7cce0e	fix rm dataset	2024-01-18 14:45:37 +08:00
hiyouga	d9f1cae351	support function calling	2024-01-18 09:54:23 +08:00
hiyouga	42859f0734	support export push_to_hub #2183	2024-01-16 23:59:42 +08:00
hiyouga	a83fb6d3ff	fix #2195	2024-01-16 23:53:50 +08:00
hiyouga	65c5b0477c	fix args	2023-12-28 18:47:19 +08:00
hiyouga	e165354fac	fix export format	2023-12-28 18:40:46 +08:00
hiyouga	6629087e12	update loader	2023-12-24 19:10:23 +08:00
hiyouga	e44b82ee24	update patcher	2023-12-23 15:24:27 +08:00
hiyouga	0bbf7118df	fix #1909	2023-12-23 14:42:20 +08:00
hiyouga	7aad0b889d	support unsloth	2023-12-23 00:14:33 +08:00
hiyouga	ba69378841	fix param type	2023-12-21 17:33:01 +08:00
hiyouga	71a9c16171	fix tokenizer for Yi chat models #1617 #1875	2023-12-18 17:18:11 +08:00
hiyouga	b87c74289d	support dpo-ftx	2023-12-16 19:21:41 +08:00
hiyouga	3524aa1e58	support quantization in export model	2023-12-15 23:44:50 +08:00
hiyouga	0716f5e470	refactor adapter hparam	2023-12-15 20:53:11 +08:00
hiyouga	3a8a50d4d4	remove loftq	2023-12-13 01:53:46 +08:00
hiyouga	6219dfbd93	support loftq	2023-12-12 22:47:06 +08:00