131 Commits

Author	SHA1	Message	Date
hiyouga	ceccad3419	fix #3273 ... Former-commit-id: efc345c4b0	2024-04-15 15:32:58 +08:00
hiyouga	c9d3cc181a	fix #3238 ... Former-commit-id: 232642a621	2024-04-12 14:28:11 +08:00
hiyouga	88d9f47a0b	fix #3116 ... Former-commit-id: ce77d98872	2024-04-03 14:47:59 +08:00
hiyouga	bf5ffeeae0	simplify readme ... Former-commit-id: 92dab8a90b	2024-04-02 20:07:43 +08:00
hiyouga	f4be51f356	add moe aux loss control #3085 ... Former-commit-id: b267aeb53f	2024-04-02 14:26:31 +08:00
hiyouga	b7468ea0a8	support infer 4bit model on GPUs #3023 ... Former-commit-id: eb259cc573	2024-04-01 17:34:04 +08:00
hiyouga	2f878bde11	support ORPO ... Former-commit-id: 17bf8a2c3a	2024-03-31 18:29:50 +08:00
hiyouga	e4f3d583df	fix #2982 ... Former-commit-id: 8d603f8820	2024-03-28 20:22:31 +08:00
hiyouga	c311375b50	fix bug ... Former-commit-id: 3164b4f11b	2024-03-26 17:30:12 +08:00
hiyouga	ec94e5e876	fix #2961 ... Former-commit-id: 511f675402	2024-03-26 17:26:14 +08:00
hiyouga	196a33cca4	tiny fix ... Former-commit-id: 98a42cbdaa	2024-03-25 23:28:52 +08:00
hiyouga	b18749fb01	add arg check ... Former-commit-id: 1484f76a95	2024-03-25 22:42:58 +08:00
hiyouga	8b8671817f	improve lora+ impl. ... Former-commit-id: 72367307df	2024-03-13 23:32:51 +08:00
齐保元	24c9277488	[FEATURE]: ADD LORA+ ALGORITHM ... Former-commit-id: a0965cd62c	2024-03-13 19:43:27 +08:00
hiyouga	a74426df0f	fix kv cache ... Former-commit-id: 96ce76cd27	2024-03-13 01:21:50 +08:00
hiyouga	bbf272f96e	support QDoRA ... Former-commit-id: 19ef482649	2024-03-12 22:12:42 +08:00
hiyouga	0b7e870b07	fix #2802 ... Former-commit-id: 8d8956bad5	2024-03-12 17:08:34 +08:00
hiyouga	7124b71676	fix #2782 #2798 ... Former-commit-id: 07f9b754a7	2024-03-12 15:53:29 +08:00
hiyouga	566bfad930	update parser ... Former-commit-id: be99799413	2024-03-10 13:35:20 +08:00
hiyouga	4a4e4b4354	support layerwise galore ... Former-commit-id: 8664262cde	2024-03-10 00:24:11 +08:00
hiyouga	868444e124	allow non-packing pretraining ... Former-commit-id: bdb496644c	2024-03-09 22:21:46 +08:00
hiyouga	5c00783697	update hardware requirements ... Former-commit-id: 393c2de27c	2024-03-09 03:58:18 +08:00
hiyouga	7443ac3116	fix chat engine, update webui ... Former-commit-id: 5d956e2a51	2024-03-08 03:01:53 +08:00
hiyouga	2235020cc9	update galore args ... Former-commit-id: 0ac6b40a47	2024-03-08 01:17:32 +08:00
hiyouga	5b50458acf	fix galore ... Former-commit-id: 33a4c24a8a	2024-03-08 00:44:51 +08:00
hiyouga	2c010c72b8	support galore ... Former-commit-id: 28f7862188	2024-03-07 22:41:36 +08:00
hiyouga	34533b2f35	support vllm ... Former-commit-id: d07ad5cc1c	2024-03-07 20:26:31 +08:00
hiyouga	37e40563f1	fix #2735 ... Former-commit-id: f74f804a71	2024-03-07 16:15:53 +08:00
hiyouga	e887aface7	fix version checking ... Former-commit-id: 3016e65657	2024-03-06 14:51:51 +08:00
hiyouga	9561809ce9	improve aqlm optim ... Former-commit-id: 259af60d28	2024-03-05 20:49:50 +08:00
hiyouga	d1e6e02461	fix #2649 ... Former-commit-id: 4e5fae2fac	2024-03-01 13:02:41 +08:00
hiyouga	8e7d50dae4	release v0.5.3 ... Former-commit-id: fa5ab21ebc	2024-02-29 00:34:19 +08:00
hiyouga	5abbca70d3	support DoRA, AWQ, AQLM #2512 ... Former-commit-id: cfefacaa37	2024-02-28 19:53:28 +08:00
hiyouga	2f738a1db6	fix #2532 ... Former-commit-id: 3cc10a01a7	2024-02-21 21:55:14 +08:00
hiyouga	0fcb931f18	support lora for llama pro ... Former-commit-id: 9aeb404a94	2024-02-21 02:17:22 +08:00
hiyouga	48ae2110aa	update webui ... Former-commit-id: ba998c67ab	2024-02-19 16:49:58 +08:00
hiyouga	96265ec154	support llama pro #2338 , add rslora ... Former-commit-id: 7924ffc55d	2024-02-15 02:27:36 +08:00
hiyouga	75adbfec79	add option to disable version check ... Former-commit-id: 91d09a01ac	2024-02-10 22:31:23 +08:00
hiyouga	db2051684b	improve aligner ... Former-commit-id: 7d2dc83c5e	2024-02-10 16:39:19 +08:00
hiyouga	23dd337ac2	lint ... Former-commit-id: 88a1bc9773	2024-02-07 01:10:04 +08:00
hiyouga	91b7fd1ec3	fix reserved label len ... Former-commit-id: db0ab4d601	2024-02-04 17:54:26 +08:00
hiyouga	0fc8612b97	add hint for freeze #2412 ... Former-commit-id: 6545c02790	2024-02-03 23:38:56 +08:00
hiyouga	40514bf865	support minicpm #2404 ... Former-commit-id: 901faa16cc	2024-02-03 22:36:46 +08:00
hiyouga	509e35ffc8	fix #2282 and update tool prompt ... Former-commit-id: b2fb0eca56	2024-01-22 22:27:30 +08:00
hiyouga	4ac36c14ae	release v0.5.0 ... Former-commit-id: 71cfdc2658	2024-01-20 20:21:39 +08:00
hiyouga	b27e91222c	format style ... Former-commit-id: 638234ceee	2024-01-20 20:15:56 +08:00
hiyouga	edf725208d	add upcast_lmhead option ... Former-commit-id: 8cbe4e9609	2024-01-19 23:54:25 +08:00
hiyouga	e199967391	add bf16 lora option ... Former-commit-id: b6ec112beb	2024-01-19 16:29:03 +08:00
hiyouga	6af2f1f217	fix rm dataset ... Former-commit-id: 5edf7cce0e	2024-01-18 14:45:37 +08:00
hiyouga	4e3bfb799d	support function calling ... Former-commit-id: d9f1cae351	2024-01-18 09:54:23 +08:00