84 Commits

Author	SHA1	Message	Date
hiyouga	fc066cad7f	release v0.6.1 ... Former-commit-id: ca793028c6	2024-03-29 11:36:08 +08:00
hiyouga	e4f3d583df	fix #2982 ... Former-commit-id: 8d603f8820	2024-03-28 20:22:31 +08:00
hiyouga	89c400633a	update trainers ... Former-commit-id: 8c77b10912	2024-03-28 18:16:27 +08:00
hoshi-hiyouga	ae9ad13f2a	fix ds optimizer ... Former-commit-id: 3bcd41b639	2024-03-26 23:39:56 +08:00
hiyouga	ec94e5e876	fix #2961 ... Former-commit-id: 511f675402	2024-03-26 17:26:14 +08:00
hiyouga	62312716d9	release v0.6.0 (real) ... Former-commit-id: ba70aca8fb	2024-03-25 23:37:48 +08:00
hiyouga	27151b8c65	release v0.6.0 ... Former-commit-id: 6f2b563f12	2024-03-25 22:38:56 +08:00
hiyouga	2d73831177	tiny fix ... Former-commit-id: 558a538724	2024-03-25 21:18:08 +08:00
marko1616	1d0e24549f	pass ruff check ... Former-commit-id: c8f0d99704	2024-03-24 16:12:10 +08:00
marko1616	a68101cbbb	fix Llama lora merge crash ... Former-commit-id: 6f080fdba3	2024-03-24 03:06:11 +08:00
marko1616	645c27e5e2	fix Llama lora merge crash ... Former-commit-id: 51349ea1cc	2024-03-24 02:55:23 +08:00
marko1616	c083708433	fix Llama lora merge crash ... Former-commit-id: c1e2c4ea45	2024-03-24 02:44:35 +08:00
hiyouga	8717e98200	fix #2777 #2895 ... Former-commit-id: 9bec3c98a2	2024-03-20 17:59:45 +08:00
hiyouga	3d483e0914	fix packages ... Former-commit-id: 8e04794b2d	2024-03-17 22:32:03 +08:00
hiyouga	06860e8f0f	fix export ... Former-commit-id: 6bc2c23b6d	2024-03-15 15:06:30 +08:00
hiyouga	7ef49586be	tiny fix ... Former-commit-id: 6ebde4f23e	2024-03-14 21:19:06 +08:00
hiyouga	2cf95d4efe	fix export ... Former-commit-id: 3b4a59bfb1	2024-03-14 18:17:01 +08:00
hiyouga	edd28dbe2c	fix bug ... Former-commit-id: 8172530d54	2024-03-13 23:55:31 +08:00
hiyouga	9ff7c99eb1	fix bug ... Former-commit-id: 714d936dfb	2024-03-13 23:43:42 +08:00
hiyouga	8b8671817f	improve lora+ impl. ... Former-commit-id: 72367307df	2024-03-13 23:32:51 +08:00
齐保元	24c9277488	[FEATURE]: ADD LORA+ ALGORITHM ... Former-commit-id: a0965cd62c	2024-03-13 19:43:27 +08:00
hiyouga	c88062347e	fix #2775 ... Former-commit-id: e874c00906	2024-03-11 00:42:54 +08:00
hiyouga	4a4e4b4354	support layerwise galore ... Former-commit-id: 8664262cde	2024-03-10 00:24:11 +08:00
hiyouga	868444e124	allow non-packing pretraining ... Former-commit-id: bdb496644c	2024-03-09 22:21:46 +08:00
hiyouga	1173441661	fix #2766 ... Former-commit-id: 412c52e325	2024-03-09 21:35:24 +08:00
hiyouga	c561b268ef	fix #2756 , patch #2746 ... Former-commit-id: e8dd38b7fd	2024-03-09 02:01:26 +08:00
hiyouga	5b50458acf	fix galore ... Former-commit-id: 33a4c24a8a	2024-03-08 00:44:51 +08:00
hiyouga	2c010c72b8	support galore ... Former-commit-id: 28f7862188	2024-03-07 22:41:36 +08:00
hiyouga	31c618f1f7	tiny fix ... Former-commit-id: 0048a2021e	2024-03-06 17:25:08 +08:00
hiyouga	768358b960	fix export model ... Former-commit-id: e5edcf440f	2024-03-05 11:05:41 +08:00
hiyouga	d1e6e02461	fix #2649 ... Former-commit-id: 4e5fae2fac	2024-03-01 13:02:41 +08:00
hoshi-hiyouga	db53b67fe4	Merge pull request #2525 from stephen-nju/main ... update project_kwargs for ppo config Former-commit-id: 4aab19c7ef	2024-02-25 15:54:00 +08:00
hiyouga	2f738a1db6	fix #2532 ... Former-commit-id: 3cc10a01a7	2024-02-21 21:55:14 +08:00
stephen	1b4d54b873	update project_kwargs for ppo config ... Former-commit-id: 42c23798f2	2024-02-21 13:47:38 +08:00
hiyouga	96265ec154	support llama pro #2338 , add rslora ... Former-commit-id: 7924ffc55d	2024-02-15 02:27:36 +08:00
hiyouga	7cc0721028	fix #2189 ... Former-commit-id: b988ce0a0c	2024-02-04 00:47:37 +08:00
hiyouga	b8a827faeb	fix #2320 ... Former-commit-id: 2bc30763e9	2024-01-24 16:19:18 +08:00
hoshi-hiyouga	5159c9719c	Update tuner.py ... Former-commit-id: 662b9a9dcf	2024-01-21 12:39:38 +08:00
yhyu13	f036b9c7ba	Remove manully set use_cache; torch_dtype is not str, save model as bfloat16 used to fail; ... Former-commit-id: 9cdbd3bfc8	2024-01-21 11:12:15 +08:00
hiyouga	b27e91222c	format style ... Former-commit-id: 638234ceee	2024-01-20 20:15:56 +08:00
hiyouga	2f7684a8ee	fix tests ... Former-commit-id: f6d6e00337	2024-01-20 19:58:04 +08:00
hiyouga	69e8925249	support longlora for main branch ... Former-commit-id: 38af076a75	2024-01-20 19:25:22 +08:00
hiyouga	6e33982849	Update tuner.py ... Former-commit-id: ddd48ce8ab	2024-01-18 15:06:02 +08:00
hiyouga	4e3bfb799d	support function calling ... Former-commit-id: d9f1cae351	2024-01-18 09:54:23 +08:00
hiyouga	6a954cc075	support export push_to_hub #2183 ... Former-commit-id: 42859f0734	2024-01-16 23:59:42 +08:00
hiyouga	69d966eb1f	fix #2164 ... Former-commit-id: 4b2d11ec28	2024-01-12 00:27:57 +08:00
hiyouga	6378864390	fix #2161 ... Former-commit-id: 898ec3696a	2024-01-11 17:04:13 +08:00
hiyouga	fbe945aba0	improve model export ... Former-commit-id: 05ed4e8028	2024-01-09 22:26:24 +08:00
hiyouga	61960189b2	fix #1789 ... Former-commit-id: 4571068e1e	2024-01-09 18:31:27 +08:00
hiyouga	6bbcf5ad16	improve model export ... Former-commit-id: d2a676c8ba	2024-01-05 18:51:49 +08:00