80 Commits

Author	SHA1	Message	Date
liuzc	61bc5bd0dd	support resize embed for zero3 ... Former-commit-id: a5f6a7f4fb	2024-01-16 15:16:20 +08:00
hiyouga	61960189b2	fix #1789 ... Former-commit-id: 4571068e1e	2024-01-09 18:31:27 +08:00
hiyouga	f53bc7d9a0	fix #2127 ... Former-commit-id: ebee4f6a2a	2024-01-09 14:49:13 +08:00
hiyouga	6bbcf5ad16	improve model export ... Former-commit-id: d2a676c8ba	2024-01-05 18:51:49 +08:00
hiyouga	7c50959fe6	fix #2098 ... Former-commit-id: f6fdd83f8a	2024-01-05 17:11:26 +08:00
hiyouga	dc8714a003	fix #2081 ... Former-commit-id: 33f2c0d4f8	2024-01-04 23:19:08 +08:00
hiyouga	3fff67e3c7	fix dispatch ... Former-commit-id: 1696698eb9	2024-01-03 16:33:16 +08:00
hiyouga	eb021ca748	fix valuehead patch ... Former-commit-id: 24d8d6f224	2024-01-03 16:19:23 +08:00
hiyouga	1a86cc3078	fix rm server ... Former-commit-id: 55021097d5	2024-01-03 15:30:46 +08:00
hiyouga	afa3c86391	fix version ... Former-commit-id: 47da742fc9	2023-12-29 04:53:36 +08:00
hiyouga	498b83d77a	fix bug ... Former-commit-id: e4bb846c43	2023-12-24 19:20:12 +08:00
hiyouga	2a3980d6ba	update loader ... Former-commit-id: 6629087e12	2023-12-24 19:10:23 +08:00
hiyouga	5d440f978e	update patcher ... Former-commit-id: e44b82ee24	2023-12-23 15:24:27 +08:00
hiyouga	a7fc20cb2d	fix unsloth dtype ... Former-commit-id: 779cfefb78	2023-12-23 01:59:49 +08:00
hiyouga	938c4cb132	fix dpo trainer ... Former-commit-id: 074745b170	2023-12-23 01:51:55 +08:00
hiyouga	f0d405f392	support unsloth ... Former-commit-id: 7aad0b889d	2023-12-23 00:14:33 +08:00
ShaneTian	3eaabe12aa	Fix slow model initialization in bfloat16 dtype. ... Former-commit-id: d032daa4bd	2023-12-22 16:27:28 +08:00
hiyouga	fee0fef052	fix ds zero3 check ... Former-commit-id: 083355fc05	2023-12-21 01:19:22 +08:00
hiyouga	de6be321b9	match version ... Former-commit-id: af0194e6d9	2023-12-20 22:17:35 +08:00
hiyouga	23a875a8b1	improve quantization ... Former-commit-id: 624cc21281	2023-12-20 18:27:16 +08:00
hiyouga	c1233ab65f	add max_memory for gptq #1923 ... Former-commit-id: c4a3977ad7	2023-12-20 18:15:17 +08:00
hiyouga	a862ce636f	fix mixtral inference #1821 ... Former-commit-id: f86857bd9e	2023-12-20 15:11:15 +08:00
hiyouga	e06b9c4fa1	fix #1900 ... Former-commit-id: 0c6ab7c75e	2023-12-19 17:21:46 +08:00
hiyouga	8154b4bdf6	fix #1742 ... Former-commit-id: 870426ff70	2023-12-16 20:50:45 +08:00
hiyouga	7c362509a6	add noisy mean initialization #1815 ... Former-commit-id: a66186b872	2023-12-16 19:47:51 +08:00
hiyouga	4e75ca1222	support dpo-ftx ... Former-commit-id: b87c74289d	2023-12-16 19:21:41 +08:00
hiyouga	f0f9d253d8	support autogptq in llama board #246 ... Former-commit-id: 71389be37c	2023-12-16 16:31:30 +08:00
hiyouga	7dbc670902	support quantization in export model ... Former-commit-id: 3524aa1e58	2023-12-15 23:44:50 +08:00
hiyouga	2db4cfab40	update dc link ... Former-commit-id: 87ef3f47b5	2023-12-15 22:11:31 +08:00
hiyouga	329576a5b4	fix bug ... Former-commit-id: 00c77104f8	2023-12-15 21:54:02 +08:00
hiyouga	f32c8614c2	fix bug ... Former-commit-id: 9e509b99af	2023-12-15 21:49:26 +08:00
hiyouga	d24d2f0458	add configurer ... Former-commit-id: 2740aa9cbb	2023-12-15 21:46:40 +08:00
hiyouga	bd03307bbd	refactor adapter hparam ... Former-commit-id: 0716f5e470	2023-12-15 20:53:11 +08:00
hiyouga	6a186d4386	add loftq ... Former-commit-id: d4c351f1ec	2023-12-14 21:53:56 +08:00
hiyouga	e55e32efc4	fix valuehead model ... Former-commit-id: bfdee1608f	2023-12-14 20:15:20 +08:00
hoshi-hiyouga	fa99ead86b	tiny fix ... Former-commit-id: 81167cd19d	2023-12-13 17:32:36 +08:00
hoshi-hiyouga	3f8d33695c	revert peft version ... Former-commit-id: 9b0630f84f	2023-12-13 10:49:45 +08:00
hoshi-hiyouga	ad1860d35e	update peft version ... Former-commit-id: 573a12c86b	2023-12-13 10:23:51 +08:00
hoshi-hiyouga	657dff438c	tiny fix ... Former-commit-id: 6953096c9d	2023-12-13 10:21:29 +08:00
hoshi-hiyouga	5b211cfbe9	fix #1819 ... Former-commit-id: 1fcd545c3d	2023-12-13 10:14:01 +08:00
hiyouga	15b321da8e	remove loftq ... Former-commit-id: 3a8a50d4d4	2023-12-13 01:53:46 +08:00
hiyouga	4c69025a83	support loftq ... Former-commit-id: 6219dfbd93	2023-12-12 22:47:06 +08:00
hiyouga	1a0bdd305c	support system column #1765 ... Former-commit-id: 0a9c6e0146	2023-12-12 19:45:59 +08:00
hiyouga	cefc0b2f03	fix modelscope data hub ... Former-commit-id: d5b2c57a35	2023-12-12 18:33:06 +08:00
hiyouga	bd28dd0fe6	update readme ... Former-commit-id: 8cace77808	2023-12-12 11:44:30 +08:00
hiyouga	b7d99ad5f4	support mixtral ... Former-commit-id: 96380f5e18	2023-12-12 11:39:04 +08:00
hiyouga	e3e86340ec	fix baichuan resize ... Former-commit-id: f4657de7d5	2023-12-11 20:55:50 +08:00
hiyouga	2e42e38ff2	tiny fix ... Former-commit-id: 0239d29fa0	2023-12-11 18:09:40 +08:00
hiyouga	9ead5a2d21	support resize embeddings #1786 ... Former-commit-id: 64744dde89	2023-12-11 17:50:02 +08:00
hiyouga	5819eb7121	use peft 0.7.0, fix #1561 #1764 ... Former-commit-id: 9ce1b0e2f2	2023-12-11 17:13:40 +08:00