49 Commits

Author	SHA1	Message	Date
A-Cepheus	e1d5c98519	fix: ZeRO3 does not work with MoE models	2024-01-22 15:21:14 +08:00
hiyouga	638234ceee	format style	2024-01-20 20:15:56 +08:00
hiyouga	d9f1cae351	support function calling	2024-01-18 09:54:23 +08:00
hiyouga	55021097d5	fix rm server	2024-01-03 15:30:46 +08:00
hiyouga	47da742fc9	fix version	2023-12-29 04:53:36 +08:00
hiyouga	6629087e12	update loader	2023-12-24 19:10:23 +08:00
hiyouga	e44b82ee24	update patcher	2023-12-23 15:24:27 +08:00
hiyouga	779cfefb78	fix unsloth dtype	2023-12-23 01:59:49 +08:00
hiyouga	7aad0b889d	support unsloth	2023-12-23 00:14:33 +08:00
ShaneTian	d032daa4bd	Fix slow model initialization in bfloat16 dtype.	2023-12-22 16:27:28 +08:00
hiyouga	af0194e6d9	match version	2023-12-20 22:17:35 +08:00
hiyouga	0c6ab7c75e	fix #1900	2023-12-19 17:21:46 +08:00
hiyouga	870426ff70	fix #1742	2023-12-16 20:50:45 +08:00
hiyouga	b87c74289d	support dpo-ftx	2023-12-16 19:21:41 +08:00
hiyouga	3524aa1e58	support quantization in export model	2023-12-15 23:44:50 +08:00
hiyouga	00c77104f8	fix bug	2023-12-15 21:54:02 +08:00
hiyouga	9e509b99af	fix bug	2023-12-15 21:49:26 +08:00
hiyouga	2740aa9cbb	add configurer	2023-12-15 21:46:40 +08:00
hiyouga	0716f5e470	refactor adapter hparam	2023-12-15 20:53:11 +08:00
hiyouga	d4c351f1ec	add loftq	2023-12-14 21:53:56 +08:00
hiyouga	bfdee1608f	fix valuehead model	2023-12-14 20:15:20 +08:00
hoshi-hiyouga	9b0630f84f	revert peft version	2023-12-13 10:49:45 +08:00
hoshi-hiyouga	573a12c86b	update peft version	2023-12-13 10:23:51 +08:00
hiyouga	3a8a50d4d4	remove loftq	2023-12-13 01:53:46 +08:00
hiyouga	6219dfbd93	support loftq	2023-12-12 22:47:06 +08:00
hiyouga	0a9c6e0146	support system column #1765	2023-12-12 19:45:59 +08:00
hiyouga	d5b2c57a35	fix modelscope data hub	2023-12-12 18:33:06 +08:00
hiyouga	96380f5e18	support mixtral	2023-12-12 11:39:04 +08:00
hiyouga	64744dde89	support resize embeddings #1786	2023-12-11 17:50:02 +08:00
hiyouga	9ce1b0e2f2	use peft 0.7.0, fix #1561 #1764	2023-12-11 17:13:40 +08:00
hiyouga	d42c0b1d34	fix #1771 and temporarily fix #1764	2023-12-08 16:26:20 +08:00
hiyouga	c9b166615c	fix #1715	2023-12-03 22:35:47 +08:00
hiyouga	7df4f3ab20	implement rm server #1543	2023-12-03 20:52:54 +08:00
hiyouga	03d05991f8	fix #1707 #1710	2023-12-03 11:33:12 +08:00
hiyouga	01e6c539b0	fix gptq model inference	2023-12-01 23:34:14 +08:00
hiyouga	bd42c229b0	patch modelscope	2023-12-01 22:53:15 +08:00
yuze.zyz	5aa6751e52	add readme	2023-12-01 16:11:30 +08:00
yuze.zyz	fb2204c183	fix	2023-11-29 21:43:58 +08:00
yuze.zyz	d38a2e7341	support ms	2023-11-29 20:36:55 +08:00
hiyouga	475a3fa0f4	fix #1659	2023-11-28 20:52:28 +08:00
hiyouga	5021062493	update ppo trainer	2023-11-20 21:39:15 +08:00
hiyouga	2a36fd5064	fix value head model resuming	2023-11-20 19:01:37 +08:00
hiyouga	99a3f06377	fix #1567	2023-11-20 18:46:36 +08:00
hiyouga	ccb0f58e22	fix quantization	2023-11-17 22:21:29 +08:00
hiyouga	1bbc1be95e	fix #1550	2023-11-17 17:23:13 +08:00
hiyouga	6efa38be46	fix bug in web ui	2023-11-16 15:21:24 +08:00
hiyouga	1817ffc86f	fix rlhf callback	2023-11-16 03:26:19 +08:00
hiyouga	ce78303600	support full-parameter PPO	2023-11-16 02:08:04 +08:00
hiyouga	4736344eb1	disentangle model from tuner and rename modules	2023-11-15 16:29:09 +08:00