20 Commits

Author	SHA1	Message	Date
hiyouga	9ce1b0e2f2	use peft 0.7.0, fix #1561 #1764	2023-12-11 17:13:40 +08:00
hiyouga	d42c0b1d34	fix #1771 and temporarily fix #1764	2023-12-08 16:26:20 +08:00
hiyouga	c9b166615c	fix #1715	2023-12-03 22:35:47 +08:00
hiyouga	7df4f3ab20	implement rm server #1543	2023-12-03 20:52:54 +08:00
hiyouga	03d05991f8	fix #1707 #1710	2023-12-03 11:33:12 +08:00
hiyouga	01e6c539b0	fix gptq model inference	2023-12-01 23:34:14 +08:00
hiyouga	bd42c229b0	patch modelscope	2023-12-01 22:53:15 +08:00
yuze.zyz	5aa6751e52	add readme	2023-12-01 16:11:30 +08:00
yuze.zyz	fb2204c183	fix	2023-11-29 21:43:58 +08:00
yuze.zyz	d38a2e7341	support ms	2023-11-29 20:36:55 +08:00
hiyouga	475a3fa0f4	fix #1659	2023-11-28 20:52:28 +08:00
hiyouga	5021062493	update ppo trainer	2023-11-20 21:39:15 +08:00
hiyouga	2a36fd5064	fix value head model resuming	2023-11-20 19:01:37 +08:00
hiyouga	99a3f06377	fix #1567	2023-11-20 18:46:36 +08:00
hiyouga	ccb0f58e22	fix quantization	2023-11-17 22:21:29 +08:00
hiyouga	1bbc1be95e	fix #1550	2023-11-17 17:23:13 +08:00
hiyouga	6efa38be46	fix bug in web ui	2023-11-16 15:21:24 +08:00
hiyouga	1817ffc86f	fix rlhf callback	2023-11-16 03:26:19 +08:00
hiyouga	ce78303600	support full-parameter PPO	2023-11-16 02:08:04 +08:00
hiyouga	4736344eb1	disentangle model from tuner and rename modules	2023-11-15 16:29:09 +08:00