34 Commits

Author	SHA1	Message	Date
hiyouga	b1deb0a0b9	support unsloth generate	2024-04-24 04:46:53 +08:00
hiyouga	fbbe0dba2f	fix optimizers	2024-04-21 20:40:54 +08:00
hiyouga	5c62881c5a	fix bug in galore optimizer	2024-04-21 18:53:22 +08:00
hoshi-hiyouga	c9828f4c6e	Update utils.py	2024-04-16 17:30:12 +08:00
Jonery	06c8908d3f	Feature BAdam	2024-04-15 23:15:27 +08:00
hiyouga	cce52351b5	update examples	2024-04-15 22:14:34 +08:00
hiyouga	c53a11b6fd	fix model card	2024-04-12 17:11:59 +08:00
hiyouga	148bda353f	fix resize vocab at inference #3022	2024-04-03 18:14:24 +08:00
hiyouga	ca793028c6	release v0.6.1	2024-03-29 11:36:08 +08:00
hiyouga	8c77b10912	update trainers	2024-03-28 18:16:27 +08:00
hiyouga	511f675402	fix #2961	2024-03-26 17:26:14 +08:00
hiyouga	ba70aca8fb	release v0.6.0 (real)	2024-03-25 23:37:48 +08:00
hiyouga	9bec3c98a2	fix #2777 #2895	2024-03-20 17:59:45 +08:00
hiyouga	8e04794b2d	fix packages	2024-03-17 22:32:03 +08:00
hiyouga	8172530d54	fix bug	2024-03-13 23:55:31 +08:00
hiyouga	714d936dfb	fix bug	2024-03-13 23:43:42 +08:00
hiyouga	72367307df	improve lora+ impl.	2024-03-13 23:32:51 +08:00
齐保元	a0965cd62c	[FEATURE]: ADD LORA+ ALGORITHM	2024-03-13 19:43:27 +08:00
hiyouga	e874c00906	fix #2775	2024-03-11 00:42:54 +08:00
hiyouga	8664262cde	support layerwise galore	2024-03-10 00:24:11 +08:00
hiyouga	bdb496644c	allow non-packing pretraining	2024-03-09 22:21:46 +08:00
hiyouga	412c52e325	fix #2766	2024-03-09 21:35:24 +08:00
hiyouga	33a4c24a8a	fix galore	2024-03-08 00:44:51 +08:00
hiyouga	28f7862188	support galore	2024-03-07 22:41:36 +08:00
hiyouga	7924ffc55d	support llama pro #2338 , add rslora	2024-02-15 02:27:36 +08:00
hiyouga	638234ceee	format style	2024-01-20 20:15:56 +08:00
hiyouga	d9f1cae351	support function calling	2024-01-18 09:54:23 +08:00
hiyouga	0716f5e470	refactor adapter hparam	2023-12-15 20:53:11 +08:00
hiyouga	747db40172	ppo support rm server	2023-12-03 21:38:51 +08:00
hiyouga	7df4f3ab20	implement rm server #1543	2023-12-03 20:52:54 +08:00
hiyouga	1740131d63	fix #1558	2023-11-19 14:15:47 +08:00
hiyouga	ff52b1779c	fix bug in freeze tuning	2023-11-16 14:25:11 +08:00
hiyouga	856522a3df	fix bug in PPO training	2023-11-16 02:32:54 +08:00
hiyouga	35b91ea34c	fix import bug	2023-11-16 02:27:03 +08:00