92 Commits

Author	SHA1	Message	Date
hiyouga	bf5ffeeae0	simplify readme ... Former-commit-id: 92dab8a90b	2024-04-02 20:07:43 +08:00
hiyouga	829cf6458a	fix #3083 ... Former-commit-id: 4a6ca621c0	2024-04-01 22:53:52 +08:00
hiyouga	bd52e2b404	fix ORPO loss ... Former-commit-id: 816d714146	2024-04-01 14:42:41 +08:00
hiyouga	69e1d39832	fix IPO and ORPO loss ... Former-commit-id: 5b9b40403d	2024-04-01 14:37:53 +08:00
hiyouga	e7ade84bba	fix plots ... Former-commit-id: 5907216a1c	2024-03-31 19:43:48 +08:00
hiyouga	b873dcb09d	use log1p in orpo loss ... https://github.com/huggingface/trl/pull/1491 Former-commit-id: 68aaa4904b	2024-03-31 19:27:08 +08:00
hiyouga	2f878bde11	support ORPO ... Former-commit-id: 17bf8a2c3a	2024-03-31 18:29:50 +08:00
marko1616	67c05c2031	Fix Llama model save for full param train ... Former-commit-id: eb178eaff3	2024-03-30 23:45:04 +08:00
hiyouga	fc066cad7f	release v0.6.1 ... Former-commit-id: ca793028c6	2024-03-29 11:36:08 +08:00
hiyouga	e4f3d583df	fix #2982 ... Former-commit-id: 8d603f8820	2024-03-28 20:22:31 +08:00
hiyouga	89c400633a	update trainers ... Former-commit-id: 8c77b10912	2024-03-28 18:16:27 +08:00
hoshi-hiyouga	ae9ad13f2a	fix ds optimizer ... Former-commit-id: 3bcd41b639	2024-03-26 23:39:56 +08:00
hiyouga	ec94e5e876	fix #2961 ... Former-commit-id: 511f675402	2024-03-26 17:26:14 +08:00
hiyouga	62312716d9	release v0.6.0 (real) ... Former-commit-id: ba70aca8fb	2024-03-25 23:37:48 +08:00
hiyouga	27151b8c65	release v0.6.0 ... Former-commit-id: 6f2b563f12	2024-03-25 22:38:56 +08:00
hiyouga	2d73831177	tiny fix ... Former-commit-id: 558a538724	2024-03-25 21:18:08 +08:00
marko1616	1d0e24549f	pass ruff check ... Former-commit-id: c8f0d99704	2024-03-24 16:12:10 +08:00
marko1616	a68101cbbb	fix Llama lora merge crash ... Former-commit-id: 6f080fdba3	2024-03-24 03:06:11 +08:00
marko1616	645c27e5e2	fix Llama lora merge crash ... Former-commit-id: 51349ea1cc	2024-03-24 02:55:23 +08:00
marko1616	c083708433	fix Llama lora merge crash ... Former-commit-id: c1e2c4ea45	2024-03-24 02:44:35 +08:00
hiyouga	8717e98200	fix #2777 #2895 ... Former-commit-id: 9bec3c98a2	2024-03-20 17:59:45 +08:00
hiyouga	3d483e0914	fix packages ... Former-commit-id: 8e04794b2d	2024-03-17 22:32:03 +08:00
hiyouga	06860e8f0f	fix export ... Former-commit-id: 6bc2c23b6d	2024-03-15 15:06:30 +08:00
hiyouga	7ef49586be	tiny fix ... Former-commit-id: 6ebde4f23e	2024-03-14 21:19:06 +08:00
hiyouga	2cf95d4efe	fix export ... Former-commit-id: 3b4a59bfb1	2024-03-14 18:17:01 +08:00
hiyouga	edd28dbe2c	fix bug ... Former-commit-id: 8172530d54	2024-03-13 23:55:31 +08:00
hiyouga	9ff7c99eb1	fix bug ... Former-commit-id: 714d936dfb	2024-03-13 23:43:42 +08:00
hiyouga	8b8671817f	improve lora+ impl. ... Former-commit-id: 72367307df	2024-03-13 23:32:51 +08:00
齐保元	24c9277488	[FEATURE]: ADD LORA+ ALGORITHM ... Former-commit-id: a0965cd62c	2024-03-13 19:43:27 +08:00
hiyouga	c88062347e	fix #2775 ... Former-commit-id: e874c00906	2024-03-11 00:42:54 +08:00
hiyouga	4a4e4b4354	support layerwise galore ... Former-commit-id: 8664262cde	2024-03-10 00:24:11 +08:00
hiyouga	868444e124	allow non-packing pretraining ... Former-commit-id: bdb496644c	2024-03-09 22:21:46 +08:00
hiyouga	1173441661	fix #2766 ... Former-commit-id: 412c52e325	2024-03-09 21:35:24 +08:00
hiyouga	c561b268ef	fix #2756 , patch #2746 ... Former-commit-id: e8dd38b7fd	2024-03-09 02:01:26 +08:00
hiyouga	5b50458acf	fix galore ... Former-commit-id: 33a4c24a8a	2024-03-08 00:44:51 +08:00
hiyouga	2c010c72b8	support galore ... Former-commit-id: 28f7862188	2024-03-07 22:41:36 +08:00
hiyouga	31c618f1f7	tiny fix ... Former-commit-id: 0048a2021e	2024-03-06 17:25:08 +08:00
hiyouga	768358b960	fix export model ... Former-commit-id: e5edcf440f	2024-03-05 11:05:41 +08:00
hiyouga	d1e6e02461	fix #2649 ... Former-commit-id: 4e5fae2fac	2024-03-01 13:02:41 +08:00
hoshi-hiyouga	db53b67fe4	Merge pull request #2525 from stephen-nju/main ... update project_kwargs for ppo config Former-commit-id: 4aab19c7ef	2024-02-25 15:54:00 +08:00
hiyouga	2f738a1db6	fix #2532 ... Former-commit-id: 3cc10a01a7	2024-02-21 21:55:14 +08:00
stephen	1b4d54b873	update project_kwargs for ppo config ... Former-commit-id: 42c23798f2	2024-02-21 13:47:38 +08:00
hiyouga	96265ec154	support llama pro #2338 , add rslora ... Former-commit-id: 7924ffc55d	2024-02-15 02:27:36 +08:00
hiyouga	7cc0721028	fix #2189 ... Former-commit-id: b988ce0a0c	2024-02-04 00:47:37 +08:00
hiyouga	b8a827faeb	fix #2320 ... Former-commit-id: 2bc30763e9	2024-01-24 16:19:18 +08:00
hoshi-hiyouga	5159c9719c	Update tuner.py ... Former-commit-id: 662b9a9dcf	2024-01-21 12:39:38 +08:00
yhyu13	f036b9c7ba	Remove manully set use_cache; torch_dtype is not str, save model as bfloat16 used to fail; ... Former-commit-id: 9cdbd3bfc8	2024-01-21 11:12:15 +08:00
hiyouga	b27e91222c	format style ... Former-commit-id: 638234ceee	2024-01-20 20:15:56 +08:00
hiyouga	2f7684a8ee	fix tests ... Former-commit-id: f6d6e00337	2024-01-20 19:58:04 +08:00
hiyouga	69e8925249	support longlora for main branch ... Former-commit-id: 38af076a75	2024-01-20 19:25:22 +08:00