75 Commits

Author	SHA1	Message	Date
liu-zichen	8a7ab8ab21	fix lr not change ... Former-commit-id: ddee718b31	2024-08-13 16:33:34 +08:00
hiyouga	5eacd17090	add adam_mini to readme ... Former-commit-id: e2a28f51c6	2024-08-09 20:02:03 +08:00
moontidef	44f7c4dd56	feat: add support for adammini ... Former-commit-id: 82bc15dc79	2024-08-07 10:08:22 +08:00
moontidef	b0d32b2041	fix: rename optimzer to optimizer ... Former-commit-id: 40908a36fa	2024-08-07 10:05:01 +08:00
hiyouga	20013e130b	fix #5048 ... Former-commit-id: b7ca6c8dc1	2024-08-05 23:48:19 +08:00
codingma	8132725f2e	fix pissa save ... Former-commit-id: 2c1ca9f742	2024-07-29 10:44:34 +08:00
hiyouga	e1e01d7efd	add unittest ... Former-commit-id: 608de799a2	2024-07-19 01:06:27 +08:00
hiyouga	3c7b10b1fa	fix metrics #4786 ... Former-commit-id: beec77a089	2024-07-17 00:47:00 +08:00
hiyouga	e90fae61f4	support batch_eval_metrics, fix #4826 ... Former-commit-id: d774b94f12	2024-07-17 00:33:00 +08:00
hiyouga	84e6715423	fix #4820 ... Former-commit-id: fd8cc49008	2024-07-15 22:32:07 +08:00
hiyouga	14bc7b0551	fix up ... Former-commit-id: 29ebcd75d5	2024-07-15 01:04:56 +08:00
hoshi-hiyouga	2b22a7da48	Merge pull request #4691 from codemayq/feature-suppot-eval-dataset ... add eval dataset support Former-commit-id: 15b399a82f	2024-07-15 01:00:34 +08:00
hzhaoy	955e01c038	tiny fix ... Former-commit-id: 8bab99c582	2024-07-12 00:28:44 +08:00
hoshi-hiyouga	4edd7c3529	Update callbacks.py ... Former-commit-id: 39cd89ce17	2024-07-10 13:32:20 +08:00
-.-	973aac3203	fix src/llamafactory/train/callbacks.py ... Former-commit-id: cff89a2e89	2024-07-10 12:05:51 +08:00
hiyouga	a9ce54d143	fix #4731 ... Former-commit-id: 51942acee8	2024-07-10 11:32:36 +08:00
hiyouga	d7130ec635	fix ppo trainer ... Former-commit-id: fb0c400116	2024-07-10 11:05:45 +08:00
hiyouga	aa15ca1719	fix #4742 ... Former-commit-id: 2f09520c0d	2024-07-09 23:24:24 +08:00
codingma	74f0d02eb8	1. add custom eval dataset support ... 2. merge load dataset and split dataset function Former-commit-id: 76f3bbcfc0	2024-07-05 15:52:10 +08:00
hiyouga	7b3c1f29ff	fix packing for eager/sdpa attn ... Former-commit-id: 6fd6aa4530	2024-07-04 01:52:43 +08:00
hiyouga	3595d98b4c	fix #4609 ... unwrap_model_for_generation(reward_model) is necessary for zero3 training Former-commit-id: 8845e94f91	2024-07-03 19:45:51 +08:00
hiyouga	104151d558	tiny fix ... Former-commit-id: 8b1172b910	2024-07-03 02:31:50 +08:00
hiyouga	c9e9beee4e	tiny fix ... Former-commit-id: 71cdf8956e	2024-07-02 23:06:13 +08:00
hiyouga	ea2d3f6c18	remove rlhf support for chatglm2&3 ... Former-commit-id: 821bb6660e	2024-07-02 23:03:17 +08:00
hiyouga	4828bed837	upcast logits ... Former-commit-id: c13ae2df19	2024-07-02 22:32:05 +08:00
hiyouga	cc31014002	improve rlhf ... Former-commit-id: c47ab6c072	2024-07-02 22:23:08 +08:00
hiyouga	08296f4092	fix ppo callbacks ... Former-commit-id: 4c296001c4	2024-07-02 17:34:56 +08:00
hiyouga	2cf03017a0	tiny fix ... Former-commit-id: 73280b7dc7	2024-07-01 05:43:17 +08:00
hiyouga	54e786346e	add eval acc ... Former-commit-id: 1856a08e87	2024-07-01 03:51:20 +08:00
hiyouga	2b006beab1	loose gemma2 attention ... Former-commit-id: 2f4b89ace1	2024-06-29 01:42:14 +08:00
hiyouga	d3b7c489f2	add Gemma2 models ... Former-commit-id: 6f63050e1b	2024-06-28 01:26:50 +08:00
hiyouga	835f0578c2	refactor pissa, improve llamaboard ... Former-commit-id: 8baf3b22b0	2024-06-28 01:04:24 +08:00
hzhaoy	e1751f6398	fix #4579 ... Former-commit-id: 677c86594e	2024-06-27 13:49:57 +08:00
hiyouga	28e613efd0	fix #4458 ... Former-commit-id: 8d6cd69ac4	2024-06-26 19:52:35 +08:00
hiyouga	ad0304e147	fix #4379 ... Former-commit-id: cc016461e6	2024-06-25 02:31:44 +08:00
hiyouga	a225b5a70c	tiny fix about badam ... Former-commit-id: 095fab58d3	2024-06-25 01:54:53 +08:00
hoshi-hiyouga	fe6ef6400c	Merge pull request #4352 from Ledzy/main ... [Enhancement] Support ZeRO-3 when using BAdam Former-commit-id: d0f953bf5b	2024-06-25 01:49:13 +08:00
hiyouga	7be502c5c5	update readme ... Former-commit-id: e507e60638	2024-06-24 18:22:12 +08:00
hiyouga	7735456561	fix templates ... Former-commit-id: 4cff6a4ad5	2024-06-19 17:44:05 +08:00
Jonery	c779899f7b	Cleaner integration. ... Former-commit-id: 5c2ff1b749	2024-06-19 12:29:40 +08:00
Jonery	3a5eacb4cf	Support distributed BAdam. ... Former-commit-id: 0f72aac8c9	2024-06-18 12:27:47 +08:00
Jonery	5d59f6562a	Merge remote-tracking branch 'upstream/main' ... Former-commit-id: ea1f3ba5e0	2024-06-17 18:44:51 +08:00
Jonery	756566342d	adapt for badam with ds zero3 ... Former-commit-id: 33b4372778	2024-06-17 18:18:10 +08:00
hiyouga	ce4a27a5f7	fix tol ... Former-commit-id: 46093b5786	2024-06-16 01:38:44 +08:00
hiyouga	f25b8626bf	support pissa ... Former-commit-id: 8c1046d78a	2024-06-16 01:08:12 +08:00
hiyouga	c0c6b8075a	tiny fix ... Former-commit-id: 38b6b0f52e	2024-06-16 01:06:41 +08:00
hiyouga	2946153cea	add license ... Former-commit-id: d87108daa6	2024-06-15 17:54:33 +08:00
hiyouga	ab66ae8cd2	fix #4295 ... Former-commit-id: 78589cf90c	2024-06-15 04:34:55 +08:00
hiyouga	a3f4925c2c	add test cases ... Former-commit-id: b27269bd2b	2024-06-15 04:05:54 +08:00
hiyouga	8fccaf20c5	fix #4221 ... Former-commit-id: 6baafd4eb3	2024-06-13 02:48:21 +08:00