93 Commits

Author	SHA1	Message	Date
hoshi-hiyouga	f6014742fa	fix #5366 ... Former-commit-id: e9bda48c6d	2024-09-05 18:08:09 +08:00
hiyouga	666013d09d	fix ci ... Former-commit-id: 1173f7fc1d	2024-09-05 03:02:59 +08:00
hiyouga	d5ea05cfff	update get template ... Former-commit-id: dabad5570b	2024-09-04 22:36:20 +08:00
hiyouga	22deca0e9e	lazy image load ... Former-commit-id: 47ea97fb1b	2024-09-04 02:27:08 +08:00
hiyouga	982585e375	lint ... Former-commit-id: 22959bcdd3	2024-09-03 00:46:25 +08:00
hiyouga	6e98872622	fix #5324 ... Former-commit-id: a61c8c4890	2024-09-02 23:56:21 +08:00
hoshi-hiyouga	5af92971bc	fix trainer predict ... Former-commit-id: 99fd9637bd	2024-09-02 10:15:29 +08:00
hoshi-hiyouga	5c9972a2d5	remove .cpu() ... Former-commit-id: a6c6750e8a	2024-09-02 10:10:53 +08:00
hiyouga	bfdcc6bacf	add rlhf-v dataset ... Former-commit-id: 8e49940746	2024-09-01 22:57:41 +08:00
hiyouga	236f97b35c	tiny fix ... Former-commit-id: 55027282cd	2024-09-01 21:15:44 +08:00
hiyouga	cb776752f6	fix mixed mm inputs and rlhf-v ... Former-commit-id: 9967ccb3ae	2024-09-01 20:52:47 +08:00
hiyouga	f31e7e0dfc	remove visual_inputs, fix qlora ... Former-commit-id: a025c3df61	2024-08-31 00:24:51 +08:00
hiyouga	51a0016873	optimize predict vram ... Former-commit-id: a244f143f4	2024-08-30 23:08:45 +08:00
hiyouga	a83756b5e9	refactor mm training ... Former-commit-id: 3382317e32	2024-08-30 02:14:31 +08:00
hiyouga	21d3976eea	fix #5295 ... Former-commit-id: ad72f3e065	2024-08-29 20:30:18 +08:00
hiyouga	1494fa1f18	fix #5305 ... Former-commit-id: 364b757e30	2024-08-29 20:16:01 +08:00
hiyouga	7b5834b2dd	tiny fix ... Former-commit-id: f6ae4e75dd	2024-08-27 12:49:32 +08:00
hiyouga	daebca2368	tiny fix ... Former-commit-id: c8b4c7fee5	2024-08-20 00:10:52 +08:00
liu-zichen	8a7ab8ab21	fix lr not change ... Former-commit-id: ddee718b31	2024-08-13 16:33:34 +08:00
hiyouga	5eacd17090	add adam_mini to readme ... Former-commit-id: e2a28f51c6	2024-08-09 20:02:03 +08:00
moontidef	44f7c4dd56	feat: add support for adammini ... Former-commit-id: 82bc15dc79	2024-08-07 10:08:22 +08:00
moontidef	b0d32b2041	fix: rename optimzer to optimizer ... Former-commit-id: 40908a36fa	2024-08-07 10:05:01 +08:00
hiyouga	20013e130b	fix #5048 ... Former-commit-id: b7ca6c8dc1	2024-08-05 23:48:19 +08:00
codingma	8132725f2e	fix pissa save ... Former-commit-id: 2c1ca9f742	2024-07-29 10:44:34 +08:00
hiyouga	e1e01d7efd	add unittest ... Former-commit-id: 608de799a2	2024-07-19 01:06:27 +08:00
hiyouga	3c7b10b1fa	fix metrics #4786 ... Former-commit-id: beec77a089	2024-07-17 00:47:00 +08:00
hiyouga	e90fae61f4	support batch_eval_metrics, fix #4826 ... Former-commit-id: d774b94f12	2024-07-17 00:33:00 +08:00
hiyouga	84e6715423	fix #4820 ... Former-commit-id: fd8cc49008	2024-07-15 22:32:07 +08:00
hiyouga	14bc7b0551	fix up ... Former-commit-id: 29ebcd75d5	2024-07-15 01:04:56 +08:00
hoshi-hiyouga	2b22a7da48	Merge pull request #4691 from codemayq/feature-suppot-eval-dataset ... add eval dataset support Former-commit-id: 15b399a82f	2024-07-15 01:00:34 +08:00
hzhaoy	955e01c038	tiny fix ... Former-commit-id: 8bab99c582	2024-07-12 00:28:44 +08:00
hoshi-hiyouga	4edd7c3529	Update callbacks.py ... Former-commit-id: 39cd89ce17	2024-07-10 13:32:20 +08:00
-.-	973aac3203	fix src/llamafactory/train/callbacks.py ... Former-commit-id: cff89a2e89	2024-07-10 12:05:51 +08:00
hiyouga	a9ce54d143	fix #4731 ... Former-commit-id: 51942acee8	2024-07-10 11:32:36 +08:00
hiyouga	d7130ec635	fix ppo trainer ... Former-commit-id: fb0c400116	2024-07-10 11:05:45 +08:00
hiyouga	aa15ca1719	fix #4742 ... Former-commit-id: 2f09520c0d	2024-07-09 23:24:24 +08:00
codingma	74f0d02eb8	1. add custom eval dataset support ... 2. merge load dataset and split dataset function Former-commit-id: 76f3bbcfc0	2024-07-05 15:52:10 +08:00
hiyouga	7b3c1f29ff	fix packing for eager/sdpa attn ... Former-commit-id: 6fd6aa4530	2024-07-04 01:52:43 +08:00
hiyouga	3595d98b4c	fix #4609 ... unwrap_model_for_generation(reward_model) is necessary for zero3 training Former-commit-id: 8845e94f91	2024-07-03 19:45:51 +08:00
hiyouga	104151d558	tiny fix ... Former-commit-id: 8b1172b910	2024-07-03 02:31:50 +08:00
hiyouga	c9e9beee4e	tiny fix ... Former-commit-id: 71cdf8956e	2024-07-02 23:06:13 +08:00
hiyouga	ea2d3f6c18	remove rlhf support for chatglm2&3 ... Former-commit-id: 821bb6660e	2024-07-02 23:03:17 +08:00
hiyouga	4828bed837	upcast logits ... Former-commit-id: c13ae2df19	2024-07-02 22:32:05 +08:00
hiyouga	cc31014002	improve rlhf ... Former-commit-id: c47ab6c072	2024-07-02 22:23:08 +08:00
hiyouga	08296f4092	fix ppo callbacks ... Former-commit-id: 4c296001c4	2024-07-02 17:34:56 +08:00
hiyouga	2cf03017a0	tiny fix ... Former-commit-id: 73280b7dc7	2024-07-01 05:43:17 +08:00
hiyouga	54e786346e	add eval acc ... Former-commit-id: 1856a08e87	2024-07-01 03:51:20 +08:00
hiyouga	2b006beab1	loose gemma2 attention ... Former-commit-id: 2f4b89ace1	2024-06-29 01:42:14 +08:00
hiyouga	d3b7c489f2	add Gemma2 models ... Former-commit-id: 6f63050e1b	2024-06-28 01:26:50 +08:00
hiyouga	835f0578c2	refactor pissa, improve llamaboard ... Former-commit-id: 8baf3b22b0	2024-06-28 01:04:24 +08:00