10 Commits

Author	SHA1	Message	Date
Ting	a9ae5fe5e5	support efficient tokens calculation on sft/dpo ... Former-commit-id: b157d5cccdeb42412b8b440d25d5bdfa8a50be68	2024-11-19 17:15:47 +08:00
hiyouga	3756553c25	update get template ... Former-commit-id: 21ea0d0786f91c0bce79630963e66b815a6792a0	2024-09-04 22:36:20 +08:00
hiyouga	54d4c3fca7	lazy image load ... Former-commit-id: cdd733b575411e003bc5ffd6560dd8eff8aa09cf	2024-09-04 02:27:08 +08:00
hiyouga	8ce43766c6	fix up ... Former-commit-id: 43a56cb331fae899ca35b0c312730d4ab79d0c42	2024-07-15 01:04:56 +08:00
codingma	82e941ff61	1. add custom eval dataset support ... 2. merge load dataset and split dataset function Former-commit-id: 963d97ba07e7efa3a4544c4d077283d9e112b3ad	2024-07-05 15:52:10 +08:00
hiyouga	640372cb66	tiny fix ... Former-commit-id: f7f440986b0ae3b38ea9f2da80789629d4f79ea1	2024-06-16 01:06:41 +08:00
hiyouga	acfae2e677	add license ... Former-commit-id: 69cfc98d7c81756a5ab6bf962240e393e449fef0	2024-06-15 17:54:33 +08:00
hiyouga	0b1f4a34f8	rename files ... Former-commit-id: e1a8431770fc36c0c9ee7fed4abbc3d7fdcc5efd	2024-06-07 00:09:06 +08:00
hiyouga	ed2601a909	support SimPO #3900 ... Former-commit-id: 6b954ce60155cf8334150b795cfc4bb63ca74c8b	2024-05-26 23:46:33 +08:00
hiyouga	ee759aa0d8	rename package ... Former-commit-id: a07ff0c083558cfe6f474d13027642d3052fee08	2024-05-16 18:39:08 +08:00