335 Commits

Author	SHA1	Message	Date
hiyouga	daeff710eb	update neftune logic ... Former-commit-id: 7de7174ce3	2023-10-22 17:42:13 +08:00
hiyouga	2af83198c7	fix webui ... Former-commit-id: 11b55a3270	2023-10-22 17:24:56 +08:00
hiyouga	59fd3155a1	add new options in webui ... Former-commit-id: f793ca0a2c	2023-10-22 17:17:58 +08:00
hiyouga	ce112dc744	fix recursion error ... Former-commit-id: b79ca8781e	2023-10-22 16:28:37 +08:00
hiyouga	d6c77d9196	reimplement neftune ... Former-commit-id: 7b4acf7265	2023-10-22 16:15:08 +08:00
anvie	3635823fbe	add NEFTune optimization ... Former-commit-id: 57fb40aa04	2023-10-21 13:24:10 +07:00
hiyouga	d18c708f14	fix openchat template ... Former-commit-id: 8fdff07e1f	2023-10-21 01:25:42 +08:00
hiyouga	77781d9516	fix tokenizer padding side in evaluate.py ... Former-commit-id: 641ffa2f6e	2023-10-21 00:30:04 +08:00
hiyouga	95697652f1	fix #1232 ... Former-commit-id: b665e9e133	2023-10-20 23:28:52 +08:00
hiyouga	1712a59280	fix #1215 ... Former-commit-id: 0fcf66049d	2023-10-19 16:19:21 +08:00
hiyouga	4930118761	fix #1218 ... Former-commit-id: 7a11a42dfd	2023-10-19 16:17:41 +08:00
hiyouga	0622f8a3a3	fix #1228 ... Former-commit-id: cb0edd2302	2023-10-19 15:54:10 +08:00
hiyouga	f6a8069159	fix #1217 ... Former-commit-id: 6496a99b7d	2023-10-19 15:52:24 +08:00
hiyouga	6c8bdeb6e0	rename webui ... Former-commit-id: 1611fad6bc	2023-10-16 15:16:24 +08:00
hiyouga	8febf5974d	fix #1197 ... Former-commit-id: 85480f2e86	2023-10-16 15:13:46 +08:00
hiyouga	451a90fca1	release v0.2.0 ... Former-commit-id: 7a53188048	2023-10-15 20:49:43 +08:00
hiyouga	eafde5b73f	fix config, #1191 ... Former-commit-id: a6a04be2e6	2023-10-15 18:28:45 +08:00
hiyouga	e5e740b54d	disable tqdm in webui mode ... Former-commit-id: 0d63584c03	2023-10-15 16:18:25 +08:00
hiyouga	f3fa47fa7d	refactor export, fix #1190 ... Former-commit-id: ea82f8a82a	2023-10-15 16:01:48 +08:00
hiyouga	0503d45782	fix eval resuming in webui ... Former-commit-id: 273745f9b9	2023-10-15 15:45:38 +08:00
hiyouga	99592478c9	tiny fix ... Former-commit-id: 3ad8c92eca	2023-10-15 05:02:48 +08:00
hiyouga	4f9ca28e11	fix callback ... Former-commit-id: 1e9401744c	2023-10-15 04:59:44 +08:00
hiyouga	3ae6229140	implement webui resuming training ... Former-commit-id: accde3cd39	2023-10-15 04:52:19 +08:00
hiyouga	eadb7c61af	fix bugs in webui ... Former-commit-id: fde05cacfc	2023-10-15 03:41:58 +08:00
hiyouga	a902ce4dc7	refactor webui ... Former-commit-id: 7ed1fa6fe9	2023-10-15 03:06:21 +08:00
hiyouga	089785c71b	fix loading dtype ... Former-commit-id: c874e764b8	2023-10-14 20:15:24 +08:00
hiyouga	1faba4b704	fix #1176 #1177 ... Former-commit-id: 01d8cb1ca7	2023-10-14 20:00:17 +08:00
hiyouga	e585c789ce	fix #1184 ... Former-commit-id: af18b0dce7	2023-10-14 19:20:11 +08:00
hiyouga	9ef9cb316b	fix webui ... Former-commit-id: b240b6792f	2023-10-13 16:27:59 +08:00
hiyouga	2562376f84	fix ppo args ... Former-commit-id: 11bd271364	2023-10-11 23:40:50 +08:00
hiyouga	c9d1cd108d	refactor model_dtype, fix PPO trainer ... Former-commit-id: 2818af0b09	2023-10-11 23:16:01 +08:00
hiyouga	c350ba0f05	add averaging in evaluation ... Former-commit-id: 5310e4d182	2023-10-10 23:16:31 +08:00
hiyouga	141937ead6	fix aquila template, repair sft packing mechanism ... Former-commit-id: be420e4179	2023-10-10 18:49:55 +08:00
hiyouga	7082526df5	tiny fix ... Former-commit-id: e1dcb8e4dc	2023-10-10 17:41:13 +08:00
hiyouga	180fd06e61	fix flash shift short attention ... Former-commit-id: 0a356bc897	2023-10-09 17:54:48 +08:00
hiyouga	9c6d34020c	fix webui args ... Former-commit-id: 6b24f29c8a	2023-10-09 17:13:57 +08:00
hiyouga	b6e81a0307	fix shift short attention ... Former-commit-id: ab65c3063b	2023-10-09 17:07:46 +08:00
hiyouga	8de990b1e9	update webui #1086 ... Former-commit-id: b8dbec086e	2023-10-09 14:50:14 +08:00
hiyouga	3a7bcb585b	fix #1097 ... Former-commit-id: a683c5b797	2023-10-08 22:29:26 +08:00
hiyouga	69c99819d6	add llamafy_qwen.py ... Former-commit-id: f9769cff8a	2023-10-08 22:05:36 +08:00
hiyouga	d338ab3e19	fix #1068 #1074 ... Former-commit-id: d11a545463	2023-09-28 14:39:16 +08:00
hiyouga	f88088c43d	fix bug in packed sft dataset ... Former-commit-id: de19614306	2023-09-28 01:16:46 +08:00
hiyouga	f61a000e73	tiny fix ... Former-commit-id: 5d4118b096	2023-09-28 01:03:04 +08:00
hiyouga	8a8ba08bf7	tiny fix ... Former-commit-id: d2ebd225db	2023-09-28 01:02:11 +08:00
hiyouga	755e3e49b4	fix #1064 ... Former-commit-id: c902236397	2023-09-28 00:53:29 +08:00
hiyouga	d2ce9b879b	fix bug in pretraining ... Former-commit-id: b3fbba57eb	2023-09-28 00:45:20 +08:00
hiyouga	deb17942ab	fix layer norm dtype ... Former-commit-id: 84b7486885	2023-09-28 00:25:55 +08:00
hiyouga	f66e6b91c7	fix #1026 ... Former-commit-id: b0b0138e1d	2023-09-27 22:57:09 +08:00
hiyouga	ca6a3bc76f	fix #424 ... Former-commit-id: 35fa94723c	2023-09-27 22:49:43 +08:00
hiyouga	772a1b16a1	fix #1032 ... Former-commit-id: a41e12de5e	2023-09-27 22:42:16 +08:00