Commit Graph

1808 Commits

Author SHA1 Message Date
hiyouga
84e27a1c0b remove filter in preprocess
Former-commit-id: 2caf91f824
2023-10-23 23:46:02 +08:00
hiyouga
daeff710eb update neftune logic
Former-commit-id: 7de7174ce3
2023-10-22 17:42:13 +08:00
hiyouga
2af83198c7 fix webui
Former-commit-id: 11b55a3270
2023-10-22 17:24:56 +08:00
hiyouga
59fd3155a1 add new options in webui
Former-commit-id: f793ca0a2c
2023-10-22 17:17:58 +08:00
hiyouga
ce112dc744 fix recursion error
Former-commit-id: b79ca8781e
2023-10-22 16:28:37 +08:00
hiyouga
d6c77d9196 reimplement neftune
Former-commit-id: 7b4acf7265
2023-10-22 16:15:08 +08:00
hoshi-hiyouga
3927550fa3 Merge pull request #1252 from anvie/neftune
add NEFTune optimization

Former-commit-id: b42a145253
2023-10-22 15:59:20 +08:00
anvie
3635823fbe add NEFTune optimization
Former-commit-id: 57fb40aa04
2023-10-21 13:24:10 +07:00
hiyouga
d18c708f14 fix openchat template
Former-commit-id: 8fdff07e1f
2023-10-21 01:25:42 +08:00
hiyouga
77781d9516 fix tokenizer padding side in evaluate.py
Former-commit-id: 641ffa2f6e
2023-10-21 00:30:04 +08:00
hiyouga
95697652f1 fix #1232
Former-commit-id: b665e9e133
2023-10-20 23:28:52 +08:00
hiyouga
1712a59280 fix #1215
Former-commit-id: 0fcf66049d
2023-10-19 16:19:21 +08:00
hiyouga
4930118761 fix #1218
Former-commit-id: 7a11a42dfd
2023-10-19 16:17:41 +08:00
hiyouga
0622f8a3a3 fix #1228
Former-commit-id: cb0edd2302
2023-10-19 15:54:10 +08:00
hiyouga
f6a8069159 fix #1217
Former-commit-id: 6496a99b7d
2023-10-19 15:52:24 +08:00
hiyouga
6c8bdeb6e0 rename webui
Former-commit-id: 1611fad6bc
2023-10-16 15:16:24 +08:00
hiyouga
8febf5974d fix #1197
Former-commit-id: 85480f2e86
2023-10-16 15:13:46 +08:00
hoshi-hiyouga
eae703c121 Update README_zh.md
Former-commit-id: 5f83a6e72c
2023-10-16 00:28:27 +08:00
hoshi-hiyouga
aa67673c68 Update README.md
Former-commit-id: beacb798ea
2023-10-16 00:23:37 +08:00
hiyouga
451a90fca1 release v0.2.0
Former-commit-id: 7a53188048
2023-10-15 20:49:43 +08:00
hiyouga
fca1e451b5 update readme
Former-commit-id: f5d0da4d2a
2023-10-15 20:28:14 +08:00
hoshi-hiyouga
bff1709a8c Update README.md
Former-commit-id: 25d326e135
2023-10-15 20:23:22 +08:00
hiyouga
eafde5b73f fix config, #1191
Former-commit-id: a6a04be2e6
2023-10-15 18:28:45 +08:00
hiyouga
e5e740b54d disable tqdm in webui mode
Former-commit-id: 0d63584c03
2023-10-15 16:18:25 +08:00
hiyouga
f3fa47fa7d refactor export, fix #1190
Former-commit-id: ea82f8a82a
2023-10-15 16:01:48 +08:00
hiyouga
0503d45782 fix eval resuming in webui
Former-commit-id: 273745f9b9
2023-10-15 15:45:38 +08:00
hiyouga
99592478c9 tiny fix
Former-commit-id: 3ad8c92eca
2023-10-15 05:02:48 +08:00
hiyouga
4f9ca28e11 fix callback
Former-commit-id: 1e9401744c
2023-10-15 04:59:44 +08:00
hoshi-hiyouga
90be167b5f Merge pull request #1186 from hiyouga/dev
Support Web UI resuming training

Former-commit-id: a63a1cebb2
2023-10-15 04:53:14 +08:00
hiyouga
3ae6229140 implement webui resuming training
Former-commit-id: accde3cd39
2023-10-15 04:52:19 +08:00
hiyouga
eadb7c61af fix bugs in webui
Former-commit-id: fde05cacfc
2023-10-15 03:41:58 +08:00
hiyouga
a902ce4dc7 refactor webui
Former-commit-id: 7ed1fa6fe9
2023-10-15 03:06:21 +08:00
hiyouga
089785c71b fix loading dtype
Former-commit-id: c874e764b8
2023-10-14 20:15:24 +08:00
hiyouga
1faba4b704 fix #1176 #1177
Former-commit-id: 01d8cb1ca7
2023-10-14 20:00:17 +08:00
hiyouga
e585c789ce fix #1184
Former-commit-id: af18b0dce7
2023-10-14 19:20:11 +08:00
hiyouga
9ef9cb316b fix webui
Former-commit-id: b240b6792f
2023-10-13 16:27:59 +08:00
hiyouga
64bf750a74 update readme
Former-commit-id: cb42676694
2023-10-13 13:53:43 +08:00
hiyouga
e2d412da02 update discord link
Former-commit-id: c4102f306a
2023-10-12 21:44:28 +08:00
hiyouga
819b5faa9a rename repository
Former-commit-id: 197c754d73
2023-10-12 21:42:29 +08:00
hiyouga
2bf5da7b0e Update wechat.jpg
Former-commit-id: 932e3fee3a
2023-10-12 20:45:58 +08:00
hiyouga
2562376f84 fix ppo args
Former-commit-id: 11bd271364
2023-10-11 23:40:50 +08:00
hiyouga
c9d1cd108d refactor model_dtype, fix PPO trainer
Former-commit-id: 2818af0b09
2023-10-11 23:16:01 +08:00
hiyouga
c350ba0f05 add averaging in evaluation
Former-commit-id: 5310e4d182
2023-10-10 23:16:31 +08:00
hiyouga
141937ead6 fix aquila template, repair sft packing mechanism
Former-commit-id: be420e4179
2023-10-10 18:49:55 +08:00
hiyouga
7082526df5 tiny fix
Former-commit-id: e1dcb8e4dc
2023-10-10 17:41:13 +08:00
hiyouga
3ba788fc2c update readme
Former-commit-id: 8e2ed6b8ce
2023-10-09 20:02:50 +08:00
hiyouga
180fd06e61 fix flash shift short attention
Former-commit-id: 0a356bc897
2023-10-09 17:54:48 +08:00
hiyouga
9c6d34020c fix webui args
Former-commit-id: 6b24f29c8a
2023-10-09 17:13:57 +08:00
hiyouga
b6e81a0307 fix shift short attention
Former-commit-id: ab65c3063b
2023-10-09 17:07:46 +08:00
hiyouga
8de990b1e9 update webui #1086
Former-commit-id: b8dbec086e
2023-10-09 14:50:14 +08:00