462 Commits

Author SHA1 Message Date
hiyouga
fcfcac4858 support dataset cache
Former-commit-id: 3fe7df628db4093d7b3c121ececff60be0aa3a8a
2023-10-26 21:48:45 +08:00
hiyouga
4906092811 fix #1287
Former-commit-id: 838ed9aa8737e8f74ec7e8c660254cabbbbcf6ef
2023-10-26 17:49:41 +08:00
hiyouga
4d6606a72c fix #1285
Former-commit-id: aff9363ce399fd9f1b29d5a088b49c865001f37a
2023-10-26 16:34:52 +08:00
hiyouga
596bda345c Update wechat.jpg
Former-commit-id: d357e08b5819a6281adcf6410c57ff50e3a3e3ef
2023-10-24 16:02:12 +08:00
hiyouga
84e27a1c0b remove filter in preprocess
Former-commit-id: 2caf91f824320b226daa4666eda2da7cb853db9c
2023-10-23 23:46:02 +08:00
hiyouga
daeff710eb update neftune logic
Former-commit-id: 7de7174ce3ea804b2ba58560193cda25cbd675ef
2023-10-22 17:42:13 +08:00
hiyouga
2af83198c7 fix webui
Former-commit-id: 11b55a3270983f0b84a8ab1068bc9af26ed80f8b
2023-10-22 17:24:56 +08:00
hiyouga
59fd3155a1 add new options in webui
Former-commit-id: f793ca0a2c9e7abab360658d0e65506c1f97e1ae
2023-10-22 17:17:58 +08:00
hiyouga
ce112dc744 fix recursion error
Former-commit-id: b79ca8781e368b17c83e585f1644346628d7e2de
2023-10-22 16:28:37 +08:00
hiyouga
d6c77d9196 reimplement neftune
Former-commit-id: 7b4acf7265b04cc4a674b3dcafdb90e76f149e39
2023-10-22 16:15:08 +08:00
hoshi-hiyouga
3927550fa3 Merge pull request #1252 from anvie/neftune
add NEFTune optimization

Former-commit-id: b42a145253fba36efef137b23a7126d4ba95d817
2023-10-22 15:59:20 +08:00
anvie
3635823fbe add NEFTune optimization
Former-commit-id: 57fb40aa04fec11ca165a97ea463579faeaeebe7
2023-10-21 13:24:10 +07:00
hiyouga
d18c708f14 fix openchat template
Former-commit-id: 8fdff07e1f056afa5fe39fe794c6af030fc5f225
2023-10-21 01:25:42 +08:00
hiyouga
77781d9516 fix tokenizer padding side in evaluate.py
Former-commit-id: 641ffa2f6ee05bda5b8548286c161c30aa0bcfb6
2023-10-21 00:30:04 +08:00
hiyouga
95697652f1 fix #1232
Former-commit-id: b665e9e133bf2f6f10346c374eb0de8a96dd5c7e
2023-10-20 23:28:52 +08:00
hiyouga
1712a59280 fix #1215
Former-commit-id: 0fcf66049df0893e8f0f20b2098a98bedb291259
2023-10-19 16:19:21 +08:00
hiyouga
4930118761 fix #1218
Former-commit-id: 7a11a42dfd414d140cd83b7a74760715d2ae2078
2023-10-19 16:17:41 +08:00
hiyouga
0622f8a3a3 fix #1228
Former-commit-id: cb0edd230251886dfbf2c8f0595297be04f5e5b3
2023-10-19 15:54:10 +08:00
hiyouga
f6a8069159 fix #1217
Former-commit-id: 6496a99b7d9a5aa57bfc8b935b274f1481580864
2023-10-19 15:52:24 +08:00
hiyouga
6c8bdeb6e0 rename webui
Former-commit-id: 1611fad6bc5cd7417f22bcfcf155bc772c2dc51a
2023-10-16 15:16:24 +08:00
hiyouga
8febf5974d fix #1197
Former-commit-id: 85480f2e86bc13dc169f62e0eedf2407c0ebab42
2023-10-16 15:13:46 +08:00
hoshi-hiyouga
eae703c121 Update README_zh.md
Former-commit-id: 5f83a6e72c095dfd3c840661fee5b6c7030be593
2023-10-16 00:28:27 +08:00
hoshi-hiyouga
aa67673c68 Update README.md
Former-commit-id: beacb798ea83a910c2941e3993b78e446b9bd267
2023-10-16 00:23:37 +08:00
hiyouga
451a90fca1 release v0.2.0
Former-commit-id: 7a5318804870b1f2bedec8d4a676e465b48d5c3e
v0.2.0
2023-10-15 20:49:43 +08:00
hiyouga
fca1e451b5 update readme
Former-commit-id: f5d0da4d2ac995c85ab891b103503bfa8a80f6db
2023-10-15 20:28:14 +08:00
hoshi-hiyouga
bff1709a8c Update README.md
Former-commit-id: 25d326e13543894e562173c7afc9b28bff8bd1aa
2023-10-15 20:23:22 +08:00
hiyouga
eafde5b73f fix config, #1191
Former-commit-id: a6a04be2e6700050c64e59c00a86698f1098e7cc
2023-10-15 18:28:45 +08:00
hiyouga
e5e740b54d disable tqdm in webui mode
Former-commit-id: 0d63584c036a65cc81e5db504274bdf9808d1849
2023-10-15 16:18:25 +08:00
hiyouga
f3fa47fa7d refactor export, fix #1190
Former-commit-id: ea82f8a82a7356bbdf204190d596d0b1c8ef1a84
2023-10-15 16:01:48 +08:00
hiyouga
0503d45782 fix eval resuming in webui
Former-commit-id: 273745f9b9d117d4053afc1746108af95b0a51a4
2023-10-15 15:45:38 +08:00
hiyouga
99592478c9 tiny fix
Former-commit-id: 3ad8c92ecabaf2c169e53a8485687b4d04a772e7
2023-10-15 05:02:48 +08:00
hiyouga
4f9ca28e11 fix callback
Former-commit-id: 1e9401744cadecdef043b6f744b2616a74c64bca
2023-10-15 04:59:44 +08:00
hoshi-hiyouga
90be167b5f Merge pull request #1186 from hiyouga/dev
Support Web UI resuming training

Former-commit-id: a63a1cebb25cbac214e84cf1b19cb12e961cf755
2023-10-15 04:53:14 +08:00
hiyouga
3ae6229140 implement webui resuming training
Former-commit-id: accde3cd39ec7b09d96cf1865f8f51850693f5ce
2023-10-15 04:52:19 +08:00
hiyouga
eadb7c61af fix bugs in webui
Former-commit-id: fde05cacfc8e669909858587ce5e84380b2e35fb
2023-10-15 03:41:58 +08:00
hiyouga
a902ce4dc7 refactor webui
Former-commit-id: 7ed1fa6fe9025a179bbd2a23a0d50213f53ffba2
2023-10-15 03:06:21 +08:00
hiyouga
089785c71b fix loading dtype
Former-commit-id: c874e764b8334c18091233c3781009a39d67e794
2023-10-14 20:15:24 +08:00
hiyouga
1faba4b704 fix #1176 #1177
Former-commit-id: 01d8cb1ca76e1d599fa5e970b2fcaa3ceedbfffd
2023-10-14 20:00:17 +08:00
hiyouga
e585c789ce fix #1184
Former-commit-id: af18b0dce7a4ef10b30da069d454010eddd269af
2023-10-14 19:20:11 +08:00
hiyouga
9ef9cb316b fix webui
Former-commit-id: b240b6792fdb734dd77ed54861fdde059feb1855
2023-10-13 16:27:59 +08:00
hiyouga
64bf750a74 update readme
Former-commit-id: cb426766944487c72c10ca6e59ffb9888ca8b1e2
2023-10-13 13:53:43 +08:00
hiyouga
e2d412da02 update discord link
Former-commit-id: c4102f306a4c6c0e0397adce6001bbbf3f09314c
2023-10-12 21:44:28 +08:00
hiyouga
819b5faa9a rename repository
Former-commit-id: 197c754d731d495330f33bbf962f8bbc7a10c0cc
2023-10-12 21:42:29 +08:00
hiyouga
2bf5da7b0e Update wechat.jpg
Former-commit-id: 932e3fee3ae31e8b6a231fe96987c33f5cd88619
2023-10-12 20:45:58 +08:00
hiyouga
2562376f84 fix ppo args
Former-commit-id: 11bd271364488d523d5117ec2ea26f39853175b7
2023-10-11 23:40:50 +08:00
hiyouga
c9d1cd108d refactor model_dtype, fix PPO trainer
Former-commit-id: 2818af0b0967d7695f27658acac0b7e2c2728e5d
2023-10-11 23:16:01 +08:00
hiyouga
c350ba0f05 add averaging in evaluation
Former-commit-id: 5310e4d1829f36619c8f224d09ec15eeaf7a4877
2023-10-10 23:16:31 +08:00
hiyouga
141937ead6 fix aquila template, repair sft packing mechanism
Former-commit-id: be420e417920211b68f5b86a5ef5426aeaa62bb0
2023-10-10 18:49:55 +08:00
hiyouga
7082526df5 tiny fix
Former-commit-id: e1dcb8e4dc958a677bf484e27aec43b9710d7287
2023-10-10 17:41:13 +08:00
hiyouga
3ba788fc2c update readme
Former-commit-id: 8e2ed6b8ceb710c50cd73f8047ff4be305674567
2023-10-09 20:02:50 +08:00