Commit Graph

712 Commits

Author SHA1 Message Date
hiyouga
ecdea0036c fix #1383
Former-commit-id: 2e77a5718a
2023-11-06 11:42:23 +08:00
hiyouga
034b658348 fix deepseek template
Former-commit-id: d08f5e8a14
2023-11-05 13:08:46 +08:00
hiyouga
04107b7af6 support deepseek coder #1378
Former-commit-id: 2a8a258195
2023-11-05 12:51:03 +08:00
hiyouga
0d488085b8 fix #1365
Former-commit-id: 63ff909310
2023-11-05 12:21:07 +08:00
hiyouga
983779c474 tiny fix
Former-commit-id: 05d9fc7eff
2023-11-03 01:26:06 +08:00
hiyouga
574a7d175c fix #1290
Former-commit-id: eb9d9e104a
2023-11-03 00:44:53 +08:00
hiyouga
5507014392 fix bug in data loader, support dpo eval
Former-commit-id: b355f6cac9
2023-11-03 00:34:26 +08:00
hiyouga
a9db89a025 update data readme (zh)
Former-commit-id: cc8ffa10d8
2023-11-02 23:42:49 +08:00
hiyouga
a1b0655457 support sharegpt format, add datasets
Former-commit-id: a837172413
2023-11-02 23:10:04 +08:00
hiyouga
89c1a80920 support pagination in webui preview
Former-commit-id: c1edb0cf1b
2023-11-02 21:21:45 +08:00
hiyouga
c3fab5307b fix webui
Former-commit-id: 34d8b2e56c
2023-11-02 18:03:14 +08:00
hiyouga
11ff5d1e43 support warning in webui
Former-commit-id: 9cde5e8af6
2023-11-02 17:57:04 +08:00
hiyouga
a465785df0 fix #1349
Former-commit-id: f8703aac08
2023-11-02 17:02:44 +08:00
hiyouga
15cef791ba fix #1356
Former-commit-id: dff128c7e3
2023-11-02 16:51:52 +08:00
hiyouga
22b3c913e9 fix #1325
Former-commit-id: 083787dbfe
2023-11-01 23:38:49 +08:00
hiyouga
d57f70bf8a fix chat
Former-commit-id: 8b912690e3
2023-11-01 23:07:58 +08:00
hiyouga
e3d64e119e update gradio, support multiple resp in api
Former-commit-id: 84af10cec9
2023-11-01 23:02:16 +08:00
hiyouga
abd6ec174f fix SFT trainer
Former-commit-id: d8cf8cfdeb
2023-10-31 21:52:52 +08:00
hiyouga
6493f6d2e9 fix #1316
Former-commit-id: f4e4a04529
2023-10-31 11:32:08 +08:00
hiyouga
d48478ef88 update constants
Former-commit-id: f28a034a9b
2023-10-29 13:30:20 +08:00
hiyouga
bf0faf129d fix vicuna template
Former-commit-id: 52fc24d166
2023-10-27 22:15:25 +08:00
hiyouga
5705c82cd8 fix chatglm3 template
Former-commit-id: 4117f38827
2023-10-27 21:12:06 +08:00
hiyouga
8a76b1e499 support chatglm3
Former-commit-id: 1c0ab9a908
2023-10-27 19:16:28 +08:00
hiyouga
fcfcac4858 support dataset cache
Former-commit-id: 3fe7df628d
2023-10-26 21:48:45 +08:00
hiyouga
4906092811 fix #1287
Former-commit-id: 838ed9aa87
2023-10-26 17:49:41 +08:00
hiyouga
4d6606a72c fix #1285
Former-commit-id: aff9363ce3
2023-10-26 16:34:52 +08:00
hiyouga
84e27a1c0b remove filter in preprocess
Former-commit-id: 2caf91f824
2023-10-23 23:46:02 +08:00
hiyouga
daeff710eb update neftune logic
Former-commit-id: 7de7174ce3
2023-10-22 17:42:13 +08:00
hiyouga
2af83198c7 fix webui
Former-commit-id: 11b55a3270
2023-10-22 17:24:56 +08:00
hiyouga
59fd3155a1 add new options in webui
Former-commit-id: f793ca0a2c
2023-10-22 17:17:58 +08:00
hiyouga
ce112dc744 fix recursion error
Former-commit-id: b79ca8781e
2023-10-22 16:28:37 +08:00
hiyouga
d6c77d9196 reimplement neftune
Former-commit-id: 7b4acf7265
2023-10-22 16:15:08 +08:00
anvie
3635823fbe add NEFTune optimization
Former-commit-id: 57fb40aa04
2023-10-21 13:24:10 +07:00
hiyouga
d18c708f14 fix openchat template
Former-commit-id: 8fdff07e1f
2023-10-21 01:25:42 +08:00
hiyouga
77781d9516 fix tokenizer padding side in evaluate.py
Former-commit-id: 641ffa2f6e
2023-10-21 00:30:04 +08:00
hiyouga
95697652f1 fix #1232
Former-commit-id: b665e9e133
2023-10-20 23:28:52 +08:00
hiyouga
1712a59280 fix #1215
Former-commit-id: 0fcf66049d
2023-10-19 16:19:21 +08:00
hiyouga
4930118761 fix #1218
Former-commit-id: 7a11a42dfd
2023-10-19 16:17:41 +08:00
hiyouga
0622f8a3a3 fix #1228
Former-commit-id: cb0edd2302
2023-10-19 15:54:10 +08:00
hiyouga
f6a8069159 fix #1217
Former-commit-id: 6496a99b7d
2023-10-19 15:52:24 +08:00
hiyouga
6c8bdeb6e0 rename webui
Former-commit-id: 1611fad6bc
2023-10-16 15:16:24 +08:00
hiyouga
8febf5974d fix #1197
Former-commit-id: 85480f2e86
2023-10-16 15:13:46 +08:00
hiyouga
451a90fca1 release v0.2.0
Former-commit-id: 7a53188048
2023-10-15 20:49:43 +08:00
hiyouga
eafde5b73f fix config, #1191
Former-commit-id: a6a04be2e6
2023-10-15 18:28:45 +08:00
hiyouga
e5e740b54d disable tqdm in webui mode
Former-commit-id: 0d63584c03
2023-10-15 16:18:25 +08:00
hiyouga
f3fa47fa7d refactor export, fix #1190
Former-commit-id: ea82f8a82a
2023-10-15 16:01:48 +08:00
hiyouga
0503d45782 fix eval resuming in webui
Former-commit-id: 273745f9b9
2023-10-15 15:45:38 +08:00
hiyouga
99592478c9 tiny fix
Former-commit-id: 3ad8c92eca
2023-10-15 05:02:48 +08:00
hiyouga
4f9ca28e11 fix callback
Former-commit-id: 1e9401744c
2023-10-15 04:59:44 +08:00
hiyouga
3ae6229140 implement webui resuming training
Former-commit-id: accde3cd39
2023-10-15 04:52:19 +08:00