Commit Graph

1268 Commits

Author SHA1 Message Date
hiyouga
733b395822 update readme
Former-commit-id: 20cf27976f
2023-08-07 15:02:02 +08:00
hiyouga
871f7de3d0 fix #376
Former-commit-id: 081345baca
2023-08-07 13:58:59 +08:00
hiyouga
77f6647e8f update trainer
Former-commit-id: 220175ab24
2023-08-07 13:34:35 +08:00
hiyouga
2faa1af4eb fix qwen eos token
Former-commit-id: e21ae01356
2023-08-06 13:31:17 +08:00
hiyouga
39955c28ff fix qwen tokenizer #361
Former-commit-id: 7f18d2a335
2023-08-05 17:06:05 +08:00
hiyouga
45af1a951f fix template for tiktoken
Former-commit-id: 1afa51c2fa
2023-08-05 13:42:42 +08:00
hiyouga
1a1caf2116 remove redundant code
Former-commit-id: 53d95725c5
2023-08-05 00:27:27 +08:00
hiyouga
ab95f569a4 fix template
Former-commit-id: c183b3551d
2023-08-05 00:25:00 +08:00
hiyouga
7a89fce4c7 fix llama2 template
Former-commit-id: e4a15f863c
2023-08-05 00:07:54 +08:00
hiyouga
65369ecf48 fix bos and eos token
Former-commit-id: d87c8fd8ab
2023-08-04 23:55:57 +08:00
hiyouga
dbb284b5a2 fix encode
Former-commit-id: 8172ad1b5e
2023-08-04 23:27:55 +08:00
hiyouga
ea045b0e5b support chatml safe encoding
Former-commit-id: b4852f9406
2023-08-04 23:14:28 +08:00
hiyouga
b32ed1d7be support interleave probs
Former-commit-id: 69744c17e8
2023-08-04 21:27:35 +08:00
hiyouga
cddf324a5e fix webui export model
Former-commit-id: d6b14658d4
2023-08-04 14:20:27 +08:00
hiyouga
0328c0e07c fix mtloader
Former-commit-id: a0173c427d
2023-08-03 19:29:02 +08:00
hiyouga
2d96ec9c3e tiny fix
Former-commit-id: ff98f1cba8
2023-08-03 17:42:28 +08:00
hiyouga
788d1250c1 fix qwen inference
Former-commit-id: 2780792754
2023-08-03 16:31:55 +08:00
hiyouga
65ef0ff491 fix qwen inference
Former-commit-id: ea30da4794
2023-08-03 16:15:38 +08:00
hiyouga
9c84c4ed5d support Qwen-7B, fix InternLM-7B inference
Former-commit-id: 87f8f830e2
2023-08-03 15:53:32 +08:00
hiyouga
471ef69218 update web demo
Former-commit-id: 53d6dc396d
2023-08-03 13:28:28 +08:00
hiyouga
91d178f14d fix webui
Former-commit-id: e23a3a366c
2023-08-03 12:43:12 +08:00
hiyouga
4242897b78 modify code structure
Former-commit-id: 08f180e788
2023-08-02 23:17:36 +08:00
hiyouga
4b8e4398bc fix PPO trainer
Former-commit-id: 1d8a1878ea
2023-08-02 19:10:23 +08:00
hiyouga
569df8ccd6 update ppo trainer
Former-commit-id: b5ba87952a
2023-08-02 18:46:41 +08:00
hiyouga
ab739e72ea fix memory leak of PPO trainer
Former-commit-id: 286f7be346
2023-08-02 17:41:34 +08:00
hiyouga
534e3320b5 release v0.1.5
Former-commit-id: c689857bbb
2023-08-02 16:10:31 +08:00
YC Chen
bb2b38a31f [fix] Remove useless code
Former-commit-id: ca125da0eb
2023-08-02 14:35:35 +08:00
YC Chen
bf844e8a99 [feature] Fix template of Llama2 to match the offical template
Former-commit-id: 4323773089
2023-08-02 14:10:15 +08:00
hiyouga
de407b59ea fix bug in preprocessing
Former-commit-id: 968ce0dcce
2023-08-02 01:10:28 +08:00
hiyouga
43762f96e6 fix #296
Former-commit-id: e3f80774c4
2023-08-01 18:43:53 +08:00
hiyouga
5c7337d6f3 Fix #294
Former-commit-id: e6a3894b99
2023-08-01 18:13:03 +08:00
hiyouga
40f3f5722e fix webui
Former-commit-id: befaab5720
2023-08-01 12:11:37 +08:00
hiyouga
c5ad96375e fix RM save model
Former-commit-id: ac88ce5233
2023-08-01 11:56:17 +08:00
hiyouga
aa4335eac7 release v0.1.4
Former-commit-id: 973a638665
2023-08-01 10:08:47 +08:00
hiyouga
e34fc5fd2e fix inference
Former-commit-id: d3a0692d4d
2023-08-01 00:06:48 +08:00
hiyouga
d5d3b2a42f fix arg check
Former-commit-id: 9cb1f119a4
2023-07-31 23:48:57 +08:00
hiyouga
a437424381 update readme
Former-commit-id: 62dca5bb82
2023-07-31 23:42:32 +08:00
hiyouga
e80b75b560 support streaming data, fix #284 #274 #268
Former-commit-id: 0411a4b3e1
2023-07-31 23:33:00 +08:00
hiyouga
2a664783c3 Update data_args.py
Former-commit-id: 513e1f1ec9
2023-07-28 17:42:41 +08:00
hiyouga
3e3652f4e0 fix #268
Former-commit-id: 91dd17d8a6
2023-07-28 17:02:26 +08:00
hiyouga
c52dd3e86f fix #242
Former-commit-id: 00efa8a07f
2023-07-25 17:04:02 +08:00
hiyouga
261ca840d0 update readme, fix web ui postprocess
Former-commit-id: 035c966d5c
2023-07-22 14:29:22 +08:00
NULL
df1d02a7d9 Merge branch 'hiyouga:main' into main
Former-commit-id: 7007fbc0b6
2023-07-21 17:00:26 +08:00
mrhan1993
cdd887908c 根据GLM Efficient Tuning添加中文README,web添加了server_port
Former-commit-id: 9f0b57b370
2023-07-21 16:57:58 +08:00
hiyouga
ee7aa86312 release v0.1.3
Former-commit-id: 0b6150bc31
2023-07-21 16:48:34 +08:00
hiyouga
daf81288a1 fix save function
Former-commit-id: d2f18197e3
2023-07-21 14:09:07 +08:00
hiyouga
42c78bf591 Update runner.py
Former-commit-id: 1d1d8538c9
2023-07-21 13:35:19 +08:00
hiyouga
f769c2d3fc update web UI, support rm predict #210
Former-commit-id: ed0e186a13
2023-07-21 13:27:27 +08:00
hiyouga
5ad443eaa6 release v0.1.2
Former-commit-id: 4c45a3a884
2023-07-20 22:33:59 +08:00
hiyouga
f1010ff65f fix api
Former-commit-id: 8333795fcb
2023-07-20 22:14:54 +08:00