11 Commits

Author SHA1 Message Date
hiyouga
733b395822 update readme
Former-commit-id: 20cf27976f24db2667955a8007e0ce2baa35fc82
2023-08-07 15:02:02 +08:00
hiyouga
65369ecf48 fix bos and eos token
Former-commit-id: d87c8fd8ab84c9f58c0b1f3fb4ad0adf98b25715
2023-08-04 23:55:57 +08:00
hiyouga
dbb284b5a2 fix encode
Former-commit-id: 8172ad1b5e3fa0b224d761ce6069d0db4397da2d
2023-08-04 23:27:55 +08:00
hiyouga
ea045b0e5b support chatml safe encoding
Former-commit-id: b4852f94065a11c8cd00ffa7e71ac0e0b2bf477a
2023-08-04 23:14:28 +08:00
hiyouga
b32ed1d7be support interleave probs
Former-commit-id: 69744c17e8180e0ad549b57d575454724b820d01
2023-08-04 21:27:35 +08:00
hiyouga
de407b59ea fix bug in preprocessing
Former-commit-id: 968ce0dcce6bfef582ce37aea6566a65f5aac811
2023-08-02 01:10:28 +08:00
hiyouga
43762f96e6 fix #296
Former-commit-id: e3f80774c46625dbeb85adeb5443450a41fb7ba2
2023-08-01 18:43:53 +08:00
hiyouga
e80b75b560 support streaming data, fix #284 #274 #268
Former-commit-id: 0411a4b3e122e7907441bc7a64b004948741a620
2023-07-31 23:33:00 +08:00
hiyouga
f769c2d3fc update web UI, support rm predict #210
Former-commit-id: ed0e186a134de816d6a9278f4e47baa6250a52d1
2023-07-21 13:27:27 +08:00
hiyouga
64b4f71673 simplify code
Former-commit-id: 67a27730744b71795b10260d050501bfe2329c26
2023-07-20 15:08:57 +08:00
hiyouga
a696148d6b modity code structure
Former-commit-id: f75137661358f9070bc70c341dfa2cc5fd69cf94
2023-07-15 16:54:28 +08:00