10 Commits

Author	SHA1	Message	Date
hiyouga	d87c8fd8ab	fix bos and eos token	2023-08-04 23:55:57 +08:00
hiyouga	8172ad1b5e	fix encode	2023-08-04 23:27:55 +08:00
hiyouga	b4852f9406	support chatml safe encoding	2023-08-04 23:14:28 +08:00
hiyouga	69744c17e8	support interleave probs	2023-08-04 21:27:35 +08:00
hiyouga	968ce0dcce	fix bug in preprocessing	2023-08-02 01:10:28 +08:00
hiyouga	e3f80774c4	fix #296	2023-08-01 18:43:53 +08:00
hiyouga	0411a4b3e1	support streaming data, fix #284 #274 #268	2023-07-31 23:33:00 +08:00
hiyouga	ed0e186a13	update web UI, support rm predict #210	2023-07-21 13:27:27 +08:00
hiyouga	67a2773074	simplify code	2023-07-20 15:08:57 +08:00
hiyouga	f751376613	modity code structure	2023-07-15 16:54:28 +08:00