13 Commits

Author	SHA1	Message	Date
hiyouga	5d021d4ad5	fix inference, add prompt template	2023-06-07 10:52:35 +08:00
hiyouga	3d8d5ee5d5	add API demo from #1	2023-06-05 21:32:18 +08:00
hiyouga	56eb99106a	increase max length in cli demo	2023-06-05 16:49:14 +08:00
hiyouga	fe1d930816	implement stream generating	2023-06-05 16:43:44 +08:00
hiyouga	1bd13d7ca1	fix int8 inference	2023-06-03 23:22:05 +08:00
hiyouga	926291940d	reduce repetition penalty	2023-06-03 21:57:39 +08:00
hiyouga	de09ee1315	add ziya prompt template	2023-06-03 19:05:51 +08:00
hiyouga	dca27b4412	add logits processor	2023-06-03 16:34:54 +08:00
hiyouga	50d9a20f81	alter rewards data type	2023-06-02 14:19:51 +08:00
hiyouga	fd709eacff	fix bug at inference	2023-05-31 18:11:53 +08:00
hiyouga	740a5daf56	support BLOOM models	2023-05-31 16:54:06 +08:00
hiyouga	c0e5df92d6	fix checkpoint loading	2023-05-29 17:43:16 +08:00
hiyouga	769c6ab56b	Initial commit	2023-05-28 18:09:04 +08:00