Commit Graph

13 Commits

Author SHA1 Message Date
hiyouga
5d021d4ad5 fix inference, add prompt template 2023-06-07 10:52:35 +08:00
hiyouga
3d8d5ee5d5 add API demo from #1 2023-06-05 21:32:18 +08:00
hiyouga
56eb99106a increase max length in cli demo 2023-06-05 16:49:14 +08:00
hiyouga
fe1d930816 implement stream generating 2023-06-05 16:43:44 +08:00
hiyouga
1bd13d7ca1 fix int8 inference 2023-06-03 23:22:05 +08:00
hiyouga
926291940d reduce repetition penalty 2023-06-03 21:57:39 +08:00
hiyouga
de09ee1315 add ziya prompt template 2023-06-03 19:05:51 +08:00
hiyouga
dca27b4412 add logits processor 2023-06-03 16:34:54 +08:00
hiyouga
50d9a20f81 alter rewards data type 2023-06-02 14:19:51 +08:00
hiyouga
fd709eacff fix bug at inference 2023-05-31 18:11:53 +08:00
hiyouga
740a5daf56 support BLOOM models 2023-05-31 16:54:06 +08:00
hiyouga
c0e5df92d6 fix checkpoint loading 2023-05-29 17:43:16 +08:00
hiyouga
769c6ab56b Initial commit 2023-05-28 18:09:04 +08:00