Commit Graph

16 Commits

Author SHA1 Message Date
hiyouga
531a3764d9 fix generating args 2023-06-13 01:33:56 +08:00
hiyouga
cec6524d6b support RM metrics, add generating Args 2023-06-12 15:48:48 +08:00
hiyouga
909af8f496 add prompt template class 2023-06-07 11:55:25 +08:00
hiyouga
5d021d4ad5 fix inference, add prompt template 2023-06-07 10:52:35 +08:00
hiyouga
3d8d5ee5d5 add API demo from #1 2023-06-05 21:32:18 +08:00
hiyouga
a38d57ddd7 fix bug in web demo 2023-06-05 17:58:29 +08:00
hiyouga
fe1d930816 implement stream generating 2023-06-05 16:43:44 +08:00
hiyouga
1bd13d7ca1 fix int8 inference 2023-06-03 23:22:05 +08:00
hiyouga
926291940d reduce repetition penalty 2023-06-03 21:57:39 +08:00
hiyouga
de09ee1315 add ziya prompt template 2023-06-03 19:05:51 +08:00
hiyouga
dca27b4412 add logits processor 2023-06-03 16:34:54 +08:00
hiyouga
50d9a20f81 alter rewards data type 2023-06-02 14:19:51 +08:00
hiyouga
fd709eacff fix bug at inference 2023-05-31 18:11:53 +08:00
hiyouga
740a5daf56 support BLOOM models 2023-05-31 16:54:06 +08:00
hiyouga
c0e5df92d6 fix checkpoint loading 2023-05-29 17:43:16 +08:00
hiyouga
769c6ab56b Initial commit 2023-05-28 18:09:04 +08:00