14 Commits

Author SHA1 Message Date
hiyouga
8875f565ad add prompt template class
Former-commit-id: 3d7e3a38d00aa5d9664824093043951af8c3f707
2023-06-07 11:55:25 +08:00
hiyouga
701a1d84c6 fix inference, add prompt template
Former-commit-id: 3940e50c71472b210bbc1b01248bf85a191c4065
2023-06-07 10:52:35 +08:00
hiyouga
5bedf2b21a add API demo from #1
Former-commit-id: c955edcef168da44257c5b50d7bc59266d909782
2023-06-05 21:32:18 +08:00
hiyouga
ae649012de increase max length in cli demo
Former-commit-id: 0113cdb12728419022b5c01c932a5d52e626a200
2023-06-05 16:49:14 +08:00
hiyouga
9b35130c06 implement stream generating
Former-commit-id: 6cc9535975d823ffef7e1686749b69b40347a8ec
2023-06-05 16:43:44 +08:00
hiyouga
d2e80fff76 fix int8 inference
Former-commit-id: d05202943e9634526f96d189288f67852d3d1c40
2023-06-03 23:22:05 +08:00
hiyouga
eaf536378c reduce repetition penalty
Former-commit-id: 0381d93fc10ea5346724fe6295caa565a8eb4f61
2023-06-03 21:57:39 +08:00
hiyouga
315e2bea67 add ziya prompt template
Former-commit-id: 321e44ac54a91260cf00a4caa1991708814473fc
2023-06-03 19:05:51 +08:00
hiyouga
cba25893d3 add logits processor
Former-commit-id: f6f4b1554ae1e8849b437d705ffa34ce7ebd56bb
2023-06-03 16:34:54 +08:00
hiyouga
587d0f5311 alter rewards data type
Former-commit-id: 3eb7eb2d37525da50fe401ab7c59532e6e1ef984
2023-06-02 14:19:51 +08:00
hiyouga
4edd01fc08 fix bug at inference
Former-commit-id: df9b41af4401006b8040eb53c44dd290b604e0eb
2023-05-31 18:11:53 +08:00
hiyouga
a74fcc4149 support BLOOM models
Former-commit-id: 1314b6ea39a01aa8ac325e1d875ac013d43aec45
2023-05-31 16:54:06 +08:00
hiyouga
6f89f64c73 fix checkpoint loading
Former-commit-id: d31aa5c2c0bcb6a4ef4a62e21693548dd9acaae6
2023-05-29 17:43:16 +08:00
hiyouga
54574f1dfa Initial commit
Former-commit-id: 5ca8e1d63727e7bcb8cab16542c763c47e48184a
2023-05-28 18:09:04 +08:00