30 Commits

Author SHA1 Message Date
hiyouga
50459a39f4 fix api
Former-commit-id: a4149fbcd600d4f3815f9353e5e92c569719bed6
2024-01-21 00:03:09 +08:00
hiyouga
aed00a97b6 fix cli_demo
Former-commit-id: e8336b3653f43618cf7cd70f8da004208de970c0
2024-01-20 23:27:10 +08:00
hiyouga
7543dc4a9d fix #2260
Former-commit-id: ba97550671811a27177306dd231bb427130b26fb
2024-01-20 23:22:09 +08:00
hiyouga
66e0e651b9 format style
Former-commit-id: 53b683531b83cd1d19de97c6565f16c1eca6f5e1
2024-01-20 20:15:56 +08:00
hiyouga
81530133ff fix #1507
Former-commit-id: 1ba9c53bd9743fa95fca1516c0ed9da352dbe9a1
2023-11-15 16:22:32 +08:00
hiyouga
87197ba91d fix #1489
Former-commit-id: ebdeaca9cdfd6138c690a0fcb9f676deaddff177
2023-11-14 15:27:05 +08:00
hiyouga
1cb9a38ac2 fix #1215
Former-commit-id: d91b43a8afbea4859357f2224e3d9b9d71160e6d
2023-10-19 16:19:21 +08:00
hiyouga
da08fa7c63 update web demo
Former-commit-id: 5b6ad9adb665096bfb36dc90789a1d4a16345122
2023-08-03 13:28:28 +08:00
hiyouga
28a51b622b modify code structure
Former-commit-id: 6369f9b1751e6f9bb709ba76a85f69cbe0823e5d
2023-08-02 23:17:36 +08:00
hiyouga
5ba0b80e5c simplify code
Former-commit-id: d3731754ab7c28ae81f60784e0e4213f279d93fe
2023-07-20 15:08:57 +08:00
hiyouga
a8deee27f8 create chat model
Former-commit-id: bddf583b2fc099c957a1037418bd8504a837663e
2023-07-15 19:26:20 +08:00
hiyouga
6261fb362a modity code structure
Former-commit-id: 0682ed357210897e0b67c4a6eb31a94b3eb929f1
2023-07-15 16:54:28 +08:00
hiyouga
391bf1c699 match api with OpenAI format
Former-commit-id: 9cbe2b98b024393817e86ff8e3ff1636776fa263
2023-06-22 20:27:00 +08:00
hiyouga
de9da40b18 add source prefix
Former-commit-id: 4f0fe959fcd2dded56a95ff3ad620bd381ae17a6
2023-06-16 16:32:17 +08:00
hiyouga
aa1bb8a9a2 support multiturn training like FastChat
Former-commit-id: 629cafb1a09924e82d7ea1f9fba318d3f5593196
2023-06-14 22:27:39 +08:00
hiyouga
4724ae3492 support RM metrics, add generating Args
Former-commit-id: c461c6190bc124e98dde7f3cf96a59ce40b26fb0
2023-06-12 15:48:48 +08:00
hiyouga
b9feb82e4e add prompt template class
Former-commit-id: 3d7e3a38d00aa5d9664824093043951af8c3f707
2023-06-07 11:55:25 +08:00
hiyouga
3da427a665 fix inference, add prompt template
Former-commit-id: 3940e50c71472b210bbc1b01248bf85a191c4065
2023-06-07 10:52:35 +08:00
hiyouga
ac6f50dedf add API demo from #1
Former-commit-id: c955edcef168da44257c5b50d7bc59266d909782
2023-06-05 21:32:18 +08:00
hiyouga
3f5869111b increase max length in cli demo
Former-commit-id: 0113cdb12728419022b5c01c932a5d52e626a200
2023-06-05 16:49:14 +08:00
hiyouga
f9c51a8340 implement stream generating
Former-commit-id: 6cc9535975d823ffef7e1686749b69b40347a8ec
2023-06-05 16:43:44 +08:00
hiyouga
2308d5a179 fix int8 inference
Former-commit-id: d05202943e9634526f96d189288f67852d3d1c40
2023-06-03 23:22:05 +08:00
hiyouga
7d6542115c reduce repetition penalty
Former-commit-id: 0381d93fc10ea5346724fe6295caa565a8eb4f61
2023-06-03 21:57:39 +08:00
hiyouga
fa850ae6e5 add ziya prompt template
Former-commit-id: 321e44ac54a91260cf00a4caa1991708814473fc
2023-06-03 19:05:51 +08:00
hiyouga
9b8b6623ac add logits processor
Former-commit-id: f6f4b1554ae1e8849b437d705ffa34ce7ebd56bb
2023-06-03 16:34:54 +08:00
hiyouga
e9ab06678f alter rewards data type
Former-commit-id: 3eb7eb2d37525da50fe401ab7c59532e6e1ef984
2023-06-02 14:19:51 +08:00
hiyouga
1512711ca2 fix bug at inference
Former-commit-id: df9b41af4401006b8040eb53c44dd290b604e0eb
2023-05-31 18:11:53 +08:00
hiyouga
693c049eac support BLOOM models
Former-commit-id: 1314b6ea39a01aa8ac325e1d875ac013d43aec45
2023-05-31 16:54:06 +08:00
hiyouga
304be6dc28 fix checkpoint loading
Former-commit-id: d31aa5c2c0bcb6a4ef4a62e21693548dd9acaae6
2023-05-29 17:43:16 +08:00
hiyouga
17024ebc1a Initial commit
Former-commit-id: 5ca8e1d63727e7bcb8cab16542c763c47e48184a
2023-05-28 18:09:04 +08:00