30 Commits

Author SHA1 Message Date
hiyouga
865f48f1c3 fix api
Former-commit-id: 55f707196e772514907226d5a09fad1cdee6395d
2024-01-21 00:03:09 +08:00
hiyouga
0be7b16955 fix cli_demo
Former-commit-id: c550987a72b0b88ea0116eb47a507142c8544df4
2024-01-20 23:27:10 +08:00
hiyouga
baaa0acdf1 fix #2260
Former-commit-id: cf818a25982c8a2808cf21f22e1e5eb4dd7e0713
2024-01-20 23:22:09 +08:00
hiyouga
b27e91222c format style
Former-commit-id: 638234ceee1b19716e45b6e5f4ea54d9122da4df
2024-01-20 20:15:56 +08:00
hiyouga
8ee48a9c9e fix #1507
Former-commit-id: 2f02f688e15db8bf8f0dad3b7284863998c207a3
2023-11-15 16:22:32 +08:00
hiyouga
9176b55fe6 fix #1489
Former-commit-id: 3743b7420b823c5a56aef6100121d89b677ffb0e
2023-11-14 15:27:05 +08:00
hiyouga
1712a59280 fix #1215
Former-commit-id: 0fcf66049df0893e8f0f20b2098a98bedb291259
2023-10-19 16:19:21 +08:00
hiyouga
471ef69218 update web demo
Former-commit-id: 53d6dc396dbfb1d25236bbc3075404cd5be6b376
2023-08-03 13:28:28 +08:00
hiyouga
4242897b78 modify code structure
Former-commit-id: 08f180e78862cad902b6cdbbd8c86e39b5cacf8a
2023-08-02 23:17:36 +08:00
hiyouga
64b4f71673 simplify code
Former-commit-id: 67a27730744b71795b10260d050501bfe2329c26
2023-07-20 15:08:57 +08:00
hiyouga
b8b38a9ade create chat model
Former-commit-id: 657cf0f55a7f0886bc837bdd44528971dc5e5caa
2023-07-15 19:26:20 +08:00
hiyouga
a696148d6b modity code structure
Former-commit-id: f75137661358f9070bc70c341dfa2cc5fd69cf94
2023-07-15 16:54:28 +08:00
hiyouga
620cd2eb7e match api with OpenAI format
Former-commit-id: 76ecb8c222cec34fa6dbcef71e3907c95f67c22f
2023-06-22 20:27:00 +08:00
hiyouga
36ea46e85c add source prefix
Former-commit-id: fc4d8155b35dcc453a64a50b21ce59050a15be99
2023-06-16 16:32:17 +08:00
hiyouga
3419396945 support multiturn training like FastChat
Former-commit-id: b6faf0207d5b637722a1fd45984d27b3ac095fd4
2023-06-14 22:27:39 +08:00
hiyouga
1fbda5d139 support RM metrics, add generating Args
Former-commit-id: cec6524d6b1be65c5d171a5b3dcaae7818132bc5
2023-06-12 15:48:48 +08:00
hiyouga
ce08b4a7ec add prompt template class
Former-commit-id: 909af8f49698a1de3010becf61817cbedecf7879
2023-06-07 11:55:25 +08:00
hiyouga
4cd43f018b fix inference, add prompt template
Former-commit-id: 5d021d4ad514974dd9dcc5240871713cf53a87f2
2023-06-07 10:52:35 +08:00
hiyouga
1a49937351 add API demo from #1
Former-commit-id: 3d8d5ee5d54102dd73856fac3a80922ea3104a06
2023-06-05 21:32:18 +08:00
hiyouga
666fe30708 increase max length in cli demo
Former-commit-id: 56eb99106aa69eef8dab6b3518779db3373e639b
2023-06-05 16:49:14 +08:00
hiyouga
e92ac44cd2 implement stream generating
Former-commit-id: fe1d9308163699b7c4dd791915788855b2e6854f
2023-06-05 16:43:44 +08:00
hiyouga
08d6079140 fix int8 inference
Former-commit-id: 1bd13d7ca197edaa9a1143b061249b4fa6003b97
2023-06-03 23:22:05 +08:00
hiyouga
3bf4b20d0b reduce repetition penalty
Former-commit-id: 926291940de4b59a40489e6a509fdc0135c8616d
2023-06-03 21:57:39 +08:00
hiyouga
342ee89d28 add ziya prompt template
Former-commit-id: de09ee1315759a085e4fcf20e94963293c881aae
2023-06-03 19:05:51 +08:00
hiyouga
42c9c8de39 add logits processor
Former-commit-id: dca27b4412e8e41cadcd623582222e1c216db78b
2023-06-03 16:34:54 +08:00
hiyouga
4003ddcc3b alter rewards data type
Former-commit-id: 50d9a20f8103fcfb92a3e2a5e6f0055d27b29d53
2023-06-02 14:19:51 +08:00
hiyouga
3f3b475412 fix bug at inference
Former-commit-id: fd709eacff09d52636541cba009a1ded6aac22dc
2023-05-31 18:11:53 +08:00
hiyouga
3bfb086399 support BLOOM models
Former-commit-id: 740a5daf5634f70a61b41fa8a31ee4a587fa03f3
2023-05-31 16:54:06 +08:00
hiyouga
0ab4419b86 fix checkpoint loading
Former-commit-id: c0e5df92d601966444956c65482441bd757fd7a1
2023-05-29 17:43:16 +08:00
hiyouga
54b8ce7b63 Initial commit
Former-commit-id: 769c6ab56be0c9d26e9289f61ac54a4068d935c1
2023-05-28 18:09:04 +08:00