Commit Graph

575 Commits

Author SHA1 Message Date
hiyouga
c87910ada3 support falcon model #72
Former-commit-id: c136f362c1
2023-07-05 15:00:06 +08:00
hiyouga
9e8854535b fix bleu score
Former-commit-id: cac87fd553
2023-07-05 00:11:21 +08:00
hiyouga
023f9367fc set use_cache before saving model
Former-commit-id: 395ed1cf1b
2023-07-04 23:18:20 +08:00
hiyouga
b9d56b2ac5 fix seq2seq predictions
Former-commit-id: 65e9ce2cdd
2023-07-04 22:56:51 +08:00
hiyouga
4ec1bff116 fix typo
Former-commit-id: 92fa515e97
2023-06-30 10:09:59 +08:00
hiyouga
1ce7b5e0f3 update loading logic
Former-commit-id: 4d0fddba21
2023-06-28 12:07:16 +08:00
hiyouga
2ff577810a fix loading best model
Former-commit-id: 0a46313cca
2023-06-28 01:55:12 +08:00
hiyouga
c3cd2067b2 fix RM accuracy
Former-commit-id: 7826a8ca77
2023-06-28 01:40:13 +08:00
hiyouga
c5ec4eaef5 tiny fix
Former-commit-id: 450910c1db
2023-06-27 23:54:24 +08:00
hiyouga
e877b8d55b fix initializing data arguments
Former-commit-id: 18f87c1b25
2023-06-27 22:50:23 +08:00
hiyouga
307f5866e9 support save full model, replace BOS token
Former-commit-id: 2e01abfda5
2023-06-27 21:40:11 +08:00
hiyouga
86a7b2dc5d fix decoding in seq2seq
Former-commit-id: 1c732e2537
2023-06-27 19:33:08 +08:00
hiyouga
c145ca4ad6 fix generation in seq2seq.py
Former-commit-id: 1175948029
2023-06-26 18:07:06 +08:00
hiyouga
8f1d99c926 support prefixes, loading multiple local files
Former-commit-id: cec9760eb8
2023-06-26 15:32:40 +08:00
hiyouga
e4a869dc42 update api
Former-commit-id: f030b09924
2023-06-26 13:39:57 +08:00
hiyouga
cf29a9af35 update readme
Former-commit-id: 0697643358
2023-06-23 00:17:05 +08:00
hiyouga
0c7eb90f6b update API
Former-commit-id: 614d3a996c
2023-06-22 20:46:24 +08:00
hiyouga
620cd2eb7e match api with OpenAI format
Former-commit-id: 76ecb8c222
2023-06-22 20:27:00 +08:00
Bun
cd066afa7b Compatible with OpenAI API.
Former-commit-id: 6e4db0903f
2023-06-21 14:45:04 +08:00
hiyouga
eeb78bd75c add default template
Former-commit-id: f621f7631a
2023-06-16 21:12:17 +08:00
hiyouga
653ce9397e fix freeze layers
Former-commit-id: a6c4b141cd
2023-06-16 17:38:21 +08:00
hiyouga
36ea46e85c add source prefix
Former-commit-id: fc4d8155b3
2023-06-16 16:32:17 +08:00
hiyouga
c6d56e7109 support loading lora from hub
Former-commit-id: 0574b590ef
2023-06-16 00:02:17 +08:00
hiyouga
a68808d6d9 support baichuan model
Former-commit-id: 0cee6ad67f
2023-06-15 16:02:01 +08:00
hiyouga
50494db8d6 fix bug in template vanilla
Former-commit-id: c527399424
2023-06-15 14:36:55 +08:00
hiyouga
dd1e7ed3cf add BOS token in pre-training
Former-commit-id: d668f8b501
2023-06-15 01:46:17 +08:00
hiyouga
3419396945 support multiturn training like FastChat
Former-commit-id: b6faf0207d
2023-06-14 22:27:39 +08:00
hiyouga
ca90a1e6d9 fix loading valuehead
Former-commit-id: 875e8e2349
2023-06-13 11:13:06 +08:00
hiyouga
c92bfb158f fix generating args
Former-commit-id: 531a3764d9
2023-06-13 01:33:56 +08:00
hiyouga
1fbda5d139 support RM metrics, add generating Args
Former-commit-id: cec6524d6b
2023-06-12 15:48:48 +08:00
BUAADreamer
b1c6ee9cf5 add code for reading from multi files in one directory
Former-commit-id: a2af9df5a9
2023-06-10 16:27:30 +08:00
BUAADreamer
53727aee3e add code for reading from multi files in one directory
Former-commit-id: 3dd5f9a874
2023-06-10 15:53:47 +08:00
hiyouga
587d7a907f tiny fix
Former-commit-id: 2ba5d69c7f
2023-06-07 16:42:31 +08:00
hiyouga
fb9dedcb36 tiny fix
Former-commit-id: 16c2860d56
2023-06-07 16:02:07 +08:00
hiyouga
37c6234126 tiny fix
Former-commit-id: edafb97733
2023-06-07 12:58:14 +08:00
hiyouga
c43d3f2460 add templates
Former-commit-id: 3875b19a34
2023-06-07 12:40:44 +08:00
hiyouga
6e5414bf1d add belle template
Former-commit-id: 17acf3a3eb
2023-06-07 12:30:11 +08:00
hiyouga
93f2e35035 tiny fix
Former-commit-id: ce43386080
2023-06-07 12:08:39 +08:00
hiyouga
ce08b4a7ec add prompt template class
Former-commit-id: 909af8f496
2023-06-07 11:55:25 +08:00
hiyouga
4cd43f018b fix inference, add prompt template
Former-commit-id: 5d021d4ad5
2023-06-07 10:52:35 +08:00
hiyouga
8849bee763 recover logging
Former-commit-id: 13d1f0709c
2023-06-06 21:36:37 +08:00
hiyouga
794c2fd506 support distributed quantized training
Former-commit-id: 4eb17bcf6c
2023-06-06 17:39:41 +08:00
hiyouga
1a49937351 add API demo from #1
Former-commit-id: 3d8d5ee5d5
2023-06-05 21:32:18 +08:00
hoshi-hiyouga
2c34b7f858 Merge pull request #11 from hiyouga/api
Api

Former-commit-id: 06e1b120e1
2023-06-05 20:58:02 +08:00
hiyouga
dc4d9e514e fix bug in web demo
Former-commit-id: a38d57ddd7
2023-06-05 17:58:29 +08:00
hiyouga
666fe30708 increase max length in cli demo
Former-commit-id: 56eb99106a
2023-06-05 16:49:14 +08:00
hiyouga
e92ac44cd2 implement stream generating
Former-commit-id: fe1d930816
2023-06-05 16:43:44 +08:00
hiyouga
e94cf814ff tiny fix
Former-commit-id: 44298c1235
2023-06-05 15:25:22 +08:00
hiyouga
b982a9df83 tiny fix
Former-commit-id: 38b83533a4
2023-06-04 16:35:50 +08:00
hiyouga
95a6f1759b tiny fix
Former-commit-id: eac9921e5c
2023-06-04 12:55:40 +08:00