hoshi-hiyouga
|
a9beb90abc
|
Merge pull request #84 from wu-yy/patch-1
Update requirements.txt
Former-commit-id: 95b057f5af
|
2023-06-26 15:39:08 +08:00 |
|
蓝鲸123
|
784065e16a
|
Update requirements.txt
LlamaTokenizer requires the SentencePiece library but it was not found in your environment.
Former-commit-id: e2a16d549e
|
2023-06-26 15:36:19 +08:00 |
|
hiyouga
|
8f1d99c926
|
support prefixes, loading multiple local files
Former-commit-id: cec9760eb8
|
2023-06-26 15:32:40 +08:00 |
|
hiyouga
|
e4a869dc42
|
update api
Former-commit-id: f030b09924
|
2023-06-26 13:39:57 +08:00 |
|
hiyouga
|
194f38df8f
|
Update wechat.jpg
Former-commit-id: d21cc71750
|
2023-06-25 23:41:11 +08:00 |
|
hiyouga
|
cf29a9af35
|
update readme
Former-commit-id: 0697643358
|
2023-06-23 00:17:05 +08:00 |
|
hiyouga
|
0c7eb90f6b
|
update API
Former-commit-id: 614d3a996c
|
2023-06-22 20:46:24 +08:00 |
|
hiyouga
|
620cd2eb7e
|
match api with OpenAI format
Former-commit-id: 76ecb8c222
|
2023-06-22 20:27:00 +08:00 |
|
hoshi-hiyouga
|
993d005242
|
Merge pull request #68 from mMrBun/main
Compatible with OpenAI API.
Former-commit-id: 9324940b76
|
2023-06-22 15:52:34 +08:00 |
|
Bun
|
cd066afa7b
|
Compatible with OpenAI API.
Former-commit-id: 6e4db0903f
|
2023-06-21 14:45:04 +08:00 |
|
hiyouga
|
45b4588a3d
|
Update wechat.jpg
Former-commit-id: ded5aa3c3d
|
2023-06-19 19:46:04 +08:00 |
|
hiyouga
|
eeb78bd75c
|
add default template
Former-commit-id: f621f7631a
|
2023-06-16 21:12:17 +08:00 |
|
hiyouga
|
9155401bf9
|
add belle multiturn dataset
Former-commit-id: 334d1a6d26
|
2023-06-16 20:01:16 +08:00 |
|
hiyouga
|
653ce9397e
|
fix freeze layers
Former-commit-id: a6c4b141cd
|
2023-06-16 17:38:21 +08:00 |
|
hiyouga
|
36ea46e85c
|
add source prefix
Former-commit-id: fc4d8155b3
|
2023-06-16 16:32:17 +08:00 |
|
hiyouga
|
c6d56e7109
|
support loading lora from hub
Former-commit-id: 0574b590ef
|
2023-06-16 00:02:17 +08:00 |
|
hiyouga
|
a68808d6d9
|
support baichuan model
Former-commit-id: 0cee6ad67f
|
2023-06-15 16:02:01 +08:00 |
|
hiyouga
|
50494db8d6
|
fix bug in template vanilla
Former-commit-id: c527399424
|
2023-06-15 14:36:55 +08:00 |
|
hiyouga
|
64080d185e
|
Update wechat.jpg
Former-commit-id: 0a36658bb6
|
2023-06-15 13:48:53 +08:00 |
|
hiyouga
|
dd1e7ed3cf
|
add BOS token in pre-training
Former-commit-id: d668f8b501
|
2023-06-15 01:46:17 +08:00 |
|
hiyouga
|
3419396945
|
support multiturn training like FastChat
Former-commit-id: b6faf0207d
|
2023-06-14 22:27:39 +08:00 |
|
hiyouga
|
ca90a1e6d9
|
fix loading valuehead
Former-commit-id: 875e8e2349
|
2023-06-13 11:13:06 +08:00 |
|
hiyouga
|
c92bfb158f
|
fix generating args
Former-commit-id: 531a3764d9
|
2023-06-13 01:33:56 +08:00 |
|
hiyouga
|
1fbda5d139
|
support RM metrics, add generating Args
Former-commit-id: cec6524d6b
|
2023-06-12 15:48:48 +08:00 |
|
hoshi-hiyouga
|
5fe70c9350
|
Merge pull request #26 from BUAADreamer/main
add code for reading from multi files in one directory
Former-commit-id: e3f380c1be
|
2023-06-11 19:06:29 +08:00 |
|
BUAADreamer
|
465264f852
|
update json line file to .jsonl
Former-commit-id: e3b53a67c7
|
2023-06-11 18:59:19 +08:00 |
|
BUAADreamer
|
c4128832e5
|
add some
Former-commit-id: 676d910260
|
2023-06-11 18:55:53 +08:00 |
|
BUAADreamer
|
b1c6ee9cf5
|
add code for reading from multi files in one directory
Former-commit-id: a2af9df5a9
|
2023-06-10 16:27:30 +08:00 |
|
BUAADreamer
|
53727aee3e
|
add code for reading from multi files in one directory
Former-commit-id: 3dd5f9a874
|
2023-06-10 15:53:47 +08:00 |
|
hiyouga
|
587d7a907f
|
tiny fix
Former-commit-id: 2ba5d69c7f
|
2023-06-07 16:42:31 +08:00 |
|
hiyouga
|
fb9dedcb36
|
tiny fix
Former-commit-id: 16c2860d56
|
2023-06-07 16:02:07 +08:00 |
|
hiyouga
|
37c6234126
|
tiny fix
Former-commit-id: edafb97733
|
2023-06-07 12:58:14 +08:00 |
|
hiyouga
|
c43d3f2460
|
add templates
Former-commit-id: 3875b19a34
|
2023-06-07 12:40:44 +08:00 |
|
hiyouga
|
6e5414bf1d
|
add belle template
Former-commit-id: 17acf3a3eb
|
2023-06-07 12:30:11 +08:00 |
|
hiyouga
|
93f2e35035
|
tiny fix
Former-commit-id: ce43386080
|
2023-06-07 12:08:39 +08:00 |
|
hiyouga
|
ce08b4a7ec
|
add prompt template class
Former-commit-id: 909af8f496
|
2023-06-07 11:55:25 +08:00 |
|
hiyouga
|
4cd43f018b
|
fix inference, add prompt template
Former-commit-id: 5d021d4ad5
|
2023-06-07 10:52:35 +08:00 |
|
hiyouga
|
8849bee763
|
recover logging
Former-commit-id: 13d1f0709c
|
2023-06-06 21:36:37 +08:00 |
|
hiyouga
|
794c2fd506
|
support distributed quantized training
Former-commit-id: 4eb17bcf6c
|
2023-06-06 17:39:41 +08:00 |
|
hiyouga
|
1a49937351
|
add API demo from #1
Former-commit-id: 3d8d5ee5d5
|
2023-06-05 21:32:18 +08:00 |
|
hoshi-hiyouga
|
2c34b7f858
|
Merge pull request #11 from hiyouga/api
Api
Former-commit-id: 06e1b120e1
|
2023-06-05 20:58:02 +08:00 |
|
hiyouga
|
dc4d9e514e
|
fix bug in web demo
Former-commit-id: a38d57ddd7
|
2023-06-05 17:58:29 +08:00 |
|
hiyouga
|
666fe30708
|
increase max length in cli demo
Former-commit-id: 56eb99106a
|
2023-06-05 16:49:14 +08:00 |
|
hiyouga
|
e92ac44cd2
|
implement stream generating
Former-commit-id: fe1d930816
|
2023-06-05 16:43:44 +08:00 |
|
hiyouga
|
e94cf814ff
|
tiny fix
Former-commit-id: 44298c1235
|
2023-06-05 15:25:22 +08:00 |
|
hiyouga
|
b982a9df83
|
tiny fix
Former-commit-id: 38b83533a4
|
2023-06-04 16:35:50 +08:00 |
|
hiyouga
|
95a6f1759b
|
tiny fix
Former-commit-id: eac9921e5c
|
2023-06-04 12:55:40 +08:00 |
|
hiyouga
|
4d4636c48e
|
support QLoRA
Former-commit-id: 3b9eee8cd2
|
2023-06-04 00:08:56 +08:00 |
|
hiyouga
|
08d6079140
|
fix int8 inference
Former-commit-id: 1bd13d7ca1
|
2023-06-03 23:22:05 +08:00 |
|
hiyouga
|
3bf4b20d0b
|
reduce repetition penalty
Former-commit-id: 926291940d
|
2023-06-03 21:57:39 +08:00 |
|