111 Commits

Author SHA1 Message Date
hiyouga
9468b15d84 Update README.md
Former-commit-id: 6b5eda6e39c1ff8df48418ca0fc734279e1e5abe
2023-07-09 14:57:13 +08:00
hiyouga
7a90e44b03 update api to match langchain
Former-commit-id: 0016cf6525b151a6e7262967399d67033569b7eb
2023-07-07 20:35:39 +08:00
hiyouga
43cef53355 Update README.md
Former-commit-id: 3c2b547dab03f3675ec7224f9f558392dc81cac4
2023-07-07 12:06:28 +08:00
hiyouga
60108653a9 support InternLM
Former-commit-id: a454ef7d57d9c06302d51464cfe39f6d0c48c5a8
2023-07-07 11:02:28 +08:00
hiyouga
642dab8081 fix rouge score
Former-commit-id: b84b03a2a5ca72ce0ba71d9a9c3db1a687283fa6
2023-07-06 14:28:34 +08:00
hiyouga
be61b12c0f update readme
Former-commit-id: 38b555c1819bb1fed1c17608ed6110d9572db98c
2023-07-05 23:03:58 +08:00
hiyouga
83bc87e73f fix streaming response in API
Former-commit-id: 72a17ae3b4fac2dc93b04a816f16f863120bc71b
2023-07-05 22:42:31 +08:00
hiyouga
82cbbc0e48 fix freeze tuning
Former-commit-id: e32a1db967da02f502559df59ec6d1ab4554febf
2023-07-05 21:18:28 +08:00
hiyouga
837c27525c fix bug in PPO stage
Former-commit-id: a27373128d10b4e483d306100d91a55c0b796488
2023-07-05 19:14:10 +08:00
hiyouga
2e75897fc1 fix compute dtype
Former-commit-id: 5aadbb22730d19570b039462c91df443dbb34b5f
2023-07-05 15:13:00 +08:00
hiyouga
6b5a085ddf support falcon model #72
Former-commit-id: 72cc3ff0e6de641073de1159196319705f8efe85
2023-07-05 15:00:06 +08:00
hiyouga
195099e5df fix bleu score
Former-commit-id: 6874dce4444e6e6ce9d6125275dbf3dfdfb4fb22
2023-07-05 00:11:21 +08:00
hiyouga
7e8e0c320b set use_cache before saving model
Former-commit-id: a6a0161f32f600f3001188ff4c7929c5f13c2a03
2023-07-04 23:18:20 +08:00
hiyouga
a2e7d88473 fix seq2seq predictions
Former-commit-id: 045316d62f713311bdabdfb56be442238e03a007
2023-07-04 22:56:51 +08:00
hoshi-hiyouga
1e9dd0e1dc Merge pull request #119 from codemayq/main
add the pre-built version of bitsandbytes library for windows user

Former-commit-id: f1f0e2277469976f8666370645a83b2665a267ec
2023-07-03 19:51:46 +08:00
codemayq
d5b11d6fd0 add the pre-built version of bitsandbytes library for windows user
Former-commit-id: 1cb8429647972147634433e81e3d8df5bded936a
2023-07-03 13:58:10 +08:00
hiyouga
08150ce3e1 Update auto_gptq.py
Former-commit-id: 84ebfd87692031a6736b86dd8a35f635f14c1c97
2023-07-02 20:56:11 +08:00
hiyouga
8b7f99d536 add autogptq
Former-commit-id: 43321557c272862d9c6531fc48a4569cfc88e4e7
2023-07-02 20:36:37 +08:00
hiyouga
1c24c80a6b fix typo
Former-commit-id: 23c0d36abe881d9be839d5c647841bdef178307b
2023-06-30 10:09:59 +08:00
hiyouga
f20b3dc626 Update README.md
Former-commit-id: f3891213f50ef3da84d4a06ce71ec0806a7a4866
2023-06-29 19:36:22 +08:00
hiyouga
9efeb68b3f rename evaluate.py
Former-commit-id: 29d3e62b11964914c636f27beb422b10752cd3ae
2023-06-29 15:40:39 +08:00
hiyouga
7f1796e006 Update evaluate.py
Former-commit-id: 54a48d30b768b0421e760e6eab41fdb12e78995f
2023-06-29 15:40:03 +08:00
hiyouga
fb152e05ec Update README.md
Former-commit-id: 5b3f485af23e0a3804106c1cadc90ba02a8675e6
2023-06-29 15:37:19 +08:00
hiyouga
fe45c17b25 add open assistant dataset
Former-commit-id: 1694cf3078d04a14bce96da04b9d8c52176b1044
2023-06-28 23:09:33 +08:00
hiyouga
11f8c31101 update loading logic
Former-commit-id: f1da17bb0deeb39a29da4dc208951d1ad69bb8ba
2023-06-28 12:07:16 +08:00
hiyouga
72d2656c04 fix loading best model
Former-commit-id: cf7db6855d353a57344c78d6b56478ffb14ceff2
2023-06-28 01:55:12 +08:00
hiyouga
7ba498d142 fix RM accuracy
Former-commit-id: 532a385ea60693fdf835e6bc8e240ff8d55ff3a7
2023-06-28 01:40:13 +08:00
hiyouga
a4d7769ef9 add star history
Former-commit-id: 08f0dbcac3b72165e8993398111cc2b84006fbe5
2023-06-27 23:56:29 +08:00
hiyouga
d21a64160d tiny fix
Former-commit-id: 994f2a79831a1dea8425e3eff62f0bc8238b78d6
2023-06-27 23:54:24 +08:00
hiyouga
4f2c204f13 fix initializing data arguments
Former-commit-id: e6b83c8b87cb93358086121a6f9ccaba5dfa7497
2023-06-27 22:50:23 +08:00
hiyouga
9342c6411b support save full model, replace BOS token
Former-commit-id: 32e56c290802ba971c08f471b94a33daec85671a
2023-06-27 21:40:11 +08:00
hiyouga
f5efc01531 fix decoding in seq2seq
Former-commit-id: 44227f651bf9a6a4741b3e0845cdb5f2ab58ea63
2023-06-27 19:33:08 +08:00
hiyouga
683f1a5a8c Update evaluate.py
Former-commit-id: 40201845b707c8b888b17744622ad78b4fb08a09
2023-06-26 23:41:33 +08:00
hiyouga
14b899bde2 Create evaluate.py
Former-commit-id: 45a6742f00d17e504b54468d8eefdeb2aa877a29
2023-06-26 23:30:18 +08:00
hoshi-hiyouga
4a6ea7ce6c Merge pull request #86 from Jingsong-Yan/main
Update README.md with baichuan-7b-rtx3090

Former-commit-id: c3592307df08f088cf5b71bbc072b58c6c3b491d
2023-06-26 20:14:40 +08:00
Jingsong-Yan
bf5a9d1e0a Update README.md with baichuan-7b-rtx3090
在 Changelog 中新增 baichuan-7b-rtx3090 分支的描述

Former-commit-id: acdada61a773857e27b8a930cb22eb075eff6fa4
2023-06-26 19:45:41 +08:00
hiyouga
3532d4f5e9 Merge branch 'main' of https://github.com/hiyouga/LLaMA-Efficient-Tuning
Former-commit-id: 9d0391ad8ba9e794808154c6c5700db96c664f89
2023-06-26 18:07:09 +08:00
hiyouga
f2dc451141 fix generation in seq2seq.py
Former-commit-id: f847d196beb6d04e456d64665a10dc9316a869f2
2023-06-26 18:07:06 +08:00
hoshi-hiyouga
e909b0c43c Merge pull request #84 from wu-yy/patch-1
Update requirements.txt

Former-commit-id: 190a89b3a8f1a31c9a334742694900f39e4cf36a
2023-06-26 15:39:08 +08:00
蓝鲸123
2f3fa65f04 Update requirements.txt
LlamaTokenizer requires the SentencePiece library but it was not found in your environment.

Former-commit-id: 948519a1829c8a2488e5204c1c7883ea9a824ebc
2023-06-26 15:36:19 +08:00
hiyouga
b6968a6940 support prefixes, loading multiple local files
Former-commit-id: 6672e09836ed0103693a381ece010377bd0ef4f8
2023-06-26 15:32:40 +08:00
hiyouga
d97da03cd5 update api
Former-commit-id: a90db46e336a657d5fcf480986bfc68c77ad416b
2023-06-26 13:39:57 +08:00
hiyouga
a9e6753f4e update readme
Former-commit-id: 6b08adc8219caacefa8d7b5a618e33ccd6060eec
2023-06-23 00:17:05 +08:00
hiyouga
3d08e8c7fb update API
Former-commit-id: b5c47b0bef022e90e42406e28b6282492419e3fb
2023-06-22 20:46:24 +08:00
hiyouga
bfe015e30f match api with OpenAI format
Former-commit-id: 9cbe2b98b024393817e86ff8e3ff1636776fa263
2023-06-22 20:27:00 +08:00
hoshi-hiyouga
18ccece745 Merge pull request #68 from mMrBun/main
Compatible with OpenAI API.

Former-commit-id: 510935da9f5b4fae2fc8a3a41697dd1563411308
2023-06-22 15:52:34 +08:00
Bun
13fabdcc96 Compatible with OpenAI API.
Former-commit-id: d21d51377bf7834a019efc009f4543b14c438389
2023-06-21 14:45:04 +08:00
hiyouga
b9e225bc20 add default template
Former-commit-id: c64fb6b83fdbedd62073417213f0215207ff1311
2023-06-16 21:12:17 +08:00
hiyouga
e52b201c13 add belle multiturn dataset
Former-commit-id: ac907ae1c37969df3cd09d4ab5f3f7f352eb259c
2023-06-16 20:01:16 +08:00
hiyouga
3db9b51f04 fix freeze layers
Former-commit-id: 8a16359c121d543aeea3650612df46fc1bad1428
2023-06-16 17:38:21 +08:00