60 Commits

Author SHA1 Message Date
hiyouga
c32fc1d89b update api and support abort eval in webui
Former-commit-id: ed8f8be752ba2dcbaa6e8b1dc0a2e2821db1a5b8
2024-05-04 15:59:15 +08:00
hiyouga
289d1f3679 update webui and add CLIs
Former-commit-id: 245fe47ece22a4b7822449b126715aaa8ec25aba
2024-05-03 02:58:23 +08:00
hiyouga
eb14501a52 release v0.7.0
Former-commit-id: 168f56683ae4909ae50edd4859032fad60149d00
2024-04-26 23:18:00 +08:00
hiyouga
d2df4c22ab support mllm hf inference
Former-commit-id: e057c8de486bfbc829240924f9238d6212c917f1
2024-04-26 05:34:58 +08:00
hiyouga
7b4e1ca788 vllm + lora support
Former-commit-id: 28571da80a35a7cf302a2134a05592505128a0d6
2024-04-25 20:24:31 +08:00
hiyouga
34ecad4af8 fix #3347 #3387
Former-commit-id: 707f0b1d5d42b8e2c5b783c7783f65dfa9890a68
2024-04-24 01:30:16 +08:00
hiyouga
f9c859e97b fix #3317
Former-commit-id: 6d641af70361756131eaee456362909bd82a6c58
2024-04-17 22:17:19 +08:00
hiyouga
fb385b8c26 update examples
Former-commit-id: cce52351b54f70904f33902d9c17411134f9f6eb
2024-04-15 22:14:34 +08:00
hiyouga
a6d347726f fix requires for windows
Former-commit-id: 7f6e4126041f2eaa577426310622a115049fbde7
2024-04-03 21:56:43 +08:00
hiyouga
2ecf2bcbf0 fix resize vocab at inference #3022
Former-commit-id: 148bda353f0b53af022c51da9a9e59a56f341510
2024-04-03 18:14:24 +08:00
hiyouga
7124b71676 fix #2782 #2798
Former-commit-id: 07f9b754a7418b489e839bd674aa47094583a92d
2024-03-12 15:53:29 +08:00
hiyouga
1173441661 fix #2766
Former-commit-id: 412c52e325660e8b871ffd59f5564f84f46a143f
2024-03-09 21:35:24 +08:00
hiyouga
7443ac3116 fix chat engine, update webui
Former-commit-id: 5d956e2a5167201aecdfce2794c25d8a2d84e234
2024-03-08 03:01:53 +08:00
hiyouga
34533b2f35 support vllm
Former-commit-id: d07ad5cc1cdbc13879afd84f653afdfee03a6933
2024-03-07 20:26:31 +08:00
hiyouga
36f092b53f improve fix tokenizer
Former-commit-id: 54ea9684ed05ac7fa5bbaa04d39636eda37cd34e
2024-02-09 14:53:14 +08:00
hiyouga
caeffc780d fix #2438
Former-commit-id: ebf31b62eb1b75399cff7c7542c45ac72f6f41dd
2024-02-06 15:23:08 +08:00
hiyouga
1fbf83acc2 finish agent
Former-commit-id: 3e982cc7146b408b359bb38ed4aa840183b23d72
2024-01-21 01:47:33 +08:00
hiyouga
cb8abce2f3 fix internlm2 template
Former-commit-id: a9c18255aa039550ca65145b930576edeb905d53
2024-01-20 23:33:50 +08:00
hiyouga
0be7b16955 fix cli_demo
Former-commit-id: c550987a72b0b88ea0116eb47a507142c8544df4
2024-01-20 23:27:10 +08:00
hiyouga
baaa0acdf1 fix #2260
Former-commit-id: cf818a25982c8a2808cf21f22e1e5eb4dd7e0713
2024-01-20 23:22:09 +08:00
hiyouga
b27e91222c format style
Former-commit-id: 638234ceee1b19716e45b6e5f4ea54d9122da4df
2024-01-20 20:15:56 +08:00
hiyouga
1323b8f102 add tool test
Former-commit-id: 83dbfce8c30bc1183a5c86fb77a5676bf0b753af
2024-01-18 10:26:26 +08:00
hiyouga
4e3bfb799d support function calling
Former-commit-id: d9f1cae35150cce594a7abd96dd2beb811fa33f2
2024-01-18 09:54:23 +08:00
hiyouga
5b61063048 fix api server
Former-commit-id: 08464183b9b034abdbf179d7043705a0754837e5
2024-01-07 17:14:42 +08:00
hiyouga
1a0bdd305c support system column #1765
Former-commit-id: 0a9c6e0146ebc71d5438c837463d6ab236e227c4
2023-12-12 19:45:59 +08:00
hiyouga
64eead3fb1 ppo support rm server
Former-commit-id: 747db4017291b0eb91946f57011bb31659056037
2023-12-03 21:38:51 +08:00
hiyouga
1cb390b9b2 implement rm server #1543
Former-commit-id: 7df4f3ab206fddb462f6ed865eaf04234fd72ed6
2023-12-03 20:52:54 +08:00
hiyouga
4a0be64ae6 fix imports
Former-commit-id: bbbce1f516840f722247edd37057d16502ea0557
2023-11-15 16:47:45 +08:00
hiyouga
06a4820836 disentangle model from tuner and rename modules
Former-commit-id: 4736344eb1595ee023a50d49e8118f4eee46305f
2023-11-15 16:29:09 +08:00
hiyouga
d57f70bf8a fix chat
Former-commit-id: 8b912690e34b040b98c4eac5eef5c56876345b1d
2023-11-01 23:07:58 +08:00
hiyouga
e3d64e119e update gradio, support multiple resp in api
Former-commit-id: 84af10cec912309b82fc16e20879eec1c2e3729a
2023-11-01 23:02:16 +08:00
hiyouga
632fff02e0 fix #887
Former-commit-id: 8857e4560219c4052bdb7c7dc1a014a5f5fd0163
2023-09-14 17:56:58 +08:00
hiyouga
f865d0bd51 fix lora target
Former-commit-id: a51b7c98acc599de5ed2eaeeebe7b184105722c5
2023-09-09 17:04:45 +08:00
hiyouga
405df0f63d fix #761
Former-commit-id: b34797a845dec8f6daea59e3c353b8a8f8830100
2023-09-08 20:22:18 +08:00
hiyouga
f74b980650 fix baichuan templates
Former-commit-id: 85b1f6632a752029dabdaed87c58986deb3a6b1d
2023-09-07 18:54:14 +08:00
hiyouga
caf4a61e21 fix ChatGLM2 ppo #527 #528
Former-commit-id: 9f4c2adc9a9ca8e458d3868805e077182e0d336a
2023-08-18 00:34:59 +08:00
hiyouga
623a34b16f fix generation bug #532
Former-commit-id: be21fc83f9aed0af1e5a2f83f5d5eeb36f1d283c
2023-08-17 22:21:34 +08:00
hiyouga
048f99354f fix generation
Former-commit-id: d9e62711a3349d7c6fd3512fb25c709bdfbb311a
2023-08-16 22:39:54 +08:00
hiyouga
edc15c62fa fix system prompt
Former-commit-id: 7407d9daa16bf6b3cd5002e16b2c53e402d2bc39
2023-08-16 01:35:52 +08:00
hiyouga
3f0a2d6adc support rope scaling, fix #475 #476 #478
Former-commit-id: fa940c17b8d3e379af08804003f1a522c1cd6ac4
2023-08-12 20:46:27 +08:00
hiyouga
abdfa26d06 support DPO training (2305.18290)
Former-commit-id: 3ec4351cfdaf2aefcc7d13345e19d79874ed61d3
2023-08-11 03:02:53 +08:00
hiyouga
4f714ba314 update webui
Former-commit-id: 3a720aac669708d17152d4e96c2018b5ccc27b75
2023-08-09 00:26:11 +08:00
hiyouga
77aa9853fb fix tokenizer #417
Former-commit-id: eecc4b2131e88b38fcd2659b52799a2f6459822f
2023-08-08 23:59:41 +08:00
hiyouga
70b53d9503 fix bug
Former-commit-id: 4b841a6b35585120c65e2718d6002c69cc40b925
2023-08-08 17:55:55 +08:00
hiyouga
733b395822 update readme
Former-commit-id: 20cf27976f24db2667955a8007e0ce2baa35fc82
2023-08-07 15:02:02 +08:00
hiyouga
ea045b0e5b support chatml safe encoding
Former-commit-id: b4852f94065a11c8cd00ffa7e71ac0e0b2bf477a
2023-08-04 23:14:28 +08:00
hiyouga
2d96ec9c3e tiny fix
Former-commit-id: ff98f1cba8d3be5b6a516b26a6019f867365110e
2023-08-03 17:42:28 +08:00
hiyouga
788d1250c1 fix qwen inference
Former-commit-id: 2780792754b484bf4d42af5ebbc51c7ed2181ce9
2023-08-03 16:31:55 +08:00
hiyouga
65ef0ff491 fix qwen inference
Former-commit-id: ea30da4794c094ce5442b7b2936de0686a1739eb
2023-08-03 16:15:38 +08:00
hiyouga
9c84c4ed5d support Qwen-7B, fix InternLM-7B inference
Former-commit-id: 87f8f830e20aa839e089559c1d038954742000ef
2023-08-03 15:53:32 +08:00