103 Commits

Author SHA1 Message Date
hiyouga
a6d347726f fix requires for windows
Former-commit-id: 7f6e4126041f2eaa577426310622a115049fbde7
2024-04-03 21:56:43 +08:00
hiyouga
808ad2071f upgrade gradio to 4.21.0
Former-commit-id: 831c5321ac9b5ec91d9cc1dbcc87967dcdc486f5
2024-03-30 20:37:08 +08:00
hiyouga
b265002c19 add project
Former-commit-id: 1e43319f9cdf53741b4bf6c61749c409db119388
2024-03-28 20:24:27 +08:00
Remek Kinas
f4ee888dfa Update requirements.txt
Former-commit-id: b02899bf89eb77a7b0b60526fa7bfb7d3a79bdf7
2024-03-25 14:30:58 +01:00
hiyouga
7999836fb6 support fsdp + qlora
Former-commit-id: 84082251621e1470b3b5406a56d0a967780a1804
2024-03-21 00:36:06 +08:00
hiyouga
b983de9f4f fix #2803
Former-commit-id: 06c97083e150d461631a4a9bebb03b33da760098
2024-03-12 16:57:39 +08:00
hiyouga
2c010c72b8 support galore
Former-commit-id: 28f78621883917425fabe49f5473778111012127
2024-03-07 22:41:36 +08:00
hiyouga
5abbca70d3 support DoRA, AWQ, AQLM #2512
Former-commit-id: cfefacaa37453a15c55866d019887f24e886a577
2024-02-28 19:53:28 +08:00
Katehuuh
a7dc4a25c3 bump accelerate
Former-commit-id: 7dc352a4c255988b4b1c20a4c83f1e23ec764c5e
2024-02-27 08:56:45 +01:00
hiyouga
96265ec154 support llama pro #2338 , add rslora
Former-commit-id: 7924ffc55d98e33bfbfbca303e46c8f476435673
2024-02-15 02:27:36 +08:00
hiyouga
b1064d2f9b bump up transformers version
Former-commit-id: 38e63bfd28179fbf4b06adc0d127c358fd297e58
2024-02-04 00:01:16 +08:00
hiyouga
4e3bfb799d support function calling
Former-commit-id: d9f1cae35150cce594a7abd96dd2beb811fa33f2
2024-01-18 09:54:23 +08:00
hiyouga
de9148930f fix #2125
Former-commit-id: 3ae735ffe8acbe1df05324daa9e18ec37f33d594
2024-01-08 21:42:25 +08:00
Dristanta Das
25dfa4a1ee Update requirements.txt With einops dependency
Former-commit-id: e4cde81851fddfa8868a335cd2ecbd732e782819
2024-01-07 21:03:30 +05:30
hiyouga
f0d405f392 support unsloth
Former-commit-id: 7aad0b889d9a316fffd65f32a419078418fc0986
2023-12-23 00:14:33 +08:00
ShaneTian
69cb0038f0 Update transformers to 4.36.2 to resolve bug when saving a checkpoint in the multi-node setting.
Former-commit-id: 390f0caf7ff28b75b51eb0f3bba079288e8b66d6
2023-12-20 22:00:41 +08:00
hiyouga
4e75ca1222 support dpo-ftx
Former-commit-id: b87c74289d523ef88611b376074199ffd03cf103
2023-12-16 19:21:41 +08:00
hiyouga
bd03307bbd refactor adapter hparam
Former-commit-id: 0716f5e470afffd2df5a815712b552a4b4797153
2023-12-15 20:53:11 +08:00
hoshi-hiyouga
3f8d33695c revert peft version
Former-commit-id: 9b0630f84fe8eaae7a5a3123626807408645521f
2023-12-13 10:49:45 +08:00
hoshi-hiyouga
ad1860d35e update peft version
Former-commit-id: 573a12c86b6ccd9085d4cbeebcbdbfcc24e1990e
2023-12-13 10:23:51 +08:00
hiyouga
b7d99ad5f4 support mixtral
Former-commit-id: 96380f5e1887bb166be339e58ab8f65e464d4010
2023-12-12 11:39:04 +08:00
hiyouga
5819eb7121 use peft 0.7.0, fix #1561 #1764
Former-commit-id: 9ce1b0e2f21a4601defe8e8f1f3f312626abe3d8
2023-12-11 17:13:40 +08:00
hiyouga
89cf856776 fix #1771 and temporarily fix #1764
Former-commit-id: d42c0b1d3482af5912ebe578b3e6b4d08cd7ee99
2023-12-08 16:26:20 +08:00
hiyouga
125587b187 refactor evaluation, upgrade trl to 074
Former-commit-id: 442aefb925c4ff02b98aa30c49c2e01d04f6496a
2023-11-13 22:20:35 +08:00
hiyouga
b9f42172dd fix #1438 #1439
Former-commit-id: 33422e1feff706bb7cfb235b9e40bd2e124222be
2023-11-09 13:45:10 +08:00
hiyouga
d843efc413 fix #1418
Former-commit-id: 7ebd63a609d4bc4f8a645c5c60be77842ebac825
2023-11-07 16:17:22 +08:00
hiyouga
3d40bdb600 upgrade peft, fix #1088 #1411
Former-commit-id: b2a60905f384ada92618bf21301fe96dac1c10bf
2023-11-07 16:13:36 +08:00
hiyouga
936297aeac update requirements
Former-commit-id: 66a91e1fe39483b83c7636c8199c8a87cf6a599e
2023-11-06 19:01:21 +08:00
hiyouga
e3d64e119e update gradio, support multiple resp in api
Former-commit-id: 84af10cec912309b82fc16e20879eec1c2e3729a
2023-11-01 23:02:16 +08:00
hiyouga
4906092811 fix #1287
Former-commit-id: 838ed9aa8737e8f74ec7e8c660254cabbbbcf6ef
2023-10-26 17:49:41 +08:00
hiyouga
eafde5b73f fix config, #1191
Former-commit-id: a6a04be2e6700050c64e59c00a86698f1098e7cc
2023-10-15 18:28:45 +08:00
hiyouga
3ba788fc2c update readme
Former-commit-id: 8e2ed6b8ceb710c50cd73f8047ff4be305674567
2023-10-09 20:02:50 +08:00
hiyouga
8de990b1e9 update webui #1086
Former-commit-id: b8dbec086eef655870f2922697e76733de427f5a
2023-10-09 14:50:14 +08:00
hiyouga
4e86462bad fix #762 #814
Former-commit-id: d4be857e23c74ed65e06903e19da6f18f15d9e30
2023-09-12 16:10:10 +08:00
hiyouga
4410387859 Release v0.1.8
Former-commit-id: ccb3553576164113c31be714a0295ea82321d67d
2023-09-11 17:31:34 +08:00
hiyouga
6a71361a54 remove PeftTrainer
Former-commit-id: b218c271edfb07006ddc34b1aca404088de6c528
2023-09-10 22:23:23 +08:00
hiyouga
f225a71445 update requirements
Former-commit-id: f5351c18e15cd26fe628ed364eaa4ecd49874596
2023-09-07 19:26:25 +08:00
hiyouga
a4fd976048 refactor dataset_attr, add eos in pt, fix #757
Former-commit-id: a9d1fb72f791ae57a4d12f4e3a7e2abccf6a7077
2023-09-01 19:00:45 +08:00
hiyouga
abdfa26d06 support DPO training (2305.18290)
Former-commit-id: 3ec4351cfdaf2aefcc7d13345e19d79874ed61d3
2023-08-11 03:02:53 +08:00
jiongxuc
7ffd961b8b huggingface login for projects must login while running
Former-commit-id: 3e000c2b60c2e29bcafcf8d39c1a5d567ae2491c
2023-08-10 14:57:12 +08:00
hiyouga
4f714ba314 update webui
Former-commit-id: 3a720aac669708d17152d4e96c2018b5ccc27b75
2023-08-09 00:26:11 +08:00
hiyouga
9c84c4ed5d support Qwen-7B, fix InternLM-7B inference
Former-commit-id: 87f8f830e20aa839e089559c1d038954742000ef
2023-08-03 15:53:32 +08:00
hiyouga
ee7aa86312 release v0.1.3
Former-commit-id: 0b6150bc31b5a1be3a269af971c3827ae8cc5aac
2023-07-21 16:48:34 +08:00
hiyouga
18656a6316 fix API
Former-commit-id: 29af67b015ff92e5dd9bf2985ce7723dc036d989
2023-07-19 00:01:14 +08:00
hiyouga
091805d38e release v0.1.0
Former-commit-id: f8193e8009451cf569a28a10eb4bd88831844441
2023-07-18 00:18:25 +08:00
hiyouga
799524b37b fix #175
Former-commit-id: 85c2210452cc45470c228f17b2b0df09b47e9575
2023-07-17 18:07:17 +08:00
hiyouga
a696148d6b modity code structure
Former-commit-id: f75137661358f9070bc70c341dfa2cc5fd69cf94
2023-07-15 16:54:28 +08:00
hiyouga
28c1381671 update readme
Former-commit-id: 89c623e4bfef760174f013c5de27810cc90e0f6e
2023-07-05 23:03:58 +08:00
hiyouga
22fa516bd5 fix streaming response in API
Former-commit-id: 4abd2485e10e7198b63a396ce5432ac89c9f2d98
2023-07-05 22:42:31 +08:00
蓝鲸123
784065e16a Update requirements.txt
LlamaTokenizer requires the SentencePiece library but it was not found in your environment.

Former-commit-id: e2a16d549e5dd8b46763bb09b728f4ed8ce9b73e
2023-06-26 15:36:19 +08:00