70 Commits

Author SHA1 Message Date
hiyouga
a83756b5e9 refactor mm training
Former-commit-id: 3382317e32f88ed377d3e7759bdeaf0f2559d22a
2024-08-30 02:14:31 +08:00
hiyouga
21d3976eea fix #5295
Former-commit-id: ad72f3e06593f124d661d61774def336511716e0
2024-08-29 20:30:18 +08:00
hiyouga
20013e130b fix #5048
Former-commit-id: b7ca6c8dc14f689d0df16684a6121cc0ec24f8ba
2024-08-05 23:48:19 +08:00
MengqingCao
cd563116ca update dependencies
Former-commit-id: 7d4a29303350711558566d10d02230ed85ee1b69
2024-06-20 02:09:47 +00:00
hoshi-hiyouga
09c34e5b6c Update requirements.txt
Former-commit-id: e8c518c08a1235f83f66f83d6f8a6fcad8c598df
2024-06-18 22:27:24 +08:00
胡翀
8ab2d707e5 Update requirements.txt
add pandas version requirements

Former-commit-id: 12869c3ede9bf11bc0fbdfa7af559808551563be
2024-06-17 16:45:57 +08:00
hiyouga
d3196318be fix #4120
Former-commit-id: f9e818d79cf686cb34789327add7ed1f749966c6
2024-06-07 04:18:05 +08:00
hiyouga
a16786d8ba fix #4090
Former-commit-id: 67fe822324a9f830175e44f89acdd9d759b38852
2024-06-06 00:50:32 +08:00
hiyouga
ecd06d0110 fix #4079
Former-commit-id: 83a005e3d404f5a8ccb7b8ac17c50db75df4e8d4
2024-06-05 16:56:54 +08:00
hiyouga
af7748139a bump versions
transformers 4.37.2->4.41.2
datasets 2.14.3->2.16.0
accelerate 0.27.2->0.30.1
peft 0.10.0->0.11.1
trl 0.8.1->0.8.6


Former-commit-id: 876bc92865605be872bc811a56a1d1e05490ec8a
2024-06-03 18:29:38 +08:00
hiyouga
9dc209b458 resolve python 3.8 package
Former-commit-id: 75aec4cf8e9089808a1731e2848b29191f26d51d
2024-05-09 16:52:27 +08:00
hiyouga
1d3fb90590 add deepseek moe 236B
Former-commit-id: 10ab83f4c4dc96013e916462f056d1497c6ddf6c
2024-05-08 16:37:54 +08:00
hiyouga
289d1f3679 update webui and add CLIs
Former-commit-id: 245fe47ece22a4b7822449b126715aaa8ec25aba
2024-05-03 02:58:23 +08:00
hiyouga
80c8586534 reenable sdpa and fast tok by default
Former-commit-id: 07737a3d2d026c973ab964f948953d6ce0e1f2a9
2024-04-24 02:18:44 +08:00
hiyouga
8beb7a9239 update readme and gradio version
Former-commit-id: 5d62a51c12061c59b509db8fe367817f4e48f737
2024-04-16 18:09:16 +08:00
hiyouga
f334b89616 back to gradio 4.21 and fix chat
Former-commit-id: 4b920f24d35c73814b83d56373dd5c913bb57e49
2024-04-04 02:07:20 +08:00
hiyouga
54a4a8217a fix bug in latest gradio
Former-commit-id: 5ddcecda50ccff93d51bebc9ac72c2a0dd483e9b
2024-04-04 00:55:31 +08:00
hiyouga
a6d347726f fix requires for windows
Former-commit-id: 7f6e4126041f2eaa577426310622a115049fbde7
2024-04-03 21:56:43 +08:00
hiyouga
808ad2071f upgrade gradio to 4.21.0
Former-commit-id: 831c5321ac9b5ec91d9cc1dbcc87967dcdc486f5
2024-03-30 20:37:08 +08:00
hiyouga
b265002c19 add project
Former-commit-id: 1e43319f9cdf53741b4bf6c61749c409db119388
2024-03-28 20:24:27 +08:00
Remek Kinas
f4ee888dfa Update requirements.txt
Former-commit-id: b02899bf89eb77a7b0b60526fa7bfb7d3a79bdf7
2024-03-25 14:30:58 +01:00
hiyouga
7999836fb6 support fsdp + qlora
Former-commit-id: 84082251621e1470b3b5406a56d0a967780a1804
2024-03-21 00:36:06 +08:00
hiyouga
b983de9f4f fix #2803
Former-commit-id: 06c97083e150d461631a4a9bebb03b33da760098
2024-03-12 16:57:39 +08:00
hiyouga
2c010c72b8 support galore
Former-commit-id: 28f78621883917425fabe49f5473778111012127
2024-03-07 22:41:36 +08:00
hiyouga
5abbca70d3 support DoRA, AWQ, AQLM #2512
Former-commit-id: cfefacaa37453a15c55866d019887f24e886a577
2024-02-28 19:53:28 +08:00
Katehuuh
a7dc4a25c3 bump accelerate
Former-commit-id: 7dc352a4c255988b4b1c20a4c83f1e23ec764c5e
2024-02-27 08:56:45 +01:00
hiyouga
96265ec154 support llama pro #2338 , add rslora
Former-commit-id: 7924ffc55d98e33bfbfbca303e46c8f476435673
2024-02-15 02:27:36 +08:00
hiyouga
b1064d2f9b bump up transformers version
Former-commit-id: 38e63bfd28179fbf4b06adc0d127c358fd297e58
2024-02-04 00:01:16 +08:00
hiyouga
4e3bfb799d support function calling
Former-commit-id: d9f1cae35150cce594a7abd96dd2beb811fa33f2
2024-01-18 09:54:23 +08:00
hiyouga
de9148930f fix #2125
Former-commit-id: 3ae735ffe8acbe1df05324daa9e18ec37f33d594
2024-01-08 21:42:25 +08:00
Dristanta Das
25dfa4a1ee Update requirements.txt With einops dependency
Former-commit-id: e4cde81851fddfa8868a335cd2ecbd732e782819
2024-01-07 21:03:30 +05:30
hiyouga
f0d405f392 support unsloth
Former-commit-id: 7aad0b889d9a316fffd65f32a419078418fc0986
2023-12-23 00:14:33 +08:00
ShaneTian
69cb0038f0 Update transformers to 4.36.2 to resolve bug when saving a checkpoint in the multi-node setting.
Former-commit-id: 390f0caf7ff28b75b51eb0f3bba079288e8b66d6
2023-12-20 22:00:41 +08:00
hiyouga
4e75ca1222 support dpo-ftx
Former-commit-id: b87c74289d523ef88611b376074199ffd03cf103
2023-12-16 19:21:41 +08:00
hiyouga
bd03307bbd refactor adapter hparam
Former-commit-id: 0716f5e470afffd2df5a815712b552a4b4797153
2023-12-15 20:53:11 +08:00
hoshi-hiyouga
3f8d33695c revert peft version
Former-commit-id: 9b0630f84fe8eaae7a5a3123626807408645521f
2023-12-13 10:49:45 +08:00
hoshi-hiyouga
ad1860d35e update peft version
Former-commit-id: 573a12c86b6ccd9085d4cbeebcbdbfcc24e1990e
2023-12-13 10:23:51 +08:00
hiyouga
b7d99ad5f4 support mixtral
Former-commit-id: 96380f5e1887bb166be339e58ab8f65e464d4010
2023-12-12 11:39:04 +08:00
hiyouga
5819eb7121 use peft 0.7.0, fix #1561 #1764
Former-commit-id: 9ce1b0e2f21a4601defe8e8f1f3f312626abe3d8
2023-12-11 17:13:40 +08:00
hiyouga
89cf856776 fix #1771 and temporarily fix #1764
Former-commit-id: d42c0b1d3482af5912ebe578b3e6b4d08cd7ee99
2023-12-08 16:26:20 +08:00
hiyouga
125587b187 refactor evaluation, upgrade trl to 074
Former-commit-id: 442aefb925c4ff02b98aa30c49c2e01d04f6496a
2023-11-13 22:20:35 +08:00
hiyouga
b9f42172dd fix #1438 #1439
Former-commit-id: 33422e1feff706bb7cfb235b9e40bd2e124222be
2023-11-09 13:45:10 +08:00
hiyouga
d843efc413 fix #1418
Former-commit-id: 7ebd63a609d4bc4f8a645c5c60be77842ebac825
2023-11-07 16:17:22 +08:00
hiyouga
3d40bdb600 upgrade peft, fix #1088 #1411
Former-commit-id: b2a60905f384ada92618bf21301fe96dac1c10bf
2023-11-07 16:13:36 +08:00
hiyouga
936297aeac update requirements
Former-commit-id: 66a91e1fe39483b83c7636c8199c8a87cf6a599e
2023-11-06 19:01:21 +08:00
hiyouga
e3d64e119e update gradio, support multiple resp in api
Former-commit-id: 84af10cec912309b82fc16e20879eec1c2e3729a
2023-11-01 23:02:16 +08:00
hiyouga
4906092811 fix #1287
Former-commit-id: 838ed9aa8737e8f74ec7e8c660254cabbbbcf6ef
2023-10-26 17:49:41 +08:00
hiyouga
eafde5b73f fix config, #1191
Former-commit-id: a6a04be2e6700050c64e59c00a86698f1098e7cc
2023-10-15 18:28:45 +08:00
hiyouga
3ba788fc2c update readme
Former-commit-id: 8e2ed6b8ceb710c50cd73f8047ff4be305674567
2023-10-09 20:02:50 +08:00
hiyouga
8de990b1e9 update webui #1086
Former-commit-id: b8dbec086eef655870f2922697e76733de427f5a
2023-10-09 14:50:14 +08:00