hoshi-hiyouga
|
77d16ada1e
|
Update adapter.py
Former-commit-id: 98bc97d8d218182c026e9f57bbcbf40ab1e0bc87
|
2024-04-10 00:57:51 +08:00 |
|
hoshi-hiyouga
|
e5b4cb62e0
|
Update adapter.py
Former-commit-id: 2111b586b648caa150a8e41877c7fede75911da8
|
2024-04-10 00:57:30 +08:00 |
|
Erich Schubert
|
3dccd3c67e
|
Pass additional_target to unsloth
Fixes #3200
Former-commit-id: b5eefe5c4c084b63a12b023cae877fcd1914d4fc
|
2024-04-09 17:53:40 +02:00 |
|
hiyouga
|
8b8671817f
|
improve lora+ impl.
Former-commit-id: 72367307dfadf936fb989ebe8bc9f0ff229fb933
|
2024-03-13 23:32:51 +08:00 |
|
hiyouga
|
8673abbe5e
|
fix #2802
Former-commit-id: b9f87cdc11b3fe712574b91455dc722b69c60c66
|
2024-03-13 12:33:45 +08:00 |
|
hiyouga
|
5b50458acf
|
fix galore
Former-commit-id: 33a4c24a8a3c153bc62edf74b9246699a0ae3233
|
2024-03-08 00:44:51 +08:00 |
|
hiyouga
|
5abbca70d3
|
support DoRA, AWQ, AQLM #2512
Former-commit-id: cfefacaa37453a15c55866d019887f24e886a577
|
2024-02-28 19:53:28 +08:00 |
|
hiyouga
|
0fcb931f18
|
support lora for llama pro
Former-commit-id: 9aeb404a946795d6c4fa3cb45e3e96ffeec13646
|
2024-02-21 02:17:22 +08:00 |
|
hiyouga
|
62b78001b7
|
fix #2481
Former-commit-id: 22acab8aff8cadbba2a67e56af5701c0261ade49
|
2024-02-15 19:07:47 +08:00 |
|
hiyouga
|
96265ec154
|
support llama pro #2338 , add rslora
Former-commit-id: 7924ffc55d98e33bfbfbca303e46c8f476435673
|
2024-02-15 02:27:36 +08:00 |
|
hiyouga
|
0fc8612b97
|
add hint for freeze #2412
Former-commit-id: 6545c02790e39395a87d664682ab73e0e3191099
|
2024-02-03 23:38:56 +08:00 |
|
hiyouga
|
b27e91222c
|
format style
Former-commit-id: 638234ceee1b19716e45b6e5f4ea54d9122da4df
|
2024-01-20 20:15:56 +08:00 |
|
hiyouga
|
69e8925249
|
support longlora for main branch
Former-commit-id: 38af076a75c33da26d641780820694e4b7342d92
|
2024-01-20 19:25:22 +08:00 |
|
hiyouga
|
e199967391
|
add bf16 lora option
Former-commit-id: b6ec112bebcb379caa32617a135df4d5d3cf865b
|
2024-01-19 16:29:03 +08:00 |
|
hiyouga
|
4e3bfb799d
|
support function calling
Former-commit-id: d9f1cae35150cce594a7abd96dd2beb811fa33f2
|
2024-01-18 09:54:23 +08:00 |
|
hiyouga
|
dc8714a003
|
fix #2081
Former-commit-id: 33f2c0d4f89cf76671c0fdfbcee79d732b6a020e
|
2024-01-04 23:19:08 +08:00 |
|
hiyouga
|
f0d405f392
|
support unsloth
Former-commit-id: 7aad0b889d9a316fffd65f32a419078418fc0986
|
2023-12-23 00:14:33 +08:00 |
|
hiyouga
|
bd03307bbd
|
refactor adapter hparam
Former-commit-id: 0716f5e470afffd2df5a815712b552a4b4797153
|
2023-12-15 20:53:11 +08:00 |
|
hiyouga
|
15b321da8e
|
remove loftq
Former-commit-id: 3a8a50d4d42082b3bdce549653b398e49f2eb554
|
2023-12-13 01:53:46 +08:00 |
|
hiyouga
|
4c69025a83
|
support loftq
Former-commit-id: 6219dfbd9377528bce286c724ae2dd0090881095
|
2023-12-12 22:47:06 +08:00 |
|
hiyouga
|
cefc0b2f03
|
fix modelscope data hub
Former-commit-id: d5b2c57a356539df9993e4774b856231eca8a6da
|
2023-12-12 18:33:06 +08:00 |
|
hiyouga
|
5819eb7121
|
use peft 0.7.0, fix #1561 #1764
Former-commit-id: 9ce1b0e2f21a4601defe8e8f1f3f312626abe3d8
|
2023-12-11 17:13:40 +08:00 |
|
hiyouga
|
4cc08e00c7
|
fix gptq training
Former-commit-id: f57445c7a01b726160070c4ea29486702a650ed6
|
2023-12-02 00:27:15 +08:00 |
|
hiyouga
|
4966bd7911
|
support GPTQ tuning #729 #1481 #1545 , fix chatglm template #1453 #1480 #1569
Former-commit-id: 9ea93801459b0d271d21a2d730c44abae9106c51
|
2023-11-20 22:52:11 +08:00 |
|
hiyouga
|
0ed0b8f9c5
|
fix bug in freeze tuning
Former-commit-id: ff52b1779c909819d0aef83d3f7ea663199cbe54
|
2023-11-16 14:25:11 +08:00 |
|
hiyouga
|
f441932bd1
|
support full-parameter PPO
Former-commit-id: ce783036001397a20b0b4c5da2fea6d0c03389d2
|
2023-11-16 02:08:04 +08:00 |
|
hiyouga
|
e30290444a
|
support multiple modules in freeze training #1514
Former-commit-id: 4907452d955367ebe987e6deae4fd4213628f2b2
|
2023-11-15 17:08:18 +08:00 |
|
hiyouga
|
06a4820836
|
disentangle model from tuner and rename modules
Former-commit-id: 4736344eb1595ee023a50d49e8118f4eee46305f
|
2023-11-15 16:29:09 +08:00 |
|