18 Commits

Author SHA1 Message Date
hiyouga
0fc8612b97 add hint for freeze #2412
Former-commit-id: 6545c02790e39395a87d664682ab73e0e3191099
2024-02-03 23:38:56 +08:00
hiyouga
b27e91222c format style
Former-commit-id: 638234ceee1b19716e45b6e5f4ea54d9122da4df
2024-01-20 20:15:56 +08:00
hiyouga
69e8925249 support longlora for main branch
Former-commit-id: 38af076a75c33da26d641780820694e4b7342d92
2024-01-20 19:25:22 +08:00
hiyouga
e199967391 add bf16 lora option
Former-commit-id: b6ec112bebcb379caa32617a135df4d5d3cf865b
2024-01-19 16:29:03 +08:00
hiyouga
4e3bfb799d support function calling
Former-commit-id: d9f1cae35150cce594a7abd96dd2beb811fa33f2
2024-01-18 09:54:23 +08:00
hiyouga
dc8714a003 fix #2081
Former-commit-id: 33f2c0d4f89cf76671c0fdfbcee79d732b6a020e
2024-01-04 23:19:08 +08:00
hiyouga
f0d405f392 support unsloth
Former-commit-id: 7aad0b889d9a316fffd65f32a419078418fc0986
2023-12-23 00:14:33 +08:00
hiyouga
bd03307bbd refactor adapter hparam
Former-commit-id: 0716f5e470afffd2df5a815712b552a4b4797153
2023-12-15 20:53:11 +08:00
hiyouga
15b321da8e remove loftq
Former-commit-id: 3a8a50d4d42082b3bdce549653b398e49f2eb554
2023-12-13 01:53:46 +08:00
hiyouga
4c69025a83 support loftq
Former-commit-id: 6219dfbd9377528bce286c724ae2dd0090881095
2023-12-12 22:47:06 +08:00
hiyouga
cefc0b2f03 fix modelscope data hub
Former-commit-id: d5b2c57a356539df9993e4774b856231eca8a6da
2023-12-12 18:33:06 +08:00
hiyouga
5819eb7121 use peft 0.7.0, fix #1561 #1764
Former-commit-id: 9ce1b0e2f21a4601defe8e8f1f3f312626abe3d8
2023-12-11 17:13:40 +08:00
hiyouga
4cc08e00c7 fix gptq training
Former-commit-id: f57445c7a01b726160070c4ea29486702a650ed6
2023-12-02 00:27:15 +08:00
hiyouga
4966bd7911 support GPTQ tuning #729 #1481 #1545 , fix chatglm template #1453 #1480 #1569
Former-commit-id: 9ea93801459b0d271d21a2d730c44abae9106c51
2023-11-20 22:52:11 +08:00
hiyouga
0ed0b8f9c5 fix bug in freeze tuning
Former-commit-id: ff52b1779c909819d0aef83d3f7ea663199cbe54
2023-11-16 14:25:11 +08:00
hiyouga
f441932bd1 support full-parameter PPO
Former-commit-id: ce783036001397a20b0b4c5da2fea6d0c03389d2
2023-11-16 02:08:04 +08:00
hiyouga
e30290444a support multiple modules in freeze training #1514
Former-commit-id: 4907452d955367ebe987e6deae4fd4213628f2b2
2023-11-15 17:08:18 +08:00
hiyouga
06a4820836 disentangle model from tuner and rename modules
Former-commit-id: 4736344eb1595ee023a50d49e8118f4eee46305f
2023-11-15 16:29:09 +08:00