67 Commits

Author SHA1 Message Date
hiyouga
8b8671817f improve lora+ impl.
Former-commit-id: 72367307dfadf936fb989ebe8bc9f0ff229fb933
2024-03-13 23:32:51 +08:00
hiyouga
276def1897 fix #2732
Former-commit-id: 18ffce36b5ee0809f2e2905c2fd44843a3725ea0
2024-03-09 22:37:16 +08:00
hiyouga
868444e124 allow non-packing pretraining
Former-commit-id: bdb496644ce2c18806fc4fdae1fedcb3e5b5f808
2024-03-09 22:21:46 +08:00
hiyouga
c561b268ef fix #2756 , patch #2746
Former-commit-id: e8dd38b7fdf8e172745d2538eb103895f2839c38
2024-03-09 02:01:26 +08:00
hoshi-hiyouga
36d65289d0 Merge pull request #2746 from stephen-nju/main
fix deepspeed ppo RuntimeError

Former-commit-id: 516d0ddc666c179616a2a610b1353728db57391e
2024-03-09 01:37:00 +08:00
hiyouga
398c261c7c fix aqlm version
Former-commit-id: 10be2f0eccc3963a985afcd24e5b8b8fc638b1c3
2024-03-09 00:09:09 +08:00
stephen
495b858606 fix ppo runtime error
Former-commit-id: cdb7f82869b07d9d5d31b7b2aaf6b033bd00e32e
2024-03-08 11:48:26 +08:00
hiyouga
37e40563f1 fix #2735
Former-commit-id: f74f804a715dfb16bf24a056bc95db6b102f9ed7
2024-03-07 16:15:53 +08:00
hiyouga
e887aface7 fix version checking
Former-commit-id: 3016e6565708637c1d760f2cd5a67cbd8a5a6c26
2024-03-06 14:51:51 +08:00
hiyouga
9561809ce9 improve aqlm optim
Former-commit-id: 259af60d28985b919911587716c24a3ac7f7de64
2024-03-05 20:49:50 +08:00
hiyouga
c776cdfc3e optimize aqlm training
Former-commit-id: d3d3dac7070eb9055bcdc91eaf53f5b3741c0bda
2024-03-05 18:35:41 +08:00
hiyouga
d1e6e02461 fix #2649
Former-commit-id: 4e5fae2fac85227641bd16159cf296a32e0b18b4
2024-03-01 13:02:41 +08:00
hiyouga
3787d13816 fix #2642
Former-commit-id: c0be617195f43d972681dd59727857b1247eeb7e
2024-02-29 18:32:54 +08:00
hiyouga
8e7d50dae4 release v0.5.3
Former-commit-id: fa5ab21ebc0ab738178c0c57578db3bda995ae06
2024-02-29 00:34:19 +08:00
hiyouga
5abbca70d3 support DoRA, AWQ, AQLM #2512
Former-commit-id: cfefacaa37453a15c55866d019887f24e886a577
2024-02-28 19:53:28 +08:00
hiyouga
96265ec154 support llama pro #2338 , add rslora
Former-commit-id: 7924ffc55d98e33bfbfbca303e46c8f476435673
2024-02-15 02:27:36 +08:00
younesbelkada
6b98435a53 add v1 hf tags
Former-commit-id: 0ca0f08162b18d326787939f12bb5ba07904fb4a
2024-02-13 05:58:49 +00:00
hiyouga
75adbfec79 add option to disable version check
Former-commit-id: 91d09a01ac3b5da29d284b8d51cdfe4252b391e0
2024-02-10 22:31:23 +08:00
hiyouga
b1064d2f9b bump up transformers version
Former-commit-id: 38e63bfd28179fbf4b06adc0d127c358fd297e58
2024-02-04 00:01:16 +08:00
hiyouga
b27e91222c format style
Former-commit-id: 638234ceee1b19716e45b6e5f4ea54d9122da4df
2024-01-20 20:15:56 +08:00
hiyouga
4e3bfb799d support function calling
Former-commit-id: d9f1cae35150cce594a7abd96dd2beb811fa33f2
2024-01-18 09:54:23 +08:00
hiyouga
1a86cc3078 fix rm server
Former-commit-id: 55021097d565536a68113ee33af31beaff38334e
2024-01-03 15:30:46 +08:00
hiyouga
afa3c86391 fix version
Former-commit-id: 47da742fc971520a697ed5ce611f8d6de61ab22b
2023-12-29 04:53:36 +08:00
hiyouga
2a3980d6ba update loader
Former-commit-id: 6629087e12f64f2635f24311234202077814083c
2023-12-24 19:10:23 +08:00
hiyouga
5d440f978e update patcher
Former-commit-id: e44b82ee245a7ee99057c7b58b1edef5c222dc1f
2023-12-23 15:24:27 +08:00
hiyouga
a7fc20cb2d fix unsloth dtype
Former-commit-id: 779cfefb7841d00fc712a5f5addf0fe3eb14c6fd
2023-12-23 01:59:49 +08:00
hiyouga
f0d405f392 support unsloth
Former-commit-id: 7aad0b889d9a316fffd65f32a419078418fc0986
2023-12-23 00:14:33 +08:00
ShaneTian
3eaabe12aa Fix slow model initialization in bfloat16 dtype.
Former-commit-id: d032daa4bd598dd0d71b43eb68a614de77a699a6
2023-12-22 16:27:28 +08:00
hiyouga
de6be321b9 match version
Former-commit-id: af0194e6d9ba1c67a8592c840c01cee7991b0b0e
2023-12-20 22:17:35 +08:00
hiyouga
e06b9c4fa1 fix #1900
Former-commit-id: 0c6ab7c75e671348f24d28309d450aecec0a157f
2023-12-19 17:21:46 +08:00
hiyouga
8154b4bdf6 fix #1742
Former-commit-id: 870426ff70c060213ac283b10a9b1f4bf71679ef
2023-12-16 20:50:45 +08:00
hiyouga
4e75ca1222 support dpo-ftx
Former-commit-id: b87c74289d523ef88611b376074199ffd03cf103
2023-12-16 19:21:41 +08:00
hiyouga
7dbc670902 support quantization in export model
Former-commit-id: 3524aa1e58da94ab00e9a2024952ea1b4119b2af
2023-12-15 23:44:50 +08:00
hiyouga
329576a5b4 fix bug
Former-commit-id: 00c77104f8f9675e1421f99d78de710b21cab047
2023-12-15 21:54:02 +08:00
hiyouga
f32c8614c2 fix bug
Former-commit-id: 9e509b99af95666ea27f5540bedd64a330357ad7
2023-12-15 21:49:26 +08:00
hiyouga
d24d2f0458 add configurer
Former-commit-id: 2740aa9cbbcfc6dcfef82915b7db4e0f8b2c1bae
2023-12-15 21:46:40 +08:00
hiyouga
bd03307bbd refactor adapter hparam
Former-commit-id: 0716f5e470afffd2df5a815712b552a4b4797153
2023-12-15 20:53:11 +08:00
hiyouga
6a186d4386 add loftq
Former-commit-id: d4c351f1ec82b0864cc32c5602b03daddf9aeaba
2023-12-14 21:53:56 +08:00
hiyouga
e55e32efc4 fix valuehead model
Former-commit-id: bfdee1608f53a6334d8e73c48dbeb4160969d783
2023-12-14 20:15:20 +08:00
hoshi-hiyouga
3f8d33695c revert peft version
Former-commit-id: 9b0630f84fe8eaae7a5a3123626807408645521f
2023-12-13 10:49:45 +08:00
hoshi-hiyouga
ad1860d35e update peft version
Former-commit-id: 573a12c86b6ccd9085d4cbeebcbdbfcc24e1990e
2023-12-13 10:23:51 +08:00
hiyouga
15b321da8e remove loftq
Former-commit-id: 3a8a50d4d42082b3bdce549653b398e49f2eb554
2023-12-13 01:53:46 +08:00
hiyouga
4c69025a83 support loftq
Former-commit-id: 6219dfbd9377528bce286c724ae2dd0090881095
2023-12-12 22:47:06 +08:00
hiyouga
1a0bdd305c support system column #1765
Former-commit-id: 0a9c6e0146ebc71d5438c837463d6ab236e227c4
2023-12-12 19:45:59 +08:00
hiyouga
cefc0b2f03 fix modelscope data hub
Former-commit-id: d5b2c57a356539df9993e4774b856231eca8a6da
2023-12-12 18:33:06 +08:00
hiyouga
b7d99ad5f4 support mixtral
Former-commit-id: 96380f5e1887bb166be339e58ab8f65e464d4010
2023-12-12 11:39:04 +08:00
hiyouga
9ead5a2d21 support resize embeddings #1786
Former-commit-id: 64744dde89ccb9a24a46985a99151ad2dde03919
2023-12-11 17:50:02 +08:00
hiyouga
5819eb7121 use peft 0.7.0, fix #1561 #1764
Former-commit-id: 9ce1b0e2f21a4601defe8e8f1f3f312626abe3d8
2023-12-11 17:13:40 +08:00
hiyouga
89cf856776 fix #1771 and temporarily fix #1764
Former-commit-id: d42c0b1d3482af5912ebe578b3e6b4d08cd7ee99
2023-12-08 16:26:20 +08:00
hiyouga
cd2b0a024b fix #1715
Former-commit-id: c9b166615c882ea6df29a1b379654fdbc680d904
2023-12-03 22:35:47 +08:00