hiyouga
|
8465e54d38
|
refactor patcher
Former-commit-id: aa2b79eb23c60825e6601b0b8cc6b59e3f566b2d
|
2024-04-24 03:02:23 +08:00 |
|
hiyouga
|
34ecad4af8
|
fix #3347 #3387
Former-commit-id: 707f0b1d5d42b8e2c5b783c7783f65dfa9890a68
|
2024-04-24 01:30:16 +08:00 |
|
hiyouga
|
ec81d45d27
|
fix mod stuff
Former-commit-id: f58425ab45727f7859583d4b9fda776715e27ff6
|
2024-04-21 18:11:10 +08:00 |
|
hoshi-hiyouga
|
7c63a9b5fd
|
Merge pull request #3338 from astramind-ai/main
Adding Mixture of Depth
Former-commit-id: d0273787be481fb2cbed993580f8239e63d74f7f
|
2024-04-21 18:05:52 +08:00 |
|
hoshi-hiyouga
|
e9b1aff447
|
fix #3348
Former-commit-id: 1fa287fd637aad0c5e8893046515a54bbff4c009
|
2024-04-20 10:34:09 +08:00 |
|
Marco
|
639297a5ef
|
Added Mixture of Depths
Former-commit-id: 620add7b9f634de1a711f7b87b16050adf735e9b
|
2024-04-18 20:31:24 +02:00 |
|
hiyouga
|
b40f266617
|
support unsloth 2024.4
Former-commit-id: 7dc72fb58cb988418323f63821a21a184ecf0718
|
2024-04-16 00:25:03 +08:00 |
|
hiyouga
|
bd2b758b48
|
add codegemma
Former-commit-id: 6543f3d4496218f7f90c582cb6aa8c852d716cbf
|
2024-04-16 00:11:15 +08:00 |
|
hiyouga
|
2dc3343b1c
|
support cohere commandR #3184
Former-commit-id: e0dbac28450a0e1e0b84e1577ef785fc762c0b46
|
2024-04-15 23:26:42 +08:00 |
|
hiyouga
|
fb385b8c26
|
update examples
Former-commit-id: cce52351b54f70904f33902d9c17411134f9f6eb
|
2024-04-15 22:14:34 +08:00 |
|
hiyouga
|
0e08c209c4
|
fix quant infer and qwen2moe
Former-commit-id: 7f6c2486b83e1d2c96a2314bfa8e1519ca5f574e
|
2024-04-09 17:12:59 +08:00 |
|
hiyouga
|
2ecf2bcbf0
|
fix resize vocab at inference #3022
Former-commit-id: 148bda353f0b53af022c51da9a9e59a56f341510
|
2024-04-03 18:14:24 +08:00 |
|
hiyouga
|
f4be51f356
|
add moe aux loss control #3085
Former-commit-id: b267aeb53fc49d2eeb0f3fc5ebe55e643f5db377
|
2024-04-02 14:26:31 +08:00 |
|
hiyouga
|
75829c8699
|
fix #2928
Former-commit-id: 7afbc85daee295cf38dcee9ded5afd87b2c4cfd1
|
2024-03-24 00:34:54 +08:00 |
|
hiyouga
|
8b8671817f
|
improve lora+ impl.
Former-commit-id: 72367307dfadf936fb989ebe8bc9f0ff229fb933
|
2024-03-13 23:32:51 +08:00 |
|
hiyouga
|
276def1897
|
fix #2732
Former-commit-id: 18ffce36b5ee0809f2e2905c2fd44843a3725ea0
|
2024-03-09 22:37:16 +08:00 |
|
hiyouga
|
868444e124
|
allow non-packing pretraining
Former-commit-id: bdb496644ce2c18806fc4fdae1fedcb3e5b5f808
|
2024-03-09 22:21:46 +08:00 |
|
hiyouga
|
c561b268ef
|
fix #2756 , patch #2746
Former-commit-id: e8dd38b7fdf8e172745d2538eb103895f2839c38
|
2024-03-09 02:01:26 +08:00 |
|
hoshi-hiyouga
|
36d65289d0
|
Merge pull request #2746 from stephen-nju/main
fix deepspeed ppo RuntimeError
Former-commit-id: 516d0ddc666c179616a2a610b1353728db57391e
|
2024-03-09 01:37:00 +08:00 |
|
hiyouga
|
398c261c7c
|
fix aqlm version
Former-commit-id: 10be2f0eccc3963a985afcd24e5b8b8fc638b1c3
|
2024-03-09 00:09:09 +08:00 |
|
stephen
|
495b858606
|
fix ppo runtime error
Former-commit-id: cdb7f82869b07d9d5d31b7b2aaf6b033bd00e32e
|
2024-03-08 11:48:26 +08:00 |
|
hiyouga
|
37e40563f1
|
fix #2735
Former-commit-id: f74f804a715dfb16bf24a056bc95db6b102f9ed7
|
2024-03-07 16:15:53 +08:00 |
|
hiyouga
|
e887aface7
|
fix version checking
Former-commit-id: 3016e6565708637c1d760f2cd5a67cbd8a5a6c26
|
2024-03-06 14:51:51 +08:00 |
|
hiyouga
|
9561809ce9
|
improve aqlm optim
Former-commit-id: 259af60d28985b919911587716c24a3ac7f7de64
|
2024-03-05 20:49:50 +08:00 |
|
hiyouga
|
c776cdfc3e
|
optimize aqlm training
Former-commit-id: d3d3dac7070eb9055bcdc91eaf53f5b3741c0bda
|
2024-03-05 18:35:41 +08:00 |
|
hiyouga
|
d1e6e02461
|
fix #2649
Former-commit-id: 4e5fae2fac85227641bd16159cf296a32e0b18b4
|
2024-03-01 13:02:41 +08:00 |
|
hiyouga
|
3787d13816
|
fix #2642
Former-commit-id: c0be617195f43d972681dd59727857b1247eeb7e
|
2024-02-29 18:32:54 +08:00 |
|
hiyouga
|
8e7d50dae4
|
release v0.5.3
Former-commit-id: fa5ab21ebc0ab738178c0c57578db3bda995ae06
|
2024-02-29 00:34:19 +08:00 |
|
hiyouga
|
5abbca70d3
|
support DoRA, AWQ, AQLM #2512
Former-commit-id: cfefacaa37453a15c55866d019887f24e886a577
|
2024-02-28 19:53:28 +08:00 |
|
hiyouga
|
96265ec154
|
support llama pro #2338 , add rslora
Former-commit-id: 7924ffc55d98e33bfbfbca303e46c8f476435673
|
2024-02-15 02:27:36 +08:00 |
|
younesbelkada
|
6b98435a53
|
add v1 hf tags
Former-commit-id: 0ca0f08162b18d326787939f12bb5ba07904fb4a
|
2024-02-13 05:58:49 +00:00 |
|
hiyouga
|
75adbfec79
|
add option to disable version check
Former-commit-id: 91d09a01ac3b5da29d284b8d51cdfe4252b391e0
|
2024-02-10 22:31:23 +08:00 |
|
hiyouga
|
b1064d2f9b
|
bump up transformers version
Former-commit-id: 38e63bfd28179fbf4b06adc0d127c358fd297e58
|
2024-02-04 00:01:16 +08:00 |
|
hiyouga
|
b27e91222c
|
format style
Former-commit-id: 638234ceee1b19716e45b6e5f4ea54d9122da4df
|
2024-01-20 20:15:56 +08:00 |
|
hiyouga
|
4e3bfb799d
|
support function calling
Former-commit-id: d9f1cae35150cce594a7abd96dd2beb811fa33f2
|
2024-01-18 09:54:23 +08:00 |
|
hiyouga
|
1a86cc3078
|
fix rm server
Former-commit-id: 55021097d565536a68113ee33af31beaff38334e
|
2024-01-03 15:30:46 +08:00 |
|
hiyouga
|
afa3c86391
|
fix version
Former-commit-id: 47da742fc971520a697ed5ce611f8d6de61ab22b
|
2023-12-29 04:53:36 +08:00 |
|
hiyouga
|
2a3980d6ba
|
update loader
Former-commit-id: 6629087e12f64f2635f24311234202077814083c
|
2023-12-24 19:10:23 +08:00 |
|
hiyouga
|
5d440f978e
|
update patcher
Former-commit-id: e44b82ee245a7ee99057c7b58b1edef5c222dc1f
|
2023-12-23 15:24:27 +08:00 |
|
hiyouga
|
a7fc20cb2d
|
fix unsloth dtype
Former-commit-id: 779cfefb7841d00fc712a5f5addf0fe3eb14c6fd
|
2023-12-23 01:59:49 +08:00 |
|
hiyouga
|
f0d405f392
|
support unsloth
Former-commit-id: 7aad0b889d9a316fffd65f32a419078418fc0986
|
2023-12-23 00:14:33 +08:00 |
|
ShaneTian
|
3eaabe12aa
|
Fix slow model initialization in bfloat16 dtype.
Former-commit-id: d032daa4bd598dd0d71b43eb68a614de77a699a6
|
2023-12-22 16:27:28 +08:00 |
|
hiyouga
|
de6be321b9
|
match version
Former-commit-id: af0194e6d9ba1c67a8592c840c01cee7991b0b0e
|
2023-12-20 22:17:35 +08:00 |
|
hiyouga
|
e06b9c4fa1
|
fix #1900
Former-commit-id: 0c6ab7c75e671348f24d28309d450aecec0a157f
|
2023-12-19 17:21:46 +08:00 |
|
hiyouga
|
8154b4bdf6
|
fix #1742
Former-commit-id: 870426ff70c060213ac283b10a9b1f4bf71679ef
|
2023-12-16 20:50:45 +08:00 |
|
hiyouga
|
4e75ca1222
|
support dpo-ftx
Former-commit-id: b87c74289d523ef88611b376074199ffd03cf103
|
2023-12-16 19:21:41 +08:00 |
|
hiyouga
|
7dbc670902
|
support quantization in export model
Former-commit-id: 3524aa1e58da94ab00e9a2024952ea1b4119b2af
|
2023-12-15 23:44:50 +08:00 |
|
hiyouga
|
329576a5b4
|
fix bug
Former-commit-id: 00c77104f8f9675e1421f99d78de710b21cab047
|
2023-12-15 21:54:02 +08:00 |
|
hiyouga
|
f32c8614c2
|
fix bug
Former-commit-id: 9e509b99af95666ea27f5540bedd64a330357ad7
|
2023-12-15 21:49:26 +08:00 |
|
hiyouga
|
d24d2f0458
|
add configurer
Former-commit-id: 2740aa9cbbcfc6dcfef82915b7db4e0f8b2c1bae
|
2023-12-15 21:46:40 +08:00 |
|