24 Commits

Author SHA1 Message Date
hiyouga
fb2d563be5 fix #2268
Former-commit-id: e0a717aa3aa97ca5a5d6a2ad8c1711a1f92b001b
2024-01-21 14:11:38 +08:00
hiyouga
b27e91222c format style
Former-commit-id: 638234ceee1b19716e45b6e5f4ea54d9122da4df
2024-01-20 20:15:56 +08:00
hiyouga
69e8925249 support longlora for main branch
Former-commit-id: 38af076a75c33da26d641780820694e4b7342d92
2024-01-20 19:25:22 +08:00
hoshi-hiyouga
b36dea7e7b Merge pull request #2201 from liu-zichen/token_embed_resize
support resize embed for zero3

Former-commit-id: bb92cdd0db1e7dd1ea9ec38a0b1d9494a8b5801d
2024-01-20 17:45:38 +08:00
hiyouga
edf725208d add upcast_lmhead option
Former-commit-id: 8cbe4e960983ace47f8b956cdc31411347592129
2024-01-19 23:54:25 +08:00
hiyouga
ffde3d94bf set use_reentrant=False
Former-commit-id: 0ff9a1fb4fdf42d91095f2dc113d9844bfe4368a
2024-01-19 23:29:54 +08:00
hiyouga
4e3bfb799d support function calling
Former-commit-id: d9f1cae35150cce594a7abd96dd2beb811fa33f2
2024-01-18 09:54:23 +08:00
liuzc
61bc5bd0dd support resize embed for zero3
Former-commit-id: a5f6a7f4fb057511428011c37422c535f31b79d2
2024-01-16 15:16:20 +08:00
hiyouga
6bbcf5ad16 improve model export
Former-commit-id: d2a676c8ba550e1dd7f4e12cb397a32e01831d85
2024-01-05 18:51:49 +08:00
hiyouga
7c50959fe6 fix #2098
Former-commit-id: f6fdd83f8a6bf3e48cf08fd098ec7b08d34d16d7
2024-01-05 17:11:26 +08:00
hiyouga
dc8714a003 fix #2081
Former-commit-id: 33f2c0d4f89cf76671c0fdfbcee79d732b6a020e
2024-01-04 23:19:08 +08:00
hiyouga
3fff67e3c7 fix dispatch
Former-commit-id: 1696698eb980fef36a44f860105711bc06d674c9
2024-01-03 16:33:16 +08:00
hiyouga
eb021ca748 fix valuehead patch
Former-commit-id: 24d8d6f224ccb98387ec72e688fa32f5f308dd07
2024-01-03 16:19:23 +08:00
hiyouga
1a86cc3078 fix rm server
Former-commit-id: 55021097d565536a68113ee33af31beaff38334e
2024-01-03 15:30:46 +08:00
hiyouga
498b83d77a fix bug
Former-commit-id: e4bb846c43c087bfdd99d0c9eb0318e95b943977
2023-12-24 19:20:12 +08:00
hiyouga
2a3980d6ba update loader
Former-commit-id: 6629087e12f64f2635f24311234202077814083c
2023-12-24 19:10:23 +08:00
hiyouga
5d440f978e update patcher
Former-commit-id: e44b82ee245a7ee99057c7b58b1edef5c222dc1f
2023-12-23 15:24:27 +08:00
hiyouga
f0d405f392 support unsloth
Former-commit-id: 7aad0b889d9a316fffd65f32a419078418fc0986
2023-12-23 00:14:33 +08:00
hiyouga
fee0fef052 fix ds zero3 check
Former-commit-id: 083355fc051f5d25400eb80887ff5e0d15ce729b
2023-12-21 01:19:22 +08:00
hiyouga
23a875a8b1 improve quantization
Former-commit-id: 624cc212819b7cd16295c72084cd454b67cf89a6
2023-12-20 18:27:16 +08:00
hiyouga
c1233ab65f add max_memory for gptq #1923
Former-commit-id: c4a3977ad7278b59a9b3dadcb446bb4c99da5c9d
2023-12-20 18:15:17 +08:00
hiyouga
f0f9d253d8 support autogptq in llama board #246
Former-commit-id: 71389be37cb0f1a65db6e501e11ca14e615c1a24
2023-12-16 16:31:30 +08:00
hiyouga
7dbc670902 support quantization in export model
Former-commit-id: 3524aa1e58da94ab00e9a2024952ea1b4119b2af
2023-12-15 23:44:50 +08:00
hiyouga
d24d2f0458 add configurer
Former-commit-id: 2740aa9cbbcfc6dcfef82915b7db4e0f8b2c1bae
2023-12-15 21:46:40 +08:00