37 Commits

Author SHA1 Message Date
hiyouga
8b8671817f improve lora+ impl.
Former-commit-id: 72367307dfadf936fb989ebe8bc9f0ff229fb933
2024-03-13 23:32:51 +08:00
hiyouga
34533b2f35 support vllm
Former-commit-id: d07ad5cc1cdbc13879afd84f653afdfee03a6933
2024-03-07 20:26:31 +08:00
hiyouga
0fcb931f18 support lora for llama pro
Former-commit-id: 9aeb404a946795d6c4fa3cb45e3e96ffeec13646
2024-02-21 02:17:22 +08:00
hiyouga
96265ec154 support llama pro #2338 , add rslora
Former-commit-id: 7924ffc55d98e33bfbfbca303e46c8f476435673
2024-02-15 02:27:36 +08:00
hiyouga
f6b2bcfa16 fix #2420
Former-commit-id: 19d33ede137a687417bb8697f10e1749781d0d23
2024-02-04 15:51:47 +08:00
hiyouga
b27e91222c format style
Former-commit-id: 638234ceee1b19716e45b6e5f4ea54d9122da4df
2024-01-20 20:15:56 +08:00
hiyouga
4e3bfb799d support function calling
Former-commit-id: d9f1cae35150cce594a7abd96dd2beb811fa33f2
2024-01-18 09:54:23 +08:00
hiyouga
61960189b2 fix #1789
Former-commit-id: 4571068e1e00dc234c9131185fe0924c726add84
2024-01-09 18:31:27 +08:00
hiyouga
f53bc7d9a0 fix #2127
Former-commit-id: ebee4f6a2a20a39ad7fbb87edfa63e244da7b5e6
2024-01-09 14:49:13 +08:00
hiyouga
3fff67e3c7 fix dispatch
Former-commit-id: 1696698eb980fef36a44f860105711bc06d674c9
2024-01-03 16:33:16 +08:00
hiyouga
1a86cc3078 fix rm server
Former-commit-id: 55021097d565536a68113ee33af31beaff38334e
2024-01-03 15:30:46 +08:00
hiyouga
2a3980d6ba update loader
Former-commit-id: 6629087e12f64f2635f24311234202077814083c
2023-12-24 19:10:23 +08:00
hiyouga
5d440f978e update patcher
Former-commit-id: e44b82ee245a7ee99057c7b58b1edef5c222dc1f
2023-12-23 15:24:27 +08:00
hiyouga
c1233ab65f add max_memory for gptq #1923
Former-commit-id: c4a3977ad7278b59a9b3dadcb446bb4c99da5c9d
2023-12-20 18:15:17 +08:00
hiyouga
a862ce636f fix mixtral inference #1821
Former-commit-id: f86857bd9ef456e77ad79a584f1fa08a129e5270
2023-12-20 15:11:15 +08:00
hiyouga
8154b4bdf6 fix #1742
Former-commit-id: 870426ff70c060213ac283b10a9b1f4bf71679ef
2023-12-16 20:50:45 +08:00
hiyouga
7c362509a6 add noisy mean initialization #1815
Former-commit-id: a66186b8724ffd0351a32593ab52d8a2312f339b
2023-12-16 19:47:51 +08:00
hiyouga
d24d2f0458 add configurer
Former-commit-id: 2740aa9cbbcfc6dcfef82915b7db4e0f8b2c1bae
2023-12-15 21:46:40 +08:00
hiyouga
bd03307bbd refactor adapter hparam
Former-commit-id: 0716f5e470afffd2df5a815712b552a4b4797153
2023-12-15 20:53:11 +08:00
hoshi-hiyouga
fa99ead86b tiny fix
Former-commit-id: 81167cd19dac4926da9bd259f4e3cb064c22825c
2023-12-13 17:32:36 +08:00
hoshi-hiyouga
657dff438c tiny fix
Former-commit-id: 6953096c9d8f85d56cc980a4bec3a052411fb4a0
2023-12-13 10:21:29 +08:00
hoshi-hiyouga
5b211cfbe9 fix #1819
Former-commit-id: 1fcd545c3dd78bd2113cde8ef788c5395de11c34
2023-12-13 10:14:01 +08:00
hiyouga
bd28dd0fe6 update readme
Former-commit-id: 8cace7780867dd78760f40c46fd5b6ddd47dea0a
2023-12-12 11:44:30 +08:00
hiyouga
e3e86340ec fix baichuan resize
Former-commit-id: f4657de7d574fdab5d164c679bd474d35140894a
2023-12-11 20:55:50 +08:00
hiyouga
2e42e38ff2 tiny fix
Former-commit-id: 0239d29fa02a88b50f27caa706834f3c3ce0262d
2023-12-11 18:09:40 +08:00
hiyouga
9ead5a2d21 support resize embeddings #1786
Former-commit-id: 64744dde89ccb9a24a46985a99151ad2dde03919
2023-12-11 17:50:02 +08:00
hiyouga
6720189f3f fix #1642
Former-commit-id: b69763ff9237a450194c0de6377745ba3086a4ce
2023-12-02 00:37:53 +08:00
hiyouga
4cc08e00c7 fix gptq training
Former-commit-id: f57445c7a01b726160070c4ea29486702a650ed6
2023-12-02 00:27:15 +08:00
hiyouga
c8eff09c7c tiny fix
Former-commit-id: a973ce6e890d3f384fd225334f53a49907fff10d
2023-12-01 23:37:10 +08:00
hiyouga
e0da912f8e fix gptq model inference
Former-commit-id: 01e6c539b08e45c18878deb99550099d62f7645b
2023-12-01 23:34:14 +08:00
hiyouga
d1e03512f4 fix model card network issue
Former-commit-id: 211b2db5a8290f6b52f0a076de56fcc2b06671d6
2023-11-19 23:03:19 +08:00
hiyouga
48d6d925f7 fix #1558
Former-commit-id: 1740131d63d32aefc0370441baf4716ddb5ebcfe
2023-11-19 14:15:47 +08:00
hiyouga
112108d564 fix evaluator and cached_file in 4.31.0
Former-commit-id: ff6056405dea8e89a95fd3741fd309d3c7679896
2023-11-18 19:39:23 +08:00
hiyouga
f9df6c17ed fix #1550
Former-commit-id: 1bbc1be95eedf0796c0b311568dff8c75f87dfbb
2023-11-17 17:23:13 +08:00
hiyouga
eb5a852dd5 fix import bug
Former-commit-id: 35b91ea34caade45dd51813b94da5177b852aa4c
2023-11-16 02:27:03 +08:00
hiyouga
f441932bd1 support full-parameter PPO
Former-commit-id: ce783036001397a20b0b4c5da2fea6d0c03389d2
2023-11-16 02:08:04 +08:00
hiyouga
06a4820836 disentangle model from tuner and rename modules
Former-commit-id: 4736344eb1595ee023a50d49e8118f4eee46305f
2023-11-15 16:29:09 +08:00