423A35C7/LLaMA-Factory
1
0
Fork 0
mirror of https://github.com/hiyouga/LLaMA-Factory.git synced 2025-12-14 19:06:26 +08:00
Code Issues Packages Projects Releases Wiki Activity
718 Commits 1 Branch 34 Tags
a7fc20cb2d8ac84908bb7223823ebc7d27346f5d
Commit Graph

439 Commits

Author SHA1 Message Date
hiyouga
a7fc20cb2d fix unsloth dtype 
Former-commit-id: 779cfefb78
 2023-12-23 01:59:49 +08:00
hiyouga
938c4cb132 fix dpo trainer 
Former-commit-id: 074745b170
 2023-12-23 01:51:55 +08:00
hiyouga
bf872424da llama board: add unsloth 
Former-commit-id: 9a18a85639
 2023-12-23 00:35:53 +08:00
hiyouga
f0d405f392 support unsloth 
Former-commit-id: 7aad0b889d
 2023-12-23 00:14:33 +08:00
ShaneTian
3eaabe12aa Fix slow model initialization in bfloat16 dtype. 
Former-commit-id: d032daa4bd
 2023-12-22 16:27:28 +08:00
hiyouga
ce79528bb1 fix param type 
Former-commit-id: ba69378841
 2023-12-21 17:33:01 +08:00
hiyouga
fee0fef052 fix ds zero3 check 
Former-commit-id: 083355fc05
 2023-12-21 01:19:22 +08:00
hiyouga
de6be321b9 match version 
Former-commit-id: af0194e6d9
 2023-12-20 22:17:35 +08:00
hiyouga
9337568e23 fix stop words 
Former-commit-id: dec360d5ae
 2023-12-20 19:06:43 +08:00
hiyouga
622d31e398 fix yi template #1895 
Former-commit-id: 5af8841c4f
 2023-12-20 18:58:16 +08:00
hiyouga
23a875a8b1 improve quantization 
Former-commit-id: 624cc21281
 2023-12-20 18:27:16 +08:00
hiyouga
c1233ab65f add max_memory for gptq #1923 
Former-commit-id: c4a3977ad7
 2023-12-20 18:15:17 +08:00
hiyouga
82a79e9fdf fix #1073 #1462 #1735 #1908 
Former-commit-id: 31165a9822
 2023-12-20 17:15:40 +08:00
hiyouga
f64be8ee84 optimize data loading logic 
Former-commit-id: ec1fe1daa9
 2023-12-20 16:15:41 +08:00
hiyouga
633624dc3c fix #1909 
Former-commit-id: c6abbbfe90
 2023-12-20 16:11:07 +08:00
hiyouga
a862ce636f fix mixtral inference #1821 
Former-commit-id: f86857bd9e
 2023-12-20 15:11:15 +08:00
hiyouga
e06b9c4fa1 fix #1900 
Former-commit-id: 0c6ab7c75e
 2023-12-19 17:21:46 +08:00
hiyouga
3981927d6b add codegeex template 
Former-commit-id: a67a440644
 2023-12-18 19:52:35 +08:00
hiyouga
51c636db54 add xverse-65B-2 model 
Former-commit-id: 2df923540c
 2023-12-18 19:24:09 +08:00
hiyouga
1af13cb737 add models 
Former-commit-id: 709ac8870a
 2023-12-18 19:09:31 +08:00
hiyouga
5a199af387 fix tokenizer for Yi chat models #1617 #1875 
Former-commit-id: 71a9c16171
 2023-12-18 17:18:11 +08:00
hiyouga
16cc0321f2 fix llama board 
Former-commit-id: c46879575f
 2023-12-16 22:17:37 +08:00
hiyouga
8154b4bdf6 fix #1742 
Former-commit-id: 870426ff70
 2023-12-16 20:50:45 +08:00
hiyouga
397f6bb615 add xverse-65b-chat model 
Former-commit-id: 7ae6919b9b
 2023-12-16 20:21:29 +08:00
hiyouga
ff5f57bfbf set version 
Former-commit-id: 328ad06bd4
 2023-12-16 20:17:51 +08:00
hiyouga
7c362509a6 add noisy mean initialization #1815 
Former-commit-id: a66186b872
 2023-12-16 19:47:51 +08:00
hiyouga
4e75ca1222 support dpo-ftx 
Former-commit-id: b87c74289d
 2023-12-16 19:21:41 +08:00
hiyouga
f0f9d253d8 support autogptq in llama board #246 
Former-commit-id: 71389be37c
 2023-12-16 16:31:30 +08:00
yhyu13
cc91724507 Use llmtuner logger 
Former-commit-id: fc70a92cb6
 2023-12-16 07:15:27 +00:00
yhyu13
362e3c913f Improve logging for unknown args 
Former-commit-id: 26817143ff
 2023-12-16 05:16:29 +00:00
hiyouga
7db6fe4754 update tips 
Former-commit-id: 3551171d49
 2023-12-15 23:52:50 +08:00
hiyouga
9a88387b91 fix #1770 
Former-commit-id: 439a26c276
 2023-12-15 23:50:15 +08:00
hiyouga
7dbc670902 support quantization in export model 
Former-commit-id: 3524aa1e58
 2023-12-15 23:44:50 +08:00
hiyouga
2db4cfab40 update dc link 
Former-commit-id: 87ef3f47b5
 2023-12-15 22:11:31 +08:00
hiyouga
329576a5b4 fix bug 
Former-commit-id: 00c77104f8
 2023-12-15 21:54:02 +08:00
hiyouga
f32c8614c2 fix bug 
Former-commit-id: 9e509b99af
 2023-12-15 21:49:26 +08:00
hiyouga
d24d2f0458 add configurer 
Former-commit-id: 2740aa9cbb
 2023-12-15 21:46:40 +08:00
hiyouga
bd03307bbd refactor adapter hparam 
Former-commit-id: 0716f5e470
 2023-12-15 20:53:11 +08:00
hiyouga
6a186d4386 add loftq 
Former-commit-id: d4c351f1ec
 2023-12-14 21:53:56 +08:00
hiyouga
e55e32efc4 fix valuehead model 
Former-commit-id: bfdee1608f
 2023-12-14 20:15:20 +08:00
hoshi-hiyouga
fa99ead86b tiny fix 
Former-commit-id: 81167cd19d
 2023-12-13 17:32:36 +08:00
hoshi-hiyouga
3f8d33695c revert peft version 
Former-commit-id: 9b0630f84f
 2023-12-13 10:49:45 +08:00
hoshi-hiyouga
ad1860d35e update peft version 
Former-commit-id: 573a12c86b
 2023-12-13 10:23:51 +08:00
hoshi-hiyouga
657dff438c tiny fix 
Former-commit-id: 6953096c9d
 2023-12-13 10:21:29 +08:00
hoshi-hiyouga
5b211cfbe9 fix #1819 
Former-commit-id: 1fcd545c3d
 2023-12-13 10:14:01 +08:00
hiyouga
15b321da8e remove loftq 
Former-commit-id: 3a8a50d4d4
 2023-12-13 01:53:46 +08:00
hiyouga
c9a2a7a3b3 fix sharegpt loading 
Former-commit-id: 2c8e88f9c1
 2023-12-13 00:56:16 +08:00
hiyouga
f9ab303629 add model urls 
Former-commit-id: 3552035d7e
 2023-12-13 00:09:17 +08:00
hiyouga
4c69025a83 support loftq 
Former-commit-id: 6219dfbd93
 2023-12-12 22:47:06 +08:00
hiyouga
b43a8dcfbf fix #1795 
Former-commit-id: ada0e536c9
 2023-12-12 19:58:34 +08:00