Commit Graph

235 Commits

Author SHA1 Message Date
hiyouga
acd62fddb8 change default replace jinja to false
Former-commit-id: bcc413cf64
2024-12-17 19:27:10 +00:00
ylfeng
857d23b324 Support Mistral format tools
Former-commit-id: 115924af47
2024-12-17 19:13:26 +00:00
hiyouga
f6a2bfc0e8 fix llama3 tool template
Former-commit-id: df5655f61c
2024-12-17 17:05:10 +00:00
hoshi-hiyouga
1cc24ed206 Merge pull request #6367 from hiyouga/hiyouga/add_model
[model&template] add llama3.3 & support llama3 tool prompt

Former-commit-id: e12c80ace8
2024-12-18 00:13:28 +08:00
hiyouga
a935933bed support llama3 tool prompt
Former-commit-id: b24ae55ebf
2024-12-17 15:52:37 +00:00
Yaser Afshar
fe4546a7bb Add trust_remote_code parameter and remove True
- Introduced a new model parameter `trust_remote_code`
- Set the default value of `trust_remote_code` to `False`
  to enhance security


Former-commit-id: 0943776326
2024-12-17 12:25:12 +00:00
hiyouga
50ca43c3fb fix #6348
Former-commit-id: 142191e466
2024-12-17 10:06:46 +00:00
hiyouga
6f1e450739 fix mrope
Former-commit-id: 2811814fc4
2024-12-12 15:08:17 +00:00
hiyouga
88b06a0c7f support qwen2vl vllm infer
Former-commit-id: 207f8b069c
2024-12-05 10:17:26 +00:00
hiyouga
819f487c8f fix scripts
Former-commit-id: eb3e147d19
2024-12-05 03:47:32 +00:00
hoshi-hiyouga
9bbeba6323 Merge pull request #6160 from village-way/pr_dataloader
fix:tokenized_path not None and load_from_disk return Dataset Trigger…
Former-commit-id: cf29846830
2024-12-04 22:18:19 +08:00
hoshi-hiyouga
92940817e7 lint
Former-commit-id: 6a5074e466
2024-12-04 22:08:27 +08:00
hiyouga
0ef1dc4dd5 fix vlm zero3 training
Former-commit-id: dbb9e5b70e
2024-12-04 09:40:39 +00:00
wangdepeng
ae09c6c214 fix:tokenized_path not None and load_from_disk return Dataset Trigger stuck
Former-commit-id: 4424d4de8a
2024-11-27 16:44:42 +08:00
hiyouga
9822cb7bac fix dataset
Former-commit-id: 046b6fb118
2024-11-27 06:27:44 +00:00
hiyouga
d51d96d594 add skywork o1
Former-commit-id: ec9ff8caa2
2024-11-27 05:51:59 +00:00
hiyouga
ab3782b0fa add marco-o1 and openo1 dataset
Former-commit-id: 17afb7d410
2024-11-27 04:20:23 +00:00
hoshi-hiyouga
6cd90efb82 Merge pull request #6152 from hiyouga/hiyouga/add_num_proc_in_data_load
[data] add num_proc in load_dataset

Former-commit-id: b26c490ac3
2024-11-27 00:16:15 +08:00
hiyouga
358708ee97 fix #6149
Former-commit-id: 362d579ce8
2024-11-26 16:03:02 +00:00
hiyouga
006022cadd fix mllama cross_mask
Former-commit-id: 598c22e43f
2024-11-26 15:56:58 +00:00
hoshi-hiyouga
118ffe50e3 lint
Former-commit-id: da9e4ddd26
2024-11-25 22:55:56 +08:00
hoshi-hiyouga
c0ffe68745 fix #6139
Former-commit-id: d87e16cf5c
2024-11-25 22:22:06 +08:00
hiyouga
65699c29d4 fix vllm
Former-commit-id: 13ee1f5cec
2024-11-25 00:07:24 +08:00
hiyouga
e99031daa4 fix inputs
Former-commit-id: 446441fdb0
2024-11-23 18:26:02 +00:00
marko1616
3295519099 Tiny fix.
Former-commit-id: 8372c5e377
2024-11-23 16:09:01 +00:00
marko1616
20faaf3418 Support llama3.2vl.
Former-commit-id: 3f2c056253
2024-11-23 16:07:35 +00:00
hiyouga
d4e0010027 add qwen-coder and opencoder
Former-commit-id: 431ac4892c
2024-11-15 21:48:38 +08:00
hiyouga
1598e5d355 add image input type
Former-commit-id: ffa39ba3db
2024-11-04 08:27:20 +00:00
hoshi-hiyouga
8c2b7aa1ab update template
Former-commit-id: 478cbb1aa7
2024-11-02 21:21:22 +08:00
hoshi-hiyouga
d99e164cad Merge branch 'main' into main
Former-commit-id: 5f14910910
2024-11-02 21:20:27 +08:00
hoshi-hiyouga
6f79974e8b Merge pull request #5910 from Cuiyn/index
Support Index series models.

Former-commit-id: c58cc22d06
2024-11-02 20:16:54 +08:00
hiyouga
e83cb17f97 support rank0 logger
Former-commit-id: c38aa29336
2024-11-02 18:31:04 +08:00
Cuiyn
7806bde8ad Add support for Index
Former-commit-id: a15a69ab44
2024-11-02 13:45:27 +08:00
hoshi-hiyouga
4b2c47fcae Merge pull request #5909 from hiyouga/hiyouga/dev2
[data] support auto convert for single image, add image_dir argument

Former-commit-id: bd08b8c441
2024-11-02 13:43:04 +08:00
hiyouga
ac677205c9 fix #5904
Former-commit-id: bfe1abd7af
2024-11-02 13:08:15 +08:00
hiyouga
7fa46a24df fix #5883
Former-commit-id: 24da9f59b0
2024-11-02 13:06:34 +08:00
hiyouga
8ecc12ee2a support multiimage inference
Former-commit-id: e80a481927
2024-11-01 07:25:20 +00:00
hiyouga
1b02915d19 tiny fix
Former-commit-id: 0c22da4f1c
2024-10-30 08:56:29 +00:00
hoshi-hiyouga
49054329d0 Update mm_plugin.py
Former-commit-id: 049c554aee
2024-10-29 22:16:22 +08:00
hoshi-hiyouga
54961946ac Update template.py
Former-commit-id: c3239ba6b2
2024-10-29 22:11:21 +08:00
hoshi-hiyouga
fb8f35558a Update collator.py
Former-commit-id: f745c4b28f
2024-10-29 22:03:42 +08:00
Kingsley
3053a806e9 Merge branch 'hiyouga:main' into pixtral-patch
Former-commit-id: 67f59579d7
2024-10-29 21:01:25 +08:00
hiyouga
0d8aa6e6ef use pre-commit
Former-commit-id: 21db8ed2f4
2024-10-29 09:07:46 +00:00
KUANGDD
9d1f079ca5 rm comment
Former-commit-id: c1d17b0f01
2024-10-23 15:50:59 +08:00
KUANGDD
b9c6fcfe98 rm useless code
Former-commit-id: f5c1cdfaab
2024-10-23 15:38:11 +08:00
KUANGDD
006b708b57 rm import torch
Former-commit-id: a857184456
2024-10-23 15:32:33 +08:00
KUANGDD
62cbcb646a modify style & little change
Former-commit-id: 9d6143e36a
2024-10-23 15:24:07 +08:00
KUANGDD
9c4941a1ea fix bug for webui infer
Former-commit-id: 7ea29bbfe0
2024-10-16 01:09:33 +08:00
Kingsley
bcb40fddc0 Merge branch 'pixtral-patch' of https://github.com/Kuangdd01/LLaMA-Factory-X into pixtral-patch
Former-commit-id: 3d51caa053
2024-10-15 17:09:56 +08:00
Kingsley
ae869639dd add extra test for pixtral mm_input
Former-commit-id: 0fc949783d
2024-10-15 17:09:24 +08:00