Commit Graph

278 Commits

Author SHA1 Message Date
hiyouga
eb3e147d19 fix scripts 2024-12-05 03:47:32 +00:00
hoshi-hiyouga
cf29846830 Merge pull request #6160 from village-way/pr_dataloader
fix:tokenized_path not None and load_from_disk return Dataset Trigger…
2024-12-04 22:18:19 +08:00
hoshi-hiyouga
6a5074e466 lint 2024-12-04 22:08:27 +08:00
hiyouga
dbb9e5b70e fix vlm zero3 training 2024-12-04 09:40:39 +00:00
wangdepeng
4424d4de8a fix:tokenized_path not None and load_from_disk return Dataset Trigger stuck 2024-11-27 16:44:42 +08:00
hiyouga
046b6fb118 fix dataset 2024-11-27 06:27:44 +00:00
hiyouga
ec9ff8caa2 add skywork o1 2024-11-27 05:51:59 +00:00
hiyouga
17afb7d410 add marco-o1 and openo1 dataset 2024-11-27 04:20:23 +00:00
hoshi-hiyouga
b26c490ac3 Merge pull request #6152 from hiyouga/hiyouga/add_num_proc_in_data_load
[data] add num_proc in load_dataset
2024-11-27 00:16:15 +08:00
hiyouga
362d579ce8 fix #6149 2024-11-26 16:03:02 +00:00
hiyouga
598c22e43f fix mllama cross_mask 2024-11-26 15:56:58 +00:00
hoshi-hiyouga
da9e4ddd26 lint 2024-11-25 22:55:56 +08:00
hoshi-hiyouga
d87e16cf5c fix #6139 2024-11-25 22:22:06 +08:00
hiyouga
13ee1f5cec fix vllm 2024-11-25 00:07:24 +08:00
hiyouga
446441fdb0 fix inputs 2024-11-23 18:26:02 +00:00
marko1616
8372c5e377 Tiny fix. 2024-11-23 16:09:01 +00:00
marko1616
3f2c056253 Support llama3.2vl. 2024-11-23 16:07:35 +00:00
hiyouga
431ac4892c add qwen-coder and opencoder 2024-11-15 21:48:38 +08:00
hiyouga
ffa39ba3db add image input type 2024-11-04 08:27:20 +00:00
steven
6eefb4d7d2 support granite3 models 2024-11-04 10:35:03 +08:00
hoshi-hiyouga
478cbb1aa7 update template 2024-11-02 21:21:22 +08:00
hoshi-hiyouga
5f14910910 Merge branch 'main' into main 2024-11-02 21:20:27 +08:00
hoshi-hiyouga
c58cc22d06 Merge pull request #5910 from Cuiyn/index
Support Index series models.
2024-11-02 20:16:54 +08:00
hiyouga
c38aa29336 support rank0 logger 2024-11-02 18:31:04 +08:00
Cuiyn
a15a69ab44 Add support for Index 2024-11-02 13:45:27 +08:00
hoshi-hiyouga
bd08b8c441 Merge pull request #5909 from hiyouga/hiyouga/dev2
[data] support auto convert for single image, add image_dir argument
2024-11-02 13:43:04 +08:00
hiyouga
bfe1abd7af fix #5904 2024-11-02 13:08:15 +08:00
hiyouga
24da9f59b0 fix #5883 2024-11-02 13:06:34 +08:00
hiyouga
e80a481927 support multiimage inference 2024-11-01 07:25:20 +00:00
hiyouga
0c22da4f1c tiny fix 2024-10-30 08:56:29 +00:00
hoshi-hiyouga
049c554aee Update mm_plugin.py 2024-10-29 22:16:22 +08:00
hoshi-hiyouga
c3239ba6b2 Update template.py 2024-10-29 22:11:21 +08:00
hoshi-hiyouga
f745c4b28f Update collator.py 2024-10-29 22:03:42 +08:00
Kingsley
67f59579d7 Merge branch 'hiyouga:main' into pixtral-patch 2024-10-29 21:01:25 +08:00
hiyouga
21db8ed2f4 use pre-commit 2024-10-29 09:07:46 +00:00
KUANGDD
c1d17b0f01 rm comment 2024-10-23 15:50:59 +08:00
KUANGDD
f5c1cdfaab rm useless code 2024-10-23 15:38:11 +08:00
KUANGDD
a857184456 rm import torch 2024-10-23 15:32:33 +08:00
KUANGDD
9d6143e36a modify style & little change 2024-10-23 15:24:07 +08:00
KUANGDD
7ea29bbfe0 fix bug for webui infer 2024-10-16 01:09:33 +08:00
Kingsley
3d51caa053 Merge branch 'pixtral-patch' of https://github.com/Kuangdd01/LLaMA-Factory-X into pixtral-patch 2024-10-15 17:09:56 +08:00
Kingsley
0fc949783d add extra test for pixtral mm_input 2024-10-15 17:09:24 +08:00
BUAADreamer
58b97197b8 tiny fix [skip ci] 2024-10-15 13:53:33 +08:00
KUANGDD
2df2be1c47 plugin test & check 2024-10-15 12:12:46 +08:00
KUANGDD
9f44598b92 required transformers version 2024-10-14 21:11:09 +08:00
Kingsley
962b9730a7 remove bs condition 2024-10-14 16:55:59 +08:00
Kingsley
95330893c5 Merge branch 'hiyouga:main' into pixtral-patch 2024-10-13 17:42:02 +08:00
hiyouga
3af57795dd tiny fix 2024-10-11 23:51:54 +08:00
huniu20
843b5d85e9 bugs fixed 2024-10-11 19:56:13 +08:00
huniu20
7b91be33c9 add om_hub_token argument 2024-10-10 17:16:46 +08:00