Commit Graph

1649 Commits

Author SHA1 Message Date
hiyouga
92a0d08e27 fix webui
Former-commit-id: 369cca8110
2024-12-19 06:48:03 +00:00
hiyouga
433d116080 add paligemma2
Former-commit-id: d3509050dc
2024-12-18 08:57:26 +00:00
hoshi-hiyouga
d43080b534 Merge pull request #6313 from ge-xing/main
support telechat2 model

Former-commit-id: 015f213788
2024-12-18 16:16:17 +08:00
hiyouga
a421113466 support qwen tool format
Former-commit-id: 98795854e3
2024-12-17 20:12:06 +00:00
hiyouga
acd62fddb8 change default replace jinja to false
Former-commit-id: bcc413cf64
2024-12-17 19:27:10 +00:00
ylfeng
857d23b324 Support Mistral format tools
Former-commit-id: 115924af47
2024-12-17 19:13:26 +00:00
hiyouga
f6a2bfc0e8 fix llama3 tool template
Former-commit-id: df5655f61c
2024-12-17 17:05:10 +00:00
hoshi-hiyouga
1cc24ed206 Merge pull request #6367 from hiyouga/hiyouga/add_model
[model&template] add llama3.3 & support llama3 tool prompt

Former-commit-id: e12c80ace8
2024-12-18 00:13:28 +08:00
hiyouga
a935933bed support llama3 tool prompt
Former-commit-id: b24ae55ebf
2024-12-17 15:52:37 +00:00
Yaser Afshar
76ebd62ac1 Add missing key to init_kwargs
Former-commit-id: 1c8ad22a5f
2024-12-17 12:34:05 +00:00
Yaser Afshar
fe4546a7bb Add trust_remote_code parameter and remove True
- Introduced a new model parameter `trust_remote_code`
- Set the default value of `trust_remote_code` to `False`
  to enhance security


Former-commit-id: 0943776326
2024-12-17 12:25:12 +00:00
zhaohu xing
cfb4c42ae4 support telechat2 model
Former-commit-id: 04f19ed0f3
2024-12-17 12:15:33 +00:00
hoshi-hiyouga
fc18db6290 Merge pull request #6364 from hiyouga/hiyouga/control_reenterent_gc
[model] support non-reenterent-gc

Former-commit-id: a665ad6178
2024-12-17 19:58:36 +08:00
hiyouga
64bac4bc7e support non-reenterent-gc & fix #6358
Former-commit-id: f319da6937
2024-12-17 11:41:59 +00:00
hoshi-hiyouga
002c7d2867 Merge pull request #6363 from hiyouga/hiyouga/control_skip_eos
[infer] support control eos

Former-commit-id: 6973828307
2024-12-17 19:35:40 +08:00
hiyouga
a94a1eac67 support control eos, fix #6345
Former-commit-id: eda76de32b
2024-12-17 10:42:05 +00:00
hiyouga
bff1b94583 generalized packing & fix #6343
Former-commit-id: 2d107d3aef
2024-12-17 10:26:19 +00:00
hiyouga
50ca43c3fb fix #6348
Former-commit-id: 142191e466
2024-12-17 10:06:46 +00:00
hiyouga
6f1e450739 fix mrope
Former-commit-id: 2811814fc4
2024-12-12 15:08:17 +00:00
hiyouga
cf8cad8e7e support qwen2vl train proj only
Former-commit-id: 99c62660c6
2024-12-05 10:37:42 +00:00
hiyouga
88b06a0c7f support qwen2vl vllm infer
Former-commit-id: 207f8b069c
2024-12-05 10:17:26 +00:00
hiyouga
819f487c8f fix scripts
Former-commit-id: eb3e147d19
2024-12-05 03:47:32 +00:00
hoshi-hiyouga
9bbeba6323 Merge pull request #6160 from village-way/pr_dataloader
fix:tokenized_path not None and load_from_disk return Dataset Trigger…
Former-commit-id: cf29846830
2024-12-04 22:18:19 +08:00
hoshi-hiyouga
92940817e7 lint
Former-commit-id: 6a5074e466
2024-12-04 22:08:27 +08:00
hiyouga
235cdcacee support batch infer in vllm
Former-commit-id: 1324d158f9
2024-12-04 13:50:00 +00:00
hoshi-hiyouga
ed4c4bab49 Merge pull request #6170 from hykilpikonna/main
[+] Show the hostname in webui title

Former-commit-id: 263cb82bdb
2024-12-04 18:07:29 +08:00
hiyouga
0ef1dc4dd5 fix vlm zero3 training
Former-commit-id: dbb9e5b70e
2024-12-04 09:40:39 +00:00
Azalea
0efa34c9ef [U] Compute hostname differently
Former-commit-id: 6554cdeedb
2024-11-28 22:23:41 -05:00
hiyouga
1c3d86cd65 add qwq
Former-commit-id: 68a612115a
2024-11-28 08:50:57 +00:00
Azalea
f5e6e25a1b [+] Show the hostname
Former-commit-id: dfb953b1ad
2024-11-28 12:25:02 +08:00
wangdepeng
ae09c6c214 fix:tokenized_path not None and load_from_disk return Dataset Trigger stuck
Former-commit-id: 4424d4de8a
2024-11-27 16:44:42 +08:00
hiyouga
9822cb7bac fix dataset
Former-commit-id: 046b6fb118
2024-11-27 06:27:44 +00:00
hiyouga
d51d96d594 add skywork o1
Former-commit-id: ec9ff8caa2
2024-11-27 05:51:59 +00:00
hiyouga
ab3782b0fa add marco-o1 and openo1 dataset
Former-commit-id: 17afb7d410
2024-11-27 04:20:23 +00:00
hoshi-hiyouga
6cd90efb82 Merge pull request #6152 from hiyouga/hiyouga/add_num_proc_in_data_load
[data] add num_proc in load_dataset

Former-commit-id: b26c490ac3
2024-11-27 00:16:15 +08:00
hiyouga
358708ee97 fix #6149
Former-commit-id: 362d579ce8
2024-11-26 16:03:02 +00:00
hiyouga
006022cadd fix mllama cross_mask
Former-commit-id: 598c22e43f
2024-11-26 15:56:58 +00:00
hoshi-hiyouga
118ffe50e3 lint
Former-commit-id: da9e4ddd26
2024-11-25 22:55:56 +08:00
hoshi-hiyouga
c0ffe68745 fix #6139
Former-commit-id: d87e16cf5c
2024-11-25 22:22:06 +08:00
hoshi-hiyouga
a489f10986 fix visual patch
Former-commit-id: 75b586c31a
2024-11-25 20:06:06 +08:00
hoshi-hiyouga
f48d07cd6c fix #6136
Former-commit-id: 0516e556a7
2024-11-25 19:43:42 +08:00
hiyouga
f8f3638bff set dev version
Former-commit-id: b0ccc2ee86
2024-11-25 01:36:49 +08:00
hoshi-hiyouga
1176cd6779 Merge pull request #6124 from hiyouga/hiyouga/release
[release] release v0.9.1

Former-commit-id: 18daf10eda
2024-11-25 00:20:02 +08:00
hoshi-hiyouga
4165c4414d Merge pull request #6126 from hiyouga/hiyouga/fix_vllm
[inference] fix vllm

Former-commit-id: 07059a7ca4
2024-11-25 00:19:54 +08:00
hiyouga
65699c29d4 fix vllm
Former-commit-id: 13ee1f5cec
2024-11-25 00:07:24 +08:00
hiyouga
a04538e70b fix cli
Former-commit-id: 8792d78c82
2024-11-24 23:56:21 +08:00
hiyouga
708116a5f3 release v0.9.1
Former-commit-id: d622f8fdec
2024-11-24 23:48:41 +08:00
hiyouga
dcc67ac1a5 fix qwen2vl vllm infer
Former-commit-id: fa50fc470e
2024-11-24 23:27:24 +08:00
hiyouga
253752ccca add forbidden modules
Former-commit-id: df477370dc
2024-11-23 18:34:15 +00:00
hiyouga
e99031daa4 fix inputs
Former-commit-id: 446441fdb0
2024-11-23 18:26:02 +00:00