Commit Graph

2455 Commits

Author SHA1 Message Date
hiyouga
a94a1eac67 support control eos, fix #6345
Former-commit-id: eda76de32b
2024-12-17 10:42:05 +00:00
hoshi-hiyouga
4caf043cf8 Merge pull request #6359 from hiyouga/hiyouga/fix_qwen2vl_infer
[model] fix qwen2vl infern

Former-commit-id: 81815f053f
2024-12-17 18:15:23 +08:00
hiyouga
50ca43c3fb fix #6348
Former-commit-id: 142191e466
2024-12-17 10:06:46 +00:00
hoshi-hiyouga
0f49e9cb07 Merge pull request #6334 from hiyouga/hiyouga/add_examples
[assets] update wechat and examples

Former-commit-id: e2fbd07096
2024-12-15 01:37:01 +08:00
hiyouga
ba901bc000 update assets
Former-commit-id: 7059055e89
2024-12-14 17:36:03 +00:00
hiyouga
6f1e450739 fix mrope
Former-commit-id: 2811814fc4
2024-12-12 15:08:17 +00:00
hoshi-hiyouga
93d1cba06e Merge pull request #6253 from hiyouga/hiyouga/qwen2vl_mm_proj
[model] support qwen2vl train proj only

Former-commit-id: bcb4fb353e
2024-12-05 20:25:33 +08:00
hiyouga
cf8cad8e7e support qwen2vl train proj only
Former-commit-id: 99c62660c6
2024-12-05 10:37:42 +00:00
hoshi-hiyouga
255260cfcb Merge pull request #6251 from hiyouga/hiyouga/vllm_qwen2vl_infer
[infer] support qwen2vl vllm infer

Former-commit-id: 561a8e56d9
2024-12-05 18:26:19 +08:00
hiyouga
88b06a0c7f support qwen2vl vllm infer
Former-commit-id: 207f8b069c
2024-12-05 10:17:26 +00:00
hoshi-hiyouga
7f8c59144e Merge pull request #6246 from hiyouga/hiyouga/update_examples
[examples] update examples

Former-commit-id: 967a6c12a7
2024-12-05 16:49:30 +08:00
hiyouga
90fb5605c1 update examples
Former-commit-id: e5584dc7ba
2024-12-05 08:48:25 +00:00
hoshi-hiyouga
9f9ad6435d Merge pull request #6242 from hiyouga/hiyouga/fix_script
[script] fix scripts

Former-commit-id: c42890bb2b
2024-12-05 11:54:46 +08:00
hiyouga
819f487c8f fix scripts
Former-commit-id: eb3e147d19
2024-12-05 03:47:32 +00:00
hoshi-hiyouga
9bbeba6323 Merge pull request #6160 from village-way/pr_dataloader
fix:tokenized_path not None and load_from_disk return Dataset Trigger…
Former-commit-id: cf29846830
2024-12-04 22:18:19 +08:00
hoshi-hiyouga
92940817e7 lint
Former-commit-id: 6a5074e466
2024-12-04 22:08:27 +08:00
hoshi-hiyouga
68614f6bc1 Merge pull request #6238 from hiyouga/hiyouga/vllm_batchinfer
[infer] feat: support batch infer in vllm

Former-commit-id: 8328bd8fbb
2024-12-04 21:59:13 +08:00
hiyouga
235cdcacee support batch infer in vllm
Former-commit-id: 1324d158f9
2024-12-04 13:50:00 +00:00
hoshi-hiyouga
b2c67a989a Merge pull request #6190 from JieShenAI/main
add vllm_infer script

Former-commit-id: dc78355002
2024-12-04 21:19:23 +08:00
hoshi-hiyouga
ed4c4bab49 Merge pull request #6170 from hykilpikonna/main
[+] Show the hostname in webui title

Former-commit-id: 263cb82bdb
2024-12-04 18:07:29 +08:00
hoshi-hiyouga
1804e8a491 Merge pull request #6233 from hiyouga/hiyouga/vlm_zero3
[data] fix vlm zero3 training

Former-commit-id: 187402203b
2024-12-04 17:51:10 +08:00
hiyouga
0ef1dc4dd5 fix vlm zero3 training
Former-commit-id: dbb9e5b70e
2024-12-04 09:40:39 +00:00
hoshi-hiyouga
b34c3bb796 Merge pull request #6224 from hiyouga/hiyouga-patch-1
[assets] chore: update wechat

Former-commit-id: 7965e9840c
2024-12-03 21:25:38 +08:00
hoshi-hiyouga
aa5535c622 update wechat
Former-commit-id: 722a396b69
2024-12-03 20:48:48 +08:00
JieShen
d4bf81b36a add async call api
Former-commit-id: 4c61368600
2024-12-01 22:18:05 +08:00
JieShen
99265c7d2f add vllm_infer script
Former-commit-id: 961e8c2d2e
2024-11-29 14:22:20 +08:00
Azalea
0efa34c9ef [U] Compute hostname differently
Former-commit-id: 6554cdeedb
2024-11-28 22:23:41 -05:00
hoshi-hiyouga
f4729904f2 Merge pull request #6175 from hiyouga/hiyouga/add_qwq
[model] add QwQ

Former-commit-id: f2b2a37f08
2024-11-28 17:01:53 +08:00
hiyouga
1c3d86cd65 add qwq
Former-commit-id: 68a612115a
2024-11-28 08:50:57 +00:00
Azalea
f5e6e25a1b [+] Show the hostname
Former-commit-id: dfb953b1ad
2024-11-28 12:25:02 +08:00
wangdepeng
ae09c6c214 fix:tokenized_path not None and load_from_disk return Dataset Trigger stuck
Former-commit-id: 4424d4de8a
2024-11-27 16:44:42 +08:00
hoshi-hiyouga
265a5821de Merge pull request #6156 from hiyouga/hiyouga/add_o1
[data&model] add marco-o1, skywork-o1 and openo1

Former-commit-id: 86f41513c0
2024-11-27 14:36:01 +08:00
hiyouga
9822cb7bac fix dataset
Former-commit-id: 046b6fb118
2024-11-27 06:27:44 +00:00
hiyouga
d51d96d594 add skywork o1
Former-commit-id: ec9ff8caa2
2024-11-27 05:51:59 +00:00
hiyouga
09a3a59c88 Merge remote-tracking branch 'origin/main' into hiyouga/add_o1
Former-commit-id: b7c7f3066f
2024-11-27 05:36:41 +00:00
hoshi-hiyouga
dfa4e927dd Merge pull request #6157 from hiyouga/hiyouga/fix_ci
[ci] pin tokenizers version

Former-commit-id: 14d0d92bf3
2024-11-27 13:33:04 +08:00
hiyouga
61320965aa pin tokenizers version
Former-commit-id: b7d4cf2caf
2024-11-27 05:24:58 +00:00
hiyouga
ab3782b0fa add marco-o1 and openo1 dataset
Former-commit-id: 17afb7d410
2024-11-27 04:20:23 +00:00
hoshi-hiyouga
6cd90efb82 Merge pull request #6152 from hiyouga/hiyouga/add_num_proc_in_data_load
[data] add num_proc in load_dataset

Former-commit-id: b26c490ac3
2024-11-27 00:16:15 +08:00
hoshi-hiyouga
08ca40876a Merge pull request #6151 from hiyouga/hiyouga/fix_mllama
[model] fix mllama cross mask

Former-commit-id: 88f087c8b9
2024-11-27 00:07:54 +08:00
hiyouga
358708ee97 fix #6149
Former-commit-id: 362d579ce8
2024-11-26 16:03:02 +00:00
hiyouga
006022cadd fix mllama cross_mask
Former-commit-id: 598c22e43f
2024-11-26 15:56:58 +00:00
hoshi-hiyouga
e0325b1123 Merge pull request #6141 from hiyouga/hiyouga-patch-1
[misc] chore: lint

Former-commit-id: 00031b1a66
2024-11-25 23:02:11 +08:00
hoshi-hiyouga
118ffe50e3 lint
Former-commit-id: da9e4ddd26
2024-11-25 22:55:56 +08:00
hoshi-hiyouga
a6aeb98af6 Merge pull request #6140 from hiyouga/hiyouga/fix_mllama
[data] fix mllama plugin

Former-commit-id: 3924a3d6e9
2024-11-25 22:32:07 +08:00
hoshi-hiyouga
c0ffe68745 fix #6139
Former-commit-id: d87e16cf5c
2024-11-25 22:22:06 +08:00
hoshi-hiyouga
1a8c26a7d9 Merge pull request #6138 from hiyouga/hiyouga/update_data
[data] update dataset info

Former-commit-id: 3a1402a4ed
2024-11-25 21:47:23 +08:00
hoshi-hiyouga
4f1d5b6396 update dataset
Former-commit-id: 5214d3ea06
2024-11-25 21:47:04 +08:00
hoshi-hiyouga
697657271f Merge pull request #6137 from hiyouga/hiyouga/fix_mllama
[model] fix mllama hidden_size

Former-commit-id: 2b7157dc1d
2024-11-25 20:17:33 +08:00
hoshi-hiyouga
a489f10986 fix visual patch
Former-commit-id: 75b586c31a
2024-11-25 20:06:06 +08:00