2428 Commits

Author SHA1 Message Date
JieShen
d4bf81b36a add async call api
Former-commit-id: 4c61368600a6648ec20753a41536ad3c7986703b
2024-12-01 22:18:05 +08:00
JieShen
99265c7d2f add vllm_infer script
Former-commit-id: 961e8c2d2e5505de14702cf8609d54b4f3a23b1e
2024-11-29 14:22:20 +08:00
hoshi-hiyouga
f4729904f2 Merge pull request #6175 from hiyouga/hiyouga/add_qwq
[model] add QwQ

Former-commit-id: f2b2a37f0819bb344998a9059c02b97ca5a5ae74
2024-11-28 17:01:53 +08:00
hiyouga
1c3d86cd65 add qwq
Former-commit-id: 68a612115aebba51695d22be4397c16c86f3b40a
2024-11-28 08:50:57 +00:00
hoshi-hiyouga
265a5821de Merge pull request #6156 from hiyouga/hiyouga/add_o1
[data&model] add marco-o1, skywork-o1 and openo1

Former-commit-id: 86f41513c04424f8f4ccfeca78d28a4cc7ba8728
2024-11-27 14:36:01 +08:00
hiyouga
9822cb7bac fix dataset
Former-commit-id: 046b6fb118e3ea75062c6a759720a1759639e93c
2024-11-27 06:27:44 +00:00
hiyouga
d51d96d594 add skywork o1
Former-commit-id: ec9ff8caa2637965d41937cce7de4e4d51d054eb
2024-11-27 05:51:59 +00:00
hiyouga
09a3a59c88 Merge remote-tracking branch 'origin/main' into hiyouga/add_o1
Former-commit-id: b7c7f3066f7c33fc6e52d9d1d57b831966e53c7f
2024-11-27 05:36:41 +00:00
hoshi-hiyouga
dfa4e927dd Merge pull request #6157 from hiyouga/hiyouga/fix_ci
[ci] pin tokenizers version

Former-commit-id: 14d0d92bf38ac09f0b7f7f9484345310e32fbbe6
2024-11-27 13:33:04 +08:00
hiyouga
61320965aa pin tokenizers version
Former-commit-id: b7d4cf2caf2d02f7d16bab3f0ec8bf0108b7be75
2024-11-27 05:24:58 +00:00
hiyouga
ab3782b0fa add marco-o1 and openo1 dataset
Former-commit-id: 17afb7d4103499a9a090a6624896cfa123e9e1d6
2024-11-27 04:20:23 +00:00
hoshi-hiyouga
6cd90efb82 Merge pull request #6152 from hiyouga/hiyouga/add_num_proc_in_data_load
[data] add num_proc in load_dataset

Former-commit-id: b26c490ac3a0a8a6342f940eb6ccb7b8b6d78f93
2024-11-27 00:16:15 +08:00
hoshi-hiyouga
08ca40876a Merge pull request #6151 from hiyouga/hiyouga/fix_mllama
[model] fix mllama cross mask

Former-commit-id: 88f087c8b9cb22fa4f4e4f867ea3d71dd8606a98
2024-11-27 00:07:54 +08:00
hiyouga
358708ee97 fix #6149
Former-commit-id: 362d579ce83e63007e6f89f264d06d2698671cc6
2024-11-26 16:03:02 +00:00
hiyouga
006022cadd fix mllama cross_mask
Former-commit-id: 598c22e43f3f10a335933339cc612744c4835eb0
2024-11-26 15:56:58 +00:00
hoshi-hiyouga
e0325b1123 Merge pull request #6141 from hiyouga/hiyouga-patch-1
[misc] chore: lint

Former-commit-id: 00031b1a66ade1c2665ce7a069a756cccbcb07f1
2024-11-25 23:02:11 +08:00
hoshi-hiyouga
118ffe50e3 lint
Former-commit-id: da9e4ddd26ebd6e7eb266aa0bef7505465a6b119
2024-11-25 22:55:56 +08:00
hoshi-hiyouga
a6aeb98af6 Merge pull request #6140 from hiyouga/hiyouga/fix_mllama
[data] fix mllama plugin

Former-commit-id: 3924a3d6e9d761dd51eca92afed7f299be71e42d
2024-11-25 22:32:07 +08:00
hoshi-hiyouga
c0ffe68745 fix #6139
Former-commit-id: d87e16cf5c46dadbfcda7b8ac8edfef6a012f97f
2024-11-25 22:22:06 +08:00
hoshi-hiyouga
1a8c26a7d9 Merge pull request #6138 from hiyouga/hiyouga/update_data
[data] update dataset info

Former-commit-id: 3a1402a4ed1fb958cd38903d016b9a87dc85d4cd
2024-11-25 21:47:23 +08:00
hoshi-hiyouga
4f1d5b6396 update dataset
Former-commit-id: 5214d3ea06ac73f1179ca9574d7c7030c92b5ee1
2024-11-25 21:47:04 +08:00
hoshi-hiyouga
697657271f Merge pull request #6137 from hiyouga/hiyouga/fix_mllama
[model] fix mllama hidden_size

Former-commit-id: 2b7157dc1dfe154146012270e046f311d3b4e4df
2024-11-25 20:17:33 +08:00
hoshi-hiyouga
a489f10986 fix visual patch
Former-commit-id: 75b586c31acf47d1bd28e04566ffd1d954e45596
2024-11-25 20:06:06 +08:00
hoshi-hiyouga
f48d07cd6c fix #6136
Former-commit-id: 0516e556a71a22b8767b17734adb94eb127e7e6f
2024-11-25 19:43:42 +08:00
hoshi-hiyouga
f1a1fb675b Merge pull request #6127 from hiyouga/hiyouga/dev_version
[misc] set dev version

Former-commit-id: 44125da5a57a51d41e67522d32d9c15910d6ae9a
2024-11-25 01:42:29 +08:00
hiyouga
f8f3638bff set dev version
Former-commit-id: b0ccc2ee86b74548c55e15da525bb9f22db8188a
2024-11-25 01:36:49 +08:00
hoshi-hiyouga
1176cd6779 Merge pull request #6124 from hiyouga/hiyouga/release
[release] release v0.9.1

Former-commit-id: 18daf10eda815e29ffd7bc0f2423f0c6d12b7b31
v0.9.1
2024-11-25 00:20:02 +08:00
hoshi-hiyouga
4165c4414d Merge pull request #6126 from hiyouga/hiyouga/fix_vllm
[inference] fix vllm

Former-commit-id: 07059a7ca4bc9d79465639b1c22d8ccde5e81244
2024-11-25 00:19:54 +08:00
hoshi-hiyouga
7f74e54bee Merge pull request #6010 from XYZliang/fix-#4316
Increase shm_size to 16GB in docker-compose.yml

Former-commit-id: 8e9f4617f293077b959acc553d26a93c91c2fe6f
2024-11-25 00:16:42 +08:00
hoshi-hiyouga
3f3eeedca0 Merge pull request #6125 from hiyouga/hiyouga/fix_cli
[cli] remove shell=True in cli

Former-commit-id: 57953c8ff64ee91a8525abb0aa1d4a597ffe6ab3
2024-11-25 00:07:35 +08:00
hiyouga
65699c29d4 fix vllm
Former-commit-id: 13ee1f5cec815590c5d290f0aca264e6d16ddd5d
2024-11-25 00:07:24 +08:00
hiyouga
a04538e70b fix cli
Former-commit-id: 8792d78c82e83f319c584079d7ebfa2dccbb346a
2024-11-24 23:56:21 +08:00
hiyouga
708116a5f3 release v0.9.1
Former-commit-id: d622f8fdec744ca98035913eac13e1340949a72a
2024-11-24 23:48:41 +08:00
hoshi-hiyouga
5a7ff02806 Merge pull request #6123 from hiyouga/hiyouga/fix_qwen2vl_vllm
[inference] fix qwen2vl vllm infer

Former-commit-id: 0ce173e2a41f070051cbb7d50180a2f3b7cae89d
2024-11-24 23:42:11 +08:00
hiyouga
dcc67ac1a5 fix qwen2vl vllm infer
Former-commit-id: fa50fc470e46010214f0e509ef75a6c167caac7f
2024-11-24 23:27:24 +08:00
hoshi-hiyouga
7ed5a712f8 Merge pull request #6121 from hiyouga/hiyouga/readme
[readme] update readme

Former-commit-id: f2bfa80d55e661e2263cfffd2a16109442d47e78
2024-11-24 03:28:09 +08:00
hiyouga
7eaafe08bc update readme
Former-commit-id: a89ad72d039d03836f98625eaf438f332368a823
2024-11-23 19:27:18 +00:00
hoshi-hiyouga
503327b5bb Merge pull request #6120 from hiyouga/hiyouga/fix_ci
[test] fix ci

Former-commit-id: 5f310d92791c1a7ef0b1373b098323eacf653857
2024-11-24 03:21:11 +08:00
hiyouga
4bba121f43 fix ci
Former-commit-id: b52c38350d6092e8158484ca01da19ed016236fc
2024-11-23 19:13:32 +00:00
hoshi-hiyouga
8dff6f630c Merge pull request #5555 from marko1616/feat/llama3.2vl
Support llama3.2 vision

Former-commit-id: e68ef89600e85b1f067ca6cc70459e9a7ac77b8a
2024-11-24 02:49:07 +08:00
hiyouga
253752ccca add forbidden modules
Former-commit-id: df477370dc67315effac1a8f48068c4e9c4067a5
2024-11-23 18:34:15 +00:00
hiyouga
e99031daa4 fix inputs
Former-commit-id: 446441fdb020b5a102480251cb8536dd8b3f8f99
2024-11-23 18:26:02 +00:00
marko1616
23fc0c863e Linter.
Former-commit-id: b1e43e56db4d898c0d6d27b703b82a1eb9af70c2
2024-11-23 16:09:04 +00:00
marko1616
3295519099 Tiny fix.
Former-commit-id: 8372c5e3771c42f225d7bd80a758af920f80e893
2024-11-23 16:09:01 +00:00
marko1616
20faaf3418 Support llama3.2vl.
Former-commit-id: 3f2c056253c651e8e614c787e2045f4232e82666
2024-11-23 16:07:35 +00:00
hoshi-hiyouga
24419dd3f1 Merge commit from fork
[patch] Patch remote OS command injection vulnerability

Former-commit-id: b3aa80d54a67da45e9e237e349486fb9c162b2ac
2024-11-21 22:39:44 +08:00
hoshi-hiyouga
1eaaa85980 do not split save_cmd ret value
Former-commit-id: d20b97e7e9514e68c33d0428512fd21b548c1131
2024-11-21 22:30:23 +08:00
superboy-zjc
e272f87849 [patch] Patch remote OS command injection vulnerability
Former-commit-id: aa6a174d6822340022433c5ba38182b4932adecb
2024-11-21 01:52:12 -05:00
hoshi-hiyouga
4d49dc0559 Merge pull request #6098 from hiyouga/hiyouga-patch-2
update wechat

Former-commit-id: c8f199881aa954025f9b022f0f6b4fa7136466ad
2024-11-21 14:26:03 +08:00
hoshi-hiyouga
527ea7297b update wechat
Former-commit-id: acf491fc3a4e3d82608299dbd72271ea65045338
2024-11-21 14:25:33 +08:00