2402 Commits

Author SHA1 Message Date
hoshi-hiyouga
1176cd6779 Merge pull request #6124 from hiyouga/hiyouga/release
[release] release v0.9.1

Former-commit-id: 18daf10eda815e29ffd7bc0f2423f0c6d12b7b31
v0.9.1
2024-11-25 00:20:02 +08:00
hoshi-hiyouga
4165c4414d Merge pull request #6126 from hiyouga/hiyouga/fix_vllm
[inference] fix vllm

Former-commit-id: 07059a7ca4bc9d79465639b1c22d8ccde5e81244
2024-11-25 00:19:54 +08:00
hoshi-hiyouga
7f74e54bee Merge pull request #6010 from XYZliang/fix-#4316
Increase shm_size to 16GB in docker-compose.yml

Former-commit-id: 8e9f4617f293077b959acc553d26a93c91c2fe6f
2024-11-25 00:16:42 +08:00
hoshi-hiyouga
3f3eeedca0 Merge pull request #6125 from hiyouga/hiyouga/fix_cli
[cli] remove shell=True in cli

Former-commit-id: 57953c8ff64ee91a8525abb0aa1d4a597ffe6ab3
2024-11-25 00:07:35 +08:00
hiyouga
65699c29d4 fix vllm
Former-commit-id: 13ee1f5cec815590c5d290f0aca264e6d16ddd5d
2024-11-25 00:07:24 +08:00
hiyouga
a04538e70b fix cli
Former-commit-id: 8792d78c82e83f319c584079d7ebfa2dccbb346a
2024-11-24 23:56:21 +08:00
hiyouga
708116a5f3 release v0.9.1
Former-commit-id: d622f8fdec744ca98035913eac13e1340949a72a
2024-11-24 23:48:41 +08:00
hoshi-hiyouga
5a7ff02806 Merge pull request #6123 from hiyouga/hiyouga/fix_qwen2vl_vllm
[inference] fix qwen2vl vllm infer

Former-commit-id: 0ce173e2a41f070051cbb7d50180a2f3b7cae89d
2024-11-24 23:42:11 +08:00
hiyouga
dcc67ac1a5 fix qwen2vl vllm infer
Former-commit-id: fa50fc470e46010214f0e509ef75a6c167caac7f
2024-11-24 23:27:24 +08:00
hoshi-hiyouga
7ed5a712f8 Merge pull request #6121 from hiyouga/hiyouga/readme
[readme] update readme

Former-commit-id: f2bfa80d55e661e2263cfffd2a16109442d47e78
2024-11-24 03:28:09 +08:00
hiyouga
7eaafe08bc update readme
Former-commit-id: a89ad72d039d03836f98625eaf438f332368a823
2024-11-23 19:27:18 +00:00
hoshi-hiyouga
503327b5bb Merge pull request #6120 from hiyouga/hiyouga/fix_ci
[test] fix ci

Former-commit-id: 5f310d92791c1a7ef0b1373b098323eacf653857
2024-11-24 03:21:11 +08:00
hiyouga
4bba121f43 fix ci
Former-commit-id: b52c38350d6092e8158484ca01da19ed016236fc
2024-11-23 19:13:32 +00:00
hoshi-hiyouga
8dff6f630c Merge pull request #5555 from marko1616/feat/llama3.2vl
Support llama3.2 vision

Former-commit-id: e68ef89600e85b1f067ca6cc70459e9a7ac77b8a
2024-11-24 02:49:07 +08:00
hiyouga
253752ccca add forbidden modules
Former-commit-id: df477370dc67315effac1a8f48068c4e9c4067a5
2024-11-23 18:34:15 +00:00
hiyouga
e99031daa4 fix inputs
Former-commit-id: 446441fdb020b5a102480251cb8536dd8b3f8f99
2024-11-23 18:26:02 +00:00
marko1616
23fc0c863e Linter.
Former-commit-id: b1e43e56db4d898c0d6d27b703b82a1eb9af70c2
2024-11-23 16:09:04 +00:00
marko1616
3295519099 Tiny fix.
Former-commit-id: 8372c5e3771c42f225d7bd80a758af920f80e893
2024-11-23 16:09:01 +00:00
marko1616
20faaf3418 Support llama3.2vl.
Former-commit-id: 3f2c056253c651e8e614c787e2045f4232e82666
2024-11-23 16:07:35 +00:00
hoshi-hiyouga
24419dd3f1 Merge commit from fork
[patch] Patch remote OS command injection vulnerability

Former-commit-id: b3aa80d54a67da45e9e237e349486fb9c162b2ac
2024-11-21 22:39:44 +08:00
hoshi-hiyouga
1eaaa85980 do not split save_cmd ret value
Former-commit-id: d20b97e7e9514e68c33d0428512fd21b548c1131
2024-11-21 22:30:23 +08:00
superboy-zjc
e272f87849 [patch] Patch remote OS command injection vulnerability
Former-commit-id: aa6a174d6822340022433c5ba38182b4932adecb
2024-11-21 01:52:12 -05:00
hoshi-hiyouga
4d49dc0559 Merge pull request #6098 from hiyouga/hiyouga-patch-2
update wechat

Former-commit-id: c8f199881aa954025f9b022f0f6b4fa7136466ad
2024-11-21 14:26:03 +08:00
hoshi-hiyouga
527ea7297b update wechat
Former-commit-id: acf491fc3a4e3d82608299dbd72271ea65045338
2024-11-21 14:25:33 +08:00
hoshi-hiyouga
302e4e22bf Merge pull request #6078 from wtmlon/support-efficient-tokens-calculation
support effective tokens calculation on sft/dpo

Former-commit-id: bd639a137e6f46e1a0005cc91572f5f1ec894f74
2024-11-20 13:43:15 +08:00
hoshi-hiyouga
2ea2bc7c71 Merge pull request #6083 from hiyouga/hiyouga-patch
[asset] update wechat

Former-commit-id: fdcc78b639596ecae135d2ae726ff35a40b6f113
2024-11-20 11:46:54 +08:00
hiyouga
505edd4da0 update wechat
Former-commit-id: 2f959c73b59302f3b7cc8a07eae06326d95e7e1d
2024-11-20 10:57:30 +08:00
Ting
e27a0c3d53 code refactor
Former-commit-id: 40627c601efc9f144a227dded8c6b40babff4e8b
2024-11-19 20:33:18 +08:00
Ting
32656bc50d update
Former-commit-id: f566ecc8d1f04615351acbe4f8480b75b2daed42
2024-11-19 19:12:10 +08:00
Ting
bf2b8df540 update
Former-commit-id: ef6e14550dd76810285cee9c268590d1d9423e54
2024-11-19 19:10:07 +08:00
Ting
7ad5b5c088 support efficient tokens calculation on sft/dpo
Former-commit-id: b9f00286d8a017ed9fd2876986da3b4d7034ef07
2024-11-19 17:15:47 +08:00
hoshi-hiyouga
a2a9936e1f Merge pull request #6065 from hiyouga/hiyouga-patch-1
[misc] fix dep package version

Former-commit-id: 9c0f6556eeeef4f24b589c15aebfd68fd6f998c6
2024-11-18 21:13:59 +08:00
hoshi-hiyouga
618a8e6c9f fix #6061
Former-commit-id: 4ac5b97011225b1fd5fa741c1335948d721489ac
2024-11-18 20:56:44 +08:00
hoshi-hiyouga
acd70faf17 Merge pull request #6052 from hiyouga/hiyouga-patch-1
[trainer] fix DPO metrics

Former-commit-id: 45f32916ce3e0f1d242b91bbf9dbce2c0200f82d
2024-11-16 16:20:12 +08:00
hoshi-hiyouga
9815d1712c fix #6050
Former-commit-id: dc828218726704ff0453a2d13535663ac6ad7833
2024-11-16 16:11:16 +08:00
hoshi-hiyouga
e3a0640659 Merge pull request #6046 from hiyouga/hiyouga/add_code_model
[model] add qwen-coder and opencoder

Former-commit-id: 6c0847899d8b4f36bc362500f6ecb1c9cc14d7ea
2024-11-15 21:58:03 +08:00
hiyouga
d4e0010027 add qwen-coder and opencoder
Former-commit-id: 431ac4892cdddba802a02b285031a797e278d0eb
2024-11-15 21:48:38 +08:00
codingma
d6b9a2024b Merge pull request #6022 from codemayq/main
update wechat

Former-commit-id: 8e5aad3ffa129070a705bd7709f690d7cb6a1978
2024-11-14 10:03:46 +08:00
codemayq
625ae6f456 update wechat
Former-commit-id: fc1aa8f45c46205ad23e827c493a55ca9f0f06c9
2024-11-14 10:02:06 +08:00
XYZliang
1c1e48a570 Increase shm_size to 16GB in docker-compose.yml to optimize shared memory allocation for large-scale model fine-tuning tasks.
This pull request increases the shm_size parameter in docker-compose.yml to 16GB. The goal is to enhance the LLaMA-Factory framework’s performance for large model fine-tuning tasks by providing sufficient shared memory for efficient data loading and parallel processing.

This PR also addresses the issues discussed in [this comment](https://github.com/hiyouga/LLaMA-Factory/issues/4316#issuecomment-2466270708) regarding Shared Memory Limit error.


Former-commit-id: 64414905a3728abf3c51968177ffc42cfc653310
2024-11-13 10:13:59 +08:00
hoshi-hiyouga
8ae2056b59 Merge pull request #5990 from hiyouga/hiyouga/dev_vllm
[generate] fix vllm config args

Former-commit-id: 3eebae892be74e6d9d4e7d1f6f1fae00080957f9
2024-11-11 14:10:35 +08:00
hoshi-hiyouga
9c394f11ef fix #5988
Former-commit-id: 8d70edf39bce7cb7be272f0bd2820306adf093ad
2024-11-11 13:57:14 +08:00
hoshi-hiyouga
662093b38c Merge pull request #5984 from hiyouga/hiyouga/wechat
[readme] update wechat

Former-commit-id: 2176224f4b672f623624e906e983dfd892f9f903
2024-11-10 22:08:55 +08:00
hiyouga
e928f7fc4c update wechat
Former-commit-id: f2a44e1a2ad9c7029100dc76dd3abca47de734c4
2024-11-10 22:08:10 +08:00
hoshi-hiyouga
82344629af Merge pull request #5982 from hiyouga/hiyouga/vllm_args
[args] add vllm config

Former-commit-id: 1ca6b1582fe5743434cba855e4e7fbec3810ab1f
2024-11-10 21:37:18 +08:00
hiyouga
0d18cca0db add vllm config
Former-commit-id: 58ab4579dc81a1dcea2bf5938ba3f3116cecfc76
2024-11-10 21:28:18 +08:00
hoshi-hiyouga
0386fa6a4f Merge pull request #5973 from JJJJerry/fix_vllm_generate
fix VllmEngine: 将inputs参数替换为prompt

Former-commit-id: 40a2fcc02dad2f1633c117d457651b221b8c5ae0
2024-11-10 21:04:38 +08:00
hoshi-hiyouga
d7476aa55b Update vllm_engine.py
Former-commit-id: a543bc478dfb3472d5d81e2f81922d5ab3b90373
2024-11-10 20:57:00 +08:00
JJJJerry
d996bea1c7 fix VllmEngine: 将inputs参数替换为prompt
Former-commit-id: 1d04078bb5d460f0cb3d26798bd2f0e43c8a0467
2024-11-09 11:45:59 +08:00
hoshi-hiyouga
1e00de38cb Merge pull request #5971 from hiyouga/hiyouga/fix_webui
[webui] fix extra args

Former-commit-id: adc5849ce75cc8eda800c73c59b1f44d3108e992
2024-11-09 00:25:24 +08:00