hiyouga
d4e0010027
add qwen-coder and opencoder
...
Former-commit-id: 431ac4892c
2024-11-15 21:48:38 +08:00
codingma
d6b9a2024b
Merge pull request #6022 from codemayq/main
...
update wechat
Former-commit-id: 8e5aad3ffa
2024-11-14 10:03:46 +08:00
codemayq
625ae6f456
update wechat
...
Former-commit-id: fc1aa8f45c
2024-11-14 10:02:06 +08:00
XYZliang
1c1e48a570
Increase shm_size to 16GB in docker-compose.yml to optimize shared memory allocation for large-scale model fine-tuning tasks.
...
This pull request increases the shm_size parameter in docker-compose.yml to 16GB. The goal is to enhance the LLaMA-Factory framework’s performance for large model fine-tuning tasks by providing sufficient shared memory for efficient data loading and parallel processing.
This PR also addresses the issues discussed in [this comment](https://github.com/hiyouga/LLaMA-Factory/issues/4316#issuecomment-2466270708 ) regarding Shared Memory Limit error.
Former-commit-id: 64414905a3
2024-11-13 10:13:59 +08:00
hoshi-hiyouga
8ae2056b59
Merge pull request #5990 from hiyouga/hiyouga/dev_vllm
...
[generate] fix vllm config args
Former-commit-id: 3eebae892b
2024-11-11 14:10:35 +08:00
hoshi-hiyouga
9c394f11ef
fix #5988
...
Former-commit-id: 8d70edf39b
2024-11-11 13:57:14 +08:00
hoshi-hiyouga
662093b38c
Merge pull request #5984 from hiyouga/hiyouga/wechat
...
[readme] update wechat
Former-commit-id: 2176224f4b
2024-11-10 22:08:55 +08:00
hiyouga
e928f7fc4c
update wechat
...
Former-commit-id: f2a44e1a2a
2024-11-10 22:08:10 +08:00
hoshi-hiyouga
82344629af
Merge pull request #5982 from hiyouga/hiyouga/vllm_args
...
[args] add vllm config
Former-commit-id: 1ca6b1582f
2024-11-10 21:37:18 +08:00
hiyouga
0d18cca0db
add vllm config
...
Former-commit-id: 58ab4579dc
2024-11-10 21:28:18 +08:00
hoshi-hiyouga
0386fa6a4f
Merge pull request #5973 from JJJJerry/fix_vllm_generate
...
fix VllmEngine: 将inputs参数替换为prompt
Former-commit-id: 40a2fcc02d
2024-11-10 21:04:38 +08:00
hoshi-hiyouga
d7476aa55b
Update vllm_engine.py
...
Former-commit-id: a543bc478d
2024-11-10 20:57:00 +08:00
JJJJerry
d996bea1c7
fix VllmEngine: 将inputs参数替换为prompt
...
Former-commit-id: 1d04078bb5
2024-11-09 11:45:59 +08:00
hoshi-hiyouga
1e00de38cb
Merge pull request #5971 from hiyouga/hiyouga/fix_webui
...
[webui] fix extra args
Former-commit-id: adc5849ce7
2024-11-09 00:25:24 +08:00
hiyouga
d7e35ddcaa
fix extra args
...
Former-commit-id: eb294fed13
2024-11-09 00:24:27 +08:00
hoshi-hiyouga
162f7028fc
Merge pull request #5970 from hiyouga/hiyouga/fix_beam
...
[generation] fix vllm v0.6.3
Former-commit-id: 39e330196d
2024-11-08 23:58:15 +08:00
hiyouga
97f4451912
fix #5966
...
Former-commit-id: 8f3a32286e
2024-11-08 23:49:16 +08:00
hoshi-hiyouga
265875fffd
Merge pull request #5929 from hiyouga/hiyouga/dev_wechat
...
[readme] update wechat
Former-commit-id: 707ff5a370
2024-11-04 16:44:31 +08:00
hiyouga
bf2959c175
update wechat
...
Former-commit-id: 882635cac3
2024-11-04 08:43:21 +00:00
hoshi-hiyouga
2e6dd72539
Merge pull request #5927 from hiyouga/hiyouga/dev_fixmmchat
...
[fix] chat engines
Former-commit-id: bcbd1bebb0
2024-11-04 16:36:23 +08:00
hiyouga
1598e5d355
add image input type
...
Former-commit-id: ffa39ba3db
2024-11-04 08:27:20 +00:00
hiyouga
2360d63ebc
fix chat engines
...
Former-commit-id: 8c88065c38
2024-11-04 08:18:12 +00:00
hoshi-hiyouga
d68af5b04a
Merge pull request #5926 from hiyouga/hiyouga/dev_deps
...
[version] update datasets version
Former-commit-id: 22ee197a40
2024-11-04 16:04:00 +08:00
hiyouga
3730fc046f
update datasets version
...
Former-commit-id: c5fae465ec
2024-11-04 07:52:26 +00:00
steven
7f7ee0a660
support granite3 models
...
Former-commit-id: 6eefb4d7d2
2024-11-04 10:35:03 +08:00
hoshi-hiyouga
e3fb3c313c
Merge pull request #5914 from hiyouga/hiyouga/dev_read
...
[misc] update readme
Former-commit-id: 04c10d2e80
2024-11-02 21:44:10 +08:00
hoshi-hiyouga
9d463b611c
Merge pull request #5475 from menibrief/main
...
Fix phi-3-small issues
Former-commit-id: 9a42c5f76f
2024-11-02 21:31:34 +08:00
hiyouga
feb547aa99
fix phi3 template
...
Former-commit-id: 2e843d989e
2024-11-02 21:31:23 +08:00
hiyouga
f05685c7cf
update readme
...
Former-commit-id: e7ed5091e1
2024-11-02 21:28:04 +08:00
hoshi-hiyouga
8c2b7aa1ab
update template
...
Former-commit-id: 478cbb1aa7
2024-11-02 21:21:22 +08:00
hoshi-hiyouga
d99e164cad
Merge branch 'main' into main
...
Former-commit-id: 5f14910910
2024-11-02 21:20:27 +08:00
hoshi-hiyouga
7dbb338df7
Merge pull request #5913 from hiyouga/hiyouga/dev_metrics
...
[train] support gather DPO metrics, fix return output
Former-commit-id: 344ff76d26
2024-11-02 21:13:43 +08:00
hiyouga
604f4005c9
fix webchat
...
Former-commit-id: ba10d54bf9
2024-11-02 21:04:18 +08:00
hiyouga
c2766af6f4
fix dpo metrics
...
Former-commit-id: 4270f7dfb9
2024-11-02 20:59:01 +08:00
hoshi-hiyouga
e7b11e4fdb
Merge pull request #5880 from sd3ntato/make-image-parametric
...
make base image parametric.
Former-commit-id: 07e5088851
2024-11-02 20:26:14 +08:00
hoshi-hiyouga
5ad86fc71d
Update Dockerfile
...
Former-commit-id: 5e8a619d1d
2024-11-02 20:20:26 +08:00
hoshi-hiyouga
6f79974e8b
Merge pull request #5910 from Cuiyn/index
...
Support Index series models.
Former-commit-id: c58cc22d06
2024-11-02 20:16:54 +08:00
Cuiyn
51177c933a
fix: rename to Index-1.9B-Charater-Chat and Index-1.9B-Chat-32K
...
Former-commit-id: ecca9db66b
2024-11-02 20:04:14 +08:00
hoshi-hiyouga
0f53217bbc
Merge pull request #5912 from hiyouga/hiyouga/dev_logging
...
[misc] support rank0 logger
Former-commit-id: 83535bbe8b
2024-11-02 18:48:41 +08:00
hiyouga
e83cb17f97
support rank0 logger
...
Former-commit-id: c38aa29336
2024-11-02 18:31:04 +08:00
Cuiyn
7806bde8ad
Add support for Index
...
Former-commit-id: a15a69ab44
2024-11-02 13:45:27 +08:00
hoshi-hiyouga
4b2c47fcae
Merge pull request #5909 from hiyouga/hiyouga/dev2
...
[data] support auto convert for single image, add image_dir argument
Former-commit-id: bd08b8c441
2024-11-02 13:43:04 +08:00
hoshi-hiyouga
33e8bfc3ae
Merge pull request #5907 from hiyouga/hiyouga/dev
...
[data] fix template replace behavior
Former-commit-id: 8408339d83
2024-11-02 13:42:53 +08:00
hiyouga
ac677205c9
fix #5904
...
Former-commit-id: bfe1abd7af
2024-11-02 13:08:15 +08:00
hiyouga
7fa46a24df
fix #5883
...
Former-commit-id: 24da9f59b0
2024-11-02 13:06:34 +08:00
hoshi-hiyouga
7555c54c9f
Merge pull request #5906 from hiyouga/dev
...
[test] update tests
Former-commit-id: 3ef7d590b1
2024-11-02 12:50:43 +08:00
hiyouga
3f7c874594
update tests
...
Former-commit-id: 93d3b8f43f
2024-11-02 12:41:44 +08:00
hoshi-hiyouga
25093c2d82
Merge pull request #5895 from hiyouga/dev
...
[inference] support multiple images
Former-commit-id: 0a55e60693
2024-11-01 16:52:55 +08:00
hiyouga
2eba98e152
add examples
...
Former-commit-id: e824b715ad
2024-11-01 08:41:54 +00:00
hiyouga
8ecc12ee2a
support multiimage inference
...
Former-commit-id: e80a481927
2024-11-01 07:25:20 +00:00
