9 Commits

Author SHA1 Message Date
hoshi-hiyouga
519ac92803
[assets] update docker files (#8176) 2025-05-27 18:15:23 +08:00
hoshi-hiyouga
5a0fd22c05 [assets] update readme (#7209)
Former-commit-id: cdf8fc647819523eca8139ba62a510c3078b694d
2025-03-07 17:27:49 +08:00
leo-pony
e86cb8a4fa [npu] update cann base image and torch 2.4 (#7061)
* Update base npu container image version:The Python version required for Hugging Face Transformers is >= python3.10

* Fix the bug: arg type of INSTALL_DEEPSPEED shoud been string now.

* Update Ascend CANN, CANN-Kernel and corresponding torch and torch-npu version

* Upgrade torch-npu needs packages' version: torch==2.1.0 and torch-npu==2.4.0.post2

Former-commit-id: acc52e0fe75d59c2581ef45346ebfbffe45f762b
2025-02-25 23:32:01 +08:00
XYZliang
1c1e48a570 Increase shm_size to 16GB in docker-compose.yml to optimize shared memory allocation for large-scale model fine-tuning tasks.
This pull request increases the shm_size parameter in docker-compose.yml to 16GB. The goal is to enhance the LLaMA-Factory framework’s performance for large model fine-tuning tasks by providing sufficient shared memory for efficient data loading and parallel processing.

This PR also addresses the issues discussed in [this comment](https://github.com/hiyouga/LLaMA-Factory/issues/4316#issuecomment-2466270708) regarding Shared Memory Limit error.


Former-commit-id: 64414905a3728abf3c51968177ffc42cfc653310
2024-11-13 10:13:59 +08:00
hiyouga
e90a1199da tiny fix
Former-commit-id: 3af57795dda5d236200bad4aa3f2e29ae8930fe2
2024-10-11 23:51:54 +08:00
MengqingCao
7c7d6614d8 fix docker-compose path
Former-commit-id: 106647a99d36c4a624511edf651cf5f7624c4c9a
2024-06-26 02:15:00 +00:00
hiyouga
dafc9268bc fix #4419
Former-commit-id: efb81b25ecd5cb9f4cfda8f2da8b159e4ab26a90
2024-06-25 01:51:29 +08:00
hoshi-hiyouga
af5b2b9299 Update docker-compose.yml
Former-commit-id: 721acd87688b3edd41d2e1890971eb387afc1b6e
2024-06-25 00:54:28 +08:00
MengqingCao
3b499948a5 update docker files
1. add docker-npu (Dockerfile and docker-compose.yml)
  2. move cuda docker to docker-cuda and tiny changes to adapt to the new path


Former-commit-id: d7207e8ad10c7df6dcb1f5e59ff8eb06f9d77e67
2024-06-24 10:57:36 +00:00