Kingsley
13170577b2
[feat] support megatron-LM training by mcore_adapter ( #9237 )
...
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Yaowei Zheng <hiyouga@buaa.edu.cn>
2025-10-26 16:21:30 +08:00
Yaowei Zheng
4b0ec83928
[deps] bump transformers to 4.49.0 ( #8564 )
2025-07-07 20:31:50 +08:00
Redwood-Digital
1b1ec9bfb6
[docs] add nvidia-container-toolkit to Linux Docker setup instructions ( #8557 )
2025-07-06 19:37:08 +08:00
Yaowei Zheng
ed70f8d5a2
[assets] fix npu docker ( #8298 )
2025-06-05 19:09:20 +08:00
Yaowei Zheng
e9fe9cee29
[assets] update docker files ( #8291 )
2025-06-04 23:30:46 +08:00
hoshi-hiyouga
83a9ff5853
[assets] fix docker images ( #8203 )
2025-05-28 22:26:05 +08:00
hoshi-hiyouga
dbc9f5a5d9
[assets] update Dockerfile ( #8201 )
2025-05-28 20:20:59 +08:00
hoshi-hiyouga
4d3ffa2ec4
[assets] fix docker image ( #8180 )
2025-05-27 19:01:31 +08:00
hoshi-hiyouga
00974a3169
[assets] update docker files ( #8176 )
2025-05-27 18:15:23 +08:00
rumichi
3612946dd9
[docker] upgrade to torch 2.6 ( #7442 )
2025-03-23 21:18:08 +08:00
hoshi-hiyouga
9adc0a2c3f
[assets] update readme ( #7209 )
...
Former-commit-id: d1631b38dad9ba3d41aebbb00e3500eb79b9e8e9
2025-03-07 17:27:49 +08:00
hiyouga
0eeae9061c
update wechat
...
Former-commit-id: 11a9d96a042e8afd972e0bf2fa3e51f95e4799ec
2025-01-04 07:59:57 +00:00
shibingli@yeah.net
58bc6943dc
Add ARG HTTP_PROXY in Dockerfile to support HTTP proxy during image building.
...
Former-commit-id: c46af4c45f96f1942dfaf77bdbdbe5d0fe85a387
2024-12-27 18:31:14 +08:00
shibingli@yeah.net
2dedf7b401
Add ARG HTTP_PROXY in Dockerfile to support HTTP proxy during image building.This commit introduces an ARG parameter named HTTP_PROXY in the Dockerfile. This addition allows for the configuration of an HTTP proxy, facilitating image building in environments with network restrictions.
...
Former-commit-id: d59fe30bca636bc2ca132d50172dba0032cecb6b
2024-12-27 18:17:17 +08:00
XYZliang
25da686758
Increase shm_size to 16GB in docker-compose.yml to optimize shared memory allocation for large-scale model fine-tuning tasks.
...
This pull request increases the shm_size parameter in docker-compose.yml to 16GB. The goal is to enhance the LLaMA-Factory framework’s performance for large model fine-tuning tasks by providing sufficient shared memory for efficient data loading and parallel processing.
This PR also addresses the issues discussed in [this comment](https://github.com/hiyouga/LLaMA-Factory/issues/4316#issuecomment-2466270708 ) regarding Shared Memory Limit error.
Former-commit-id: de2616d103b4bdc2458874068b1a223c7de82b4e
2024-11-13 10:13:59 +08:00
hoshi-hiyouga
1ed921bff7
Update Dockerfile
...
Former-commit-id: 89a1c1eb6d717b20107c06a645652b87fba388e8
2024-11-02 20:20:26 +08:00
Valerio Mariani
a2d7d6a518
make base image parametric.
...
default `BASE_IMAGE` is nvcr.io/nvidia/pytorch:24.02-py3 for retro-compatibility
Former-commit-id: db8d00536acb02b29d10a3d735438d194656ece3
2024-10-30 21:53:32 +01:00
hiyouga
c7efc7f2ed
tiny fix
...
Former-commit-id: 1fe424323b212094856f423351dc2a15774d39c3
2024-10-11 23:51:54 +08:00
StrangeBytesDev
111c644bf1
Add additional install options to Dockerfiles
...
Former-commit-id: 5310af2f2ac8d226b95785d6b1eb0632312871a7
2024-09-24 16:54:46 -07:00
hzhaoy
485b8dc18b
fix #4780
...
Former-commit-id: 15f73c41d556c5f8d989697d774725a88d36f1b4
2024-07-12 00:25:48 +08:00
hzhaoy
875f9078d1
fix #4779
...
Former-commit-id: 0c8cbf9ea57292de5e222618f86e1fc5379fe008
2024-07-12 00:15:15 +08:00
hiyouga
a1437c15f7
fix docker flashattn
...
Former-commit-id: 0966f5d4616a3877a6b921976dc39e8799831d36
2024-06-28 01:28:59 +08:00
hiyouga
95bf795de4
fix docker file
...
Former-commit-id: 688f02decb1185deb74b26444f7643cab7d355c1
2024-06-27 20:29:16 +08:00
hiyouga
bf99223a80
tiny fix
...
Former-commit-id: c1a78a3a9f8ab9d57577cee37f9c457d60863ba2
2024-06-27 20:14:48 +08:00
hoshi-hiyouga
727c7b0dc6
Merge pull request #4461 from hzhaoy/feature/support-flash-attn
...
support flash-attn in Dockerfile
Former-commit-id: e30a47ab5bda9303c8a2eb814caf0dd40c01b125
2024-06-27 20:05:26 +08:00
hzhaoy
b46bd07119
add flash-attn installation flag in Dockerfile
...
Former-commit-id: 2535044e95f6df628bd1f01e0eecb02407105d79
2024-06-27 00:13:30 +08:00
MengqingCao
e115d55585
fix docker-compose path
...
Former-commit-id: 9de3c24aa2a8268be06c8fef8e47f4fb6715c7ec
2024-06-26 02:15:00 +00:00
hzhaoy
daea86e047
support flash-attn in Dockerfile
...
Former-commit-id: 0dba000aa178f915cea7d75bf0c9d47e671a21d2
2024-06-25 15:13:07 +08:00
hiyouga
98fb3d015a
fix #4419
...
Former-commit-id: 15069c3ca814d5ac9beec77d914b71cde7ea0f47
2024-06-25 01:51:29 +08:00
hoshi-hiyouga
8360544d65
Update docker-compose.yml
...
Former-commit-id: 56af208074e6af5465183af85367e7edd89d5aa6
2024-06-25 00:46:47 +08:00
hoshi-hiyouga
b5cdef43a1
Update Dockerfile
...
Former-commit-id: c897a70501707c0f4c432bb8e9a9beeb4e8953a3
2024-06-25 00:46:08 +08:00
hoshi-hiyouga
2e5d521ed8
Update Dockerfile
...
Former-commit-id: 632681d8ece0eaac59bb364d971435a3bc6665a9
2024-06-24 23:41:35 +08:00
MengqingCao
af2607de1a
update docker files
...
1. add docker-npu (Dockerfile and docker-compose.yml)
2. move cuda docker to docker-cuda and tiny changes to adapt to the new path
Former-commit-id: 5431c1f18aadb072208efe7fd8e36fdcfbf807c2
2024-06-24 10:57:36 +00:00
