51 Commits

Author SHA1 Message Date
Butui Hu
83688b0b4d
[launcher] Add elastic and fault-tolerant training support (#8286)
Signed-off-by: Butui Hu <hot123tea123@gmail.com>
2025-06-05 16:40:03 +08:00
hoshi-hiyouga
c6bcca4c83
[example] update examples (#7964) 2025-05-06 17:24:25 +02:00
hoshi-hiyouga
a8430f4244
[misc] fix uv (#7913) 2025-04-30 07:45:03 +08:00
hoshi-hiyouga
a62cba3d05
[example] add bash usage (#7794) 2025-04-22 00:25:51 +08:00
Juanxi Tian
d128382d3c
[trainer] Add Muon Optimizer (#7749)
Co-authored-by: hoshi-hiyouga <hiyouga@buaa.edu.cn>
2025-04-21 23:38:37 +08:00
hoshi-hiyouga
278df4308d
[parser] support omegaconf (#7793) 2025-04-21 23:30:30 +08:00
hoshi-hiyouga
4831552856
[infer] set env for vllm ascend (#7745) 2025-04-17 01:08:55 +08:00
leo-pony
e1fdd6e2f8
[infer] support vllm-ascend (#7739) 2025-04-16 20:06:47 +08:00
Eric Tang
e515fe62de [example] fix path to ray example (#6906)
Former-commit-id: ee5fe216dc73a458431e1b689787a8ddabf8de17
2025-02-13 00:29:32 +08:00
hoshi-hiyouga
c6be9e242c [misc] support export ollama modelfile (#6899)
* support export ollama modelfile

* update config

* add system and num ctx

Former-commit-id: 9184a6e0ed7ff5f632c848f861bfa448c4cd06fc
2025-02-11 19:52:25 +08:00
hoshi-hiyouga
9ef85f8fc4 [optim] clean apollo (#6645)
* clean apollo code

* update readme

Former-commit-id: 7a04021d0461caea2c7b82169839340b7f51f463
2025-01-15 01:42:50 +08:00
hoshi-hiyouga
d8cba9464f [inference] fix stop token for object detection (#6624)
* fix stop token

* update minicpm data pipeline

* fix npu qlora examples

Former-commit-id: e3e2c8c689c54ebb2af264de808502e5a8ba0f2b
2025-01-13 21:34:20 +08:00
hiyouga
b4174021d6 refactor ray integration, support save ckpt
Former-commit-id: d8cac6f54663e6cffeddf2c65e3da454e7b86a75
2025-01-07 09:39:10 +00:00
hiyouga
6f1e450739 fix mrope
Former-commit-id: 2811814fc42fb214b3e8be1055f9f57ffd0ffb12
2024-12-12 15:08:17 +00:00
hiyouga
90fb5605c1 update examples
Former-commit-id: e5584dc7ba356264034c14ff7d8efcd3d50fa9a3
2024-12-05 08:48:25 +00:00
hiyouga
235cdcacee support batch infer in vllm
Former-commit-id: 1324d158f954d777f1fbf09f46149c372704b388
2024-12-04 13:50:00 +00:00
hiyouga
3f7c874594 update tests
Former-commit-id: 93d3b8f43faf4a81b809d2f7d897e39bdb5475c3
2024-11-02 12:41:44 +08:00
hiyouga
bfdcc6bacf add rlhf-v dataset
Former-commit-id: 8e49940746c1a6ff910f07dbefbec14af9d0f3c6
2024-09-01 22:57:41 +08:00
hiyouga
c883542583 add examples
Former-commit-id: e08045a9468986edf1e84001e6043db0ee2e5265
2024-08-30 21:43:19 +08:00
hiyouga
a83756b5e9 refactor mm training
Former-commit-id: 3382317e32f88ed377d3e7759bdeaf0f2559d22a
2024-08-30 02:14:31 +08:00
hiyouga
f8c11bd540 update examples
Former-commit-id: 0a690ada6f9f791e7d013eb89799975b12212ed0
2024-08-09 20:13:46 +08:00
hiyouga
5eacd17090 add adam_mini to readme
Former-commit-id: e2a28f51c635d64ff9de65a37087d89356bdedcc
2024-08-09 20:02:03 +08:00
hiyouga
6e03536dca update examples
Former-commit-id: d417e63f928048036717d51eba42be843c51dff2
2024-06-27 00:53:33 +08:00
hiyouga
004f289074 tiny fix
Former-commit-id: 2bf2863a58c93206f271de17d7dfcbcd6375cd73
2024-06-17 17:47:25 +08:00
hiyouga
f25b8626bf support pissa
Former-commit-id: 8c1046d78ac6c8f9429b73617e35e1eccb35138f
2024-06-16 01:08:12 +08:00
hiyouga
d4ce280fbc Update README.md
Former-commit-id: 2d43b8bb49057e14a9f79146acdcc0cfa94bcc5a
2024-06-13 16:02:21 +08:00
hiyouga
f81a839197 update examples
Former-commit-id: 892e561c28cbbab1ee38a8022ddd9b397c873563
2024-06-13 03:26:10 +08:00
hiyouga
0926d81053 update examples
Former-commit-id: b6e008c152421db668c971b0828cbee6a80b16bc
2024-06-13 03:15:06 +08:00
hiyouga
e4ce59243b fix #4005 #4013
Former-commit-id: eed33862bc733361f3c28b3c95dc0eb4ea00884c
2024-06-03 19:12:29 +08:00
hiyouga
3ea8f5e6b9 support DDP in webui
Former-commit-id: 7c016b22aa9208ec14f00a9bdb51f69aebb02af5
2024-05-28 19:24:22 +08:00
hiyouga
4807c11db8 support SimPO #3900
Former-commit-id: cb63b32986c43f97994211ec34dc5928fc3bb9d7
2024-05-26 23:46:33 +08:00
hiyouga
13d7b48efe improve KTO impl., replace datasets
Former-commit-id: c450ee87a35ff9235f9b695b0de2e042b2971178
2024-05-18 03:44:56 +08:00
hiyouga
5eb8107db2 fix examples #3769
Former-commit-id: 3df986c6793a51ec2cb5f31fd1808cd3a9883bc4
2024-05-16 19:12:09 +08:00
hiyouga
c4743674ab update examples
Former-commit-id: 5bdad463875100e402329d47cd4c14bf9bc3b84b
2024-05-15 00:05:17 +08:00
hiyouga
3318b6e188 update examples
Former-commit-id: dae83f419919305cb23bb2b9da1277a1616179c5
2024-05-13 20:39:36 +08:00
hiyouga
52cc6bce38 fix #3602
Former-commit-id: b0888262e371280f2b69ab529040b3a99632fc12
2024-05-07 17:50:27 +08:00
hiyouga
fe494fe97e update examples
Former-commit-id: 047313f48e0b2c050952592329509e8b3dfc6f81
2024-05-06 23:07:55 +08:00
hiyouga
92cafef325 update example docs
Former-commit-id: f02f87c6fbd20adae105c83526baa23dba2042fd
2024-05-06 22:51:02 +08:00
hiyouga
eb21a527a6 update docs
Former-commit-id: 34d33e22570338da709b8499830adb06b202095c
2024-05-06 21:47:00 +08:00
hiyouga
d2df4c22ab support mllm hf inference
Former-commit-id: e057c8de486bfbc829240924f9238d6212c917f1
2024-04-26 05:34:58 +08:00
hiyouga
84031c5bf9 add export_device in webui #3333
Former-commit-id: 3a7c1286ce7fdfe5db60b17720ce734408913b7f
2024-04-25 19:02:32 +08:00
hiyouga
23f738fda5 update examples
Former-commit-id: 2efd9b6ba0e06f62d8dc48bc3c4100c829d6795b
2024-04-23 18:29:46 +08:00
hiyouga
d8deb0f99e update readme and examples
Former-commit-id: a1f1fac33b2a727b38e8ba52d68a224814d4848b
2024-04-22 00:37:32 +08:00
hiyouga
ec81d45d27 fix mod stuff
Former-commit-id: f58425ab45727f7859583d4b9fda776715e27ff6
2024-04-21 18:11:10 +08:00
Marco
639297a5ef Added Mixture of Depths
Former-commit-id: 620add7b9f634de1a711f7b87b16050adf735e9b
2024-04-18 20:31:24 +02:00
hiyouga
0a94fab357 support badam for all stages
Former-commit-id: e3d8fc75eb2cfc54efd35bfd9ad6c4ac5acc458c
2024-04-16 17:44:48 +08:00
hiyouga
fb385b8c26 update examples
Former-commit-id: cce52351b54f70904f33902d9c17411134f9f6eb
2024-04-15 22:14:34 +08:00
hiyouga
86513f28dc update examples
Former-commit-id: fc7f1cc365ee481b76f9c7e6f1947b49cf131fbf
2024-04-02 21:09:25 +08:00
hiyouga
e341fa59fe update examples
Former-commit-id: f22eaeb5bc5329146feb0cc5455fae8ce10380f8
2024-04-02 20:51:21 +08:00
hiyouga
9df316931b update examples
Former-commit-id: 31ffbde24dd2e30c3d06331ac4b47d966fc2a191
2024-04-02 20:41:49 +08:00