Commit Graph

48 Commits

Author SHA1 Message Date
Zeju Qiu
842595698b [feature] adding orthogononal finetuning (OFT) to llama factory (#8623)
Co-authored-by: Zeju <zqiu@g003.internal.cluster.is.localnet>
Co-authored-by: Zeju <zqiu@login2.is.localnet>
Co-authored-by: Yaowei Zheng <hiyouga@buaa.edu.cn>
2025-08-18 18:22:47 +08:00
Butui Hu
83688b0b4d [launcher] Add elastic and fault-tolerant training support (#8286)
Signed-off-by: Butui Hu <hot123tea123@gmail.com>
2025-06-05 16:40:03 +08:00
hoshi-hiyouga
c6bcca4c83 [example] update examples (#7964) 2025-05-06 17:24:25 +02:00
hoshi-hiyouga
a8430f4244 [misc] fix uv (#7913) 2025-04-30 07:45:03 +08:00
hoshi-hiyouga
a62cba3d05 [example] add bash usage (#7794) 2025-04-22 00:25:51 +08:00
Juanxi Tian
d128382d3c [trainer] Add Muon Optimizer (#7749)
Co-authored-by: hoshi-hiyouga <hiyouga@buaa.edu.cn>
2025-04-21 23:38:37 +08:00
hoshi-hiyouga
278df4308d [parser] support omegaconf (#7793) 2025-04-21 23:30:30 +08:00
hoshi-hiyouga
4831552856 [infer] set env for vllm ascend (#7745) 2025-04-17 01:08:55 +08:00
leo-pony
e1fdd6e2f8 [infer] support vllm-ascend (#7739) 2025-04-16 20:06:47 +08:00
hoshi-hiyouga
07aa7b71a3 [misc] update readme (#6917)
Former-commit-id: 499ea45d1f
2025-02-13 00:58:10 +08:00
hoshi-hiyouga
c6be9e242c [misc] support export ollama modelfile (#6899)
* support export ollama modelfile

* update config

* add system and num ctx

Former-commit-id: 9184a6e0ed
2025-02-11 19:52:25 +08:00
hoshi-hiyouga
9ef85f8fc4 [optim] clean apollo (#6645)
* clean apollo code

* update readme

Former-commit-id: 7a04021d04
2025-01-15 01:42:50 +08:00
hoshi-hiyouga
d8cba9464f [inference] fix stop token for object detection (#6624)
* fix stop token

* update minicpm data pipeline

* fix npu qlora examples

Former-commit-id: e3e2c8c689
2025-01-13 21:34:20 +08:00
hiyouga
b4174021d6 refactor ray integration, support save ckpt
Former-commit-id: d8cac6f546
2025-01-07 09:39:10 +00:00
hiyouga
6f1e450739 fix mrope
Former-commit-id: 2811814fc4
2024-12-12 15:08:17 +00:00
hiyouga
90fb5605c1 update examples
Former-commit-id: e5584dc7ba
2024-12-05 08:48:25 +00:00
hiyouga
235cdcacee support batch infer in vllm
Former-commit-id: 1324d158f9
2024-12-04 13:50:00 +00:00
hiyouga
3f7c874594 update tests
Former-commit-id: 93d3b8f43f
2024-11-02 12:41:44 +08:00
hiyouga
bfdcc6bacf add rlhf-v dataset
Former-commit-id: 8e49940746
2024-09-01 22:57:41 +08:00
hiyouga
c883542583 add examples
Former-commit-id: e08045a946
2024-08-30 21:43:19 +08:00
hiyouga
a83756b5e9 refactor mm training
Former-commit-id: 3382317e32
2024-08-30 02:14:31 +08:00
hiyouga
f8c11bd540 update examples
Former-commit-id: 0a690ada6f
2024-08-09 20:13:46 +08:00
hiyouga
5eacd17090 add adam_mini to readme
Former-commit-id: e2a28f51c6
2024-08-09 20:02:03 +08:00
hiyouga
6e03536dca update examples
Former-commit-id: d417e63f92
2024-06-27 00:53:33 +08:00
hiyouga
004f289074 tiny fix
Former-commit-id: 2bf2863a58
2024-06-17 17:47:25 +08:00
hiyouga
f25b8626bf support pissa
Former-commit-id: 8c1046d78a
2024-06-16 01:08:12 +08:00
hiyouga
f81a839197 update examples
Former-commit-id: 892e561c28
2024-06-13 03:26:10 +08:00
hiyouga
0926d81053 update examples
Former-commit-id: b6e008c152
2024-06-13 03:15:06 +08:00
hiyouga
e4ce59243b fix #4005 #4013
Former-commit-id: eed33862bc
2024-06-03 19:12:29 +08:00
hiyouga
3ea8f5e6b9 support DDP in webui
Former-commit-id: 7c016b22aa
2024-05-28 19:24:22 +08:00
hiyouga
4807c11db8 support SimPO #3900
Former-commit-id: cb63b32986
2024-05-26 23:46:33 +08:00
hiyouga
13d7b48efe improve KTO impl., replace datasets
Former-commit-id: c450ee87a3
2024-05-18 03:44:56 +08:00
hiyouga
5eb8107db2 fix examples #3769
Former-commit-id: 3df986c679
2024-05-16 19:12:09 +08:00
hiyouga
c4743674ab update examples
Former-commit-id: 5bdad46387
2024-05-15 00:05:17 +08:00
hiyouga
3318b6e188 update examples
Former-commit-id: dae83f4199
2024-05-13 20:39:36 +08:00
hiyouga
52cc6bce38 fix #3602
Former-commit-id: b0888262e3
2024-05-07 17:50:27 +08:00
hiyouga
fe494fe97e update examples
Former-commit-id: 047313f48e
2024-05-06 23:07:55 +08:00
hiyouga
92cafef325 update example docs
Former-commit-id: f02f87c6fb
2024-05-06 22:51:02 +08:00
hiyouga
d2df4c22ab support mllm hf inference
Former-commit-id: e057c8de48
2024-04-26 05:34:58 +08:00
hiyouga
23f738fda5 update examples
Former-commit-id: 2efd9b6ba0
2024-04-23 18:29:46 +08:00
hiyouga
d8deb0f99e update readme and examples
Former-commit-id: a1f1fac33b
2024-04-22 00:37:32 +08:00
hiyouga
ec81d45d27 fix mod stuff
Former-commit-id: f58425ab45
2024-04-21 18:11:10 +08:00
Marco
639297a5ef Added Mixture of Depths
Former-commit-id: 620add7b9f
2024-04-18 20:31:24 +02:00
hiyouga
0a94fab357 support badam for all stages
Former-commit-id: e3d8fc75eb
2024-04-16 17:44:48 +08:00
hiyouga
fb385b8c26 update examples
Former-commit-id: cce52351b5
2024-04-15 22:14:34 +08:00
khazic
652caa3cbd Upgrade README.md
Former-commit-id: fe5d3bb8f0
2024-04-13 20:50:49 +08:00
hiyouga
86513f28dc update examples
Former-commit-id: fc7f1cc365
2024-04-02 21:09:25 +08:00
hiyouga
03c538ebb3 add zh readme
Former-commit-id: 7765f337c7
2024-04-02 20:58:45 +08:00