Commit Graph

101 Commits

Author SHA1 Message Date
hiyouga
0d8aa6e6ef use pre-commit
Former-commit-id: 21db8ed2f4
2024-10-29 09:07:46 +00:00
hiyouga
3aa6a3e45b add e2e tests
Former-commit-id: 94d5b1bd8f
2024-09-05 21:52:28 +08:00
hiyouga
bfdcc6bacf add rlhf-v dataset
Former-commit-id: 8e49940746
2024-09-01 22:57:41 +08:00
hiyouga
f31e7e0dfc remove visual_inputs, fix qlora
Former-commit-id: a025c3df61
2024-08-31 00:24:51 +08:00
hiyouga
c883542583 add examples
Former-commit-id: e08045a946
2024-08-30 21:43:19 +08:00
hiyouga
a83756b5e9 refactor mm training
Former-commit-id: 3382317e32
2024-08-30 02:14:31 +08:00
simonJJJ
8a09b1e732 initial-commit
Former-commit-id: aeb85f200b
2024-08-28 16:51:35 +08:00
hiyouga
f8c11bd540 update examples
Former-commit-id: 0a690ada6f
2024-08-09 20:13:46 +08:00
hiyouga
5eacd17090 add adam_mini to readme
Former-commit-id: e2a28f51c6
2024-08-09 20:02:03 +08:00
hiyouga
25b9cfa163 update scripts
Former-commit-id: 86f7099fa3
2024-08-09 19:16:23 +08:00
hiyouga
b5146facff follow #5115
Former-commit-id: c87023d539
2024-08-09 18:03:00 +08:00
codingma
17c73b44da fix eval_dataset in example
Former-commit-id: 823e7c122b
2024-08-07 18:24:19 +08:00
hiyouga
fae881b854 fix #4944
Former-commit-id: 1bbd49faae
2024-07-24 16:42:51 +08:00
hoshi-hiyouga
df1f0a1258 Update llama3_lora_eval.yaml
Former-commit-id: 91ba083f37
2024-07-15 22:55:12 +08:00
codingma
76046dfda8 1. change the task name format
2. delete split param in data_args.py


Former-commit-id: 645211dc01
2024-07-15 09:55:33 +08:00
hiyouga
14bc7b0551 fix up
Former-commit-id: 29ebcd75d5
2024-07-15 01:04:56 +08:00
hoshi-hiyouga
f9a4d96194 Update llava1_5.yaml
Former-commit-id: f618b80fa2
2024-07-13 20:30:06 +08:00
codingma
1ccc6153c7 1. fix output_dir in llama3_lora_pretrain.yaml
2. add llava1_5.yaml for inference


Former-commit-id: 982a1cdd24
2024-07-13 13:16:22 +08:00
hiyouga
d97bb11821 update pissa example
Former-commit-id: c9bb0757ec
2024-07-06 15:47:32 +08:00
hiyouga
2105cf6000 update examples
Former-commit-id: 2f78b5d62a
2024-06-28 01:17:07 +08:00
hiyouga
6e03536dca update examples
Former-commit-id: d417e63f92
2024-06-27 00:53:33 +08:00
hiyouga
a225b5a70c tiny fix about badam
Former-commit-id: 095fab58d3
2024-06-25 01:54:53 +08:00
Jonery
bc1c082bc2 add example
Former-commit-id: 97c5235160
2024-06-18 13:50:26 +08:00
hiyouga
004f289074 tiny fix
Former-commit-id: 2bf2863a58
2024-06-17 17:47:25 +08:00
hiyouga
f25b8626bf support pissa
Former-commit-id: 8c1046d78a
2024-06-16 01:08:12 +08:00
hiyouga
d4ce280fbc Update README.md
Former-commit-id: 2d43b8bb49
2024-06-13 16:02:21 +08:00
hiyouga
f81a839197 update examples
Former-commit-id: 892e561c28
2024-06-13 03:26:10 +08:00
hiyouga
4c40171c55 Update llama3_full_sft_ds3.yaml
Former-commit-id: a19cdd39fe
2024-06-13 03:16:20 +08:00
hiyouga
0926d81053 update examples
Former-commit-id: b6e008c152
2024-06-13 03:15:06 +08:00
hiyouga
cceff9f520 lora modules: all by default
Former-commit-id: cae4737907
2024-06-06 03:53:28 +08:00
hiyouga
00b3fb4d14 update train hparams
Former-commit-id: dc4a00dd63
2024-06-06 01:49:20 +08:00
hiyouga
0eff6a66d5 tiny fix
Former-commit-id: 5a13b3baa6
2024-06-04 00:31:10 +08:00
hiyouga
e4ce59243b fix #4005 #4013
Former-commit-id: eed33862bc
2024-06-03 19:12:29 +08:00
hiyouga
a71a6a05c3 update readme
Former-commit-id: 89ca832740
2024-05-29 18:39:11 +08:00
hiyouga
3ea8f5e6b9 support DDP in webui
Former-commit-id: 7c016b22aa
2024-05-28 19:24:22 +08:00
hiyouga
710642827a update dpo examples
Former-commit-id: 30e1c8e745
2024-05-27 19:56:04 +08:00
hiyouga
4807c11db8 support SimPO #3900
Former-commit-id: cb63b32986
2024-05-26 23:46:33 +08:00
hiyouga
13d7b48efe improve KTO impl., replace datasets
Former-commit-id: c450ee87a3
2024-05-18 03:44:56 +08:00
hiyouga
947f0e9964 update badam example #3764
Former-commit-id: e5bba7cf1b
2024-05-17 02:21:10 +08:00
hiyouga
dfff5119b4 update examples
Former-commit-id: ddec9e1b84
2024-05-17 01:02:00 +08:00
hiyouga
5eb8107db2 fix examples #3769
Former-commit-id: 3df986c679
2024-05-16 19:12:09 +08:00
hiyouga
6e6267f17c fix #3694
Former-commit-id: 2a67ab3925
2024-05-16 00:35:28 +08:00
hiyouga
213ba09b24 fix examples
Former-commit-id: 7e69e71a52
2024-05-15 00:26:10 +08:00
hiyouga
c4743674ab update examples
Former-commit-id: 5bdad46387
2024-05-15 00:05:17 +08:00
hiyouga
f5df1ceaf1 add npu examples
Former-commit-id: af343034dd
2024-05-14 23:32:53 +08:00
hiyouga
3318b6e188 update examples
Former-commit-id: dae83f4199
2024-05-13 20:39:36 +08:00
hiyouga
52cc6bce38 fix #3602
Former-commit-id: b0888262e3
2024-05-07 17:50:27 +08:00
hiyouga
fe494fe97e update examples
Former-commit-id: 047313f48e
2024-05-06 23:07:55 +08:00
hiyouga
92cafef325 update example docs
Former-commit-id: f02f87c6fb
2024-05-06 22:51:02 +08:00
hiyouga
eb21a527a6 update docs
Former-commit-id: 34d33e2257
2024-05-06 21:47:00 +08:00