hiyouga
|
6f7b6ae0c3
|
remove gc warnings in DPO&KTO
Former-commit-id: f9a206509ec8cd3abfad8bd924c9387317a4ead8
|
2024-06-03 22:53:54 +08:00 |
|
hoshi-hiyouga
|
5d96cf146e
|
Update trainer.py
Former-commit-id: 24499f40dc1d9db448a3328d2a75c60eec27feb9
|
2024-06-03 22:08:38 +08:00 |
|
enji.zhou
|
e58aca0602
|
fix KTO Trainer Sampler
Former-commit-id: 34a2c5087a174a807e5a11cae3748bcaaaf13550
|
2024-06-03 21:32:38 +08:00 |
|
hoshi-hiyouga
|
f6f1c4eacb
|
Merge pull request #4006 from Uminosachi/scheduler-kwargs
Set scheduler_specific_kwargs to get_scheduler
Former-commit-id: 0f01500b68396533ddb00dc6e92e6e26be0ce9e5
|
2024-06-03 19:27:53 +08:00 |
|
hiyouga
|
e4ce59243b
|
fix #4005 #4013
Former-commit-id: eed33862bc733361f3c28b3c95dc0eb4ea00884c
|
2024-06-03 19:12:29 +08:00 |
|
hoshi-hiyouga
|
eaab09fccb
|
Merge pull request #4007 from xu-song/patch-3
Update model_args.py
Former-commit-id: 1539c72b9493907464f29ca0f0112c6df2f997b4
|
2024-06-03 18:54:37 +08:00 |
|
hiyouga
|
d0ceb1b091
|
fix #4022
Former-commit-id: 24e1c0e2ee365812357fb9cf82e2162915299a26
|
2024-06-03 18:38:36 +08:00 |
|
hiyouga
|
af7748139a
|
bump versions
transformers 4.37.2->4.41.2
datasets 2.14.3->2.16.0
accelerate 0.27.2->0.30.1
peft 0.10.0->0.11.1
trl 0.8.1->0.8.6
Former-commit-id: 876bc92865605be872bc811a56a1d1e05490ec8a
|
2024-06-03 18:29:38 +08:00 |
|
hiyouga
|
64d24842fe
|
fix data loader hint
Former-commit-id: 49b1e88e3da3be0fb78f53e5f924a9be67568a02
|
2024-06-03 18:28:27 +08:00 |
|
ylfeng
|
62d55b71a3
|
remove empty line
Former-commit-id: b47e3174472f458a3a8b84a66b475da8fce6db79
|
2024-05-31 21:43:08 +08:00 |
|
ylfeng
|
0feb2ad35c
|
fix eos
Former-commit-id: 84aee579013f0c095a918a8c61611ccbb1d7fc84
|
2024-05-31 21:40:41 +08:00 |
|
ylfeng
|
8350e508d3
|
supervised packing with greedy knapsack algorithm
Former-commit-id: f9db439cb7511b12aa3524d5fdcc45864aebda91
|
2024-05-31 15:33:54 +08:00 |
|
Xu Song
|
abe33220bf
|
Update model_args.py
Former-commit-id: dade2f083d398f83581d935f44d20dc45244c924
|
2024-05-31 14:35:48 +08:00 |
|
Uminosachi
|
0de4e1e9e2
|
Set scheduler_specific_kwargs to get_scheduler
Former-commit-id: 14e97dc1192f6cf94ab99eb3a9b8c64029040384
|
2024-05-31 13:45:39 +09:00 |
|
faddddeout
|
64976e426c
|
fix cann't interrupt training when using multi GPUs in webui
Former-commit-id: b13d03946ed7e39f848988f7b75485a9b69bae09
|
2024-05-30 08:39:21 +00:00 |
|
hoshi-hiyouga
|
9b6bdf9449
|
Merge pull request #3829 from seanzhang-zhichen/add_dataset_sample_num
Add dataset sample num
Former-commit-id: 483eb47e5d670e23fb713b942f6890b8259f4363
|
2024-05-30 00:25:45 +08:00 |
|
hoshi-hiyouga
|
7b83c550ab
|
Update loader.py
Former-commit-id: ca5dd7c6c115a359e4b50e93f4ffcc9f2955ec2f
|
2024-05-30 00:20:20 +08:00 |
|
hoshi-hiyouga
|
9fc713da89
|
Update loader.py
Former-commit-id: f9a88b89ca8b8f9a0c5def03b154f9d67f558edf
|
2024-05-30 00:17:21 +08:00 |
|
hoshi-hiyouga
|
c0f11a280e
|
Update loader.py
Former-commit-id: b55fb611c57be03fb38218c7da1d96f6848496ba
|
2024-05-30 00:12:12 +08:00 |
|
hoshi-hiyouga
|
69a51cacb1
|
Update parser.py
Former-commit-id: 51dd454337941801d0a66eaadb0da2e007e9573d
|
2024-05-30 00:05:20 +08:00 |
|
hiyouga
|
820404946e
|
better llamaboard
* easily resume from checkpoint
* support full and freeze checkpoints
* faster ui
Former-commit-id: 80708717329b4552920dd4ce8cebc683e65d54c5
|
2024-05-29 23:55:38 +08:00 |
|
hiyouga
|
19a3262387
|
fix cohere system
Former-commit-id: d0aa36b8ad02287d97930101958456c523e699d3
|
2024-05-29 20:58:23 +08:00 |
|
hiyouga
|
c05cb3769f
|
fix #3965
Former-commit-id: 0930f5869929634baa0881167d3d6c714afc63d9
|
2024-05-29 20:55:51 +08:00 |
|
hiyouga
|
a71a6a05c3
|
update readme
Former-commit-id: 89ca832740731dfb121175aa5c16b13bd4944011
|
2024-05-29 18:39:11 +08:00 |
|
hzhaoy
|
ce1be3da4b
|
add TeleChat-12B/TeleChat-12B-v2 models
Former-commit-id: 0dd632fe9e5bbf08605d4b9c6887208b7a127317
|
2024-05-29 15:00:37 +08:00 |
|
hiyouga
|
05277ee864
|
fix hf chat engine
Former-commit-id: 97346c1d3d87f0bd5ddcd70ff485f6a8273244aa
|
2024-05-29 01:20:07 +08:00 |
|
hiyouga
|
13e7b64641
|
add ds config to webui
Former-commit-id: e4b420c146235b2bce70d66a081efd137aef98af
|
2024-05-29 01:13:17 +08:00 |
|
hiyouga
|
468d0e7ed1
|
10x generate in ppo w/ zero3
https://github.com/huggingface/trl/pull/1483
Former-commit-id: 65cd8bdbdbe1b19250ecd813aeb72c8e00ef2f9c
|
2024-05-29 00:23:23 +08:00 |
|
hiyouga
|
bfac965f9c
|
update dpo, kto trainer
Former-commit-id: 7c8e01bb74bb2d2da5dba5059a9c262e4730b802
|
2024-05-29 00:14:29 +08:00 |
|
hiyouga
|
14f6cc2b7c
|
clean kto trainer
Former-commit-id: 900e1ea622a2ffa45c5e2a359471962563fabca7
|
2024-05-28 21:43:26 +08:00 |
|
hiyouga
|
87e71df597
|
bump vllm version to 0.4.1
Former-commit-id: 1e80a3a6385f615bf038806b9c6b1f73f4a3e24f
|
2024-05-28 21:27:27 +08:00 |
|
hiyouga
|
3152c7dd1c
|
update readme
Former-commit-id: 087b9faa3947bf6d2a53a8dedef487a662d426af
|
2024-05-28 19:35:52 +08:00 |
|
hiyouga
|
3ea8f5e6b9
|
support DDP in webui
Former-commit-id: 7c016b22aa9208ec14f00a9bdb51f69aebb02af5
|
2024-05-28 19:24:22 +08:00 |
|
Yimi81
|
7324984127
|
fix yi template
Former-commit-id: dc07413e7d0b138c89eacaef17596e83ef226540
|
2024-05-27 13:11:25 +00:00 |
|
hiyouga
|
0706dbf7e6
|
tiny fix
Former-commit-id: c1fdf81df6ade5da7be4eb66b715f0efd171d5aa
|
2024-05-27 20:54:26 +08:00 |
|
hoshi-hiyouga
|
ad3ca3f556
|
Merge pull request #3921 from gusye1234/main
Add openchat-3.6-8B support
Former-commit-id: 87ea0a8bcd8d76a9e916cc8da6905bc805bb18aa
|
2024-05-27 20:52:37 +08:00 |
|
hoshi-hiyouga
|
eceec1d7fd
|
Update template.py
Former-commit-id: f1002b9f930758bb27794ab88a2adbe24417b076
|
2024-05-27 20:51:56 +08:00 |
|
hoshi-hiyouga
|
b7b8223230
|
Update template.py
Former-commit-id: 122213a7a7e114b0c390158cac0ae9faeceb2efc
|
2024-05-27 20:51:26 +08:00 |
|
Jianbai Ye
|
d2c1df7f3d
|
add openchat-3.6-8B support
Former-commit-id: cff815391fd15f30647e8694e08c47a514fd6eb2
|
2024-05-27 20:42:08 +08:00 |
|
hiyouga
|
b88ecd71fd
|
fix full/freeze tuning for mllm
Former-commit-id: 08564838bd02651668845ed74e2e60561e5b6d8c
|
2024-05-27 20:37:57 +08:00 |
|
hoshi-hiyouga
|
605e70d0e1
|
Merge pull request #3835 from BUAADreamer/main
fix some features in llava-style training
Former-commit-id: 838f2fb3e423a0471ff2898f737401e92bbafe2b
|
2024-05-27 20:23:45 +08:00 |
|
hiyouga
|
fc5a6b5c4e
|
support Aya23
Former-commit-id: e626e264460d12b282099bfbb8e6679c31e85fc0
|
2024-05-27 20:23:24 +08:00 |
|
BUAADreamer
|
5632ba3fa8
|
Merge branch 'hiyouga:main' into main
Former-commit-id: ea2afd429eab85a67d562c3f7d571ede31320393
|
2024-05-27 19:00:48 +08:00 |
|
BUAADreamer
|
606240aec0
|
add regex of only tune lm and mm_proj
Former-commit-id: 57eb13b75d8597d748e84d3549a0b08876b669db
|
2024-05-27 18:59:00 +08:00 |
|
hiyouga
|
51a1097c64
|
add phi-3 7b/14b, mistral v0.3 models
Former-commit-id: efa4b196ca8053881bb9d15cfb571204bcb0bbda
|
2024-05-27 18:20:16 +08:00 |
|
hiyouga
|
df33548b39
|
update readme
Former-commit-id: 5581cb2e4e59f3f8109e2acd4611789f9e50bfca
|
2024-05-27 18:14:02 +08:00 |
|
BUAADreamer
|
a6c2a2071d
|
Merge branch 'hiyouga:main' into main
Former-commit-id: 4bc7c10c00e6e9b5af8538af907178a37e3595f8
|
2024-05-27 11:54:01 +08:00 |
|
hiyouga
|
4807c11db8
|
support SimPO #3900
Former-commit-id: cb63b32986c43f97994211ec34dc5928fc3bb9d7
|
2024-05-26 23:46:33 +08:00 |
|
BUAADreamer
|
3eaf371a22
|
Merge branch 'hiyouga:main' into main
Former-commit-id: 60170a1da42a395cf440bbd3825c4e295c31ac38
|
2024-05-25 14:18:49 +08:00 |
|
hiyouga
|
e5d2ef4434
|
fix #3853
Former-commit-id: 063f91cc80193853d17c55fe092fb33683f5d39c
|
2024-05-24 23:29:45 +08:00 |
|