hiyouga
|
00b3fb4d14
|
update train hparams
Former-commit-id: dc4a00dd63769dc02d898c8bad2c158e4e5c0447
|
2024-06-06 01:49:20 +08:00 |
|
hiyouga
|
8f3b8ade45
|
fix setup
Former-commit-id: 4dc0632145f555ac564b0d6b560d28cbcb3ddded
|
2024-06-06 01:39:02 +08:00 |
|
hiyouga
|
0398338a0f
|
add llamafactory-cli env
Former-commit-id: d4908d57085bbcfcd29e0a8d4ee6425318ee4285
|
2024-06-06 01:28:14 +08:00 |
|
hiyouga
|
a16786d8ba
|
fix #4090
Former-commit-id: 67fe822324a9f830175e44f89acdd9d759b38852
|
2024-06-06 00:50:32 +08:00 |
|
MengqingCao
|
71b9b87d88
|
modify export_device option
Former-commit-id: 2c0305266291fdb163c4445db227d4c77529f3b5
|
2024-06-05 09:37:36 +00:00 |
|
hiyouga
|
ecd06d0110
|
fix #4079
Former-commit-id: 83a005e3d404f5a8ccb7b8ac17c50db75df4e8d4
|
2024-06-05 16:56:54 +08:00 |
|
hiyouga
|
b097f04a79
|
update readme
Former-commit-id: eef1e542a91baefebdaac0d7c747ed481b78f6ef
|
2024-06-05 16:32:32 +08:00 |
|
MengqingCao
|
55815ab1ff
|
fix #4077
Former-commit-id: 90ed3cae92c624cb53e7349bb7edeaf402d030e6
|
2024-06-05 08:03:30 +00:00 |
|
hiyouga
|
94c37490d1
|
support glm-4
Former-commit-id: f48f5e646e2da9e02333d027033141b0e75dfcf8
|
2024-06-05 15:16:38 +08:00 |
|
MengqingCao
|
15f6ab73a5
|
add npu for model export
Former-commit-id: 07045c876a4c6025ba56905b65cce6c9faedacb5
|
2024-06-05 07:06:40 +00:00 |
|
faddddeout
|
a2931b813b
|
add throughput entry to log
Former-commit-id: b2f04595423b8e84b3763d169e402a0cd34f3175
|
2024-06-04 11:04:29 +00:00 |
|
hiyouga
|
51e3229528
|
update wechat
Former-commit-id: 82a565362ca031f9b3e7c5c24d2c43d1741bbe19
|
2024-06-04 15:52:56 +08:00 |
|
hzhaoy
|
4721d0b8ff
|
add: support selecting saved configuration files and loading training parameters
Former-commit-id: b27c4cfcb367f7ab0b56da3ba238c4d9c29ff4e7
|
2024-06-04 10:33:43 +08:00 |
|
hiyouga
|
0eff6a66d5
|
tiny fix
Former-commit-id: 5a13b3baa63225e7f79e024610722de0f87e0acc
|
2024-06-04 00:31:10 +08:00 |
|
hiyouga
|
88745c9bb5
|
fix #3873
Former-commit-id: 91611d68c47dada2b74a141a5842dd289e46d356
|
2024-06-04 00:21:50 +08:00 |
|
hiyouga
|
8ecf606230
|
fix #3992
Former-commit-id: a18acf2abe28e37233bf8c8ed2600618ea3b62e9
|
2024-06-04 00:17:36 +08:00 |
|
hiyouga
|
b12d4beb8a
|
fix abort in webui DDP mode
Former-commit-id: 2187518762844472a96b72fbad4da15d8bc97bbd
|
2024-06-04 00:10:24 +08:00 |
|
hoshi-hiyouga
|
326f180397
|
Merge pull request #3987 from injet-zhou/main
Fix cann't interrupt training when using multi GPUs in webui
Former-commit-id: ae18e1e2514d2829b5bc8b4abdb7fa3e8e906c22
|
2024-06-04 00:04:07 +08:00 |
|
hiyouga
|
e2920aa925
|
fix #4043
Former-commit-id: 79784ebeb6cc712b12edadcca8203b20afcf851e
|
2024-06-03 23:30:37 +08:00 |
|
hiyouga
|
6f7b6ae0c3
|
remove gc warnings in DPO&KTO
Former-commit-id: f9a206509ec8cd3abfad8bd924c9387317a4ead8
|
2024-06-03 22:53:54 +08:00 |
|
hoshi-hiyouga
|
b2c224de69
|
Merge pull request #4045 from enji-zhou/feature/add_kto
fix KTO Trainer Sampler
Former-commit-id: 30a538e2dbb79752479e11205dbb539df956f205
|
2024-06-03 22:09:25 +08:00 |
|
hoshi-hiyouga
|
5d96cf146e
|
Update trainer.py
Former-commit-id: 24499f40dc1d9db448a3328d2a75c60eec27feb9
|
2024-06-03 22:08:38 +08:00 |
|
enji.zhou
|
e58aca0602
|
fix KTO Trainer Sampler
Former-commit-id: 34a2c5087a174a807e5a11cae3748bcaaaf13550
|
2024-06-03 21:32:38 +08:00 |
|
hoshi-hiyouga
|
f6f1c4eacb
|
Merge pull request #4006 from Uminosachi/scheduler-kwargs
Set scheduler_specific_kwargs to get_scheduler
Former-commit-id: 0f01500b68396533ddb00dc6e92e6e26be0ce9e5
|
2024-06-03 19:27:53 +08:00 |
|
hiyouga
|
a187068e7c
|
update placeholder in issue template
Former-commit-id: 88681d33575574d777b4f800e2e228389a38503d
|
2024-06-03 19:24:10 +08:00 |
|
hoshi-hiyouga
|
cdfd2ad4b1
|
Merge pull request #4011 from statelesshz/issue-template
Update bug-report.yml
Former-commit-id: d359dd2de404d1917eee197049cf44834566a23b
|
2024-06-03 19:20:43 +08:00 |
|
hiyouga
|
e4ce59243b
|
fix #4005 #4013
Former-commit-id: eed33862bc733361f3c28b3c95dc0eb4ea00884c
|
2024-06-03 19:12:29 +08:00 |
|
hoshi-hiyouga
|
eaab09fccb
|
Merge pull request #4007 from xu-song/patch-3
Update model_args.py
Former-commit-id: 1539c72b9493907464f29ca0f0112c6df2f997b4
|
2024-06-03 18:54:37 +08:00 |
|
hiyouga
|
d0ceb1b091
|
fix #4022
Former-commit-id: 24e1c0e2ee365812357fb9cf82e2162915299a26
|
2024-06-03 18:38:36 +08:00 |
|
hiyouga
|
af7748139a
|
bump versions
transformers 4.37.2->4.41.2
datasets 2.14.3->2.16.0
accelerate 0.27.2->0.30.1
peft 0.10.0->0.11.1
trl 0.8.1->0.8.6
Former-commit-id: 876bc92865605be872bc811a56a1d1e05490ec8a
|
2024-06-03 18:29:38 +08:00 |
|
hiyouga
|
64d24842fe
|
fix data loader hint
Former-commit-id: 49b1e88e3da3be0fb78f53e5f924a9be67568a02
|
2024-06-03 18:28:27 +08:00 |
|
ylfeng
|
62d55b71a3
|
remove empty line
Former-commit-id: b47e3174472f458a3a8b84a66b475da8fce6db79
|
2024-05-31 21:43:08 +08:00 |
|
ylfeng
|
0feb2ad35c
|
fix eos
Former-commit-id: 84aee579013f0c095a918a8c61611ccbb1d7fc84
|
2024-05-31 21:40:41 +08:00 |
|
ylfeng
|
8350e508d3
|
supervised packing with greedy knapsack algorithm
Former-commit-id: f9db439cb7511b12aa3524d5fdcc45864aebda91
|
2024-05-31 15:33:54 +08:00 |
|
Xu Song
|
abe33220bf
|
Update model_args.py
Former-commit-id: dade2f083d398f83581d935f44d20dc45244c924
|
2024-05-31 14:35:48 +08:00 |
|
statelesshz
|
6a6f07053d
|
Update bug-report.yml
Former-commit-id: f78e21f3417c9b561800db71d86f55defd3fa106
|
2024-05-31 13:18:18 +08:00 |
|
Uminosachi
|
0de4e1e9e2
|
Set scheduler_specific_kwargs to get_scheduler
Former-commit-id: 14e97dc1192f6cf94ab99eb3a9b8c64029040384
|
2024-05-31 13:45:39 +09:00 |
|
hiyouga
|
72ebcb9a04
|
update readme
Former-commit-id: c4f50865ad798e1e99044480e1ab05abefc30224
|
2024-05-30 16:40:17 +08:00 |
|
faddddeout
|
64976e426c
|
fix cann't interrupt training when using multi GPUs in webui
Former-commit-id: b13d03946ed7e39f848988f7b75485a9b69bae09
|
2024-05-30 08:39:21 +00:00 |
|
hoshi-hiyouga
|
e24276cab6
|
Update wechat.jpg
Former-commit-id: 2f38c1f5fded2ccaa5c92bc9fe0f426e87077100
|
2024-05-30 12:48:47 +08:00 |
|
hiyouga
|
107e39f2de
|
fix #3837
Former-commit-id: 3404e8f302d0b0308825fccedec82d8781b8c39e
|
2024-05-30 00:52:26 +08:00 |
|
hoshi-hiyouga
|
9b6bdf9449
|
Merge pull request #3829 from seanzhang-zhichen/add_dataset_sample_num
Add dataset sample num
Former-commit-id: 483eb47e5d670e23fb713b942f6890b8259f4363
|
2024-05-30 00:25:45 +08:00 |
|
hoshi-hiyouga
|
7b83c550ab
|
Update loader.py
Former-commit-id: ca5dd7c6c115a359e4b50e93f4ffcc9f2955ec2f
|
2024-05-30 00:20:20 +08:00 |
|
hoshi-hiyouga
|
9fc713da89
|
Update loader.py
Former-commit-id: f9a88b89ca8b8f9a0c5def03b154f9d67f558edf
|
2024-05-30 00:17:21 +08:00 |
|
hoshi-hiyouga
|
c0f11a280e
|
Update loader.py
Former-commit-id: b55fb611c57be03fb38218c7da1d96f6848496ba
|
2024-05-30 00:12:12 +08:00 |
|
hoshi-hiyouga
|
69a51cacb1
|
Update parser.py
Former-commit-id: 51dd454337941801d0a66eaadb0da2e007e9573d
|
2024-05-30 00:05:20 +08:00 |
|
hoshi-hiyouga
|
21e7979837
|
Update README_zh.md
Former-commit-id: c8ae7e0e6571c7ca2e526da3e8adda5f8c9948f1
|
2024-05-30 00:04:47 +08:00 |
|
hoshi-hiyouga
|
eb7ee82f16
|
Update README.md
Former-commit-id: 3761d7d5dd97ce2fe0098284e6d4821fc0d63d30
|
2024-05-30 00:04:26 +08:00 |
|
hiyouga
|
820404946e
|
better llamaboard
* easily resume from checkpoint
* support full and freeze checkpoints
* faster ui
Former-commit-id: 80708717329b4552920dd4ce8cebc683e65d54c5
|
2024-05-29 23:55:38 +08:00 |
|
hiyouga
|
19a3262387
|
fix cohere system
Former-commit-id: d0aa36b8ad02287d97930101958456c523e699d3
|
2024-05-29 20:58:23 +08:00 |
|