1650 Commits

Author SHA1 Message Date
hiyouga
b097f04a79 update readme
Former-commit-id: eef1e542a91baefebdaac0d7c747ed481b78f6ef
2024-06-05 16:32:32 +08:00
MengqingCao
55815ab1ff fix #4077
Former-commit-id: 90ed3cae92c624cb53e7349bb7edeaf402d030e6
2024-06-05 08:03:30 +00:00
hiyouga
94c37490d1 support glm-4
Former-commit-id: f48f5e646e2da9e02333d027033141b0e75dfcf8
2024-06-05 15:16:38 +08:00
MengqingCao
15f6ab73a5 add npu for model export
Former-commit-id: 07045c876a4c6025ba56905b65cce6c9faedacb5
2024-06-05 07:06:40 +00:00
faddddeout
a2931b813b add throughput entry to log
Former-commit-id: b2f04595423b8e84b3763d169e402a0cd34f3175
2024-06-04 11:04:29 +00:00
hiyouga
51e3229528 update wechat
Former-commit-id: 82a565362ca031f9b3e7c5c24d2c43d1741bbe19
2024-06-04 15:52:56 +08:00
hzhaoy
4721d0b8ff add: support selecting saved configuration files and loading training parameters
Former-commit-id: b27c4cfcb367f7ab0b56da3ba238c4d9c29ff4e7
2024-06-04 10:33:43 +08:00
hiyouga
0eff6a66d5 tiny fix
Former-commit-id: 5a13b3baa63225e7f79e024610722de0f87e0acc
2024-06-04 00:31:10 +08:00
hiyouga
88745c9bb5 fix #3873
Former-commit-id: 91611d68c47dada2b74a141a5842dd289e46d356
2024-06-04 00:21:50 +08:00
hiyouga
8ecf606230 fix #3992
Former-commit-id: a18acf2abe28e37233bf8c8ed2600618ea3b62e9
2024-06-04 00:17:36 +08:00
hiyouga
b12d4beb8a fix abort in webui DDP mode
Former-commit-id: 2187518762844472a96b72fbad4da15d8bc97bbd
2024-06-04 00:10:24 +08:00
hoshi-hiyouga
326f180397 Merge pull request #3987 from injet-zhou/main
Fix cann't interrupt training when using multi GPUs in webui

Former-commit-id: ae18e1e2514d2829b5bc8b4abdb7fa3e8e906c22
2024-06-04 00:04:07 +08:00
hiyouga
e2920aa925 fix #4043
Former-commit-id: 79784ebeb6cc712b12edadcca8203b20afcf851e
2024-06-03 23:30:37 +08:00
hiyouga
6f7b6ae0c3 remove gc warnings in DPO&KTO
Former-commit-id: f9a206509ec8cd3abfad8bd924c9387317a4ead8
2024-06-03 22:53:54 +08:00
hoshi-hiyouga
b2c224de69 Merge pull request #4045 from enji-zhou/feature/add_kto
fix KTO Trainer Sampler

Former-commit-id: 30a538e2dbb79752479e11205dbb539df956f205
2024-06-03 22:09:25 +08:00
hoshi-hiyouga
5d96cf146e Update trainer.py
Former-commit-id: 24499f40dc1d9db448a3328d2a75c60eec27feb9
2024-06-03 22:08:38 +08:00
enji.zhou
e58aca0602 fix KTO Trainer Sampler
Former-commit-id: 34a2c5087a174a807e5a11cae3748bcaaaf13550
2024-06-03 21:32:38 +08:00
hoshi-hiyouga
f6f1c4eacb Merge pull request #4006 from Uminosachi/scheduler-kwargs
Set scheduler_specific_kwargs to get_scheduler

Former-commit-id: 0f01500b68396533ddb00dc6e92e6e26be0ce9e5
2024-06-03 19:27:53 +08:00
hiyouga
a187068e7c update placeholder in issue template
Former-commit-id: 88681d33575574d777b4f800e2e228389a38503d
2024-06-03 19:24:10 +08:00
hoshi-hiyouga
cdfd2ad4b1 Merge pull request #4011 from statelesshz/issue-template
Update bug-report.yml

Former-commit-id: d359dd2de404d1917eee197049cf44834566a23b
2024-06-03 19:20:43 +08:00
hiyouga
e4ce59243b fix #4005 #4013
Former-commit-id: eed33862bc733361f3c28b3c95dc0eb4ea00884c
2024-06-03 19:12:29 +08:00
hoshi-hiyouga
eaab09fccb Merge pull request #4007 from xu-song/patch-3
Update model_args.py

Former-commit-id: 1539c72b9493907464f29ca0f0112c6df2f997b4
2024-06-03 18:54:37 +08:00
hiyouga
d0ceb1b091 fix #4022
Former-commit-id: 24e1c0e2ee365812357fb9cf82e2162915299a26
2024-06-03 18:38:36 +08:00
hiyouga
af7748139a bump versions
transformers 4.37.2->4.41.2
datasets 2.14.3->2.16.0
accelerate 0.27.2->0.30.1
peft 0.10.0->0.11.1
trl 0.8.1->0.8.6


Former-commit-id: 876bc92865605be872bc811a56a1d1e05490ec8a
2024-06-03 18:29:38 +08:00
hiyouga
64d24842fe fix data loader hint
Former-commit-id: 49b1e88e3da3be0fb78f53e5f924a9be67568a02
2024-06-03 18:28:27 +08:00
ylfeng
62d55b71a3 remove empty line
Former-commit-id: b47e3174472f458a3a8b84a66b475da8fce6db79
2024-05-31 21:43:08 +08:00
ylfeng
0feb2ad35c fix eos
Former-commit-id: 84aee579013f0c095a918a8c61611ccbb1d7fc84
2024-05-31 21:40:41 +08:00
ylfeng
8350e508d3 supervised packing with greedy knapsack algorithm
Former-commit-id: f9db439cb7511b12aa3524d5fdcc45864aebda91
2024-05-31 15:33:54 +08:00
Xu Song
abe33220bf Update model_args.py
Former-commit-id: dade2f083d398f83581d935f44d20dc45244c924
2024-05-31 14:35:48 +08:00
statelesshz
6a6f07053d Update bug-report.yml
Former-commit-id: f78e21f3417c9b561800db71d86f55defd3fa106
2024-05-31 13:18:18 +08:00
Uminosachi
0de4e1e9e2 Set scheduler_specific_kwargs to get_scheduler
Former-commit-id: 14e97dc1192f6cf94ab99eb3a9b8c64029040384
2024-05-31 13:45:39 +09:00
hiyouga
72ebcb9a04 update readme
Former-commit-id: c4f50865ad798e1e99044480e1ab05abefc30224
2024-05-30 16:40:17 +08:00
faddddeout
64976e426c fix cann't interrupt training when using multi GPUs in webui
Former-commit-id: b13d03946ed7e39f848988f7b75485a9b69bae09
2024-05-30 08:39:21 +00:00
hoshi-hiyouga
e24276cab6 Update wechat.jpg
Former-commit-id: 2f38c1f5fded2ccaa5c92bc9fe0f426e87077100
2024-05-30 12:48:47 +08:00
hiyouga
107e39f2de fix #3837
Former-commit-id: 3404e8f302d0b0308825fccedec82d8781b8c39e
2024-05-30 00:52:26 +08:00
hoshi-hiyouga
9b6bdf9449 Merge pull request #3829 from seanzhang-zhichen/add_dataset_sample_num
Add dataset sample num

Former-commit-id: 483eb47e5d670e23fb713b942f6890b8259f4363
2024-05-30 00:25:45 +08:00
hoshi-hiyouga
7b83c550ab Update loader.py
Former-commit-id: ca5dd7c6c115a359e4b50e93f4ffcc9f2955ec2f
2024-05-30 00:20:20 +08:00
hoshi-hiyouga
9fc713da89 Update loader.py
Former-commit-id: f9a88b89ca8b8f9a0c5def03b154f9d67f558edf
2024-05-30 00:17:21 +08:00
hoshi-hiyouga
c0f11a280e Update loader.py
Former-commit-id: b55fb611c57be03fb38218c7da1d96f6848496ba
2024-05-30 00:12:12 +08:00
hoshi-hiyouga
69a51cacb1 Update parser.py
Former-commit-id: 51dd454337941801d0a66eaadb0da2e007e9573d
2024-05-30 00:05:20 +08:00
hoshi-hiyouga
21e7979837 Update README_zh.md
Former-commit-id: c8ae7e0e6571c7ca2e526da3e8adda5f8c9948f1
2024-05-30 00:04:47 +08:00
hoshi-hiyouga
eb7ee82f16 Update README.md
Former-commit-id: 3761d7d5dd97ce2fe0098284e6d4821fc0d63d30
2024-05-30 00:04:26 +08:00
hiyouga
820404946e better llamaboard
* easily resume from checkpoint
* support full and freeze checkpoints
* faster ui


Former-commit-id: 80708717329b4552920dd4ce8cebc683e65d54c5
2024-05-29 23:55:38 +08:00
hiyouga
19a3262387 fix cohere system
Former-commit-id: d0aa36b8ad02287d97930101958456c523e699d3
2024-05-29 20:58:23 +08:00
hiyouga
c05cb3769f fix #3965
Former-commit-id: 0930f5869929634baa0881167d3d6c714afc63d9
2024-05-29 20:55:51 +08:00
hiyouga
a71a6a05c3 update readme
Former-commit-id: 89ca832740731dfb121175aa5c16b13bd4944011
2024-05-29 18:39:11 +08:00
hoshi-hiyouga
2e7dae0f97 Merge pull request #3930 from MengqingCao/npu
Add Ascend npu doc and dependency

Former-commit-id: 880b4a9acf5955f607639bfcaba3f3e8aae32c6d
2024-05-29 18:33:38 +08:00
MengqingCao
2192616770 update torch-npu version
Former-commit-id: b19d33b9d205911ffd191bd0eadddd162b692e68
2024-05-29 10:05:11 +00:00
MengqingCao
29fe1cd688 update cann kernels url
Former-commit-id: e14f5b37e4cf6086d80e600c88a4e2e402a74a72
2024-05-29 09:53:31 +00:00
hoshi-hiyouga
10ab2861d5 Merge pull request #3958 from hzhaoy/add_telechat_12b_support
add TeleChat-12B/TeleChat-12B-v2 models

Former-commit-id: bcddd5b066b97e2dcdff4fd8e0a8595e4bbd7fa1
2024-05-29 17:20:53 +08:00