1574 Commits

Author SHA1 Message Date
hiyouga
e4ce59243b fix #4005 #4013
Former-commit-id: eed33862bc733361f3c28b3c95dc0eb4ea00884c
2024-06-03 19:12:29 +08:00
hoshi-hiyouga
eaab09fccb Merge pull request #4007 from xu-song/patch-3
Update model_args.py

Former-commit-id: 1539c72b9493907464f29ca0f0112c6df2f997b4
2024-06-03 18:54:37 +08:00
hiyouga
d0ceb1b091 fix #4022
Former-commit-id: 24e1c0e2ee365812357fb9cf82e2162915299a26
2024-06-03 18:38:36 +08:00
hiyouga
af7748139a bump versions
transformers 4.37.2->4.41.2
datasets 2.14.3->2.16.0
accelerate 0.27.2->0.30.1
peft 0.10.0->0.11.1
trl 0.8.1->0.8.6


Former-commit-id: 876bc92865605be872bc811a56a1d1e05490ec8a
2024-06-03 18:29:38 +08:00
hiyouga
64d24842fe fix data loader hint
Former-commit-id: 49b1e88e3da3be0fb78f53e5f924a9be67568a02
2024-06-03 18:28:27 +08:00
Xu Song
abe33220bf Update model_args.py
Former-commit-id: dade2f083d398f83581d935f44d20dc45244c924
2024-05-31 14:35:48 +08:00
hiyouga
72ebcb9a04 update readme
Former-commit-id: c4f50865ad798e1e99044480e1ab05abefc30224
2024-05-30 16:40:17 +08:00
hoshi-hiyouga
e24276cab6 Update wechat.jpg
Former-commit-id: 2f38c1f5fded2ccaa5c92bc9fe0f426e87077100
2024-05-30 12:48:47 +08:00
hiyouga
107e39f2de fix #3837
Former-commit-id: 3404e8f302d0b0308825fccedec82d8781b8c39e
2024-05-30 00:52:26 +08:00
hoshi-hiyouga
9b6bdf9449 Merge pull request #3829 from seanzhang-zhichen/add_dataset_sample_num
Add dataset sample num

Former-commit-id: 483eb47e5d670e23fb713b942f6890b8259f4363
2024-05-30 00:25:45 +08:00
hoshi-hiyouga
7b83c550ab Update loader.py
Former-commit-id: ca5dd7c6c115a359e4b50e93f4ffcc9f2955ec2f
2024-05-30 00:20:20 +08:00
hoshi-hiyouga
9fc713da89 Update loader.py
Former-commit-id: f9a88b89ca8b8f9a0c5def03b154f9d67f558edf
2024-05-30 00:17:21 +08:00
hoshi-hiyouga
c0f11a280e Update loader.py
Former-commit-id: b55fb611c57be03fb38218c7da1d96f6848496ba
2024-05-30 00:12:12 +08:00
hoshi-hiyouga
69a51cacb1 Update parser.py
Former-commit-id: 51dd454337941801d0a66eaadb0da2e007e9573d
2024-05-30 00:05:20 +08:00
hoshi-hiyouga
21e7979837 Update README_zh.md
Former-commit-id: c8ae7e0e6571c7ca2e526da3e8adda5f8c9948f1
2024-05-30 00:04:47 +08:00
hoshi-hiyouga
eb7ee82f16 Update README.md
Former-commit-id: 3761d7d5dd97ce2fe0098284e6d4821fc0d63d30
2024-05-30 00:04:26 +08:00
hiyouga
820404946e better llamaboard
* easily resume from checkpoint
* support full and freeze checkpoints
* faster ui


Former-commit-id: 80708717329b4552920dd4ce8cebc683e65d54c5
2024-05-29 23:55:38 +08:00
hiyouga
19a3262387 fix cohere system
Former-commit-id: d0aa36b8ad02287d97930101958456c523e699d3
2024-05-29 20:58:23 +08:00
hiyouga
c05cb3769f fix #3965
Former-commit-id: 0930f5869929634baa0881167d3d6c714afc63d9
2024-05-29 20:55:51 +08:00
hiyouga
a71a6a05c3 update readme
Former-commit-id: 89ca832740731dfb121175aa5c16b13bd4944011
2024-05-29 18:39:11 +08:00
hoshi-hiyouga
2e7dae0f97 Merge pull request #3930 from MengqingCao/npu
Add Ascend npu doc and dependency

Former-commit-id: 880b4a9acf5955f607639bfcaba3f3e8aae32c6d
2024-05-29 18:33:38 +08:00
MengqingCao
2192616770 update torch-npu version
Former-commit-id: b19d33b9d205911ffd191bd0eadddd162b692e68
2024-05-29 10:05:11 +00:00
MengqingCao
29fe1cd688 update cann kernels url
Former-commit-id: e14f5b37e4cf6086d80e600c88a4e2e402a74a72
2024-05-29 09:53:31 +00:00
hoshi-hiyouga
10ab2861d5 Merge pull request #3958 from hzhaoy/add_telechat_12b_support
add TeleChat-12B/TeleChat-12B-v2 models

Former-commit-id: bcddd5b066b97e2dcdff4fd8e0a8595e4bbd7fa1
2024-05-29 17:20:53 +08:00
hzhaoy
ce1be3da4b add TeleChat-12B/TeleChat-12B-v2 models
Former-commit-id: 0dd632fe9e5bbf08605d4b9c6887208b7a127317
2024-05-29 15:00:37 +08:00
codemayq
2540ce58c0 update wechat_npu
Former-commit-id: 4728fe62d183603f08c3c1fa94f18a7c67d48b85
2024-05-29 11:13:59 +08:00
hiyouga
05277ee864 fix hf chat engine
Former-commit-id: 97346c1d3d87f0bd5ddcd70ff485f6a8273244aa
2024-05-29 01:20:07 +08:00
hiyouga
13e7b64641 add ds config to webui
Former-commit-id: e4b420c146235b2bce70d66a081efd137aef98af
2024-05-29 01:13:17 +08:00
hiyouga
468d0e7ed1 10x generate in ppo w/ zero3
https://github.com/huggingface/trl/pull/1483

Former-commit-id: 65cd8bdbdbe1b19250ecd813aeb72c8e00ef2f9c
2024-05-29 00:23:23 +08:00
hiyouga
bfac965f9c update dpo, kto trainer
Former-commit-id: 7c8e01bb74bb2d2da5dba5059a9c262e4730b802
2024-05-29 00:14:29 +08:00
hiyouga
14f6cc2b7c clean kto trainer
Former-commit-id: 900e1ea622a2ffa45c5e2a359471962563fabca7
2024-05-28 21:43:26 +08:00
hiyouga
87e71df597 bump vllm version to 0.4.1
Former-commit-id: 1e80a3a6385f615bf038806b9c6b1f73f4a3e24f
2024-05-28 21:27:27 +08:00
hiyouga
3152c7dd1c update readme
Former-commit-id: 087b9faa3947bf6d2a53a8dedef487a662d426af
2024-05-28 19:35:52 +08:00
hiyouga
3ea8f5e6b9 support DDP in webui
Former-commit-id: 7c016b22aa9208ec14f00a9bdb51f69aebb02af5
2024-05-28 19:24:22 +08:00
hiyouga
2a473f36fb update readme
Former-commit-id: c8765349bae1bf659cf358469ff61f2b12b7536c
2024-05-28 16:41:34 +08:00
hiyouga
ac9c52dfb4 update readme
Former-commit-id: 99ee0dadd914e13a63a49944680195d30226843a
2024-05-28 16:19:56 +08:00
hiyouga
f41319f31b fix #3931
Former-commit-id: 5d45adf47dc9942ec0aff1e35913d027cca607a0
2024-05-28 13:44:22 +08:00
MengqingCao
099a932cbc add Ascend npu doc and dependency
Former-commit-id: cd67d6eeb55ca2a096e344ba43fc20d8b739f3f7
2024-05-28 01:33:54 +00:00
hoshi-hiyouga
4f4e3160be Merge pull request #3925 from Yimi81/feat-fix-yi-template
fix yi template

Former-commit-id: 50912484d33cf7ee2906454fb9d7e68f2ba87bea
2024-05-27 22:59:32 +08:00
Yimi81
7324984127 fix yi template
Former-commit-id: dc07413e7d0b138c89eacaef17596e83ef226540
2024-05-27 13:11:25 +00:00
hiyouga
0706dbf7e6 tiny fix
Former-commit-id: c1fdf81df6ade5da7be4eb66b715f0efd171d5aa
2024-05-27 20:54:26 +08:00
hoshi-hiyouga
ad3ca3f556 Merge pull request #3921 from gusye1234/main
Add openchat-3.6-8B support

Former-commit-id: 87ea0a8bcd8d76a9e916cc8da6905bc805bb18aa
2024-05-27 20:52:37 +08:00
hoshi-hiyouga
eceec1d7fd Update template.py
Former-commit-id: f1002b9f930758bb27794ab88a2adbe24417b076
2024-05-27 20:51:56 +08:00
hoshi-hiyouga
b7b8223230 Update template.py
Former-commit-id: 122213a7a7e114b0c390158cac0ae9faeceb2efc
2024-05-27 20:51:26 +08:00
Jianbai Ye
d2c1df7f3d add openchat-3.6-8B support
Former-commit-id: cff815391fd15f30647e8694e08c47a514fd6eb2
2024-05-27 20:42:08 +08:00
hiyouga
b88ecd71fd fix full/freeze tuning for mllm
Former-commit-id: 08564838bd02651668845ed74e2e60561e5b6d8c
2024-05-27 20:37:57 +08:00
hoshi-hiyouga
605e70d0e1 Merge pull request #3835 from BUAADreamer/main
fix some features in llava-style training

Former-commit-id: 838f2fb3e423a0471ff2898f737401e92bbafe2b
2024-05-27 20:23:45 +08:00
hiyouga
fc5a6b5c4e support Aya23
Former-commit-id: e626e264460d12b282099bfbb8e6679c31e85fc0
2024-05-27 20:23:24 +08:00
BUAADreamer
f9ced0480e Merge branch 'main' of https://github.com/BUAADreamer/LLaMA-Factory
Former-commit-id: 576b0206c27f93ffe19e3b7e6df58a3cd2abbb1d
2024-05-27 20:11:23 +08:00
BUAADreamer
4a958ab909 Merge branch 'hiyouga:main' into main
Former-commit-id: e2022ce4e90b115fb8271ef0f6bf05e8f39c997f
2024-05-27 20:10:58 +08:00