Commit Graph

1184 Commits

Author SHA1 Message Date
hiyouga
8beb7a9239 update readme and gradio version
Former-commit-id: 5d62a51c12
2024-04-16 18:09:16 +08:00
hiyouga
0a94fab357 support badam for all stages
Former-commit-id: e3d8fc75eb
2024-04-16 17:44:48 +08:00
hoshi-hiyouga
496396b3bc Merge pull request #3287 from Ledzy/badam
[Feature] Add BAdam algorithm

Former-commit-id: 4d660c5ade
2024-04-16 17:32:16 +08:00
hoshi-hiyouga
6d954b2733 Update utils.py
Former-commit-id: c9828f4c6e
2024-04-16 17:30:12 +08:00
hoshi-hiyouga
5226c4fa97 Update trainer.py
Former-commit-id: 6700a1b9fa
2024-04-16 17:29:52 +08:00
hoshi-hiyouga
b92f690190 Update utils.py
Former-commit-id: 38a56706e0
2024-04-16 17:29:30 +08:00
hoshi-hiyouga
48fb0be1b9 Update patcher.py
Former-commit-id: a950f3b81d
2024-04-16 17:29:19 +08:00
hoshi-hiyouga
ce56ff22af Update adapter.py
Former-commit-id: 750cdf2e74
2024-04-16 17:28:12 +08:00
hoshi-hiyouga
0f6d691aa6 Update parser.py
Former-commit-id: 4660703674
2024-04-16 17:27:25 +08:00
hoshi-hiyouga
d68212d016 Update parser.py
Former-commit-id: 5b59ff4212
2024-04-16 17:27:02 +08:00
hoshi-hiyouga
5f48dd545e Update finetuning_args.py
Former-commit-id: ec899cccf3
2024-04-16 17:26:30 +08:00
hoshi-hiyouga
507ab397f5 Update sft.sh
Former-commit-id: 57dcd91e17
2024-04-16 17:25:40 +08:00
hoshi-hiyouga
4133811434 Update requirements.txt
Former-commit-id: 50ced257e0
2024-04-16 17:10:17 +08:00
hoshi-hiyouga
4aa17105e2 Update setup.py
Former-commit-id: f4b4a26c64
2024-04-16 17:10:02 +08:00
Jonery
0853312593 remove badam from core requirements
Former-commit-id: 86900210d3
2024-04-16 12:25:50 +08:00
Jonery
b3260c7456 resolve gradient checkpointing issue.
Former-commit-id: 7ecb61822b
2024-04-16 12:05:27 +08:00
hiyouga
627f281e5b add empty template
Former-commit-id: b3ac14ffc4
2024-04-16 03:10:02 +08:00
hiyouga
01b0913f08 update readme
Former-commit-id: cf52911fed
2024-04-16 02:36:54 +08:00
hiyouga
76b41acc10 update readme
Former-commit-id: 6084eb7cf1
2024-04-16 02:35:36 +08:00
hiyouga
b40f266617 support unsloth 2024.4
Former-commit-id: 7dc72fb58c
2024-04-16 00:25:03 +08:00
hiyouga
bd2b758b48 add codegemma
Former-commit-id: 6543f3d449
2024-04-16 00:11:15 +08:00
hiyouga
2dc3343b1c support cohere commandR #3184
Former-commit-id: e0dbac2845
2024-04-15 23:26:42 +08:00
Jonery
025f329445 Feature BAdam
Former-commit-id: 06c8908d3f
2024-04-15 23:15:27 +08:00
hoshi-hiyouga
57ddf739c2 Merge pull request #3254 from marko1616/feature/Add-support-for-CohereForAI/c4ai-command-r-plus
Add template&support for c4ai-command-r/plus (tested)

Former-commit-id: 7a8ae3f4ac
2024-04-15 22:59:35 +08:00
hoshi-hiyouga
b29b42cc42 Update template.py
Former-commit-id: 3ccf0d0977
2024-04-15 22:58:01 +08:00
hoshi-hiyouga
63f3f6b80c Update constants.py
Former-commit-id: 268f53dddb
2024-04-15 22:56:55 +08:00
hiyouga
fb385b8c26 update examples
Former-commit-id: cce52351b5
2024-04-15 22:14:34 +08:00
marko1616
8ba5704eaf change default_system accroding to official template
Former-commit-id: 2c89b38720
2024-04-15 20:45:46 +08:00
marko1616
210cf1cb57 Revert "Add support for function call(Not strictly following origin)"
This reverts commit 81c44a4390 [formerly d7b9bbc8b9].


Former-commit-id: 90c5dddf9a
2024-04-15 20:27:09 +08:00
marko1616
81c44a4390 Add support for function call(Not strictly following origin)
Former-commit-id: d7b9bbc8b9
2024-04-15 20:16:52 +08:00
hoshi-hiyouga
31e65cfa94 Merge pull request #3261 from khazic/main
Added specimens for single-card full parameter prediction

Former-commit-id: 09735ed30c
2024-04-15 16:30:57 +08:00
hoshi-hiyouga
1bdf7e4b9d Merge pull request #3276 from liu-zichen/fix_mixtral
fix: turn on output_router_logits of mixtral
Former-commit-id: 0e0942d388
2024-04-15 15:38:16 +08:00
hiyouga
ceccad3419 fix #3273
Former-commit-id: efc345c4b0
2024-04-15 15:32:58 +08:00
liuzc
11f4afc5ad fix: mixtral output_router_logits
Former-commit-id: 9f4fe62386
2024-04-15 12:11:49 +08:00
khazic
652caa3cbd Upgrade README.md
Former-commit-id: fe5d3bb8f0
2024-04-13 20:50:49 +08:00
khazic
21c4a43085 Added specimens for single-card full parameter prediction
Former-commit-id: 47111ce506
2024-04-13 20:45:19 +08:00
marko1616
94d988a8e6 Typo fix
Former-commit-id: ab033dac4f
2024-04-13 17:30:21 +08:00
marko1616
65ce4140e9 Typo fix
Former-commit-id: 42806323f0
2024-04-13 07:52:11 +08:00
marko1616
768153d0f0 Add c4ai-command-r-plus link
Former-commit-id: d0705518ee
2024-04-13 07:32:40 +08:00
marko1616
6f1323722c Add template&support(Not tested)
Former-commit-id: 6574a721d2
2024-04-13 04:31:33 +08:00
hiyouga
db42378f29 fix #3247
Former-commit-id: d1fb6c72b5
2024-04-12 17:41:33 +08:00
hiyouga
9e7b460b2d fix model card
Former-commit-id: c53a11b6fd
2024-04-12 17:11:59 +08:00
hiyouga
c9d3cc181a fix #3238
Former-commit-id: 232642a621
2024-04-12 14:28:11 +08:00
hiyouga
1ae6f0a5f3 Update wechat.jpg
Former-commit-id: f2ba59352e
2024-04-12 14:15:45 +08:00
hiyouga
64c931c0db set dev version
Former-commit-id: 3dfe4cf611
2024-04-11 20:27:34 +08:00
hiyouga
431e9804ee release v0.6.2
Former-commit-id: 9d4c949461
2024-04-11 20:08:51 +08:00
hiyouga
797077a46e Merge branch 'main' of https://github.com/hiyouga/LLaMA-Factory
Former-commit-id: 51d0a1a19e
2024-04-10 23:58:18 +08:00
hiyouga
d5ca8763ea fix #3225
Former-commit-id: a99f5ed0b6
2024-04-10 23:57:59 +08:00
hoshi-hiyouga
aa5f25b9d2 Merge pull request #3201 from kno10/patch-1 and fix #3200
Pass additional_target to unsloth

Former-commit-id: caf8373c2d
2024-04-10 00:58:48 +08:00
hoshi-hiyouga
77d16ada1e Update adapter.py
Former-commit-id: 98bc97d8d2
2024-04-10 00:57:51 +08:00