hiyouga
|
0a94fab357
|
support badam for all stages
Former-commit-id: e3d8fc75eb2cfc54efd35bfd9ad6c4ac5acc458c
|
2024-04-16 17:44:48 +08:00 |
|
hoshi-hiyouga
|
496396b3bc
|
Merge pull request #3287 from Ledzy/badam
[Feature] Add BAdam algorithm
Former-commit-id: 4d660c5ade384df4444fa0543a39edce6220903d
|
2024-04-16 17:32:16 +08:00 |
|
hoshi-hiyouga
|
6d954b2733
|
Update utils.py
Former-commit-id: c9828f4c6e6c150c884e02d0213dff0c09801e77
|
2024-04-16 17:30:12 +08:00 |
|
hoshi-hiyouga
|
5226c4fa97
|
Update trainer.py
Former-commit-id: 6700a1b9fa0cbd965ac45d3f2de1088727235c25
|
2024-04-16 17:29:52 +08:00 |
|
hoshi-hiyouga
|
b92f690190
|
Update utils.py
Former-commit-id: 38a56706e0f52297501d351d38b51bee73e881dc
|
2024-04-16 17:29:30 +08:00 |
|
hoshi-hiyouga
|
48fb0be1b9
|
Update patcher.py
Former-commit-id: a950f3b81de701f5f23ce3efa60ff0382bb40dfe
|
2024-04-16 17:29:19 +08:00 |
|
hoshi-hiyouga
|
ce56ff22af
|
Update adapter.py
Former-commit-id: 750cdf2e74097c8775d03ddf55646cc14d4a686f
|
2024-04-16 17:28:12 +08:00 |
|
hoshi-hiyouga
|
0f6d691aa6
|
Update parser.py
Former-commit-id: 4660703674233949a8ba8c76bdb17dafc9d620d4
|
2024-04-16 17:27:25 +08:00 |
|
hoshi-hiyouga
|
d68212d016
|
Update parser.py
Former-commit-id: 5b59ff421204115ced405a2e3d56ac0ee8c5b788
|
2024-04-16 17:27:02 +08:00 |
|
hoshi-hiyouga
|
5f48dd545e
|
Update finetuning_args.py
Former-commit-id: ec899cccf3b8710510e496a3cd8e4c302bb99a19
|
2024-04-16 17:26:30 +08:00 |
|
hoshi-hiyouga
|
507ab397f5
|
Update sft.sh
Former-commit-id: 57dcd91e17833a0eeb8d99af92ac73c132a77648
|
2024-04-16 17:25:40 +08:00 |
|
hoshi-hiyouga
|
4133811434
|
Update requirements.txt
Former-commit-id: 50ced257e0a1737dbd73d569f8f706ff452f70aa
|
2024-04-16 17:10:17 +08:00 |
|
hoshi-hiyouga
|
4aa17105e2
|
Update setup.py
Former-commit-id: f4b4a26c6435aa7fdccd11fb92795b8b26dd989a
|
2024-04-16 17:10:02 +08:00 |
|
Jonery
|
0853312593
|
remove badam from core requirements
Former-commit-id: 86900210d32e0d4cd9c6fb411a3692178411e970
|
2024-04-16 12:25:50 +08:00 |
|
Jonery
|
b3260c7456
|
resolve gradient checkpointing issue.
Former-commit-id: 7ecb61822b37f5d71060d696495830ff98edaa06
|
2024-04-16 12:05:27 +08:00 |
|
codingma
|
64f96cfd6d
|
add check
Former-commit-id: 62294289dc6f594f37c5c6b73585c2403248cc55
|
2024-04-16 10:56:39 +08:00 |
|
codingma
|
43d1730aa5
|
support for previewing custom dataset in directory format
Former-commit-id: 75aa6392e86e965dc4a04b288ec60cff4e83f1af
|
2024-04-16 10:43:14 +08:00 |
|
hiyouga
|
627f281e5b
|
add empty template
Former-commit-id: b3ac14ffc4c31cb54689c26b66963c20db64f21f
|
2024-04-16 03:10:02 +08:00 |
|
hiyouga
|
01b0913f08
|
update readme
Former-commit-id: cf52911fed8326dbe3f2781431c25959b175260e
|
2024-04-16 02:36:54 +08:00 |
|
hiyouga
|
76b41acc10
|
update readme
Former-commit-id: 6084eb7cf14b04e6262874cc64bbb60cc9f1e384
|
2024-04-16 02:35:36 +08:00 |
|
hiyouga
|
b40f266617
|
support unsloth 2024.4
Former-commit-id: 7dc72fb58cb988418323f63821a21a184ecf0718
|
2024-04-16 00:25:03 +08:00 |
|
hiyouga
|
bd2b758b48
|
add codegemma
Former-commit-id: 6543f3d4496218f7f90c582cb6aa8c852d716cbf
|
2024-04-16 00:11:15 +08:00 |
|
hiyouga
|
2dc3343b1c
|
support cohere commandR #3184
Former-commit-id: e0dbac28450a0e1e0b84e1577ef785fc762c0b46
|
2024-04-15 23:26:42 +08:00 |
|
Jonery
|
025f329445
|
Feature BAdam
Former-commit-id: 06c8908d3fe48907ddb585c5fa15677fc5416f94
|
2024-04-15 23:15:27 +08:00 |
|
hoshi-hiyouga
|
57ddf739c2
|
Merge pull request #3254 from marko1616/feature/Add-support-for-CohereForAI/c4ai-command-r-plus
Add template&support for c4ai-command-r/plus (tested)
Former-commit-id: 7a8ae3f4ac278f2773ec23db7f760099e18b8d0c
|
2024-04-15 22:59:35 +08:00 |
|
hoshi-hiyouga
|
b29b42cc42
|
Update template.py
Former-commit-id: 3ccf0d097708d1d96e52d820599fe74700b935c4
|
2024-04-15 22:58:01 +08:00 |
|
hoshi-hiyouga
|
63f3f6b80c
|
Update constants.py
Former-commit-id: 268f53dddbda5905859c6facfce90e90736c6f7d
|
2024-04-15 22:56:55 +08:00 |
|
hiyouga
|
fb385b8c26
|
update examples
Former-commit-id: cce52351b54f70904f33902d9c17411134f9f6eb
|
2024-04-15 22:14:34 +08:00 |
|
marko1616
|
8ba5704eaf
|
change default_system accroding to official template
Former-commit-id: 2c89b38720bc9105d20ca9ea121dabf165adddad
|
2024-04-15 20:45:46 +08:00 |
|
marko1616
|
210cf1cb57
|
Revert "Add support for function call(Not strictly following origin)"
This reverts commit 81c44a43906fe4cd7ebe15a4aa97dc52b87d9c46 [formerly d7b9bbc8b956a4aeb16b5b33179687b0972ae9a6].
Former-commit-id: 90c5dddf9a34f7c504f2b404ee86027f08f15339
|
2024-04-15 20:27:09 +08:00 |
|
marko1616
|
81c44a4390
|
Add support for function call(Not strictly following origin)
Former-commit-id: d7b9bbc8b956a4aeb16b5b33179687b0972ae9a6
|
2024-04-15 20:16:52 +08:00 |
|
hoshi-hiyouga
|
31e65cfa94
|
Merge pull request #3261 from khazic/main
Added specimens for single-card full parameter prediction
Former-commit-id: 09735ed30cc61c7ec44a5cbff2e1c4890931cf5a
|
2024-04-15 16:30:57 +08:00 |
|
hoshi-hiyouga
|
1bdf7e4b9d
|
Merge pull request #3276 from liu-zichen/fix_mixtral
fix: turn on output_router_logits of mixtral
Former-commit-id: 0e0942d388bdb0122001a7f8e081315059d5d327
|
2024-04-15 15:38:16 +08:00 |
|
hiyouga
|
ceccad3419
|
fix #3273
Former-commit-id: efc345c4b0095ec959ea23bbe54c344278780cbe
|
2024-04-15 15:32:58 +08:00 |
|
liuzc
|
11f4afc5ad
|
fix: mixtral output_router_logits
Former-commit-id: 9f4fe623866b10b30c6418dee116b36671274f9f
|
2024-04-15 12:11:49 +08:00 |
|
khazic
|
652caa3cbd
|
Upgrade README.md
Former-commit-id: fe5d3bb8f07902fbd3973a56dd73837a2c175a3d
|
2024-04-13 20:50:49 +08:00 |
|
khazic
|
21c4a43085
|
Added specimens for single-card full parameter prediction
Former-commit-id: 47111ce506d2769bfa14b37b729d22b57796b26e
|
2024-04-13 20:45:19 +08:00 |
|
marko1616
|
94d988a8e6
|
Typo fix
Former-commit-id: ab033dac4fde392b18955984e40473a923f745af
|
2024-04-13 17:30:21 +08:00 |
|
marko1616
|
65ce4140e9
|
Typo fix
Former-commit-id: 42806323f068e4857fce84682a9cb571c17b52d3
|
2024-04-13 07:52:11 +08:00 |
|
marko1616
|
768153d0f0
|
Add c4ai-command-r-plus link
Former-commit-id: d0705518ee85408364172803ca3dd68e978e829e
|
2024-04-13 07:32:40 +08:00 |
|
marko1616
|
6f1323722c
|
Add template&support(Not tested)
Former-commit-id: 6574a721d20108174fc770caf9f17cf8fa81c4b4
|
2024-04-13 04:31:33 +08:00 |
|
hiyouga
|
db42378f29
|
fix #3247
Former-commit-id: d1fb6c72b532bfd4ccd5b19f56708c8391fa53aa
|
2024-04-12 17:41:33 +08:00 |
|
hiyouga
|
9e7b460b2d
|
fix model card
Former-commit-id: c53a11b6fd477fffb2030a4e3aeb4a56fd21e7a6
|
2024-04-12 17:11:59 +08:00 |
|
hiyouga
|
c9d3cc181a
|
fix #3238
Former-commit-id: 232642a6215de9b57a1627f39b4efea127948a01
|
2024-04-12 14:28:11 +08:00 |
|
hiyouga
|
1ae6f0a5f3
|
Update wechat.jpg
Former-commit-id: f2ba59352e5721ba56590ee8c281e9c71ca57d9b
|
2024-04-12 14:15:45 +08:00 |
|
hiyouga
|
64c931c0db
|
set dev version
Former-commit-id: 3dfe4cf611a348bf6b4d374044930d5e63535f68
|
2024-04-11 20:27:34 +08:00 |
|
hiyouga
|
431e9804ee
|
release v0.6.2
Former-commit-id: 9d4c949461d232a959c14859ae7fef191faab711
v0.6.2
|
2024-04-11 20:08:51 +08:00 |
|
hiyouga
|
797077a46e
|
Merge branch 'main' of https://github.com/hiyouga/LLaMA-Factory
Former-commit-id: 51d0a1a19e9f821cdbf31350dd9ed09193a511ef
|
2024-04-10 23:58:18 +08:00 |
|
hiyouga
|
d5ca8763ea
|
fix #3225
Former-commit-id: a99f5ed0b6f7932810c6baf127d21f4be44144ad
|
2024-04-10 23:57:59 +08:00 |
|
hoshi-hiyouga
|
aa5f25b9d2
|
Merge pull request #3201 from kno10/patch-1 and fix #3200
Pass additional_target to unsloth
Former-commit-id: caf8373c2d6b0ec5bda1345416e02e3324e2e8a4
|
2024-04-10 00:58:48 +08:00 |
|