hiyouga
|
6a3ee1edd9
|
fix optimizers
Former-commit-id: fbbe0dba2f
|
2024-04-21 20:40:54 +08:00 |
|
hiyouga
|
79666c298d
|
fix #3365
Former-commit-id: a1d31ffc8c
|
2024-04-21 19:20:18 +08:00 |
|
hiyouga
|
9e45f82be7
|
fix bug in galore optimizer
Former-commit-id: 5c62881c5a
|
2024-04-21 18:53:22 +08:00 |
|
hiyouga
|
ec81d45d27
|
fix mod stuff
Former-commit-id: f58425ab45
|
2024-04-21 18:11:10 +08:00 |
|
hoshi-hiyouga
|
7c63a9b5fd
|
Merge pull request #3338 from astramind-ai/main
Adding Mixture of Depth
Former-commit-id: d0273787be
|
2024-04-21 18:05:52 +08:00 |
|
hoshi-hiyouga
|
e9b1aff447
|
fix #3348
Former-commit-id: 1fa287fd63
|
2024-04-20 10:34:09 +08:00 |
|
hiyouga
|
97c3f9e22c
|
fix #3352
Former-commit-id: ba559a659a
|
2024-04-19 22:40:01 +08:00 |
|
hiyouga
|
ac7ec7ed10
|
fix llama3 template
Former-commit-id: 14a605a2da
|
2024-04-19 15:46:51 +08:00 |
|
Marco
|
b6a87e0a3f
|
fix small typo
Former-commit-id: 4fb7e046b3
|
2024-04-18 20:33:29 +02:00 |
|
Marco
|
639297a5ef
|
Added Mixture of Depths
Former-commit-id: 620add7b9f
|
2024-04-18 20:31:24 +02:00 |
|
hoshi-hiyouga
|
15d17a1e86
|
support llama3
Former-commit-id: 2aaaede247
|
2024-04-19 01:13:50 +08:00 |
|
hiyouga
|
9aa62ffb57
|
fix #3324
Former-commit-id: 942362d008
|
2024-04-18 15:34:45 +08:00 |
|
hiyouga
|
e2e0bbde12
|
tiny fix
Former-commit-id: 3b43a3b7c5
|
2024-04-18 00:22:17 +08:00 |
|
hiyouga
|
8a369cc084
|
add mixtral 8x22B models
Former-commit-id: cab0598fd0
|
2024-04-17 23:35:59 +08:00 |
|
hiyouga
|
3b491b4e1a
|
add CodeQwen models
Former-commit-id: 5f86053d75
|
2024-04-17 23:27:22 +08:00 |
|
hiyouga
|
0170ef83a6
|
fix #3316
Former-commit-id: c9a477322d
|
2024-04-17 22:54:34 +08:00 |
|
hiyouga
|
f9c859e97b
|
fix #3317
Former-commit-id: 6d641af703
|
2024-04-17 22:17:19 +08:00 |
|
hiyouga
|
bdd253228e
|
lint
Former-commit-id: 278c5e10c4
|
2024-04-16 18:21:09 +08:00 |
|
hoshi-hiyouga
|
7daaae2005
|
Merge pull request #3291 from codemayq/main
support for previewing custom dataset in directory format
Former-commit-id: aa3206ec26
|
2024-04-16 18:12:09 +08:00 |
|
hiyouga
|
038d524fcd
|
Update parser.py
Former-commit-id: c00f0771a5
|
2024-04-16 18:09:31 +08:00 |
|
hiyouga
|
8beb7a9239
|
update readme and gradio version
Former-commit-id: 5d62a51c12
|
2024-04-16 18:09:16 +08:00 |
|
hiyouga
|
0a94fab357
|
support badam for all stages
Former-commit-id: e3d8fc75eb
|
2024-04-16 17:44:48 +08:00 |
|
hoshi-hiyouga
|
496396b3bc
|
Merge pull request #3287 from Ledzy/badam
[Feature] Add BAdam algorithm
Former-commit-id: 4d660c5ade
|
2024-04-16 17:32:16 +08:00 |
|
hoshi-hiyouga
|
6d954b2733
|
Update utils.py
Former-commit-id: c9828f4c6e
|
2024-04-16 17:30:12 +08:00 |
|
hoshi-hiyouga
|
5226c4fa97
|
Update trainer.py
Former-commit-id: 6700a1b9fa
|
2024-04-16 17:29:52 +08:00 |
|
hoshi-hiyouga
|
b92f690190
|
Update utils.py
Former-commit-id: 38a56706e0
|
2024-04-16 17:29:30 +08:00 |
|
hoshi-hiyouga
|
48fb0be1b9
|
Update patcher.py
Former-commit-id: a950f3b81d
|
2024-04-16 17:29:19 +08:00 |
|
hoshi-hiyouga
|
ce56ff22af
|
Update adapter.py
Former-commit-id: 750cdf2e74
|
2024-04-16 17:28:12 +08:00 |
|
hoshi-hiyouga
|
0f6d691aa6
|
Update parser.py
Former-commit-id: 4660703674
|
2024-04-16 17:27:25 +08:00 |
|
hoshi-hiyouga
|
d68212d016
|
Update parser.py
Former-commit-id: 5b59ff4212
|
2024-04-16 17:27:02 +08:00 |
|
hoshi-hiyouga
|
5f48dd545e
|
Update finetuning_args.py
Former-commit-id: ec899cccf3
|
2024-04-16 17:26:30 +08:00 |
|
Jonery
|
b3260c7456
|
resolve gradient checkpointing issue.
Former-commit-id: 7ecb61822b
|
2024-04-16 12:05:27 +08:00 |
|
codingma
|
64f96cfd6d
|
add check
Former-commit-id: 62294289dc
|
2024-04-16 10:56:39 +08:00 |
|
codingma
|
43d1730aa5
|
support for previewing custom dataset in directory format
Former-commit-id: 75aa6392e8
|
2024-04-16 10:43:14 +08:00 |
|
hiyouga
|
627f281e5b
|
add empty template
Former-commit-id: b3ac14ffc4
|
2024-04-16 03:10:02 +08:00 |
|
hiyouga
|
b40f266617
|
support unsloth 2024.4
Former-commit-id: 7dc72fb58c
|
2024-04-16 00:25:03 +08:00 |
|
hiyouga
|
bd2b758b48
|
add codegemma
Former-commit-id: 6543f3d449
|
2024-04-16 00:11:15 +08:00 |
|
hiyouga
|
2dc3343b1c
|
support cohere commandR #3184
Former-commit-id: e0dbac2845
|
2024-04-15 23:26:42 +08:00 |
|
Jonery
|
025f329445
|
Feature BAdam
Former-commit-id: 06c8908d3f
|
2024-04-15 23:15:27 +08:00 |
|
hoshi-hiyouga
|
57ddf739c2
|
Merge pull request #3254 from marko1616/feature/Add-support-for-CohereForAI/c4ai-command-r-plus
Add template&support for c4ai-command-r/plus (tested)
Former-commit-id: 7a8ae3f4ac
|
2024-04-15 22:59:35 +08:00 |
|
hoshi-hiyouga
|
b29b42cc42
|
Update template.py
Former-commit-id: 3ccf0d0977
|
2024-04-15 22:58:01 +08:00 |
|
hoshi-hiyouga
|
63f3f6b80c
|
Update constants.py
Former-commit-id: 268f53dddb
|
2024-04-15 22:56:55 +08:00 |
|
hiyouga
|
fb385b8c26
|
update examples
Former-commit-id: cce52351b5
|
2024-04-15 22:14:34 +08:00 |
|
marko1616
|
8ba5704eaf
|
change default_system accroding to official template
Former-commit-id: 2c89b38720
|
2024-04-15 20:45:46 +08:00 |
|
marko1616
|
210cf1cb57
|
Revert "Add support for function call(Not strictly following origin)"
This reverts commit 81c44a4390 [formerly d7b9bbc8b9].
Former-commit-id: 90c5dddf9a
|
2024-04-15 20:27:09 +08:00 |
|
marko1616
|
81c44a4390
|
Add support for function call(Not strictly following origin)
Former-commit-id: d7b9bbc8b9
|
2024-04-15 20:16:52 +08:00 |
|
hoshi-hiyouga
|
1bdf7e4b9d
|
Merge pull request #3276 from liu-zichen/fix_mixtral
fix: turn on output_router_logits of mixtral
Former-commit-id: 0e0942d388
|
2024-04-15 15:38:16 +08:00 |
|
hiyouga
|
ceccad3419
|
fix #3273
Former-commit-id: efc345c4b0
|
2024-04-15 15:32:58 +08:00 |
|
liuzc
|
11f4afc5ad
|
fix: mixtral output_router_logits
Former-commit-id: 9f4fe62386
|
2024-04-15 12:11:49 +08:00 |
|
marko1616
|
94d988a8e6
|
Typo fix
Former-commit-id: ab033dac4f
|
2024-04-13 17:30:21 +08:00 |
|