hiyouga
|
f7a4f3d9c0
|
loose gemma2 attention
Former-commit-id: a0b645017a2de3d58b6cbc71bd91ec96fc7a818b
|
2024-06-29 01:42:14 +08:00 |
|
hiyouga
|
6ce0b5891b
|
bf16 by default, gemma2 attns
Gemma2 finetuning cannot work until merging https://github.com/huggingface/transformers/pull/31674
Former-commit-id: da66c32c7be0adc28d2185b23e9f62d56acb961c
|
2024-06-28 06:00:26 +08:00 |
|
hiyouga
|
0bd6bcd95f
|
increase pissa_iter for stability
Former-commit-id: 03f8d9b0fb10ae58e7f68508197330d616957899
|
2024-06-28 03:18:54 +08:00 |
|
hiyouga
|
81094dc09a
|
add Gemma2 models
Former-commit-id: 8fc5a248ecfd6861cb90dac6c14fe89cdeaf8921
|
2024-06-28 01:26:50 +08:00 |
|
hiyouga
|
884a4a33ee
|
refactor pissa, improve llamaboard
Former-commit-id: 619556e46c19718f702c97df5d570a2a4c5fb13a
|
2024-06-28 01:04:24 +08:00 |
|
hoshi-hiyouga
|
bf8855f90b
|
Merge pull request #4580 from hzhaoy/bugfix-deepspeed-pissa
Fix bug when using pissa method with deepspeed
Former-commit-id: f260d458f91d6d2b4ed141f64844cded11d5aaad
|
2024-06-28 00:46:51 +08:00 |
|
hiyouga
|
b588a099db
|
fix #4549
Former-commit-id: c9fdef10de737d1f433209812ef73e29cb60490a
|
2024-06-28 00:41:58 +08:00 |
|
hiyouga
|
9805350811
|
tiny fix
Former-commit-id: c1a78a3a9f8ab9d57577cee37f9c457d60863ba2
|
2024-06-27 20:14:48 +08:00 |
|
faddddeout
|
c8c45d5371
|
Exit the process with the subprocess's return code when utilizing the CLI
Former-commit-id: ab42a4e2501a80fba1704a506bd1209a441570fa
|
2024-06-27 09:58:00 +00:00 |
|
hzhaoy
|
3491525d96
|
fix #4579
Former-commit-id: 0fa298ff6a4febea36ea9f11c7594277a77e6e9b
|
2024-06-27 13:49:57 +08:00 |
|
hiyouga
|
2381fb68a4
|
add quant checks
Former-commit-id: 15bb053e3549739b1a2134640a659b0f35df7de7
|
2024-06-27 01:12:25 +08:00 |
|
hiyouga
|
0bec843f70
|
tiny fix
Former-commit-id: c6747a39dbbdda8decaa104499918bc7ac5f02e4
|
2024-06-27 00:46:41 +08:00 |
|
hiyouga
|
2d6b32c227
|
tiny fix
Former-commit-id: 69dac21ed9f07977b4540eb838a0ef93f3d3abc4
|
2024-06-27 00:36:04 +08:00 |
|
hiyouga
|
28c2c7fba5
|
support HQQ/EETQ #4113
Former-commit-id: b7cb51ddb394f04fe4646b2c297fc8d918c9979e
|
2024-06-27 00:29:42 +08:00 |
|
hiyouga
|
4041aa024b
|
improve autogptq integration
Former-commit-id: d68408c7b123b8ff92014db35cac0b24b414a6f4
|
2024-06-26 22:11:44 +08:00 |
|
hiyouga
|
e823b200cf
|
fix #4458
Former-commit-id: aab14b15268dbe74ded22549dbd3677474868cbb
|
2024-06-26 19:52:35 +08:00 |
|
hiyouga
|
0265a98942
|
fix #4556
Former-commit-id: 81faa9a985c14e83e38f42aedd228edb676b0695
|
2024-06-26 19:43:16 +08:00 |
|
hiyouga
|
f5bf167a6e
|
lint
Former-commit-id: c9e424d2198b5872ce118a6ab4c109bf73be2bee
|
2024-06-25 02:55:50 +08:00 |
|
hiyouga
|
3d1d42030f
|
fix #4432
Former-commit-id: 972a3b469c600bc6528aef3a49b6fdec63d65803
|
2024-06-25 02:34:04 +08:00 |
|
hiyouga
|
8a6405f39e
|
fix #4379
Former-commit-id: 96bedb4b6445a04ff8b97fb2aadace50b2f882df
|
2024-06-25 02:31:44 +08:00 |
|
hiyouga
|
4d2c279083
|
tiny fix about badam
Former-commit-id: 03f49267c7406e36aee35639f86e6e0383897090
|
2024-06-25 01:54:53 +08:00 |
|
hoshi-hiyouga
|
0105689cf4
|
Merge pull request #4352 from Ledzy/main
[Enhancement] Support ZeRO-3 when using BAdam
Former-commit-id: 0dc75275efa7d7540b472783a52ea6aeaa503c0b
|
2024-06-25 01:49:13 +08:00 |
|
hiyouga
|
f9d00ce051
|
tiny fix
Former-commit-id: bb57478366a70a0871af30ab31c890f471e27ff4
|
2024-06-25 01:15:19 +08:00 |
|
hoshi-hiyouga
|
33bf263e4e
|
Merge pull request #4409 from kno10/patch-2
Print help if no arguments given
Former-commit-id: 94ff749773d9f30ee0c98872ace6b7b542fadeda
|
2024-06-24 23:21:31 +08:00 |
|
hoshi-hiyouga
|
c78db25a24
|
Update cli.py
Former-commit-id: 9db6126496ec9e834541823715f700f92b3968c7
|
2024-06-24 23:21:10 +08:00 |
|
hoshi-hiyouga
|
1dcb792c82
|
Merge pull request #4417 from mMrBun/main
Add tool_format parameter to rewrite templates for different function call formats.
Former-commit-id: 8d1460cad5bff5e4626fdd675046021e0a3d1947
|
2024-06-24 23:17:55 +08:00 |
|
hoshi-hiyouga
|
d9529b749e
|
Update template.py
Former-commit-id: d53517bff6f8734221d7df9982f3bdd4d2eb2cab
|
2024-06-24 23:12:59 +08:00 |
|
hoshi-hiyouga
|
70410aedc1
|
Update loader.py
Former-commit-id: afa59d61844595e6b615227e6bfdc0b16c8015dd
|
2024-06-24 23:06:18 +08:00 |
|
hiyouga
|
a27d4bb4be
|
fix #4410
Former-commit-id: f49adc4ab5eade21d7a9e029212f17688ee9b0cf
|
2024-06-24 22:34:31 +08:00 |
|
hoshi-hiyouga
|
bd26f25daa
|
Merge pull request #4446 from stceum/bug-fix
Bug Fix: `off` is parsed as `False` in yaml file
Former-commit-id: 243478a3d6c08f5677ee57871862694561617f64
|
2024-06-24 21:41:28 +08:00 |
|
hoshi-hiyouga
|
1372049120
|
Update parser.py
Former-commit-id: 60e605cd9d399bd04432864ede9c84302890eac8
|
2024-06-24 21:37:42 +08:00 |
|
stceum
|
0bf750ade8
|
Bug Fix: off is parsed as False in yaml file, changed to disabled to avoid this.
Former-commit-id: 171289d8e4c111fdca2b100282b64c74a04a4726
|
2024-06-24 20:39:31 +08:00 |
|
hiyouga
|
83ee461b9a
|
update readme
Former-commit-id: a1477208471039d3578980f929f1ca8c2a07aa96
|
2024-06-24 18:22:12 +08:00 |
|
mMrBun
|
15a104e26d
|
Add tool_format to overwrite tool formatter template
Former-commit-id: af08971ca50443fd5597e5e4412a3aa17214502f
|
2024-06-22 02:13:23 +08:00 |
|
hiyouga
|
c173a1e9ca
|
remove dup template
Former-commit-id: 5fec12203b24608af4d4993f44a657eb5a0348e5
|
2024-06-22 01:31:32 +08:00 |
|
hiyouga
|
c6f5024e41
|
fix api
Former-commit-id: dcbd6d86dfc49f12529b02ec331e3e5c05740061
|
2024-06-22 00:00:38 +08:00 |
|
Erich Schubert
|
a5a75ec20c
|
Print help if no arguments given
Former-commit-id: 08dfb7ec636fd5bfbb30dac9d5fba6e32bfc6728
|
2024-06-21 09:14:21 +02:00 |
|
ancv
|
4d345f7901
|
move configure_packing to llamafactory.model.patcher and fix constants
Former-commit-id: 9c5e972c9c81957f2e9e30bf284ef1c076de9fd0
|
2024-06-21 00:45:06 +07:00 |
|
hiyouga
|
fecde5c13f
|
tiny fix
Former-commit-id: 2d8d47f6126d68db1701ed18fc31310c6f14dd49
|
2024-06-20 22:56:05 +08:00 |
|
hiyouga
|
5ae34858da
|
improve llamaboard
Former-commit-id: e606ab35c0eced667dde7137c2d72848f264c96c
|
2024-06-19 23:46:03 +08:00 |
|
hiyouga
|
2b961c1f5b
|
fix llamaboard abort
Former-commit-id: 9ef609a2c0185040e531dea3829a6f481539cdea
|
2024-06-19 23:22:28 +08:00 |
|
hiyouga
|
0680f18633
|
update patcher
Former-commit-id: afb365e515d615dd62f791622450debab60ce5cc
|
2024-06-19 21:27:00 +08:00 |
|
hiyouga
|
fadad08706
|
set dev version
Former-commit-id: 221665345d97f839ce4ba8d54643da30c71b6083
|
2024-06-19 21:08:16 +08:00 |
|
hiyouga
|
741c0b7566
|
release v0.8.2
Former-commit-id: 3050bbe51d46acd8473275d2713fc28932e4a3d3
|
2024-06-19 20:42:09 +08:00 |
|
hiyouga
|
11f88c4fdc
|
fix jinja template
Former-commit-id: 0ebf2e2ee23918d28b0cbb20ba456732d6eedfbb
|
2024-06-19 20:03:50 +08:00 |
|
hiyouga
|
da3b0aab6d
|
fix templates
Former-commit-id: 6f357d59b73309c5955683008632e7f320e7dcb1
|
2024-06-19 17:44:05 +08:00 |
|
Jonery
|
a22e932b4f
|
Cleaner integration.
Former-commit-id: 26d4b05d424bd71f570195dd433258caf6465d92
|
2024-06-19 12:29:40 +08:00 |
|
hiyouga
|
15959d522c
|
fix bug
Former-commit-id: 412139eaa2fde98ba19e1257d21144382a59f0d6
|
2024-06-19 03:49:23 +08:00 |
|
hiyouga
|
5d7dfa75ca
|
use prefix to replace force system
Former-commit-id: 731d9a964f1c3dbfb83825524d697831e691fb9d
|
2024-06-19 03:39:52 +08:00 |
|
hiyouga
|
b11e57157f
|
fix tool formatter, allow parallel function #4362
Former-commit-id: b8f16c976db4ecec1cc8558851c8cbfb6a5b7e9c
|
2024-06-19 03:23:51 +08:00 |
|