Commit Graph

1267 Commits

Author SHA1 Message Date
hiyouga
1771251ce3 fix #4402 #4617
Deprecate reserved_label_len arg
2024-07-01 01:19:27 +08:00
hiyouga
d74244d568 fix #4398 #4592 2024-06-30 21:28:51 +08:00
hiyouga
2f4b89ace1 loose gemma2 attention 2024-06-29 01:42:14 +08:00
hiyouga
4d35e218b1 bf16 by default, gemma2 attns
Gemma2 finetuning cannot work until merging https://github.com/huggingface/transformers/pull/31674
2024-06-28 06:00:26 +08:00
hiyouga
64f4337dac increase pissa_iter for stability 2024-06-28 03:18:54 +08:00
hiyouga
6f63050e1b add Gemma2 models 2024-06-28 01:26:50 +08:00
hiyouga
8baf3b22b0 refactor pissa, improve llamaboard 2024-06-28 01:04:24 +08:00
hoshi-hiyouga
ef38daa0a4 Merge pull request #4580 from hzhaoy/bugfix-deepspeed-pissa
Fix bug when using pissa method with deepspeed
2024-06-28 00:46:51 +08:00
hiyouga
8ed6b367e2 fix #4549 2024-06-28 00:41:58 +08:00
hiyouga
e44a4f07f0 tiny fix 2024-06-27 20:14:48 +08:00
faddddeout
f6b62f0070 Exit the process with the subprocess's return code when utilizing the CLI 2024-06-27 09:58:00 +00:00
hzhaoy
677c86594e fix #4579 2024-06-27 13:49:57 +08:00
hiyouga
96a5044394 add quant checks 2024-06-27 01:12:25 +08:00
hiyouga
f17c9dfd84 tiny fix 2024-06-27 00:46:41 +08:00
hiyouga
29c710da3a tiny fix 2024-06-27 00:36:04 +08:00
hiyouga
ad144c2265 support HQQ/EETQ #4113 2024-06-27 00:29:42 +08:00
hiyouga
addca926de improve autogptq integration 2024-06-26 22:11:44 +08:00
hiyouga
8d6cd69ac4 fix #4458 2024-06-26 19:52:35 +08:00
hiyouga
59e0b4f616 fix #4556 2024-06-26 19:43:16 +08:00
hiyouga
555ca8d780 lint 2024-06-25 02:55:50 +08:00
hiyouga
1e9d0aa1e4 fix #4432 2024-06-25 02:34:04 +08:00
hiyouga
cc016461e6 fix #4379 2024-06-25 02:31:44 +08:00
hiyouga
095fab58d3 tiny fix about badam 2024-06-25 01:54:53 +08:00
hoshi-hiyouga
d0f953bf5b Merge pull request #4352 from Ledzy/main
[Enhancement] Support ZeRO-3 when using BAdam
2024-06-25 01:49:13 +08:00
hiyouga
41086059b1 tiny fix 2024-06-25 01:15:19 +08:00
hoshi-hiyouga
3bed18c644 Merge pull request #4409 from kno10/patch-2
Print help if no arguments given
2024-06-24 23:21:31 +08:00
hoshi-hiyouga
acb61f7ab7 Update cli.py 2024-06-24 23:21:10 +08:00
hoshi-hiyouga
def6d280db Merge pull request #4417 from mMrBun/main
Add tool_format parameter to rewrite templates for different function call formats.
2024-06-24 23:17:55 +08:00
hoshi-hiyouga
1240bd57d8 Update template.py 2024-06-24 23:12:59 +08:00
hoshi-hiyouga
dddfd516ee Update loader.py 2024-06-24 23:06:18 +08:00
hiyouga
fca893d73c fix #4410 2024-06-24 22:34:31 +08:00
hoshi-hiyouga
cc452c32c7 Merge pull request #4446 from stceum/bug-fix
Bug Fix: `off` is parsed as `False` in yaml file
2024-06-24 21:41:28 +08:00
hoshi-hiyouga
e90c424f55 Update parser.py 2024-06-24 21:37:42 +08:00
stceum
3ed063f281 Bug Fix: off is parsed as False in yaml file, changed to disabled to avoid this. 2024-06-24 20:39:31 +08:00
hiyouga
e507e60638 update readme 2024-06-24 18:22:12 +08:00
mMrBun
20e2e6fdcb Add tool_format to overwrite tool formatter template 2024-06-22 02:13:23 +08:00
hiyouga
db9a1912e3 remove dup template 2024-06-22 01:31:32 +08:00
hiyouga
3ce44dda99 fix api 2024-06-22 00:00:38 +08:00
Erich Schubert
7d70ba7fb8 Print help if no arguments given 2024-06-21 09:14:21 +02:00
hiyouga
8d4f5093cf tiny fix 2024-06-20 22:56:05 +08:00
hiyouga
f22d8f9ca4 improve llamaboard 2024-06-19 23:46:03 +08:00
hiyouga
3f84411b5d fix llamaboard abort 2024-06-19 23:22:28 +08:00
hiyouga
3b040e8e0f update patcher 2024-06-19 21:27:00 +08:00
hiyouga
42e69a3c63 set dev version 2024-06-19 21:08:16 +08:00
hiyouga
71327ba85a release v0.8.2 2024-06-19 20:42:09 +08:00
hiyouga
2b596fb55f fix jinja template 2024-06-19 20:03:50 +08:00
hiyouga
4cff6a4ad5 fix templates 2024-06-19 17:44:05 +08:00
Jonery
5c2ff1b749 Cleaner integration. 2024-06-19 12:29:40 +08:00
hiyouga
6d2bf216ac fix bug 2024-06-19 03:49:23 +08:00
hiyouga
4f22eae8f4 use prefix to replace force system 2024-06-19 03:39:52 +08:00