Commit Graph

1268 Commits

Author SHA1 Message Date
hiyouga
54e786346e add eval acc
Former-commit-id: 1856a08e87
2024-07-01 03:51:20 +08:00
hiyouga
ca7b65439d fix #4402 #4617
Deprecate reserved_label_len arg


Former-commit-id: 1771251ce3
2024-07-01 01:19:27 +08:00
hiyouga
bbc37b2880 fix #4398 #4592
Former-commit-id: d74244d568
2024-06-30 21:28:51 +08:00
hiyouga
2b006beab1 loose gemma2 attention
Former-commit-id: 2f4b89ace1
2024-06-29 01:42:14 +08:00
hiyouga
87e60f8bac bf16 by default, gemma2 attns
Gemma2 finetuning cannot work until merging https://github.com/huggingface/transformers/pull/31674


Former-commit-id: 4d35e218b1
2024-06-28 06:00:26 +08:00
hiyouga
b0acd27114 increase pissa_iter for stability
Former-commit-id: 64f4337dac
2024-06-28 03:18:54 +08:00
hiyouga
d3b7c489f2 add Gemma2 models
Former-commit-id: 6f63050e1b
2024-06-28 01:26:50 +08:00
hiyouga
835f0578c2 refactor pissa, improve llamaboard
Former-commit-id: 8baf3b22b0
2024-06-28 01:04:24 +08:00
hoshi-hiyouga
1dad756cff Merge pull request #4580 from hzhaoy/bugfix-deepspeed-pissa
Fix bug when using pissa method with deepspeed

Former-commit-id: ef38daa0a4
2024-06-28 00:46:51 +08:00
hiyouga
a294ef2fae fix #4549
Former-commit-id: 8ed6b367e2
2024-06-28 00:41:58 +08:00
hiyouga
7c488cea57 tiny fix
Former-commit-id: e44a4f07f0
2024-06-27 20:14:48 +08:00
faddddeout
9a2e77a5d8 Exit the process with the subprocess's return code when utilizing the CLI
Former-commit-id: f6b62f0070
2024-06-27 09:58:00 +00:00
hzhaoy
e1751f6398 fix #4579
Former-commit-id: 677c86594e
2024-06-27 13:49:57 +08:00
hiyouga
58607ec1b0 add quant checks
Former-commit-id: 96a5044394
2024-06-27 01:12:25 +08:00
hiyouga
f2425cb4ed tiny fix
Former-commit-id: f17c9dfd84
2024-06-27 00:46:41 +08:00
hiyouga
da80d41c78 tiny fix
Former-commit-id: 29c710da3a
2024-06-27 00:36:04 +08:00
hiyouga
d2d9fa4abb support HQQ/EETQ #4113
Former-commit-id: ad144c2265
2024-06-27 00:29:42 +08:00
hiyouga
6b2733ce12 improve autogptq integration
Former-commit-id: addca926de
2024-06-26 22:11:44 +08:00
hiyouga
28e613efd0 fix #4458
Former-commit-id: 8d6cd69ac4
2024-06-26 19:52:35 +08:00
hiyouga
654116c0b1 fix #4556
Former-commit-id: 59e0b4f616
2024-06-26 19:43:16 +08:00
hiyouga
f3f25ae3b7 lint
Former-commit-id: 555ca8d780
2024-06-25 02:55:50 +08:00
hiyouga
0ae1302e41 fix #4432
Former-commit-id: 1e9d0aa1e4
2024-06-25 02:34:04 +08:00
hiyouga
ad0304e147 fix #4379
Former-commit-id: cc016461e6
2024-06-25 02:31:44 +08:00
hiyouga
a225b5a70c tiny fix about badam
Former-commit-id: 095fab58d3
2024-06-25 01:54:53 +08:00
hoshi-hiyouga
fe6ef6400c Merge pull request #4352 from Ledzy/main
[Enhancement] Support ZeRO-3 when using BAdam

Former-commit-id: d0f953bf5b
2024-06-25 01:49:13 +08:00
hiyouga
d519c2fde5 tiny fix
Former-commit-id: 41086059b1
2024-06-25 01:15:19 +08:00
hoshi-hiyouga
37a079a072 Merge pull request #4409 from kno10/patch-2
Print help if no arguments given

Former-commit-id: 3bed18c644
2024-06-24 23:21:31 +08:00
hoshi-hiyouga
60937ccf32 Update cli.py
Former-commit-id: acb61f7ab7
2024-06-24 23:21:10 +08:00
hoshi-hiyouga
709bbc1d92 Merge pull request #4417 from mMrBun/main
Add tool_format parameter to rewrite templates for different function call formats.

Former-commit-id: def6d280db
2024-06-24 23:17:55 +08:00
hoshi-hiyouga
b7f5cfde6e Update template.py
Former-commit-id: 1240bd57d8
2024-06-24 23:12:59 +08:00
hoshi-hiyouga
673f27a59e Update loader.py
Former-commit-id: dddfd516ee
2024-06-24 23:06:18 +08:00
hiyouga
47651a94a3 fix #4410
Former-commit-id: fca893d73c
2024-06-24 22:34:31 +08:00
hoshi-hiyouga
fe407e8de6 Merge pull request #4446 from stceum/bug-fix
Bug Fix: `off` is parsed as `False` in yaml file

Former-commit-id: cc452c32c7
2024-06-24 21:41:28 +08:00
hoshi-hiyouga
e74fcdf7b1 Update parser.py
Former-commit-id: e90c424f55
2024-06-24 21:37:42 +08:00
stceum
9aa640f27b Bug Fix: off is parsed as False in yaml file, changed to disabled to avoid this.
Former-commit-id: 3ed063f281
2024-06-24 20:39:31 +08:00
hiyouga
7be502c5c5 update readme
Former-commit-id: e507e60638
2024-06-24 18:22:12 +08:00
mMrBun
c0e005e2ea Add tool_format to overwrite tool formatter template
Former-commit-id: 20e2e6fdcb
2024-06-22 02:13:23 +08:00
hiyouga
98abb5c900 remove dup template
Former-commit-id: db9a1912e3
2024-06-22 01:31:32 +08:00
hiyouga
ccc9a895a6 fix api
Former-commit-id: 3ce44dda99
2024-06-22 00:00:38 +08:00
Erich Schubert
cf23a279fd Print help if no arguments given
Former-commit-id: 7d70ba7fb8
2024-06-21 09:14:21 +02:00
hiyouga
0844750bb9 tiny fix
Former-commit-id: 8d4f5093cf
2024-06-20 22:56:05 +08:00
hiyouga
6ea4680334 improve llamaboard
Former-commit-id: f22d8f9ca4
2024-06-19 23:46:03 +08:00
hiyouga
029c343537 fix llamaboard abort
Former-commit-id: 3f84411b5d
2024-06-19 23:22:28 +08:00
hiyouga
030b4811c7 update patcher
Former-commit-id: 3b040e8e0f
2024-06-19 21:27:00 +08:00
hiyouga
80e9f8e000 set dev version
Former-commit-id: 42e69a3c63
2024-06-19 21:08:16 +08:00
hiyouga
9c1b04cd11 release v0.8.2
Former-commit-id: 71327ba85a
2024-06-19 20:42:09 +08:00
hiyouga
3d72b1a856 fix jinja template
Former-commit-id: 2b596fb55f
2024-06-19 20:03:50 +08:00
hiyouga
7735456561 fix templates
Former-commit-id: 4cff6a4ad5
2024-06-19 17:44:05 +08:00
Jonery
c779899f7b Cleaner integration.
Former-commit-id: 5c2ff1b749
2024-06-19 12:29:40 +08:00
hiyouga
c9557241f6 fix bug
Former-commit-id: 6d2bf216ac
2024-06-19 03:49:23 +08:00