Commit Graph

1856 Commits

Author SHA1 Message Date
hiyouga
c346f79f99 update func name 2024-07-03 23:29:33 +08:00
hiyouga
8a6a7b9c8a update arg name 2024-07-03 23:23:24 +08:00
hiyouga
575a02a23d update hparams 2024-07-03 23:18:58 +08:00
hiyouga
7f770f6895 update ui 2024-07-03 23:13:49 +08:00
hiyouga
a4a1ddbcb9 test 2024-07-03 23:05:39 +08:00
ancv
e8e13b0942 move efficient_packing from data_args to model_args 2024-07-02 18:37:55 +07:00
hoshi-hiyouga
e8e6af2651 Merge branch 'main' into main 2024-07-01 21:01:09 +08:00
hiyouga
33f2ddb8b6 Update wechat_npu.jpg 2024-07-01 16:28:54 +08:00
hiyouga
73280b7dc7 tiny fix 2024-07-01 05:43:17 +08:00
hiyouga
8c41a0aa6d tiny fix 2024-07-01 03:55:20 +08:00
hiyouga
1856a08e87 add eval acc 2024-07-01 03:51:20 +08:00
hiyouga
fc2c15d713 Update label_issue.yml 2024-07-01 01:29:09 +08:00
hiyouga
1771251ce3 fix #4402 #4617
Deprecate reserved_label_len arg
2024-07-01 01:19:27 +08:00
hiyouga
d4e2af1fa4 update readme 2024-07-01 00:22:52 +08:00
hiyouga
d74244d568 fix #4398 #4592 2024-06-30 21:28:51 +08:00
hiyouga
93e6fbb37d update npu docker 2024-06-30 21:05:31 +08:00
hiyouga
2f4b89ace1 loose gemma2 attention 2024-06-29 01:42:14 +08:00
hiyouga
0e0d69b77c update readme 2024-06-28 06:55:19 +08:00
hiyouga
4d35e218b1 bf16 by default, gemma2 attns
Gemma2 finetuning cannot work until merging https://github.com/huggingface/transformers/pull/31674
2024-06-28 06:00:26 +08:00
hiyouga
64f4337dac increase pissa_iter for stability 2024-06-28 03:18:54 +08:00
hiyouga
e3141f5f1b fix docker flashattn 2024-06-28 01:28:59 +08:00
hiyouga
6f63050e1b add Gemma2 models 2024-06-28 01:26:50 +08:00
hiyouga
2f78b5d62a update examples 2024-06-28 01:17:07 +08:00
hiyouga
8baf3b22b0 refactor pissa, improve llamaboard 2024-06-28 01:04:24 +08:00
hoshi-hiyouga
ef38daa0a4 Merge pull request #4580 from hzhaoy/bugfix-deepspeed-pissa
Fix bug when using pissa method with deepspeed
2024-06-28 00:46:51 +08:00
hiyouga
8ed6b367e2 fix #4549 2024-06-28 00:41:58 +08:00
hiyouga
0f421055da fix docker file 2024-06-27 20:29:16 +08:00
hiyouga
e44a4f07f0 tiny fix 2024-06-27 20:14:48 +08:00
hoshi-hiyouga
33ef6f4ec2 Merge pull request #4590 from injet-zhou/main
Exit the process with the subprocess's return code when utilizing the CLI
2024-06-27 20:09:36 +08:00
hoshi-hiyouga
64b131dcfa Merge pull request #4461 from hzhaoy/feature/support-flash-attn
support flash-attn in Dockerfile
2024-06-27 20:05:26 +08:00
hoshi-hiyouga
a6bf74c0c9 Merge pull request #4561 from hashstone/fix-docker-npu
fix torch-npu dependency
2024-06-27 19:58:16 +08:00
hoshi-hiyouga
5fcd33fd4f Update Dockerfile 2024-06-27 19:57:40 +08:00
hoshi-hiyouga
9624af1df3 Update Dockerfile 2024-06-27 19:51:25 +08:00
hoshi-hiyouga
569f03ca1a Update setup.py 2024-06-27 19:38:15 +08:00
hoshi-hiyouga
fc7a08e16a Update README_zh.md 2024-06-27 19:17:52 +08:00
hoshi-hiyouga
06536c44d4 Update README.md 2024-06-27 19:17:35 +08:00
hoshi-hiyouga
03389207f4 Update setup.py 2024-06-27 19:16:46 +08:00
hiyouga
719e2f1fef Update wechat.jpg 2024-06-27 18:46:47 +08:00
faddddeout
f6b62f0070 Exit the process with the subprocess's return code when utilizing the CLI 2024-06-27 09:58:00 +00:00
fanjunliang
bdda0827b3 support docker-npu-[amd64|arm64] build 2024-06-27 15:25:12 +08:00
hzhaoy
677c86594e fix #4579 2024-06-27 13:49:57 +08:00
hiyouga
96a5044394 add quant checks 2024-06-27 01:12:25 +08:00
hiyouga
d417e63f92 update examples 2024-06-27 00:53:33 +08:00
hiyouga
f17c9dfd84 tiny fix 2024-06-27 00:46:41 +08:00
hiyouga
29c710da3a tiny fix 2024-06-27 00:36:04 +08:00
hiyouga
ad144c2265 support HQQ/EETQ #4113 2024-06-27 00:29:42 +08:00
hzhaoy
e19491b0f0 add flash-attn installation flag in Dockerfile 2024-06-27 00:13:30 +08:00
hiyouga
addca926de improve autogptq integration 2024-06-26 22:11:44 +08:00
hiyouga
8d6cd69ac4 fix #4458 2024-06-26 19:52:35 +08:00
hiyouga
59e0b4f616 fix #4556 2024-06-26 19:43:16 +08:00