hiyouga
|
889c042ecd
|
update npu docker
Former-commit-id: 2f4d5174205605b8821d4fb626283e07694ecf80
|
2024-06-30 21:05:31 +08:00 |
|
hiyouga
|
3c4f8eaa55
|
loose gemma2 attention
Former-commit-id: a0b645017a2de3d58b6cbc71bd91ec96fc7a818b
|
2024-06-29 01:42:14 +08:00 |
|
hiyouga
|
6a75d57060
|
update readme
Former-commit-id: 9f809c311af373508cb51b204ae54b047729a9dc
|
2024-06-28 06:55:19 +08:00 |
|
hiyouga
|
fda2cf677b
|
bf16 by default, gemma2 attns
Gemma2 finetuning cannot work until merging https://github.com/huggingface/transformers/pull/31674
Former-commit-id: da66c32c7be0adc28d2185b23e9f62d56acb961c
|
2024-06-28 06:00:26 +08:00 |
|
hiyouga
|
cfdf5a5a78
|
increase pissa_iter for stability
Former-commit-id: 03f8d9b0fb10ae58e7f68508197330d616957899
|
2024-06-28 03:18:54 +08:00 |
|
hiyouga
|
a1437c15f7
|
fix docker flashattn
Former-commit-id: 0966f5d4616a3877a6b921976dc39e8799831d36
|
2024-06-28 01:28:59 +08:00 |
|
hiyouga
|
42e7489713
|
add Gemma2 models
Former-commit-id: 8fc5a248ecfd6861cb90dac6c14fe89cdeaf8921
|
2024-06-28 01:26:50 +08:00 |
|
hiyouga
|
024760f866
|
update examples
Former-commit-id: 66f248b90cfa2b29c73060459b2337b78154c47b
|
2024-06-28 01:17:07 +08:00 |
|
hiyouga
|
46f0189e88
|
refactor pissa, improve llamaboard
Former-commit-id: 619556e46c19718f702c97df5d570a2a4c5fb13a
|
2024-06-28 01:04:24 +08:00 |
|
hoshi-hiyouga
|
edc7498111
|
Merge pull request #4580 from hzhaoy/bugfix-deepspeed-pissa
Fix bug when using pissa method with deepspeed
Former-commit-id: f260d458f91d6d2b4ed141f64844cded11d5aaad
|
2024-06-28 00:46:51 +08:00 |
|
hiyouga
|
9103fdf866
|
fix #4549
Former-commit-id: c9fdef10de737d1f433209812ef73e29cb60490a
|
2024-06-28 00:41:58 +08:00 |
|
hiyouga
|
95bf795de4
|
fix docker file
Former-commit-id: 688f02decb1185deb74b26444f7643cab7d355c1
|
2024-06-27 20:29:16 +08:00 |
|
hiyouga
|
bf99223a80
|
tiny fix
Former-commit-id: c1a78a3a9f8ab9d57577cee37f9c457d60863ba2
|
2024-06-27 20:14:48 +08:00 |
|
hoshi-hiyouga
|
9caf9b6f91
|
Merge pull request #4590 from injet-zhou/main
Exit the process with the subprocess's return code when utilizing the CLI
Former-commit-id: c6a8a7f239d7aa7c74ba09d55a24d4416181cc02
|
2024-06-27 20:09:36 +08:00 |
|
hoshi-hiyouga
|
727c7b0dc6
|
Merge pull request #4461 from hzhaoy/feature/support-flash-attn
support flash-attn in Dockerfile
Former-commit-id: e30a47ab5bda9303c8a2eb814caf0dd40c01b125
|
2024-06-27 20:05:26 +08:00 |
|
hoshi-hiyouga
|
13d184b280
|
Merge pull request #4561 from hashstone/fix-docker-npu
fix torch-npu dependency
Former-commit-id: 14867c5cf8be3a5e8a91a6533a615d32d298fd67
|
2024-06-27 19:58:16 +08:00 |
|
hoshi-hiyouga
|
12a91774b0
|
Update Dockerfile
Former-commit-id: a239f535a64378b74ef34799cd8e2e4a78f00f4c
|
2024-06-27 19:57:40 +08:00 |
|
hoshi-hiyouga
|
88018000ac
|
Update Dockerfile
Former-commit-id: 7dea6840256472f8aa2c642f11d9e30bfa0fb96f
|
2024-06-27 19:51:25 +08:00 |
|
hoshi-hiyouga
|
f6eda1c35d
|
Update setup.py
Former-commit-id: 544e1844fb237eed3eb621f4e6e355eac2ff7b85
|
2024-06-27 19:38:15 +08:00 |
|
hoshi-hiyouga
|
a2ebdbc112
|
Update README_zh.md
Former-commit-id: 62f2e27f4355aa35c26e1146dbe90fac3b380118
|
2024-06-27 19:17:52 +08:00 |
|
hoshi-hiyouga
|
e930a42083
|
Update README.md
Former-commit-id: 01869ccbb5af2704c9d5bfdd4f2ff30978fb466d
|
2024-06-27 19:17:35 +08:00 |
|
hoshi-hiyouga
|
4b123f49cb
|
Update setup.py
Former-commit-id: 42293ab26f7fd7ffb77b308655ccd47b7c2ffa84
|
2024-06-27 19:16:46 +08:00 |
|
faddddeout
|
556eca918d
|
Exit the process with the subprocess's return code when utilizing the CLI
Former-commit-id: ab42a4e2501a80fba1704a506bd1209a441570fa
|
2024-06-27 09:58:00 +00:00 |
|
fanjunliang
|
31fcd03f3c
|
support docker-npu-[amd64|arm64] build
Former-commit-id: 25f16f5e299c94175e62bac9f0da5b47a2bb31b7
|
2024-06-27 15:25:12 +08:00 |
|
hzhaoy
|
89d9dd5aa5
|
fix #4579
Former-commit-id: 0fa298ff6a4febea36ea9f11c7594277a77e6e9b
|
2024-06-27 13:49:57 +08:00 |
|
hiyouga
|
d1aad72826
|
add quant checks
Former-commit-id: 15bb053e3549739b1a2134640a659b0f35df7de7
|
2024-06-27 01:12:25 +08:00 |
|
hiyouga
|
8e5b4bddf4
|
update examples
Former-commit-id: cce238f7d07919b79237bc9ab39265766c20f020
|
2024-06-27 00:53:33 +08:00 |
|
hiyouga
|
5a7cb9af4e
|
tiny fix
Former-commit-id: c6747a39dbbdda8decaa104499918bc7ac5f02e4
|
2024-06-27 00:46:41 +08:00 |
|
hiyouga
|
d1cda4ec68
|
tiny fix
Former-commit-id: 69dac21ed9f07977b4540eb838a0ef93f3d3abc4
|
2024-06-27 00:36:04 +08:00 |
|
hiyouga
|
8aaf1185a5
|
support HQQ/EETQ #4113
Former-commit-id: b7cb51ddb394f04fe4646b2c297fc8d918c9979e
|
2024-06-27 00:29:42 +08:00 |
|
hzhaoy
|
b46bd07119
|
add flash-attn installation flag in Dockerfile
Former-commit-id: 2535044e95f6df628bd1f01e0eecb02407105d79
|
2024-06-27 00:13:30 +08:00 |
|
hiyouga
|
08fa707085
|
improve autogptq integration
Former-commit-id: d68408c7b123b8ff92014db35cac0b24b414a6f4
|
2024-06-26 22:11:44 +08:00 |
|
hiyouga
|
72ba29d81a
|
fix #4458
Former-commit-id: aab14b15268dbe74ded22549dbd3677474868cbb
|
2024-06-26 19:52:35 +08:00 |
|
hiyouga
|
cf2dc4c444
|
fix #4556
Former-commit-id: 81faa9a985c14e83e38f42aedd228edb676b0695
|
2024-06-26 19:43:16 +08:00 |
|
fanjunliang
|
d82d86e16d
|
fix torch-npu dependency
Former-commit-id: 7c8a8061d0cda6342f6c883748fb6bc6650df9f9
|
2024-06-26 18:21:42 +08:00 |
|
hoshi-hiyouga
|
bde31d8600
|
Merge pull request #4544 from MengqingCao/npu
fix docker-compose path
Former-commit-id: a3389661d2f6eb6ff7f67204a6d11b758e08d9c8
|
2024-06-26 10:19:24 +08:00 |
|
MengqingCao
|
e115d55585
|
fix docker-compose path
Former-commit-id: 9de3c24aa2a8268be06c8fef8e47f4fb6715c7ec
|
2024-06-26 02:15:00 +00:00 |
|
hzhaoy
|
daea86e047
|
support flash-attn in Dockerfile
Former-commit-id: 0dba000aa178f915cea7d75bf0c9d47e671a21d2
|
2024-06-25 15:13:07 +08:00 |
|
hiyouga
|
a4f69d8914
|
fix #4456
Former-commit-id: 920f4fa4ca9e08bcf0d16450e085ee0fa8b4e1c5
|
2024-06-25 14:34:13 +08:00 |
|
hiyouga
|
98f382fda3
|
lint
Former-commit-id: c9e424d2198b5872ce118a6ab4c109bf73be2bee
|
2024-06-25 02:55:50 +08:00 |
|
hiyouga
|
cd899734f3
|
fix test case
Former-commit-id: 6663057cfbdc96385d901a5dfba22cfcd7a61b23
|
2024-06-25 02:51:49 +08:00 |
|
hiyouga
|
f51b435bcf
|
fix #4432
Former-commit-id: 972a3b469c600bc6528aef3a49b6fdec63d65803
|
2024-06-25 02:34:04 +08:00 |
|
hiyouga
|
0f82a55305
|
fix #4379
Former-commit-id: 96bedb4b6445a04ff8b97fb2aadace50b2f882df
|
2024-06-25 02:31:44 +08:00 |
|
hiyouga
|
9fd7a410bb
|
tiny fix about badam
Former-commit-id: 03f49267c7406e36aee35639f86e6e0383897090
|
2024-06-25 01:54:53 +08:00 |
|
hiyouga
|
98fb3d015a
|
fix #4419
Former-commit-id: 15069c3ca814d5ac9beec77d914b71cde7ea0f47
|
2024-06-25 01:51:29 +08:00 |
|
hoshi-hiyouga
|
bfb2ad7c79
|
Merge pull request #4352 from Ledzy/main
[Enhancement] Support ZeRO-3 when using BAdam
Former-commit-id: 0dc75275efa7d7540b472783a52ea6aeaa503c0b
|
2024-06-25 01:49:13 +08:00 |
|
hiyouga
|
135bfbf7c1
|
tiny fix
Former-commit-id: bb57478366a70a0871af30ab31c890f471e27ff4
|
2024-06-25 01:15:19 +08:00 |
|
hoshi-hiyouga
|
c6b17ebc20
|
Merge pull request #4355 from MengqingCao/npu
Add docker-npu
Former-commit-id: 2a59806352713764b1e4b7a54942466f972f5fdc
|
2024-06-25 01:07:43 +08:00 |
|
hoshi-hiyouga
|
b55eb30474
|
Update README_zh.md
Former-commit-id: f0c95160fea48b8c6291f42beb79ac089177fbb2
|
2024-06-25 01:06:59 +08:00 |
|
hoshi-hiyouga
|
cec2f1fc00
|
Update README.md
Former-commit-id: abe7aca5e133960da9200e3a036d9a550f474171
|
2024-06-25 01:03:38 +08:00 |
|