Commit Graph

1001 Commits

Author SHA1 Message Date
hiyouga
07f9b754a7 fix #2782 #2798 2024-03-12 15:53:29 +08:00
hoshi-hiyouga
c901aa63ff Merge pull request #2743 from S3Studio/DockerizeSupport
Add dockerize support
2024-03-12 00:05:49 +08:00
hiyouga
e874c00906 fix #2775 2024-03-11 00:42:54 +08:00
hiyouga
352693e2dc tiny fix 2024-03-11 00:17:18 +08:00
hiyouga
be99799413 update parser 2024-03-10 13:35:20 +08:00
hiyouga
8664262cde support layerwise galore 2024-03-10 00:24:11 +08:00
hiyouga
18ffce36b5 fix #2732 2024-03-09 22:37:16 +08:00
hiyouga
bdb496644c allow non-packing pretraining 2024-03-09 22:21:46 +08:00
hiyouga
412c52e325 fix #2766 2024-03-09 21:35:24 +08:00
hiyouga
af0e370fb1 use default arg for freeze tuning 2024-03-09 06:08:48 +08:00
hiyouga
818726e9bc add GaLore results 2024-03-09 04:11:55 +08:00
hiyouga
393c2de27c update hardware requirements 2024-03-09 03:58:18 +08:00
hiyouga
4c00bcdcae update examples 2024-03-09 02:30:37 +08:00
hiyouga
e8dd38b7fd fix #2756 , patch #2746 2024-03-09 02:01:26 +08:00
hoshi-hiyouga
516d0ddc66 Merge pull request #2746 from stephen-nju/main
fix deepspeed ppo RuntimeError
2024-03-09 01:37:00 +08:00
hiyouga
74ff8664d7 Update setup.py 2024-03-09 00:14:48 +08:00
hiyouga
10be2f0ecc fix aqlm version 2024-03-09 00:09:09 +08:00
hiyouga
8a45213440 fix example params 2024-03-08 20:41:43 +08:00
stephen_zhu
aa71571b77 update 2024-03-08 12:47:44 +08:00
stephen
cdb7f82869 fix ppo runtime error 2024-03-08 11:48:26 +08:00
S3Studio
3d911ae713 Add dockerize support
Already tested with the model of Qwen:1.8B and the dataset of alpaca_data_zh. Some python libraries are added to the Dockerfile as a result of the exception messages displayed throughout test procedure.
2024-03-08 10:47:28 +08:00
hiyouga
4a2cc60b94 update readme 2024-03-08 03:06:21 +08:00
hiyouga
5d956e2a51 fix chat engine, update webui 2024-03-08 03:01:53 +08:00
hiyouga
5cd4947650 Update setup.py 2024-03-08 01:23:00 +08:00
hiyouga
0ac6b40a47 update galore args 2024-03-08 01:17:32 +08:00
hiyouga
33a4c24a8a fix galore 2024-03-08 00:44:51 +08:00
hiyouga
57452a4aa1 add Yi-9B model 2024-03-07 23:11:57 +08:00
hiyouga
7230e1177d add galore examples 2024-03-07 22:53:45 +08:00
hiyouga
28f7862188 support galore 2024-03-07 22:41:36 +08:00
hiyouga
725f7cd70f update readme 2024-03-07 20:34:49 +08:00
hiyouga
77211d9843 tiny fix 2024-03-07 20:29:34 +08:00
hoshi-hiyouga
a0dc721816 Merge pull request #2739 from hiyouga/dev-vllm
support vllm
2024-03-07 20:28:18 +08:00
hiyouga
d07ad5cc1c support vllm 2024-03-07 20:26:31 +08:00
hiyouga
f74f804a71 fix #2735 2024-03-07 16:15:53 +08:00
hoshi-hiyouga
2185855bdb Merge pull request #2730 from cx2333-gt/main
fix flash_attn in train_web
2024-03-07 14:37:18 +08:00
cx2333
94b7a1b915 revert choice name 2024-03-07 14:28:55 +08:00
hiyouga
921ee82267 fix chatglm3 template 2024-03-07 14:26:16 +08:00
hiyouga
08d7dc06f2 Update wechat.jpg 2024-03-07 13:14:10 +08:00
cx2333
a8889498fa fix flash_attn in train_web 2024-03-07 10:13:55 +08:00
hiyouga
0048a2021e tiny fix 2024-03-06 17:25:08 +08:00
hiyouga
3e84f430b1 export use balanced gpu 2024-03-06 16:33:14 +08:00
hiyouga
9658c63cd9 fix add tokens 2024-03-06 15:04:02 +08:00
hiyouga
3016e65657 fix version checking 2024-03-06 14:51:51 +08:00
hiyouga
d1587c80de update examples 2024-03-06 13:14:57 +08:00
hiyouga
e0c47358f9 fix arg dtype 2024-03-05 20:53:30 +08:00
hiyouga
259af60d28 improve aqlm optim 2024-03-05 20:49:50 +08:00
hiyouga
d3d3dac707 optimize aqlm training 2024-03-05 18:35:41 +08:00
hiyouga
ddf352f861 fix dora inference 2024-03-05 11:51:41 +08:00
hiyouga
e5edcf440f fix export model 2024-03-05 11:05:41 +08:00
hiyouga
df9e6bb063 update readme 2024-03-05 03:20:23 +08:00