Commit Graph

387 Commits

Author SHA1 Message Date
hiyouga
2340b0d7df fix MMLU 2023-09-23 00:42:23 +08:00
hiyouga
465ee8119a add MMLU and C-Eval script 2023-09-23 00:34:17 +08:00
hiyouga
5cc7a44784 fix #1000 2023-09-22 15:00:48 +08:00
hiyouga
044d4425b4 update readme 2023-09-22 14:34:13 +08:00
hiyouga
5f3ab3ddde fix webui 2023-09-21 19:55:38 +08:00
hiyouga
dbaef776a1 tiny fix 2023-09-21 19:52:06 +08:00
hiyouga
338b8664ed fix #944 2023-09-21 19:51:02 +08:00
hiyouga
ace3f85a72 tiny fix 2023-09-21 15:25:29 +08:00
hiyouga
e510006ed6 Merge branch 'main' of https://github.com/hiyouga/LLaMA-Efficient-Tuning 2023-09-21 13:52:19 +08:00
hiyouga
837b487d8a Update wechat.jpg 2023-09-21 13:52:02 +08:00
hoshi-hiyouga
ac8648b431 Merge pull request #975 from statelesshz/npu-support
Add Ascend NPU support
2023-09-20 14:56:50 +08:00
statelesshz
b3e41c6d49 support export model on Ascend NPU 2023-09-20 10:26:02 +08:00
hiyouga
10ab2f8b90 fix webui 2023-09-19 18:35:21 +08:00
hiyouga
7e8655c8b5 fix error info 2023-09-19 18:30:23 +08:00
hiyouga
469f859161 add tests.cal_flops.py 2023-09-16 23:40:41 +08:00
hiyouga
acda45e463 update readme 2023-09-16 17:33:01 +08:00
hiyouga
0b5f970c05 fix #913 2023-09-15 20:58:28 +08:00
hiyouga
8632bff811 fix #896 2023-09-14 18:37:34 +08:00
hiyouga
8857e45602 fix #887 2023-09-14 17:56:58 +08:00
hoshi-hiyouga
3202985087 Merge pull request #900 from mmbwf/main
Fix PPO replace_model loading wrong default parameters.
2023-09-14 17:34:22 +08:00
hiyouga
bd4e24bfee Update wechat.jpg 2023-09-14 16:31:11 +08:00
mmbwf
30fb721f12 Update utils.py
Fix parameters load error.
2023-09-14 15:38:04 +08:00
hiyouga
026af87e7f add MathInstruct dataset 2023-09-13 22:30:14 +08:00
hiyouga
7ba57d5b14 fix ppo save model 2023-09-12 16:25:29 +08:00
hiyouga
d4be857e23 fix #762 #814 2023-09-12 16:10:10 +08:00
hiyouga
3b306478d4 tiny fix 2023-09-11 18:27:08 +08:00
hiyouga
ccb3553576 Release v0.1.8 2023-09-11 17:31:34 +08:00
hiyouga
0fbece85a7 update flashattn, fix ppo save model 2023-09-11 17:25:36 +08:00
hiyouga
b218c271ed remove PeftTrainer 2023-09-10 22:23:23 +08:00
hiyouga
baac22f4f4 truncate readme 2023-09-10 21:04:20 +08:00
hiyouga
63611de7ae update readme 2023-09-10 21:01:20 +08:00
hiyouga
34005252df update readme 2023-09-10 20:52:21 +08:00
hiyouga
d8aa1404be support FlashAttention2 2023-09-10 20:43:56 +08:00
hiyouga
815b92e698 fix #850 2023-09-10 14:22:03 +08:00
hiyouga
a51b7c98ac fix lora target 2023-09-09 17:04:45 +08:00
hiyouga
bca1a247bc support lora target auto find 2023-09-09 15:38:37 +08:00
hiyouga
d8d82ca281 fix chatglm2 tokenizer 2023-09-09 13:50:29 +08:00
hiyouga
d2015c8e12 add baichuan2 convert script 2023-09-08 22:59:41 +08:00
hiyouga
90bd085ae4 fix bug in DPO data collator 2023-09-08 20:45:07 +08:00
hiyouga
b34797a845 fix #761 2023-09-08 20:22:18 +08:00
hiyouga
8ea32e4046 change to right-padding, update reward score #803 2023-09-08 20:04:31 +08:00
hiyouga
8aaaa132d4 fix chatglm template 2023-09-08 14:45:58 +08:00
hiyouga
8b66247d2f Update wechat.jpg 2023-09-07 20:56:07 +08:00
hiyouga
f5351c18e1 update requirements 2023-09-07 19:26:25 +08:00
hiyouga
5a9970dbef fix #818 2023-09-07 19:19:53 +08:00
hiyouga
ed1c2c5557 add deepspeed check in PPO training 2023-09-07 19:12:40 +08:00
hiyouga
e2bf7c3bad fix #809 2023-09-07 19:04:32 +08:00
hiyouga
85b1f6632a fix baichuan templates 2023-09-07 18:54:14 +08:00
hiyouga
0531886e1f update baichuan2 template 2023-09-06 21:43:06 +08:00
hiyouga
60603a94c6 add Baichuan2 models 2023-09-06 18:40:11 +08:00