386 Commits

Author SHA1 Message Date
hiyouga
5ee1bdecdc add MMLU and C-Eval script
Former-commit-id: 465ee8119aa489a41bee0b01b3c105a2f3dd137f
2023-09-23 00:34:17 +08:00
hiyouga
e930682152 fix #1000
Former-commit-id: 5cc7a447843c578af602a5e054348fad1c9306ce
2023-09-22 15:00:48 +08:00
hiyouga
db21953bf0 update readme
Former-commit-id: 044d4425b447c7b67ea5473d3165d9b040040fba
2023-09-22 14:34:13 +08:00
hiyouga
ff21424290 fix webui
Former-commit-id: 5f3ab3ddde4a16fae3eb121026e94722082e24bf
2023-09-21 19:55:38 +08:00
hiyouga
3bdc40b4db tiny fix
Former-commit-id: dbaef776a171dfb316567553788f2d81d35a51fb
2023-09-21 19:52:06 +08:00
hiyouga
4581d09fa6 fix #944
Former-commit-id: 338b8664edea5ae65192ac657bb013581245ae15
2023-09-21 19:51:02 +08:00
hiyouga
d04585df59 tiny fix
Former-commit-id: ace3f85a7273fbbc531adfe6ad73bf76a5fff52d
2023-09-21 15:25:29 +08:00
hiyouga
2bc685feee Merge branch 'main' of https://github.com/hiyouga/LLaMA-Efficient-Tuning
Former-commit-id: e510006ed68aa64576b62346ae76c7c3f8867e45
2023-09-21 13:52:19 +08:00
hiyouga
7aff33a0dc Update wechat.jpg
Former-commit-id: 837b487d8a4d31a201af78351ee5e0152a2d51db
2023-09-21 13:52:02 +08:00
hoshi-hiyouga
2e493f8d2a Merge pull request #975 from statelesshz/npu-support
Add Ascend NPU support

Former-commit-id: ac8648b431878b2ecfd9f4425d1b303b2806e233
2023-09-20 14:56:50 +08:00
statelesshz
95384eefe8 support export model on Ascend NPU
Former-commit-id: b3e41c6d49728e239b61d8cd9b3603c8dc877549
2023-09-20 10:26:02 +08:00
hiyouga
d7f267a9f9 fix webui
Former-commit-id: 10ab2f8b9053424d8fa4cc9fb51e61ec74a1236e
2023-09-19 18:35:21 +08:00
hiyouga
48e7b600a8 fix error info
Former-commit-id: 7e8655c8b59c3fdc455e304cf875a6b7fcb69290
2023-09-19 18:30:23 +08:00
hiyouga
4e6e42bb55 add tests.cal_flops.py
Former-commit-id: 469f859161dec0e34f4cc849f20e43d442680b5c
2023-09-16 23:40:41 +08:00
hiyouga
65854736c3 update readme
Former-commit-id: acda45e4632c0ab87b4f38b13cf2f1c441d45e53
2023-09-16 17:33:01 +08:00
hiyouga
2a75b10015 fix #913
Former-commit-id: 0b5f970c05c524670d66c810e9f081a52a1fb5e6
2023-09-15 20:58:28 +08:00
hiyouga
5377d0bf95 fix #896
Former-commit-id: 8632bff81110b202919e27b33294898f16638c9d
2023-09-14 18:37:34 +08:00
hiyouga
632fff02e0 fix #887
Former-commit-id: 8857e4560219c4052bdb7c7dc1a014a5f5fd0163
2023-09-14 17:56:58 +08:00
hoshi-hiyouga
fe2ac71d11 Merge pull request #900 from mmbwf/main
Fix PPO replace_model loading wrong default parameters.

Former-commit-id: 3202985087870f65d639d5f0891ad90d7b39f2ef
2023-09-14 17:34:22 +08:00
hiyouga
550fa84e0d Update wechat.jpg
Former-commit-id: bd4e24bfeeac2071b1125b731f0d04dc6bf7a255
2023-09-14 16:31:11 +08:00
mmbwf
6ded1725d9 Update utils.py
Fix parameters load error.

Former-commit-id: 30fb721f1222d1b56a2712519960a63655c20360
2023-09-14 15:38:04 +08:00
hiyouga
1cd0ea1f13 add MathInstruct dataset
Former-commit-id: 026af87e7fce091a0cda1afd6df3d6ab6189de9a
2023-09-13 22:30:14 +08:00
hiyouga
c8780205bc fix ppo save model
Former-commit-id: 7ba57d5b1469cd0de0bb391b915bedec97b20ebd
2023-09-12 16:25:29 +08:00
hiyouga
4e86462bad fix #762 #814
Former-commit-id: d4be857e23c74ed65e06903e19da6f18f15d9e30
2023-09-12 16:10:10 +08:00
hiyouga
8ac7ec0b48 tiny fix
Former-commit-id: 3b306478d4ccbf037ae1acc122f6dca11c718731
2023-09-11 18:27:08 +08:00
hiyouga
4410387859 Release v0.1.8
Former-commit-id: ccb3553576164113c31be714a0295ea82321d67d
v0.1.8
2023-09-11 17:31:34 +08:00
hiyouga
33bab0e7c1 update flashattn, fix ppo save model
Former-commit-id: 0fbece85a70222e5262a2295203de07ffe648fda
2023-09-11 17:25:36 +08:00
hiyouga
6a71361a54 remove PeftTrainer
Former-commit-id: b218c271edfb07006ddc34b1aca404088de6c528
2023-09-10 22:23:23 +08:00
hiyouga
cf08bcf3d9 truncate readme
Former-commit-id: baac22f4f4c390c8c5d7b7491ff84d096521bc71
2023-09-10 21:04:20 +08:00
hiyouga
17bc66fce0 update readme
Former-commit-id: 63611de7ae09cd9578fcb9c6408035ec6bfb2cb2
2023-09-10 21:01:20 +08:00
hiyouga
7a715aac55 update readme
Former-commit-id: 34005252df4b015fd06a229b0be882ed64672cc1
2023-09-10 20:52:21 +08:00
hiyouga
8ab5566dc0 support FlashAttention2
Former-commit-id: d8aa1404bee9842f3e4cd037ad8d66c85470ac37
2023-09-10 20:43:56 +08:00
hiyouga
85aa16f6c6 fix #850
Former-commit-id: 815b92e698562bfae6eb9a6fa1b612a05d43ed67
2023-09-10 14:22:03 +08:00
hiyouga
f865d0bd51 fix lora target
Former-commit-id: a51b7c98acc599de5ed2eaeeebe7b184105722c5
2023-09-09 17:04:45 +08:00
hiyouga
c818a7ff60 support lora target auto find
Former-commit-id: bca1a247bcef51dced59655c8a14c197569367ca
2023-09-09 15:38:37 +08:00
hiyouga
c6265e6969 fix chatglm2 tokenizer
Former-commit-id: d8d82ca281811c20c89cc03dd00f69735515d6cf
2023-09-09 13:50:29 +08:00
hiyouga
f803c7c309 add baichuan2 convert script
Former-commit-id: d2015c8e12dfbf62016efbbb9aaa4198084094c9
2023-09-08 22:59:41 +08:00
hiyouga
43a20c67d4 fix bug in DPO data collator
Former-commit-id: 90bd085ae4c2775f1e82e045ab0157a451774082
2023-09-08 20:45:07 +08:00
hiyouga
405df0f63d fix #761
Former-commit-id: b34797a845dec8f6daea59e3c353b8a8f8830100
2023-09-08 20:22:18 +08:00
hiyouga
9ed4bb63d4 change to right-padding, update reward score #803
Former-commit-id: 8ea32e4046d75ddfa9517669e9de9f48fea720c6
2023-09-08 20:04:31 +08:00
hiyouga
62941919e8 fix chatglm template
Former-commit-id: 8aaaa132d49b4c758256a6159270cea4351f946c
2023-09-08 14:45:58 +08:00
hiyouga
2f243d6e73 Update wechat.jpg
Former-commit-id: 8b66247d2ffa498ff26bbc9e45e233d9d6576641
2023-09-07 20:56:07 +08:00
hiyouga
f225a71445 update requirements
Former-commit-id: f5351c18e15cd26fe628ed364eaa4ecd49874596
2023-09-07 19:26:25 +08:00
hiyouga
091326dc9f fix #818
Former-commit-id: 5a9970dbef3a6975ce5ec6ac2bef19182c75b662
2023-09-07 19:19:53 +08:00
hiyouga
5030f05126 add deepspeed check in PPO training
Former-commit-id: ed1c2c5557bb2714c3341294f0ea86f6496d4b0c
2023-09-07 19:12:40 +08:00
hiyouga
e6fa0229f4 fix #809
Former-commit-id: e2bf7c3badbd5d2fd513ca7a00bd74d9c0d62d07
2023-09-07 19:04:32 +08:00
hiyouga
f74b980650 fix baichuan templates
Former-commit-id: 85b1f6632a752029dabdaed87c58986deb3a6b1d
2023-09-07 18:54:14 +08:00
hiyouga
51f662860d update baichuan2 template
Former-commit-id: 0531886e1f534217dc3c9c0775d29fcf77ff7f5f
2023-09-06 21:43:06 +08:00
hiyouga
0ba72273d2 add Baichuan2 models
Former-commit-id: 60603a94c667fda5066af742ae1394dadce7a784
2023-09-06 18:40:11 +08:00
hiyouga
f9aee17f9d add Baichuan2 models
Former-commit-id: 62ce65c6282d2bbcb765354acc2819cc3e983a46
2023-09-06 18:36:04 +08:00