Commit Graph

488 Commits

Author SHA1 Message Date
hiyouga
f66e6b91c7 fix #1026
Former-commit-id: b0b0138e1d
2023-09-27 22:57:09 +08:00
hiyouga
ca6a3bc76f fix #424
Former-commit-id: 35fa94723c
2023-09-27 22:49:43 +08:00
hiyouga
772a1b16a1 fix #1032
Former-commit-id: a41e12de5e
2023-09-27 22:42:16 +08:00
hiyouga
927ff702ff refactor finetuning Args
Former-commit-id: 620efe1d8d
2023-09-27 22:28:06 +08:00
hiyouga
108c31e1fc support LongLoRA
Former-commit-id: 90375f600d
2023-09-27 21:55:50 +08:00
hiyouga
88f2e99c73 add CMMLU, update eval script
Former-commit-id: 4dd9b4d982
2023-09-23 21:10:17 +08:00
hiyouga
02549e3162 update evaluate
Former-commit-id: f8ff625d76
2023-09-23 11:55:31 +08:00
hiyouga
467c30d591 move file
Former-commit-id: badd2735b5
2023-09-23 11:52:12 +08:00
hiyouga
5ee1bdecdc add MMLU and C-Eval script
Former-commit-id: 465ee8119a
2023-09-23 00:34:17 +08:00
hiyouga
e930682152 fix #1000
Former-commit-id: 5cc7a44784
2023-09-22 15:00:48 +08:00
hiyouga
ff21424290 fix webui
Former-commit-id: 5f3ab3ddde
2023-09-21 19:55:38 +08:00
hiyouga
3bdc40b4db tiny fix
Former-commit-id: dbaef776a1
2023-09-21 19:52:06 +08:00
hiyouga
4581d09fa6 fix #944
Former-commit-id: 338b8664ed
2023-09-21 19:51:02 +08:00
hiyouga
d04585df59 tiny fix
Former-commit-id: ace3f85a72
2023-09-21 15:25:29 +08:00
statelesshz
95384eefe8 support export model on Ascend NPU
Former-commit-id: b3e41c6d49
2023-09-20 10:26:02 +08:00
hiyouga
d7f267a9f9 fix webui
Former-commit-id: 10ab2f8b90
2023-09-19 18:35:21 +08:00
hiyouga
48e7b600a8 fix error info
Former-commit-id: 7e8655c8b5
2023-09-19 18:30:23 +08:00
hiyouga
4e6e42bb55 add tests.cal_flops.py
Former-commit-id: 469f859161
2023-09-16 23:40:41 +08:00
hiyouga
2a75b10015 fix #913
Former-commit-id: 0b5f970c05
2023-09-15 20:58:28 +08:00
hiyouga
5377d0bf95 fix #896
Former-commit-id: 8632bff811
2023-09-14 18:37:34 +08:00
hiyouga
632fff02e0 fix #887
Former-commit-id: 8857e45602
2023-09-14 17:56:58 +08:00
mmbwf
6ded1725d9 Update utils.py
Fix parameters load error.

Former-commit-id: 30fb721f12
2023-09-14 15:38:04 +08:00
hiyouga
c8780205bc fix ppo save model
Former-commit-id: 7ba57d5b14
2023-09-12 16:25:29 +08:00
hiyouga
4e86462bad fix #762 #814
Former-commit-id: d4be857e23
2023-09-12 16:10:10 +08:00
hiyouga
8ac7ec0b48 tiny fix
Former-commit-id: 3b306478d4
2023-09-11 18:27:08 +08:00
hiyouga
4410387859 Release v0.1.8
Former-commit-id: ccb3553576
2023-09-11 17:31:34 +08:00
hiyouga
33bab0e7c1 update flashattn, fix ppo save model
Former-commit-id: 0fbece85a7
2023-09-11 17:25:36 +08:00
hiyouga
6a71361a54 remove PeftTrainer
Former-commit-id: b218c271ed
2023-09-10 22:23:23 +08:00
hiyouga
8ab5566dc0 support FlashAttention2
Former-commit-id: d8aa1404be
2023-09-10 20:43:56 +08:00
hiyouga
85aa16f6c6 fix #850
Former-commit-id: 815b92e698
2023-09-10 14:22:03 +08:00
hiyouga
f865d0bd51 fix lora target
Former-commit-id: a51b7c98ac
2023-09-09 17:04:45 +08:00
hiyouga
c818a7ff60 support lora target auto find
Former-commit-id: bca1a247bc
2023-09-09 15:38:37 +08:00
hiyouga
c6265e6969 fix chatglm2 tokenizer
Former-commit-id: d8d82ca281
2023-09-09 13:50:29 +08:00
hiyouga
43a20c67d4 fix bug in DPO data collator
Former-commit-id: 90bd085ae4
2023-09-08 20:45:07 +08:00
hiyouga
405df0f63d fix #761
Former-commit-id: b34797a845
2023-09-08 20:22:18 +08:00
hiyouga
9ed4bb63d4 change to right-padding, update reward score #803
Former-commit-id: 8ea32e4046
2023-09-08 20:04:31 +08:00
hiyouga
62941919e8 fix chatglm template
Former-commit-id: 8aaaa132d4
2023-09-08 14:45:58 +08:00
hiyouga
f225a71445 update requirements
Former-commit-id: f5351c18e1
2023-09-07 19:26:25 +08:00
hiyouga
091326dc9f fix #818
Former-commit-id: 5a9970dbef
2023-09-07 19:19:53 +08:00
hiyouga
5030f05126 add deepspeed check in PPO training
Former-commit-id: ed1c2c5557
2023-09-07 19:12:40 +08:00
hiyouga
e6fa0229f4 fix #809
Former-commit-id: e2bf7c3bad
2023-09-07 19:04:32 +08:00
hiyouga
f74b980650 fix baichuan templates
Former-commit-id: 85b1f6632a
2023-09-07 18:54:14 +08:00
hiyouga
51f662860d update baichuan2 template
Former-commit-id: 0531886e1f
2023-09-06 21:43:06 +08:00
hiyouga
f9aee17f9d add Baichuan2 models
Former-commit-id: 62ce65c628
2023-09-06 18:36:04 +08:00
Q
a46ffa68ff fix utils.py bug
Former-commit-id: a19fc2ebf7
2023-09-05 10:38:01 +08:00
hiyouga
3b5a9c60b6 fix #763
Former-commit-id: 370bdb6e43
2023-09-01 23:13:05 +08:00
hiyouga
a4fd976048 refactor dataset_attr, add eos in pt, fix #757
Former-commit-id: a9d1fb72f7
2023-09-01 19:00:45 +08:00
codemayq
ea74e5a81b update llama2 template
Former-commit-id: 0bcc489c42
2023-08-30 16:23:56 +08:00
codemayq
c955d9267c add dataset stage check
Former-commit-id: f7fdc088d4
2023-08-30 16:23:08 +08:00
codingma
00c3cd5454 Merge pull request #651 from hiyouga/feature-dataset_stage
add dataset stage

Former-commit-id: 9b4d16d040
2023-08-28 16:03:45 +08:00