173 Commits

Author SHA1 Message Date
hiyouga
85a2e81dc2 fix llamafy scripts
Former-commit-id: f99140d5e82d2123a95f9b3f8c2a5227046861e0
2024-01-18 00:37:37 +08:00
hiyouga
91c0a29732 fix llamafy_internlm2
Former-commit-id: 7ff4c874d29c476b341909bb36c3c65f3ad4520c
2024-01-18 00:26:14 +08:00
hiyouga
a95dcac6f8 add llamafy_internlm2
Former-commit-id: f1d7ca77b148e55936e396f12c256b49613b4a24
2024-01-18 00:17:41 +08:00
hiyouga
024b0b1ab2 add model link
Former-commit-id: db6cb2d0e78c1a9cab57f5067dd669ffd82ab20f
2023-12-25 19:44:38 +08:00
hiyouga
a52aafdbdc tiny update
Former-commit-id: 5b93d545e2090d8d6db2cee3a047565f834e87f1
2023-12-25 18:29:34 +08:00
hiyouga
6a186d4386 add loftq
Former-commit-id: d4c351f1ec82b0864cc32c5602b03daddf9aeaba
2023-12-14 21:53:56 +08:00
hiyouga
06a4820836 disentangle model from tuner and rename modules
Former-commit-id: 4736344eb1595ee023a50d49e8118f4eee46305f
2023-11-15 16:29:09 +08:00
hiyouga
2ba88c6b08 Update cal_lr.py
Former-commit-id: 829e879e040cae3b49ace981b3d4a8eaf1e0c4ae
2023-11-14 21:14:42 +08:00
hiyouga
426c2fc340 Update cal_lr.py
Former-commit-id: 5619e76dc5aa22bd77da80c33a6e52adb4f517d5
2023-11-14 21:13:01 +08:00
hiyouga
b45fb2b3da Update cal_lr.py
Former-commit-id: fcb2daf7f37af2833404ee8f45b538705a2ce7b3
2023-11-14 21:09:30 +08:00
hiyouga
fffb8ea764 add cal_lr.py
Former-commit-id: 42c8fc4fb970775159a68a123d5c7bedb701c8cf
2023-11-14 20:58:37 +08:00
hiyouga
69c99819d6 add llamafy_qwen.py
Former-commit-id: f9769cff8aec5cbb33d4c2d837ed47434281cf4e
2023-10-08 22:05:36 +08:00
hiyouga
5ee1bdecdc add MMLU and C-Eval script
Former-commit-id: 465ee8119aa489a41bee0b01b3c105a2f3dd137f
2023-09-23 00:34:17 +08:00
hiyouga
4e6e42bb55 add tests.cal_flops.py
Former-commit-id: 469f859161dec0e34f4cc849f20e43d442680b5c
2023-09-16 23:40:41 +08:00
hiyouga
8ab5566dc0 support FlashAttention2
Former-commit-id: d8aa1404bee9842f3e4cd037ad8d66c85470ac37
2023-09-10 20:43:56 +08:00
hiyouga
c6265e6969 fix chatglm2 tokenizer
Former-commit-id: d8d82ca281811c20c89cc03dd00f69735515d6cf
2023-09-09 13:50:29 +08:00
hiyouga
f803c7c309 add baichuan2 convert script
Former-commit-id: d2015c8e12dfbf62016efbbb9aaa4198084094c9
2023-09-08 22:59:41 +08:00
codemayq
4b83d692b1 add template encode test
Former-commit-id: cbbee7933e80df9a9af45160c8e6c076df00b4f8
2023-08-21 20:51:24 +08:00
hiyouga
c4f1d98a1c fix saving custom code
Former-commit-id: 1e1358431dde1ed774b0e1e48760ca9f0db685ef
2023-07-16 18:04:41 +08:00
hiyouga
fd023ad416 add custom baichuan-13B code supports left-padding
Former-commit-id: 2c867b9bb1c50cc42acee326f49ceddca0492a55
2023-07-15 22:37:17 +08:00
hiyouga
507726b2f0 support Baichuan-13B
Former-commit-id: f936a7af0be98cd886ce9a0611a744033818e20f
2023-07-11 16:16:14 +08:00
hiyouga
8a1cd612bc Update auto_gptq.py
Former-commit-id: 0db9d2911192194878ef4665b2471a5752b64c65
2023-07-02 20:56:11 +08:00
hiyouga
202e8f1e02 add autogptq
Former-commit-id: cf6d57fd3ee213276e805813a987c4d40395a38c
2023-07-02 20:36:37 +08:00