12 Commits

Author SHA1 Message Date
hiyouga
e98b237208 fix eval scripts
Former-commit-id: fc3743d0b82c28fbff1170761139e4fa5d2a8939
2024-05-05 00:53:07 +08:00
hiyouga
025bc4bf5c fix #1068 #1074
Former-commit-id: 26c6bfd21de06cc56be9a58e2ef69045ea70cc14
2023-09-28 14:39:16 +08:00
hiyouga
889a24ccfa add CMMLU, update eval script
Former-commit-id: 47f31f06a946eefa5a972e4a566cf3ce05e1e111
2023-09-23 21:10:17 +08:00
hiyouga
64414c68e9 move file
Former-commit-id: 8711ca9b5421f971ee4cb2fada23832f1021577c
2023-09-23 11:52:12 +08:00
hiyouga
8518760f06 shuffle few shot examples
Former-commit-id: 2c9c14c122382e640dfa41a3799628c764c99457
2023-09-23 00:53:20 +08:00
hiyouga
b54822ac04 fix MMLU
Former-commit-id: eeab92323899694010469451b8dfb1f00d685bff
2023-09-23 00:42:23 +08:00
hiyouga
e4542e1d45 add MMLU and C-Eval script
Former-commit-id: 3403f876127b4b99c5e3edb2834cc3b9a3a0063f
2023-09-23 00:34:17 +08:00
hiyouga
8b7f99d536 add autogptq
Former-commit-id: 43321557c272862d9c6531fc48a4569cfc88e4e7
2023-07-02 20:36:37 +08:00
hiyouga
9efeb68b3f rename evaluate.py
Former-commit-id: 29d3e62b11964914c636f27beb422b10752cd3ae
2023-06-29 15:40:39 +08:00
hiyouga
7f1796e006 Update evaluate.py
Former-commit-id: 54a48d30b768b0421e760e6eab41fdb12e78995f
2023-06-29 15:40:03 +08:00
hiyouga
683f1a5a8c Update evaluate.py
Former-commit-id: 40201845b707c8b888b17744622ad78b4fb08a09
2023-06-26 23:41:33 +08:00
hiyouga
14b899bde2 Create evaluate.py
Former-commit-id: 45a6742f00d17e504b54468d8eefdeb2aa877a29
2023-06-26 23:30:18 +08:00