8 Commits

Author	SHA1	Message	Date
hiyouga	442aefb925	refactor evaluation, upgrade trl to 074	2023-11-13 22:20:35 +08:00
hiyouga	de95b69282	use seed in evaluate.py	2023-11-06 18:17:51 +08:00
hiyouga	641ffa2f6e	fix tokenizer padding side in evaluate.py	2023-10-21 00:30:04 +08:00
hiyouga	b665e9e133	fix #1232	2023-10-20 23:28:52 +08:00
hiyouga	5310e4d182	add averaging in evaluation	2023-10-10 23:16:31 +08:00
hiyouga	4dd9b4d982	add CMMLU, update eval script	2023-09-23 21:10:17 +08:00
hiyouga	f8ff625d76	update evaluate	2023-09-23 11:55:31 +08:00
hiyouga	badd2735b5	move file	2023-09-23 11:52:12 +08:00