423A35C7/LLaMA-Factory
1
0
Fork 0
mirror of https://github.com/hiyouga/LLaMA-Factory.git synced 2025-08-01 11:12:50 +08:00
Code Issues Packages Projects Releases Wiki Activity

Update evaluate.py

Browse Source 
Former-commit-id: 23a7266272a79310d5b20c2f9653c5cd16f40a53
This commit is contained in:
hiyouga 2023-06-29 15:40:03 +08:00
parent 457b53ec6c
commit 36c409697e
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
evaluation/evaluate.py
View File

@ -1,7 +1,7 @@
# coding=utf-8
# Evaluates fine-tuned models automatically.
# Usage: python evaluate.py --evalset ceval/ceval-exam:law --split dev --api_base http://localhost:8000/v1 --task_type choice
# dataset format: question (string), A (string), B (string), C (string), D (string), answer Literal["A", "B", "C", "D"]
# dataset format: question (string), A (string), B (string), C (string), D (string), answer (Literal["A", "B", "C", "D"])
import os