423A35C7/LLaMA-Factory
1
0
Fork 0
mirror of https://github.com/hiyouga/LLaMA-Factory.git synced 2025-10-16 00:28:10 +08:00
Code Issues Packages Projects Releases Wiki Activity

support parquet format #1446

Browse Source 
Former-commit-id: 44a3b9ac9f10d2012b8ad3d8c48123db9a0da2f1
This commit is contained in:
hiyouga 2023-11-09 14:17:40 +08:00
parent 44fe93e9b0
commit 28c67a5be8
1 changed files with 2 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
src/llmtuner/dsets/utils.py
View File

@ -13,9 +13,11 @@ logger = get_logger(__name__)
EXT2TYPE = {
"arrow": "arrow",
"csv": "csv",
"json": "json",
"jsonl": "json",
"parquet": "parquet",
"txt": "text"
}