mrhan1993 cdd887908c 根据GLM Efficient Tuning添加中文README,web添加了server_port
Former-commit-id: 9f0b57b3701fa73f719cd5a319b1584454481bbb
2023-07-21 16:57:58 +08:00
..
2023-05-28 18:09:04 +08:00
2023-05-28 18:09:04 +08:00
2023-05-28 18:09:04 +08:00
2023-07-19 20:59:15 +08:00
2023-06-28 23:09:33 +08:00
2023-06-28 23:09:33 +08:00
2023-07-19 20:59:15 +08:00
2023-07-19 20:59:15 +08:00
2023-05-29 21:37:22 +08:00

If you are using a custom dataset, please provide your dataset definition in the following format in dataset_info.json.

"dataset_name": {
    "hf_hub_url": "the name of the dataset repository on the HuggingFace hub. (if specified, ignore below 3 arguments)",
    "script_url": "the name of the directory containing a dataset loading script. (if specified, ignore below 2 arguments)",
    "file_name": "the name of the dataset file in the this directory. (required if above are not specified)",
    "file_sha1": "the SHA-1 hash value of the dataset file. (optional)",
    "columns": {
        "prompt": "the name of the column in the datasets containing the prompts. (default: instruction)",
        "query": "the name of the column in the datasets containing the queries. (default: input)",
        "response": "the name of the column in the datasets containing the responses. (default: output)",
        "history": "the name of the column in the datasets containing the history of chat. (default: None)"
    }
}

where the prompt and response columns should contain non-empty values. The query column will be concatenated with the prompt column and used as input for the model. The history column should contain a list where each element is a string tuple representing a query-response pair.