Files
LLaMA-Factory/examples/inference/llama3_lora_sft.yaml
2024-12-04 13:50:00 +00:00

6 lines
201 B
YAML

model_name_or_path: meta-llama/Meta-Llama-3-8B-Instruct
adapter_name_or_path: saves/llama3-8b/lora/sft
template: llama3
finetuning_type: lora
infer_backend: huggingface # choices: [huggingface, vllm]