LLaMA-Factory/examples/inference/llama3_vllm.yaml
hiyouga eb21a527a6 update docs
Former-commit-id: 34d33e22570338da709b8499830adb06b202095c
2024-05-06 21:47:00 +08:00

5 lines
118 B
YAML

model_name_or_path: meta-llama/Meta-Llama-3-8B-Instruct
template: llama3
infer_backend: vllm
vllm_enforce_eager: true