mirror of
https://github.com/hiyouga/LLaMA-Factory.git
synced 2025-08-01 11:12:50 +08:00
30038d9ce7
* Mimic SGLang offline Engine * Add more tests and args * Pass all current tests * Clean Code * fix sample_params * clean code * Fix Stream Chat * change sglang from engine mode to server mode * fix * Fix Review Issues * Use SGLang Built-In Utilities * Fix test SGLang * Some Doc Issue * fix sglang engine * add readme --------- Co-authored-by: Jin Pan <jpan236@wisc.edu> Co-authored-by: hiyouga <hiyouga@buaa.edu.cn>
5 lines
119 B
YAML
5 lines
119 B
YAML
model_name_or_path: meta-llama/Meta-Llama-3-8B-Instruct
|
|
template: llama3
|
|
infer_backend: sglang
|
|
trust_remote_code: true
|