423A35C7/LLaMA-Factory
1
0
Fork 0
mirror of https://github.com/hiyouga/LLaMA-Factory.git synced 2025-12-17 04:10:36 +08:00
Code Issues Packages Projects Releases Wiki Activity

[misc] support export ollama modelfile (#6899)

Browse Source 
* support export ollama modelfile

* update config

* add system and num ctx
This commit is contained in:
hoshi-hiyouga
2025-02-11 19:52:25 +08:00
committed by GitHub
parent d1b8aa3835
commit 9184a6e0ed
14 changed files with 126 additions and 224 deletions
Download Patch File Download Diff File Expand all files Collapse all files

6
examples/README_zh.md
View File

@@ -170,6 +170,12 @@ llamafactory-cli export examples/merge_lora/llama3_lora_sft.yaml
llamafactory-cli export examples/merge_lora/llama3_gptq.yaml
```
### 保存 Ollama 配置文件
```bash
llamafactory-cli export examples/merge_lora/llama3_full_sft.yaml
```
### 推理 LoRA 模型
#### 使用 vLLM+TP 批量推理