support pissa

This commit is contained in:
hiyouga
2024-06-16 01:08:12 +08:00
parent 38b6b0f52e
commit 8c1046d78a
19 changed files with 406 additions and 76 deletions

View File

@@ -213,3 +213,9 @@ llamafactory-cli train examples/extras/llama_pro/llama3_freeze_sft.yaml
```bash
bash examples/extras/fsdp_qlora/single_node.sh
```
#### PiSSA Fine-Tuning
```bash
llamafactory-cli train examples/extras/pissa/llama3_lora_sft.yaml
```