update docs

This commit is contained in:
hiyouga
2024-05-06 21:47:00 +08:00
parent a34f526f10
commit 34d33e2257
44 changed files with 487 additions and 516 deletions

View File

@@ -1,9 +1,16 @@
We provide diverse examples about fine-tuning LLMs.
```bash
export CUDA_VISIBLE_DEVICES=0
cd examples/lora_single_gpu
llamafactory-cli train llama3_lora_pretrain.yaml # Do continuous pre-training using LoRA
```
```
examples/
├── lora_single_gpu/
│ ├── pretrain.sh: Do continuous pre-training using LoRA
│ ├── `
│ ├── sft.sh: Do supervised fine-tuning using LoRA
│ ├── reward.sh: Do reward modeling using LoRA
│ ├── ppo.sh: Do PPO training using LoRA