update docs

Former-commit-id: a4a2e94241bea6f96590f6cb8ca8b5cddee1917e
This commit is contained in:
hiyouga
2024-05-06 21:47:00 +08:00
parent cce29484cb
commit ce048fadfe
44 changed files with 487 additions and 516 deletions

View File

@@ -1,9 +1,16 @@
We provide diverse examples about fine-tuning LLMs.
```bash
export CUDA_VISIBLE_DEVICES=0
cd examples/lora_single_gpu
llamafactory-cli train llama3_lora_pretrain.yaml # Do continuous pre-training using LoRA
```
```
examples/
├── lora_single_gpu/
│ ├── pretrain.sh: Do continuous pre-training using LoRA
│ ├── `
│ ├── sft.sh: Do supervised fine-tuning using LoRA
│ ├── reward.sh: Do reward modeling using LoRA
│ ├── ppo.sh: Do PPO training using LoRA