423A35C7/LLaMA-Factory
1
0
Fork 0
mirror of https://github.com/hiyouga/LLaMA-Factory.git synced 2025-08-02 03:32:50 +08:00
Code Issues Packages Projects Releases Wiki Activity
LLaMA-Factory/examples/lora_single_gpu/README.md
hiyouga 2f878bde11 support ORPO 
Former-commit-id: 17bf8a2c3a7bb5b83071c8659cfd8751e894e692
2024-03-31 18:29:50 +08:00

339 B
Raw Blame History

Usage:

  • pretrain.sh: do pre-train (optional)
  • sft.sh: do supervised fine-tuning
  • reward.sh: do reward modeling (must after sft.sh)
  • ppo.sh: do PPO training (must after sft.sh and reward.sh)
  • dpo.sh: do DPO training (must after sft.sh)
  • orpo.sh: do ORPO training
  • predict.sh: do predict (must after sft.sh and dpo.sh)