hiyouga bf5ffeeae0 simplify readme
Former-commit-id: 92dab8a90bdd82a72a06559943467b56dde12c71
2024-04-02 20:07:43 +08:00
..
2024-03-06 13:14:57 +08:00
2024-04-01 16:23:28 +08:00
2024-03-06 13:14:57 +08:00
2024-03-06 13:14:57 +08:00
2024-04-02 20:07:43 +08:00
2024-03-06 13:14:57 +08:00
2024-03-31 18:29:50 +08:00
2024-03-06 13:14:57 +08:00
2024-03-06 13:14:57 +08:00

Usage:

  • pretrain.sh: do pre-train (optional)
  • sft.sh: do supervised fine-tuning
  • reward.sh: do reward modeling (must after sft.sh)
  • ppo.sh: do PPO training (must after sft.sh and reward.sh)
  • dpo.sh: do DPO training (must after sft.sh)
  • orpo.sh: do ORPO training
  • predict.sh: do predict (must after sft.sh and dpo.sh)