423A35C7/LLaMA-Factory
1
0
Fork 0
mirror of https://github.com/hiyouga/LLaMA-Factory.git synced 2025-08-24 23:02:49 +08:00
Code Issues Packages Projects Releases Wiki Activity

update dpo examples

Browse Source 
Former-commit-id: 30e1c8e7450a68ccabede245cbc09b416ef7a94d
This commit is contained in:
hiyouga 2024-05-27 19:56:04 +08:00
parent 51a1097c64
commit 710642827a
1 changed files with 1 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

1
examples/lora_single_gpu/llama3_lora_dpo.yaml
View File

@ -6,6 +6,7 @@ stage: dpo
do_train: true do_train: true
finetuning_type: lora finetuning_type: lora
lora_target: q_proj,v_proj lora_target: q_proj,v_proj
pref_beta: 0.1
pref_loss: sigmoid # [sigmoid (dpo), orpo, simpo] pref_loss: sigmoid # [sigmoid (dpo), orpo, simpo]
### dataset ### dataset