423A35C7/LLaMA-Factory
1
0
Fork 0
mirror of https://github.com/hiyouga/LLaMA-Factory.git synced 2025-12-14 10:56:56 +08:00
Code Issues Packages Projects Releases Wiki Activity

fix #3694

Browse Source 
Former-commit-id: 2a67ab3925
This commit is contained in:
hiyouga
2024-05-16 00:35:28 +08:00
parent a84f155563
commit 6e6267f17c
7 changed files with 133 additions and 77 deletions
Download Patch File Download Diff File Expand all files Collapse all files

4
examples/extras/llama_pro/llama3_freeze_sft.yaml
View File

@@ -5,8 +5,8 @@ model_name_or_path: models/llama3-8b-instruct-pro
stage: sft
do_train: true
finetuning_type: freeze
name_module_trainable: all
num_layer_trainable: 8
freeze_trainable_layers: 8
freeze_trainable_modules: all
use_llama_pro: true
# dataset