423A35C7/LLaMA-Factory
1
0
Fork 0
mirror of https://github.com/hiyouga/LLaMA-Factory.git synced 2025-10-16 16:48:11 +08:00
Code Issues Packages Projects Releases Wiki Activity

Merge pull request #4006 from Uminosachi/scheduler-kwargs

Browse Source 
Set scheduler_specific_kwargs to get_scheduler

Former-commit-id: c6ed1955fd8990ddb960750913c9d8b13fe0ace3
This commit is contained in:
hoshi-hiyouga 2024-06-03 19:27:53 +08:00 committed by GitHub
commit eae9f09ca8
1 changed files with 1 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

1
src/llamafactory/train/utils.py
View File

@ -379,6 +379,7 @@ def create_custom_scheduler(
optimizer=optimizer_dict[param], optimizer=optimizer_dict[param],
num_warmup_steps=training_args.get_warmup_steps(num_training_steps), num_warmup_steps=training_args.get_warmup_steps(num_training_steps),
num_training_steps=num_training_steps, num_training_steps=num_training_steps,
scheduler_specific_kwargs=training_args.lr_scheduler_kwargs,
) )
def scheduler_hook(param: "torch.nn.Parameter"): def scheduler_hook(param: "torch.nn.Parameter"):