Skip to content

Commit

Permalink
fix: fix gradient accumulate step for learning rate (huggingface#27667)
Browse files Browse the repository at this point in the history
  • Loading branch information
pphuc25 authored and nevikw39 committed Dec 7, 2023
1 parent 672757e commit 50cb171
Showing 1 changed file with 1 addition and 1 deletion.
Original file line number Diff line number Diff line change
Expand Up @@ -640,7 +640,7 @@ def compute_metrics(preds, labels):

# Create learning rate schedule
linear_decay_lr_schedule_fn = create_learning_rate_fn(
len(vectorized_datasets["train"]),
total_train_steps,
training_args.warmup_steps,
training_args.learning_rate,
)
Expand Down

0 comments on commit 50cb171

Please sign in to comment.