WarmupLRScheduler

class lightning_ir.schedulers.lr_schedulers.WarmupLRScheduler(optimizer: Optimizer, num_warmup_steps: int, **kwargs)[source]

Bases: LambdaWarmupScheduler, LambdaLR

__init__(optimizer: Optimizer, num_warmup_steps: int, **kwargs) → None[source]

Base class for learning rate schedulers with warmup.

Parameters:

  • optimizer (torch.optim.Optimizer) – Optimizer to adjust the learning rate for.

  • num_warmup_steps (int) – Number of warmup steps.

Methods

__init__(optimizer, num_warmup_steps, **kwargs)

Base class for learning rate schedulers with warmup.