LambdaWarmupScheduler

class lightning_ir.schedulers.schedulers.LambdaWarmupScheduler(num_warmup_steps: int, num_delay_steps: int = 0, *args, **kwargs)[source]

Bases: ABC

__init__(num_warmup_steps: int, num_delay_steps: int = 0, *args, **kwargs) → None[source]

Base class for schedulers with warmup.

Parameters:

num_warmup_steps (int) – Number of warmup steps
num_delay_steps (int, optional) – Number of steps to delay scheduler for, defaults to 0

Methods

`__init__`(num_warmup_steps[, num_delay_steps])	Base class for schedulers with warmup.
`value_lambda`(current_step)	Lambda function to adjust the value at each step.

abstract value_lambda(current_step: int) → float[source]

Lambda function to adjust the value at each step.