ConstantSchedulerWithLinearWarmup

class lightning_ir.schedulers.schedulers.ConstantSchedulerWithLinearWarmup(num_warmup_steps: int, num_delay_steps: int = 0, *args, **kwargs)[source]

Bases: LambdaWarmupScheduler

__init__(num_warmup_steps: int, num_delay_steps: int = 0, *args, **kwargs) → None

Base class for schedulers with warmup.

Parameters:

  • num_warmup_steps (int) – Number of warmup steps

  • num_delay_steps (int, optional) – Number of steps to delay scheduler for, defaults to 0

Methods

value_lambda(current_step)

Lambda function for no decay with linear warmup.
value_lambda(current_step: int) → float[source]

Lambda function for no decay with linear warmup.

Parameters:

current_step (int) – Current step

Returns:

Value at the current step

Return type:

float