ConstantSchedulerWithQuadraticWarmup

class lightning_ir.schedulers.schedulers.ConstantSchedulerWithQuadraticWarmup(num_warmup_steps: int, num_delay_steps: int = 0, *args, **kwargs)

Bases: LambdaWarmupScheduler

Methods

value_lambda(current_step)

Lambda function for no decay with quadratic warmup.

value_lambda(current_step: int) → float

Lambda function for no decay with quadratic warmup.

Parameters:

current_step (int) – Current step.

Returns:

Value at the current step.

Return type:

float