L2Regularization

class lightning_ir.loss.regularization.L2Regularization(query_weight: float = 0.0001, doc_weight: float = 0.0001)

Bases: RegularizationLossFunction

L2 Regularization loss function for query and document embeddings. Originally proposed in: Ridge Regression: Biased Estimation for Nonorthogonal Problems

Methods

compute_loss(output)

Compute the L2 regularization loss.

compute_loss(output: BiEncoderOutput) → torch.Tensor

Compute the L2 regularization loss.

Parameters:

output (BiEncoderOutput) – The output from the model containing query and document embeddings.

Returns:

The computed loss.

Return type:

torch.Tensor