validation_utils

Validation utilities module for Lightning IR.

This module contains utility functions for validation and evaluation of Lightning IR models.

Functions

create_qrels_from_dicts(qrels)

Convience function to create a qrels DataFrame from a list of dictionaries.

create_run_from_scores(query_ids, doc_ids, ...)

Convience function to create a run DataFrame from query and document ids and scores.

evaluate_run(run, qrels, measures)

Convience function to evaluate a run against qrels using a set of measures.