create_qrels_from_dicts

lightning_ir.base.validation_utils.create_qrels_from_dicts(qrels: Sequence[Dict[str, int]]) → DataFrame

Convenience function to create a qrels DataFrame from a list of dictionaries.

Parameters:

qrels (Sequence[Dict[str, int]]) – Mappings of doc_id -> relevance for each query. Defaults to None.

Returns:

DataFrame with columns: query_id, q0, doc_id, and relevance.

Return type:

pd.DataFrame