splade

Configuration and model for SPLADE (SParse Lexical AnD Expansion) type models.

SPLADE (SParse Lexical AnD Expansion) is a efficient retrieval model that bridges the gap between traditional keyword search and deep neural understanding. It uses a language model to analyze a document and assign importance scores to words across the entire vocabulary, expanding the text with highly relevant terms that were not originally present. This process creates a sparse, high-dimensional vector that can be stored and searched using inverted indices just like traditional search engines.

Originally proposed in SPLADE: Sparse Lexical and Expansion Model for First Stage Ranking.

Classes

SpladeConfig([query_length, doc_length, ...])

Configuration class for a SPLADE model.

SpladeModel(config, *args, **kwargs)

Sparse lexical SPLADE model.

SpladeTokenizer(*args[, query_length, ...])

Tokenizer class for SPLADE models.