Precedent checks what ships against your codebase, and speaks up only when a change pays for itself.
We read every one of these.
This scores every query-document pair through the model at request time. Late interaction precomputes the document side, so most of that work leaves the hot path.
ColBERTv2 · arXiv:2112.01488arXiv and preprints, university and frontier lab publications, company research releases, open-source drops, libraries and their vulnerabilities.
Only what makes your system faster, cheaper, or safer. Features you have no use for and benchmark wins that don't hold on your data stay where they are.