Hindsight 1.2 can hand small memory judgments to hs-decide-1-flash, an Apache 2.0 0.8B model. Vectorize says some operations get 2.5x cheaper; it is opt-in.
Five open NVIDIA retrieval models search page images and text, rerank results and parse PDFs, under the permissive OpenMDW license. What to check first.
Cross-encoders score a query and a document in one pass, which makes them more accurate than embedding search and too slow for a whole corpus. Use them to rerank the top hits.
Retrieval-augmented generation is an architecture, and the vector database is one box in it. The whole loop, the RAG variants worth knowing, reranking, and when a knowledge graph beats similarity.
Qdrant’s Clelia Bertelli blog (Sep 25, 2026) covers cross-encode-rs—a Rust ONNX Runtime cross-encoder for reranking. crates.io owner is AstraBert (not a Qdrant-org crate). ~1.1×/~1.4× vs Python stacks on M4 Max are vendor-reported; all three hand work to onnxruntime. Linux/macOS only.