Part 05 · Building LLM Applications
Reranking
Two-stage retrievalCross-encoderBi-encoderLatency budget
Fetch fast, then sort carefully: a cheap first search pulls a hundred candidates and a cross-encoder reorders the top few, inside a latency budget.
⏱ 1-2 hours · Station 40 of 92