how to perform reranking?

#13

by erjieyong - opened Jan 23, 2024

Hi, may i know if there's any cross-encoder type reranking? Appreciate clarification on how we can perform reranking. Are the below steps correct?

use the retrieval Prompt.C encode
compare similarities and retrieve k number of relevant docs
Remove Prompt.C by setting 'prompt = None' and encode the k number of relevant docs found in step 2
rerank the k number of relevant docs based on embeddings from step 3

WhereIsAI org Jan 23, 2024

Hi, it doesn't support cross-encoder now.

The steps are correct. Prompts.C is applied for the query, not documents.

Thanks @SeanLee97 . May i confirm that these steps is also how the reranking benchmarks are achieved?

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment