Inference API vs reranker.compute_score

#13

by yitao416 - opened Feb 27, 2024

Discussion

yitao416

Feb 27, 2024

I am just curious why these two have different results.

Inference API has values between 0 and 1. While reranker.compute_score can have some fairly large numbers.

Shitao

Beijing Academy of Artificial Intelligence org Apr 12, 2024

Hi, @yitao416 , the api add a sigmoid function to the output score. Now, we also add a argument normalize in function compute_score, and you can normalize the score with compute_score(sentence_pairs, normalize=True)

yitao416 changed discussion status to closed Apr 15, 2024

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment