how to use colpali for image retrieval？
#2
by susht - opened
i want to use query to search images, can i use coinse score? i find the shape of one text is (60, 128), and the shape of one image is (1030, 128), how to get cosine score?
You shouldn't use the cosine score: ColPali was built to work with the MaxSim operator ("late interaction") as it generates multi-vector embeddings. Use the ColPaliProcessor.score with your two embeddings to get your similarity score 👋🏼
tonywu71 changed discussion status to closed