How to use baa-ai/Merino-Pro-4bit with sentence-transformers:
from sentence_transformers import CrossEncoder model = CrossEncoder("baa-ai/Merino-Pro-4bit") query = "Which planet is known as the Red Planet?" passages = [ "Venus is often called Earth's twin because of its similar size and proximity.", "Mars, known for its reddish appearance, is often referred to as the Red Planet.", "Jupiter, the largest planet in our solar system, has a prominent red spot.", "Saturn, famous for its rings, is sometimes mistaken for the Red Planet." ] scores = model.predict([(query, passage) for passage in passages]) print(scores)
40cd972 802a28a
1
2
3
4
5
6
Merino-Pro-4bit Copyright (c) 2026 BAA AI (Black Sheep AI). All rights reserved. BAA Contributions: proprietary — see LICENSE. Backbone: xlm-roberta-large — MIT License — see LICENSE-xlm-roberta-large.txt.
