Update config.json 9734b02
Jia Huei Tan commited on
How to use EmbeddedLLM/bge-reranker-base-onnx-o4-o2-gpu with Transformers:
# Load model directly
from transformers import AutoTokenizer, AutoModelForSequenceClassification
tokenizer = AutoTokenizer.from_pretrained("EmbeddedLLM/bge-reranker-base-onnx-o4-o2-gpu")
model = AutoModelForSequenceClassification.from_pretrained("EmbeddedLLM/bge-reranker-base-onnx-o4-o2-gpu", device_map="auto")