How to use michaelfeil/Qwen3-Reranker-4B-seq with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-classification", model="michaelfeil/Qwen3-Reranker-4B-seq")
# Load model directly from transformers import AutoTokenizer, AutoModelForSequenceClassification tokenizer = AutoTokenizer.from_pretrained("michaelfeil/Qwen3-Reranker-4B-seq") model = AutoModelForSequenceClassification.from_pretrained("michaelfeil/Qwen3-Reranker-4B-seq")
Will you add a Q8 GGUF for this model? Thanks!
Dont have, feel free to do it yourself and link it here
· Sign up or log in to comment
