Instructions to use OpenVINO/Qwen3-Reranker-0.6B-fp16-ov with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use OpenVINO/Qwen3-Reranker-0.6B-fp16-ov with Transformers:
# Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("OpenVINO/Qwen3-Reranker-0.6B-fp16-ov") model = AutoModelForCausalLM.from_pretrained("OpenVINO/Qwen3-Reranker-0.6B-fp16-ov") - Notebooks
- Google Colab
- Kaggle
Welcome to the community
The community tab is the place to discuss and collaborate with the HF community!