Inference Providers
Active filters: vLLM
mistralai/Mistral-Medium-3.5-128B
128B • Updated • 124k
• 459
mistralai/Mistral-Small-4-119B-2603-NVFP4
Updated • 1.49k
• 132
mistralai/Mistral-Small-4-119B-2603
119B • Updated • 49.8k
• 429
mistralai/Mistral-Small-4-119B-2603-eagle
Updated • 309
• 61
QuantTrio/Qwen3.6-27B-AWQ
Image-Text-to-Text
• 28B • Updated • 219k
• 26
mistralai/Mistral-Medium-3.5-128B-EAGLE
Updated • 184
• 61
QuantTrio/GLM-5.2-Int4-Int8Mix
Text Generation
• 785B • Updated • 2.43k
• 21
model-scope/glm-4-9b-chat-GPTQ-Int4
Text Generation
• 9B • Updated • 93
• 6
model-scope/glm-4-9b-chat-GPTQ-Int8
Text Generation
• 9B • Updated • 34
• 2
tclf90/qwen2.5-72b-instruct-gptq-int4
Text Generation
• 73B • Updated • 68
• 2
tclf90/qwen2.5-72b-instruct-gptq-int3
Text Generation
• 69B • Updated • 72
prithivMLmods/Nu2-Lupi-Qwen-14B
Text Generation
• 15B • Updated • 12
• 2
mradermacher/Nu2-Lupi-Qwen-14B-GGUF
15B • Updated • 641
• 1
mradermacher/Nu2-Lupi-Qwen-14B-i1-GGUF
15B • Updated • 1.19k
• 1
JunHowie/Qwen3-0.6B-GPTQ-Int4
Text Generation
• 0.6B • Updated • 2.04k
• 1
JunHowie/Qwen3-0.6B-GPTQ-Int8
Text Generation
• 0.6B • Updated • 14
JunHowie/Qwen3-1.7B-GPTQ-Int4
Text Generation
• 2B • Updated • 588
• 1
JunHowie/Qwen3-1.7B-GPTQ-Int8
Text Generation
• 2B • Updated • 142
JunHowie/Qwen3-32B-GPTQ-Int4
Text Generation
• 33B • Updated • 585
• 4
JunHowie/Qwen3-32B-GPTQ-Int8
Text Generation
• 33B • Updated • 201
• 4
JunHowie/Qwen3-30B-A3B-GPTQ-Int4
Text Generation
• 5B • Updated • 32
• 1
JunHowie/Qwen3-14B-GPTQ-Int8
Text Generation
• 15B • Updated • 157
• 1
JunHowie/Qwen3-14B-GPTQ-Int4
Text Generation
• 15B • Updated • 1.1k
• 4
JunHowie/Qwen3-8B-GPTQ-Int8
Text Generation
• 8B • Updated • 570
JunHowie/Qwen3-8B-GPTQ-Int4
Text Generation
• 8B • Updated • 2.03k
• 4
JunHowie/Qwen3-4B-GPTQ-Int4
Text Generation
• 4B • Updated • 753
• 1
JunHowie/Qwen3-4B-GPTQ-Int8
Text Generation
• 4B • Updated • 114
JunHowie/Qwen3-30B-A3B-GPTQ-Int8
Text Generation
• 8B • Updated • 57
QuantTrio/Qwen3-235B-A22B-GPTQ-Int8
Text Generation
• 235B • Updated • 32
BeastyZ/Qwen2.5-3B-ConvSearch-R1-TopiOCQA
3B • Updated • 12