Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

147

Base only

Active filters: vulkan

julianmb/Qwen-3.8-27B-ROCmFP4-FAST-GGUF

Text Generation • 27B • Updated Aug 22 • 30.8k • 52

HoppouAI/Breeze-TTS-2.cpp

Text-to-Speech • 3B • Updated Aug 28 • 12.1k • 26

Kindadodgy/qwen38-256k-on-16gb

Text Generation • 27B • Updated Aug 24 • 486 • 3

agentionai/Qwen3.8-Flash-Next-ROCmFP4-FAST-imatrix-GGUF

Text Generation • 177B • Updated 24 days ago • 66.4k • 86

ManniX-ITA/opencoti-llamafile

Updated 3 days ago • 500 • 2

kingjones777/K2-Horizon-MoVA-36B-A4B-ROCmFP4-GGUF

Text Generation • 37B • Updated Sep 6 • 1.09k • 2

cygnal/Qwen3.8-Flash-Next-Heretic2-IQ4XS-NGQ4-GGUF

Image-Text-to-Text • 177B • Updated 18 days ago • 5.68k • 6

LocalAI-io/GEM-X-GGUF

44.3M • Updated 16 days ago • 151 • 1

infosave/cmf-decision

Text Classification • Updated 5 days ago • 1.17k • 2

Asher-1/relateanything-ggml-full

0.1B • Updated 7 days ago • 337 • 1

cafonez/GLM-5.3-Flash-Gorgon-GGUF

Text Generation • 321B • Updated 6 days ago • 50 • 1

infosave/Qwen-Image-2.1-Uncensored-CMF

Text-to-Image • Updated 1 day ago • 10 • 1

raining-codes/Gemma3-1B-LOMO-q4f16_1-MLC

Text Generation • Updated Oct 19, 2025 • 6

raining-codes/Gemma3-270M-LOMO-q4f16_1-MLC

Text Generation • Updated Oct 19, 2025 • 4

raining-codes/Qwen3-0.6B-LOMO-q4f16_1-MLC

Text Generation • Updated Oct 19, 2025 • 3

raining-codes/Qwen3-1.7B-LOMO-q4f16_1-MLC

Text Generation • Updated Oct 20, 2025 • 3

raining-codes/Qwen3-1.7B-LOMO-q4f16_1-MLC2

Text Generation • Updated Oct 21, 2025 • 3

ABBNDZ/ATTS1HG1

Text-to-Speech • 0.4B • Updated Aug 25 • 147 • 1

0xSero/Qwen3.6-35B-GGUF

Text Generation • 35B • Updated May 30 • 469 • 26

MarkShark2/omnivoice-onnx-kv-b1-fp16

Text-to-Speech • Updated Apr 27 • 1

clxudfast/huihui4-8b-a4b-v2-Q4_K_M

8B • Updated Apr 27 • 45 • 1

MarkShark2/flux2-klein-4b-onnx-webgpu-q4

Text-to-Image • Updated May 1

eric717273/Qwen3.5-122B-A10B-MXFP4_MOE-MTP-GGUF

Text Generation • 125B • Updated May 13 • 54 • 1

mlc911/drunet-ncnn

Image-to-Image • Updated May 19

jcbtc/qwen3.6-35b-a3b-crown-halo-mtp-dynamic

Image-Text-to-Text • 36B • Updated Jun 19 • 722 • 18

cafonez/GLM-4.7-Flash-REAP-23B-A3B-ROCmFP4-GGUF

23B • Updated Jun 7 • 84

plunderstruck/Qwen3.6-27B-MTP-ROCmFP4-GGUF

0.5B • Updated Jun 21 • 282 • 34

plunderstruck/Qwen3.6-35B-A3B-MTP-ROCmFP4-GGUF

0.4B • Updated Jun 21 • 6.9k • 16

zakarth/talkie-1930-13b-it-vulkan-fixed-GGUF

13B • Updated Jun 9 • 1.25k • 3

plunderstruck/Qwopus3.6-27B-Coder-MTP-ROCmFP4-GGUF

0.5B • Updated Jun 21 • 405 • 9