Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

Mixture of Experts

4-bit precision

8-bit precision

Carbon Emissions

Models

1,326

Base only

Active filters: intel

SergiioB/Nemotron-3.5-Lightning-30B-A3B-GPTQ-INT4-G64-sym

Text Generation • 32B • Updated Aug 19 • 166 • 1

SergiioB/Nemotron-3.5-Lightning-30B-A3B-DFlash-BF16

Text Generation • 0.8B • Updated Aug 19 • 130

fbaldassarri/meta-llama_Llama-3.2-3B-Instruct-auto_round-int4-gs64-sym

Text Generation • 0.8B • Updated Aug 14 • 13

fbaldassarri/meta-llama_Llama-3.2-3B-auto_round-int4-gs64-sym

Text Generation • 0.8B • Updated Aug 14 • 19

fbaldassarri/tiiuae_Falcon3-3B-Base-auto_round-int4-gs64-sym

Text Generation • 1B • Updated Aug 14 • 13

fbaldassarri/tiiuae_Falcon3-3B-Instruct-auto_round-int4-gs64-sym

Text Generation • 1B • Updated Aug 14 • 16

fbaldassarri/sapienzanlp_Minerva-3B-base-v1.0-auto_round-int4-gs64-sym

Text Generation • 0.6B • Updated Aug 14 • 10

fbaldassarri/meta-llama_Llama-3.2-3B-auto_round-int8-gs64-asym

Text Generation • 1B • Updated Aug 14 • 15

fbaldassarri/meta-llama_Llama-3.2-3B-auto_round-int8-gs64-sym

Text Generation • 1B • Updated Aug 14 • 18

fbaldassarri/meta-llama_Llama-3.2-3B-auto_gptq-int8-gs64-asym

Text Generation • 1B • Updated Aug 14 • 23

fbaldassarri/meta-llama_Llama-3.2-3B-auto_gptq-int8-gs64-sym

Text Generation • 1B • Updated Aug 14 • 22

kernelogic/Qwen3.8-27B-Uncensored-GPTQ-Int4-sym-G128-MTP-BF16

Text Generation • 28B • Updated Aug 20 • 1.8k • 1

SergiioB/Ornith-1.5-35B-A3B-GPTQ-Int4-sym-G128-MTP-BF16-MixedCal-v2

Text Generation • 36B • Updated Aug 23 • 295 • 1

HarmenWessels/Ornith-1.0-9B-int4-symg128-ov

Image-Text-to-Text • Updated Sep 18 • 9

HarmenWessels/Ministral-3-14B-Instruct-int4-symg128-ov

Text Generation • Updated Sep 18 • 15 • 1

HarmenWessels/Ministral-3-3B-Instruct-int4-symg128-ov

Text Generation • Updated Sep 18 • 15

HarmenWessels/Ministral-3-3B-Reasoning-int4-symg128-ov

Text Generation • Updated Sep 18 • 6

HarmenWessels/Ministral-3-8B-Instruct-int4-symg128-ov

Text Generation • Updated Sep 18 • 9

HarmenWessels/Ministral-3-8B-Reasoning-int4-symg128-ov

Text Generation • Updated Sep 18 • 10

SergiioB/Ornith-1.5-35B-A3B-AutoRound-W4A16-sym-G128-MTP-BF16

Image-Text-to-Text • 7B • Updated Aug 23 • 156 • 1

marfrit/Qwen3.6-27B-A3B-Coder-int4-awq-se-ov

Updated Aug 24 • 84

CySpiegel/Qwen3.8-27B-Int4-AutoRound

6B • Updated Aug 26 • 974 • 3

mgaruccio/Muse-Glimmer-30B-GPTQ-Int4-sym-G128

Text Generation • 30B • Updated Aug 27 • 35

CH3NDev/iniz-agent-guard-int8

Text Classification • Updated Aug 28

fbaldassarri/meta-llama_Llama-3.2-3B-Instruct-auto_round-int8-gs64-asym

Text Generation • 1B • Updated Sep 6 • 21

fbaldassarri/meta-llama_Llama-3.2-3B-Instruct-auto_round-int8-gs64-sym

Text Generation • 1B • Updated Sep 6 • 20

fbaldassarri/meta-llama_Llama-3.2-3B-Instruct-auto_gptq-int8-gs64-asym

Text Generation • 1B • Updated Sep 6 • 34

fbaldassarri/meta-llama_Llama-3.2-3B-Instruct-auto_gptq-int8-gs64-sym

Text Generation • 1B • Updated Sep 6 • 31

fbaldassarri/sapienzanlp_Minerva-3B-base-v1.0-auto_round-int8-gs64-asym

Text Generation • 0.9B • Updated Sep 6 • 12

fbaldassarri/sapienzanlp_Minerva-3B-base-v1.0-auto_round-int8-gs64-sym

Text Generation • 0.9B • Updated Sep 6 • 9