Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,069

Base only

Active filters: intel

fbaldassarri/EleutherAI_pythia-12b-autogptq-int4-gs64-sym

Text Generation • 12B • Updated Aug 23, 2025 • 3

fbaldassarri/EleutherAI_pythia-12b-autoawq-int4-gs64-asym

Text Generation • 12B • Updated Aug 23, 2025 • 5

fbaldassarri/EleutherAI_pythia-12b-autoawq-int4-gs64-sym

Text Generation • 12B • Updated Aug 23, 2025 • 4

fbaldassarri/EleutherAI_pythia-12b-autoround-int8-gs64-asym

Text Generation • 4B • Updated Aug 23, 2025 • 3

fbaldassarri/EleutherAI_pythia-12b-autoround-int8-gs64-sym

Text Generation • 4B • Updated Aug 24, 2025 • 3

fbaldassarri/EleutherAI_pythia-12b-autogptq-int8-gs64-asym

Text Generation • 12B • Updated Aug 24, 2025 • 4

fbaldassarri/EleutherAI_pythia-12b-autogptq-int8-gs64-sym

Text Generation • 12B • Updated Aug 24, 2025 • 5

fbaldassarri/EleutherAI_pythia-12b-deduped-autoround-int4-gs64-asym

Text Generation • 2B • Updated Aug 24, 2025 • 5

fbaldassarri/EleutherAI_pythia-12b-deduped-autoround-int4-gs64-sym

Text Generation • 2B • Updated Aug 24, 2025 • 3

fbaldassarri/EleutherAI_pythia-12b-deduped-autogptq-int4-gs64-asym

Text Generation • 12B • Updated Aug 24, 2025 • 3

fbaldassarri/EleutherAI_pythia-12b-deduped-autogptq-int4-gs64-sym

Text Generation • 12B • Updated Aug 24, 2025 • 3

fbaldassarri/EleutherAI_pythia-12b-deduped-autoawq-int4-gs64-asym

Text Generation • 12B • Updated Aug 25, 2025 • 4

fbaldassarri/EleutherAI_pythia-12b-deduped-autoawq-int4-gs64-sym

Text Generation • 12B • Updated Aug 25, 2025 • 5

fbaldassarri/EleutherAI_pythia-12b-deduped-autoround-int8-gs64-asym

Text Generation • 4B • Updated Aug 25, 2025 • 3

fbaldassarri/EleutherAI_pythia-12b-deduped-autoround-int8-gs64-sym

Text Generation • 4B • Updated Aug 25, 2025 • 4

fbaldassarri/EleutherAI_pythia-12b-deduped-autogptq-int8-gs64-asym

Text Generation • 12B • Updated Aug 25, 2025 • 4

fbaldassarri/EleutherAI_pythia-12b-deduped-autogptq-int8-gs64-sym

Text Generation • 12B • Updated Aug 25, 2025 • 4

Mitchins/t5-base-artgen-multi-instruct-OpenVINO

Text Generation • Updated Sep 3, 2025 • 4

AhtnaGlen/phi-4-mini-instruct-int4-sym-npu-ov

Text Generation • Updated Oct 27, 2025 • 5

gocharlie-ai/charlie-micro-ov

Text Generation • Updated Dec 18, 2025 • 3

DudePls/Cydonia-24B-v4.3-OpenVINO-INT4

Text Generation • Updated Jan 2 • 12 • 1

Intel/MiroThinker-v1.5-30B-gguf-q2ks-mixed-AutoRound

Text Generation • 31B • Updated May 22 • 76 • 14

Vishva007/Qwen3-4B-Instruct-2507-W4A16-AutoRound

Text Generation • 0.9B • Updated Jan 30 • 2

Vishva007/Qwen3-VL-8B-Instruct-W4A16-AutoRound

Image-Text-to-Text • 2B • Updated Feb 7 • 475

umaimaparveennineteen/tiny-random-MiniCPM-0-2_6

Text Generation • 2.95M • Updated Feb 3 • 3

Vishva007/Qwen3-VL-2B-Instruct-W4A16-AutoRound

Image-Text-to-Text • 0.9B • Updated Feb 7 • 2

Vishva007/Qwen3-VL-2B-Instruct-W4A16-AutoRound-GPTQ

Image-Text-to-Text • 2B • Updated Feb 7 • 3

Vishva007/Qwen3-VL-2B-Instruct-W4A16-AutoRound-AWQ

Image-Text-to-Text • 2B • Updated Feb 7 • 3

Vishva007/Qwen3-VL-4B-Instruct-W4A16-AutoRound

Image-Text-to-Text • 1B • Updated Feb 7 • 3

Vishva007/Qwen3-VL-4B-Instruct-W4A16-AutoRound-GPTQ

Image-Text-to-Text • 4B • Updated Feb 7 • 10