Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

439

Base only

Active filters: compression

zhc12/specturn-llama2-7b

Text Generation • Updated May 23

medelharchaoui/gpt2-large-asvd640-lora

Text Generation • Updated May 25 • 1

Asystemoffields/OLMo-3-7B-Think-VAC

Text Generation • 4B • Updated May 26 • 7

medelharchaoui/gpt2-large-asvd640-lora-cf-init

Text Generation • Updated May 26 • 3

AverageMetaheuristicsEnjoyer/qwen3-30b-a3b-td-moe-ep-nowhiten-h100

Text Generation • 23B • Updated May 29 • 9

AverageMetaheuristicsEnjoyer/qwen3-30b-a3b-td-moe-ep-h100

Text Generation • 23B • Updated May 29 • 12

AverageMetaheuristicsEnjoyer/qwen3-30b-a3b-td-moe-ep-whiten-out-h100

Text Generation • 23B • Updated May 30 • 11

potto007/gemma-4-19B-A4B-text-REAP-GGUF

Text Generation • 20B • Updated May 30 • 39

AverageMetaheuristicsEnjoyer/qwen3-30b-a3b-sparse-mobe-b32-minimal-h100

Text Generation • 23B • Updated May 30 • 8

AverageMetaheuristicsEnjoyer/qwen3-30b-a3b-sparse-mobe-b32-minimal-l1-h100

Text Generation • 23B • Updated May 30 • 6

AverageMetaheuristicsEnjoyer/qwen3-30b-a3b-mobe-b32-h100

Text Generation • 23B • Updated May 30 • 5

AverageMetaheuristicsEnjoyer/qwen3-30b-a3b-td-moe-ep-whiten-out-l24-36-h100

Text Generation • 23B • Updated May 31 • 16

AverageMetaheuristicsEnjoyer/deepseek-v2-lite-mobe-b4-bs16-h100

Text Generation • 13B • Updated May 31 • 14

AverageMetaheuristicsEnjoyer/deepseek-v2-lite-sparse-mobe-b4-bs16-minimal-lr02-h100

Text Generation • 13B • Updated May 31 • 15

AverageMetaheuristicsEnjoyer/qwen3-30b-a3b-sparse-mobe-b32-minimal-lr02-h100

Text Generation • 23B • Updated May 31 • 5

AverageMetaheuristicsEnjoyer/qwen3-30b-a3b-td-moe-ep-fix

Text Generation • 23B • Updated Jun 3 • 9

AverageMetaheuristicsEnjoyer/qwen3-30b-a3b-td-moe-ep-whiten-out-fix

Text Generation • 23B • Updated Jun 3 • 14

AverageMetaheuristicsEnjoyer/qwen3-30b-a3b-td-moe-ep-whiten-both-fix

Text Generation • 23B • Updated Jun 3 • 15

ramosvs/zest

Text Generation • 0.8B • Updated Jun 4 • 26

BoneMangler/Qwen3-Coder-Next-REAM-AWQ-4bit-Q6_K-GGUF

60B • Updated Jun 17 • 20

PeetPedro/kompress-v3

Token Classification • Updated Jun 26

PeetPedro/kompress-v31

Token Classification • Updated Jun 26

PeetPedro/kompress-v32

Token Classification • Updated Jun 26

PeetPedro/kompress-v33

Token Classification • Updated Jun 26

PeetPedro/kompress-v4

Token Classification • Updated Jun 26

PeetPedro/kompress-v5

Token Classification • Updated Jun 26

PeetPedro/kompress-v6

Token Classification • Updated Jun 26

PeetPedro/kompress-v7

Token Classification • Updated Jun 26

PeetPedro/kompress-v8

Token Classification • Updated Jun 26

PeetPedro/kompress-v9

Token Classification • Updated Jun 26