Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

108

Base only

Active filters: kv-cache

ddddamn/IronCell-Mark-1

anthonym21/Mistral-7B-v0.3-CoDA-GQA-L

Text Generation • 7B • Updated Feb 24 • 24

fromthesky/PLDR-LLM-v51-SOC-110M-1

Text Generation • 0.1B • Updated Mar 26 • 37

fromthesky/PLDR-LLM-v51-SOC-110M-2

Text Generation • 0.1B • Updated Mar 26 • 27

fromthesky/PLDR-LLM-v51-SOC-110M-3

Text Generation • 0.1B • Updated Mar 26 • 27

fromthesky/PLDR-LLM-v51-SOC-110M-4

Text Generation • 0.1B • Updated Mar 26 • 24

fromthesky/PLDR-LLM-v51-SOC-110M-5

Text Generation • 0.1B • Updated Mar 26 • 34

ElvianElvy/MESA-Qwen2.5-0.5B-KL-Regularized

Text Generation • Updated Mar 12

chinedudave06/musicgen-small-onnx

Text-to-Audio • Updated Mar 18 • 14

chinedudave06/musicgen-small-stereo-onnx

Text-to-Audio • Updated Mar 18 • 12

chinedudave06/musicgen-medium-onnx

Text-to-Audio • Updated Mar 18 • 7

chinedudave06/musicgen-medium-stereo-onnx

Text-to-Audio • Updated Mar 18 • 8

Croc-Prog-HF/LoreWeaver-2-LoRA_PREVIEW

Text Generation • Updated 13 days ago

flovflo/turboquant-mlx-qwen35-kv

Updated Mar 25 • 18

alexcovo/qwen35-9b-mlx-turboquant-tq3

Text Generation • 2B • Updated Mar 30 • 191 • 4

NOT-OMEGA/NanoMind

Text Generation • Updated Apr 3

bmeyer2025/tiny-gpt-shakespeare

Text Generation • Updated Mar 31 • 9

eigengram/eigengram-protocol

adobeXd/nexus

Text Generation • Updated Apr 4 • 1

Engram-protocol/engram

Feature Extraction • Updated Apr 3

tonera/FLUX.2-klein-9b-kv-Nunchaku

Image-to-Image • Updated 20 days ago • 490 • 10

Funkylazer/dm-qwen3.5-27b-b1p-knowledgecorridor

Text Generation • 27B • Updated Apr 7 • 13

atomicmilkshake/llama-cpp-turboquant-binaries

Updated Apr 8 • 11

majentik/Qwen3.5-27B-TurboQuant-2bit

Text Generation • Updated 3 days ago

majentik/Qwen3.5-27B-TurboQuant-MLX-2bit

Text Generation • 27B • Updated May 6 • 99

majentik/Qwen3.5-27B-RotorQuant-2bit

Text Generation • Updated 3 days ago • 1

majentik/Qwen3.5-27B-RotorQuant-MLX-2bit

Text Generation • 27B • Updated May 6 • 112

satya007/gemmacut-spectral

Text Generation • Updated Apr 13

EnsueAI/metal-int4-sdpa

Updated Apr 21 • 3 • 6

Reinforce-ai/spiral-qwen2.5-coder-7b

Text Generation • 8B • Updated Apr 22 • 3