Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

24,595

Full-text search

Active filters: imatrix

Cran-May/ghost-8b-beta-1608-Q4_K_M-GGUF

Text Generation • 8B • Updated Aug 19, 2024 • 4

cris177/PixelPI_LM

4B • Updated Aug 19, 2024 • 1

mradermacher/L3.1-70b-Ginny-i1-GGUF

71B • Updated Aug 20, 2024 • 36

anthracite-org/magnum-v2-72b-gguf

Text Generation • 73B • Updated Sep 26, 2024 • 298 • 2

DarqueDante/Llama-3.1-8B-Stheno-v3.4-IQ4_XS-GGUF

8B • Updated Aug 19, 2024 • 19

duyntnet/storytime-13b-imatrix-GGUF

Text Generation • 13B • Updated Aug 20, 2024 • 32

mradermacher/Llama-3.1-8B-Stheno-v3.4-i1-GGUF

8B • Updated Aug 20, 2024 • 282 • 2

mradermacher/Fireball-Mistral-Nemo-Base-2407-sft-v1-i1-GGUF

12B • Updated Aug 20, 2024 • 47 • 1

mradermacher/IceTea21EnergyDrinkRPV10-i1-GGUF

7B • Updated Aug 20, 2024 • 66 • 1

mradermacher/KamalaHarris-Llama-3.1-8B-Chat-i1-GGUF

8B • Updated Aug 20, 2024 • 111

mradermacher/Llama-3.1-Storm-8B-i1-GGUF

8B • Updated Aug 20, 2024 • 451 • 3

mradermacher/DonaldTrump-Llama3.1-8B-Chat-i1-GGUF

8B • Updated Aug 20, 2024 • 4.74k

mradermacher/Llama-3.1-8B-Magpie-Align-v0.1-i1-GGUF

8B • Updated Jan 22, 2025 • 166 • 1

mradermacher/IceSakeRPTrainingTestV1-7b-i1-GGUF

7B • Updated Aug 20, 2024 • 15 • 1

xaskasdf/phi-3-mini-4k-instruct-gguf

4B • Updated Aug 20, 2024 • 24

mradermacher/Llama-3.1-8B-Magpie-Align-SFT-v0.1-i1-GGUF

8B • Updated Sep 8, 2024 • 175

mradermacher/Llama-3.1-8B-Magpie-Align-SFT-v0.2-i1-GGUF

8B • Updated Aug 20, 2024 • 133

mradermacher/mistral-12b-neptune-6k-instruct-i1-GGUF

12B • Updated Aug 20, 2024 • 13 • 1

mradermacher/Fireball-Mistral-Nemo-Base-2407-v1-DPO2-i1-GGUF

12B • Updated Aug 20, 2024 • 83

Reiterate3680/MN-LooseCannon-12B-v2-GGUF

Text Generation • 12B • Updated Aug 20, 2024 • 1 • 2

mradermacher/Qra-13b-instruct-i1-GGUF

13B • Updated Aug 20, 2024 • 158

mradermacher/magnum-v2-123b-i1-GGUF

123B • Updated Sep 8, 2024 • 72 • 7

mradermacher/gemma-2-9B-it-advanced-v2.1-i1-GGUF

9B • Updated Aug 20, 2024 • 170 • 2

legraphista/Llama-3.1-Storm-8B-IMat-GGUF

Text Generation • 8B • Updated Aug 20, 2024 • 558

mradermacher/dulia-13b-8k-alpha-i1-GGUF

13B • Updated Aug 20, 2024 • 48

mradermacher/Fireball-Mistral-Nemo-Base-2407-sft-v2.1-i1-GGUF

12B • Updated Aug 20, 2024 • 54 • 3

legraphista/Phi-3.5-mini-instruct-IMat-GGUF

Text Generation • 4B • Updated Aug 20, 2024 • 318 • 1

Nabokov/Phi-3.5-mini-instruct-Q5_K_S-GGUF

Text Generation • 4B • Updated Aug 20, 2024 • 24

MaziyarPanahi/Phi-3.5-mini-instruct-GGUF

Text Generation • 4B • Updated Aug 20, 2024 • 137k • 25

duyntnet/Phi-3.5-mini-instruct-imatrix-GGUF

Text Generation • 4B • Updated Aug 21, 2024 • 52