Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

25,197

Full-text search

Active filters: imatrix

mradermacher/Silicon-Maid-7B-i1-GGUF

7B • Updated May 28, 2024 • 41

legraphista/dolphin-2.9.1-llama-3-8b-IMat-GGUF

Text Generation • 8B • Updated May 27, 2024 • 100

legraphista/openchat-3.6-8b-20240522-IMat-GGUF

Text Generation • 8B • Updated May 27, 2024 • 22.2k • 1

bartowski/Llama-3-70B-Synthia-v3.5-GGUF

Text Generation • 71B • Updated May 27, 2024 • 17 • 1

legraphista/dolphin-2.9.1-mixtral-1x22b-IMat-GGUF

Text Generation • 22B • Updated May 28, 2024 • 489

legraphista/internlm2-math-plus-1_8b-IMat-GGUF

Text Generation • 2B • Updated May 27, 2024 • 148 • 2

legraphista/internlm2-math-plus-7b-IMat-GGUF

Text Generation • 8B • Updated May 27, 2024 • 318 • 2

legraphista/internlm2-math-plus-20b-IMat-GGUF

Text Generation • 20B • Updated May 27, 2024 • 212 • 2

mradermacher/Halu-OAS-8B-Llama3-i1-GGUF

8B • Updated Aug 2, 2024 • 65 • 2

mradermacher/Moistral-11B-v5b-i1-GGUF

11B • Updated Aug 2, 2024 • 62 • 1

mradermacher/Berghof-NSFW-7B-i1-GGUF

7B • Updated Jan 7, 2025 • 122 • 8

legraphista/internlm2-math-plus-mixtral8x22b-IMat-GGUF

Text Generation • 141B • Updated May 28, 2024 • 137

bartowski/internlm2-math-plus-20b-GGUF

Text Generation • 20B • Updated May 27, 2024 • 13

duyntnet/Sailor-14B-Chat-imatrix-GGUF

Text Generation • 14B • Updated May 27, 2024

Quant-Cartel/experiment_2_8b-iMat-GGUF

8B • Updated May 28, 2024 • 37 • 2

duyntnet/Sailor-7B-Chat-imatrix-GGUF

Text Generation • 8B • Updated May 28, 2024

mradermacher/TooManyMixRolePlay-7B-Story_V2-i1-GGUF

7B • Updated Aug 2, 2024 • 57

mradermacher/Mirai-Nova-Llama3-LocalAI-8B-v0.2-i1-GGUF

8B • Updated Aug 2, 2024 • 55

VerusCommunity/llama-3-verus-8-epochs-revision-1

Text Generation • 8B • Updated Jun 11, 2024 • 40 • 1

mradermacher/L3-70B-daybreak-abliterated-v0.4-i1-GGUF

71B • Updated Aug 2, 2024 • 43 • 4

mradermacher/Mirai-Nova-Llama3-LocalAI-Unchained-8B-v0.2-i1-GGUF

8B • Updated Aug 2, 2024 • 108

mradermacher/Experimental_Orion-Nebula-10.7B-v0.1-i1-GGUF

11B • Updated Aug 2, 2024 • 3

mradermacher/Daredevil-8B-abliterated-dpomix-i1-GGUF

8B • Updated Dec 16, 2024 • 458 • 8

mradermacher/Contextual-Obedient-MoE-3x8B-Llama3-RAG-i1-GGUF

19B • Updated Aug 2, 2024 • 26 • 1

mradermacher/Twilight-Miqu-146B-i1-GGUF

146B • Updated Aug 2, 2024 • 50 • 4

bartowski/internlm2-math-plus-mixtral8x22b-GGUF

Text Generation • 141B • Updated May 28, 2024 • 65 • 1

qwp4w3hyb/Llama-3-11.5B-Instruct-V2-iMat-GGUF

Text Generation • 12B • Updated May 29, 2024 • 8 • 1

Lewdiculous/phencyclidine-8b-v1-GGUF-IQ-Imatrix

8B • Updated May 28, 2024 • 18 • 2

legraphista/AutoCoder_S_6.7B-IMat-GGUF

Text Generation • 7B • Updated May 28, 2024 • 253 • 1

legraphista/AutoCoder-IMat-GGUF

Text Generation • 33B • Updated May 28, 2024 • 138 • 1