Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

25,090

Full-text search

Active filters: imatrix

mradermacher/Bernstein-120b-i1-GGUF

120B • Updated May 6, 2024 • 26 • 1

mradermacher/EinBase-70B-v0.1-full-i1-GGUF

69B • Updated May 6, 2024 • 18

qwp4w3hyb/Cerebrum-1.0-8x7b-iMat-GGUF

47B • Updated Mar 24, 2024 • 16

mradermacher/Iambe-RP-DARE-20b-DENSE-i1-GGUF

20B • Updated May 8, 2024 • 13

mradermacher/Norocetacean-20b-10k-i1-GGUF

20B • Updated May 8, 2024 • 149 • 2

mradermacher/Iambe-RP-cDPO-20b-i1-GGUF

20B • Updated Dec 10, 2024 • 5

mradermacher/Eileithyia-20b-i1-GGUF

20B • Updated May 8, 2024 • 3 • 1

mradermacher/Miqu-70B-Alpaca-DPO-i1-GGUF

69B • Updated May 6, 2024 • 66

mradermacher/Emerhyst-20B-i1-GGUF

20B • Updated May 8, 2024 • 17 • 1

backyardai/Senku-70B-Full-GGUF

69B • Updated Jun 5, 2024 • 32

dranger003/c4ai-command-r-plus-iMat.GGUF

Text Generation • 104B • Updated May 6, 2024 • 1.19k • 141

qwp4w3hyb/c4ai-command-r-v01-iMat-GGUF

35B • Updated May 12, 2024 • 399 • 13

qwp4w3hyb/Mistral-22B-v0.1-iMat-GGUF

22B • Updated Apr 12, 2024 • 27 • 1

qwp4w3hyb/c4ai-command-r-plus-iMat-GGUF

104B • Updated May 29, 2024 • 154 • 5

qwp4w3hyb/Not-WizardLM-2-7B-iMat-GGUF

7B • Updated Apr 16, 2024 • 84 • 3

backyardai/WizardLM-2-8x22B-GGUF

141B • Updated May 22, 2024 • 59 • 1

qwp4w3hyb/Not-WizardLM-2-8x22B-iMat-GGUF

141B • Updated Apr 21, 2024 • 45 • 3

NexesQuants/Meta-Llama-3-70B-Instruct.GGUF

71B • Updated Sep 24, 2024 • 5

qwp4w3hyb/Meta-Llama-3-8B-Instruct-iMat-GGUF

Text Generation • 8B • Updated Apr 29, 2024 • 162 • 6

qwp4w3hyb/Meta-Llama-3-70B-Instruct-iMat-GGUF

Text Generation • 71B • Updated May 8, 2024 • 59 • 3

duyntnet/TinyLlama-1.1B-Chat-v1.0-imatrix-GGUF

Text Generation • 1B • Updated Apr 26, 2024 • 832

duyntnet/stable-code-instruct-3b-imatrix-GGUF

Text Generation • 3B • Updated Apr 26, 2024 • 32

duyntnet/phi-2-imatrix-GGUF

Text Generation • 3B • Updated Apr 26, 2024 • 75

duyntnet/rocket-3B-imatrix-GGUF

Text Generation • 3B • Updated Apr 26, 2024 • 20 • 1

qwp4w3hyb/Phi-3-mini-4k-instruct-iMat-GGUF

Text Generation • 4B • Updated May 22, 2024 • 272 • 1

duyntnet/Meta-Llama-3-8B-Instruct-imatrix-GGUF

Text Generation • 8B • Updated May 1, 2024 • 52

duyntnet/WizardLM-2-7B-imatrix-GGUF

Text Generation • 7B • Updated Apr 26, 2024 • 16 • 1

duyntnet/stablelm-zephyr-3b-imatrix-GGUF

Text Generation • 3B • Updated Apr 26, 2024 • 63 • 1

duyntnet/stable-code-3b-imatrix-GGUF

Text Generation • 3B • Updated Apr 26, 2024 • 30

duyntnet/MiniCPM-3B-OpenHermes-2.5-v2-imatrix-GGUF

Text Generation • 3B • Updated Apr 26, 2024 • 36