Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

32,667

Base only

Active filters: imatrix

mradermacher/EinBase-70B-v0.1-full-i1-GGUF

69B • Updated May 6, 2024 • 147

qwp4w3hyb/Cerebrum-1.0-8x7b-iMat-GGUF

47B • Updated Mar 24, 2024 • 104

mradermacher/Iambe-RP-DARE-20b-DENSE-i1-GGUF

20B • Updated May 8, 2024 • 108

mradermacher/Norocetacean-20b-10k-i1-GGUF

20B • Updated May 8, 2024 • 225 • 2

mradermacher/Iambe-RP-cDPO-20b-i1-GGUF

20B • Updated Dec 10, 2024 • 62

mradermacher/Eileithyia-20b-i1-GGUF

20B • Updated May 8, 2024 • 51 • 1

mradermacher/Miqu-70B-Alpaca-DPO-i1-GGUF

69B • Updated May 6, 2024 • 2.09k

mradermacher/Emerhyst-20B-i1-GGUF

20B • Updated May 8, 2024 • 62 • 1

backyardai/Senku-70B-Full-GGUF

69B • Updated Jun 5, 2024 • 237

dranger003/c4ai-command-r-plus-iMat.GGUF

Text Generation • 104B • Updated May 6, 2024 • 1.85k • 140

qwp4w3hyb/c4ai-command-r-v01-iMat-GGUF

35B • Updated May 12, 2024 • 727 • 13

qwp4w3hyb/Mistral-22B-v0.1-iMat-GGUF

22B • Updated Apr 12, 2024 • 61 • 1

qwp4w3hyb/c4ai-command-r-plus-iMat-GGUF

104B • Updated May 29, 2024 • 312 • 5

qwp4w3hyb/Not-WizardLM-2-7B-iMat-GGUF

7B • Updated Apr 16, 2024 • 531 • 3

backyardai/WizardLM-2-8x22B-GGUF

141B • Updated May 22, 2024 • 242 • 1

qwp4w3hyb/Not-WizardLM-2-8x22B-iMat-GGUF

141B • Updated Apr 21, 2024 • 553 • 3

NexesQuants/Meta-Llama-3-70B-Instruct.GGUF

71B • Updated Sep 24, 2024 • 45

qwp4w3hyb/Meta-Llama-3-8B-Instruct-iMat-GGUF

Text Generation • 8B • Updated Apr 29, 2024 • 1.55k • 6

qwp4w3hyb/Meta-Llama-3-70B-Instruct-iMat-GGUF

Text Generation • 71B • Updated May 8, 2024 • 814 • 3

duyntnet/TinyLlama-1.1B-Chat-v1.0-imatrix-GGUF

Text Generation • 1B • Updated Apr 26, 2024 • 1.33k

duyntnet/stable-code-instruct-3b-imatrix-GGUF

Text Generation • 3B • Updated Apr 26, 2024 • 880

duyntnet/phi-2-imatrix-GGUF

Text Generation • 3B • Updated Apr 26, 2024 • 268

duyntnet/rocket-3B-imatrix-GGUF

Text Generation • 3B • Updated Apr 26, 2024 • 276 • 1

qwp4w3hyb/Phi-3-mini-4k-instruct-iMat-GGUF

Text Generation • 4B • Updated May 22, 2024 • 873 • 1

duyntnet/Meta-Llama-3-8B-Instruct-imatrix-GGUF

Text Generation • 8B • Updated May 1, 2024 • 1.35k

duyntnet/WizardLM-2-7B-imatrix-GGUF

Text Generation • 7B • Updated Apr 26, 2024 • 328 • 1

duyntnet/stablelm-zephyr-3b-imatrix-GGUF

Text Generation • 3B • Updated Apr 26, 2024 • 450 • 1

duyntnet/stable-code-3b-imatrix-GGUF

Text Generation • 3B • Updated Apr 26, 2024 • 328

duyntnet/MiniCPM-3B-OpenHermes-2.5-v2-imatrix-GGUF

Text Generation • 3B • Updated Apr 26, 2024 • 906

duyntnet/WestIceLemonTeaRP-32k-7b-imatrix-GGUF

Text Generation • 7B • Updated Apr 26, 2024 • 1.22k