Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

32,710

Base only

Active filters: imatrix

mradermacher/Euryale-1.3-Small-7B-i1-GGUF

7B • Updated May 10, 2024 • 192

mmnga/DataPilot-ArrowPro-7B-KUJIRA-gguf

7B • Updated May 11, 2024 • 1.88k • 10

mradermacher/Yi-34B-200K-XLCTX-RAW-ORPO-0805-GaLore-i1-GGUF

34B • Updated May 28, 2024 • 47

mradermacher/Merge-Mayhem-L3-V2.1-i1-GGUF

8B • Updated May 10, 2024 • 410

mradermacher/SM_Smaug_52B-i1-GGUF

51B • Updated May 10, 2024 • 107

NexesQuants/llama-3-70B-Instruct-abliterated-CQ-GGUF

71B • Updated Jul 21, 2024 • 50 • 1

mradermacher/DiamondForce-i1-GGUF

13B • Updated Dec 16, 2024 • 25

mradermacher/daybreak-mixtral-8x7b-v1.0-hf-i1-GGUF

47B • Updated May 16, 2024 • 2

mradermacher/commander-daybreak-v0.1-hf-i1-GGUF

35B • Updated May 10, 2024 • 10

mradermacher/llama3-daybreak-lumimaid0.1-8b-hf-i1-GGUF

8B • Updated May 10, 2024 • 142

mradermacher/LlumiLuminRP-8B-Instruct-262k-v0.3-i1-GGUF

8B • Updated May 10, 2024 • 111

mradermacher/Moistral-11B-v4-i1-GGUF

11B • Updated May 11, 2024 • 6

duyntnet/Genstruct-7B-imatrix-GGUF

Text Generation • 7B • Updated May 10, 2024 • 278

bartowski/Tess-2.0-Llama-3-70B-v0.2-GGUF

Text Generation • 71B • Updated May 10, 2024 • 251 • 1

mmnga/Fugaku-LLM-13B-instruct-gguf

13B • Updated May 12, 2024 • 2.59k • 6

mradermacher/Meta-Llama-3-120B-Instruct-i1-GGUF

122B • Updated May 14, 2024 • 225 • 1

mradermacher/Orthocopter_8B-i1-GGUF

8B • Updated May 11, 2024 • 158

mradermacher/Qwen1.5-72B-i1-GGUF

72B • Updated May 11, 2024 • 198

backyardai/Midnight-Rose-70B-v2.0.3-GGUF

69B • Updated May 22, 2024 • 6.04k • 8

mradermacher/Fimbul-Airo-18B-i1-GGUF

18B • Updated Dec 16, 2024 • 551

MarsupialAI/llama-3-70B-Instruct-abliterated_iMatrix_GGUF

71B • Updated May 11, 2024 • 968

Felladrin/gguf-sharded-Qwen1.5-0.5B-Chat

0.6B • Updated Aug 6, 2024 • 238

mradermacher/LuminRP-13B-128k-i1-GGUF

13B • Updated May 11, 2024 • 37

mmnga/aixsatoshi-Ex-karakuri-8x12B-chat-v1-gguf

82B • Updated May 19, 2024 • 1.88k

duyntnet/Phi-3-mini-128k-instruct-imatrix-GGUF

Text Generation • 4B • Updated Jul 6, 2024 • 1.97k

bartowski/dolphin-2.9-llama3-70b-GGUF

Text Generation • 71B • Updated May 11, 2024 • 1.17k • 1

duyntnet/Mistral-7B-OpenOrca-imatrix-GGUF

Text Generation • 7B • Updated May 11, 2024 • 1.14k • 1

mmnga/DataPilot-ArrowPro-7B-RobinHood-gguf

7B • Updated May 11, 2024 • 2.32k • 2

mmnga/japanese-stablelm-2-instruct-1_6b-gguf

2B • Updated May 11, 2024 • 1.38k • 3

mradermacher/Qwen1.5-72B-Chat-i1-GGUF

72B • Updated May 14, 2024 • 140