Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

25,109

Full-text search

Active filters: imatrix

mradermacher/Yi-34B-200K-XLCTX-RAW-ORPO-0805-GaLore-i1-GGUF

34B • Updated May 28, 2024 • 464

mradermacher/Merge-Mayhem-L3-V2.1-i1-GGUF

8B • Updated May 10, 2024 • 34

mradermacher/SM_Smaug_52B-i1-GGUF

51B • Updated May 10, 2024 • 31

NexesQuants/llama-3-70B-Instruct-abliterated-CQ-GGUF

71B • Updated Jul 21, 2024 • 11 • 1

mradermacher/DiamondForce-i1-GGUF

13B • Updated Dec 16, 2024 • 45

mradermacher/daybreak-mixtral-8x7b-v1.0-hf-i1-GGUF

47B • Updated May 16, 2024 • 4

mradermacher/commander-daybreak-v0.1-hf-i1-GGUF

35B • Updated May 10, 2024 • 1

mradermacher/llama3-daybreak-lumimaid0.1-8b-hf-i1-GGUF

8B • Updated May 10, 2024 • 4

mradermacher/LlumiLuminRP-8B-Instruct-262k-v0.3-i1-GGUF

8B • Updated May 10, 2024 • 4

mradermacher/Moistral-11B-v4-i1-GGUF

11B • Updated May 11, 2024 • 21

duyntnet/Genstruct-7B-imatrix-GGUF

Text Generation • 7B • Updated May 10, 2024

bartowski/Tess-2.0-Llama-3-70B-v0.2-GGUF

Text Generation • 71B • Updated May 10, 2024 • 3 • 1

mmnga/Fugaku-LLM-13B-instruct-gguf

13B • Updated May 12, 2024 • 291 • 6

mradermacher/Meta-Llama-3-120B-Instruct-i1-GGUF

122B • Updated May 14, 2024 • 42 • 1

mradermacher/Orthocopter_8B-i1-GGUF

8B • Updated May 11, 2024 • 35

mradermacher/Qwen1.5-72B-i1-GGUF

72B • Updated May 11, 2024 • 76

backyardai/Midnight-Rose-70B-v2.0.3-GGUF

69B • Updated May 22, 2024 • 937 • 8

mradermacher/Fimbul-Airo-18B-i1-GGUF

18B • Updated Dec 16, 2024 • 210

MarsupialAI/llama-3-70B-Instruct-abliterated_iMatrix_GGUF

71B • Updated May 11, 2024 • 85

Felladrin/gguf-sharded-Qwen1.5-0.5B-Chat

0.6B • Updated Aug 6, 2024 • 33

mradermacher/LuminRP-13B-128k-i1-GGUF

13B • Updated May 11, 2024 • 122

mmnga/aixsatoshi-Ex-karakuri-8x12B-chat-v1-gguf

82B • Updated May 19, 2024 • 44

duyntnet/Phi-3-mini-128k-instruct-imatrix-GGUF

Text Generation • 4B • Updated Jul 6, 2024 • 121

bartowski/dolphin-2.9-llama3-70b-GGUF

Text Generation • 71B • Updated May 11, 2024 • 662 • 1

duyntnet/Mistral-7B-OpenOrca-imatrix-GGUF

Text Generation • 7B • Updated May 11, 2024 • 60 • 1

mmnga/DataPilot-ArrowPro-7B-RobinHood-gguf

7B • Updated May 11, 2024 • 218 • 2

mmnga/japanese-stablelm-2-instruct-1_6b-gguf

2B • Updated May 11, 2024 • 84 • 3

mradermacher/Qwen1.5-72B-Chat-i1-GGUF

72B • Updated May 14, 2024 • 218

mradermacher/dolphin-ultrafeedback-dpo-i1-GGUF

7B • Updated May 11, 2024 • 5

duyntnet/Nous-Hermes-2-SOLAR-10.7B-imatrix-GGUF

Text Generation • 11B • Updated May 11, 2024 • 39