Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

118

Base only

Active filters: 7-bit

Dracones/EVA-LLaMA-3.33-70B-v0.1_exl2_7.0bpw

Text Generation • Updated Feb 19, 2025 • 3

CuriousCat29/mocha-double-120-v3.6-7-bit

Updated Mar 2, 2025 • 3

Dracones/QwQ-32B_exl2_7.0bpw

Text Generation • Updated Mar 6, 2025 • 1

cshared/Qwen-QwQ-32B-7.0bpw-exl2

Text Generation • Updated Mar 6, 2025 • 4

llmixer/c4ai-command-a-03-2025-7.0bpw-h8-exl2

Text Generation • Updated Mar 15, 2025 • 4

SicariusSicariiStuff/Fiendish_LLAMA_3B-7.0bpw

Text Generation • Updated Jul 26, 2025 • 5

CuriousCat29/l3-deep-choco-120-7bit

Updated Mar 20, 2025 • 3

Dracones/QwQ-32B-ArliAI-RpR-v1_exl2_7.0bpw

Updated Apr 8, 2025 • 2

sleepdeprived3/Baptist-Christian-Bible-Expert-v2.0-24B_EXL2_7bpw_H8

Text Generation • Updated Apr 15, 2025 • 6

ArtusDev/TheDrummer_Valkyrie-49B-v1_EXL3_7.0bpw_H8

22B • Updated May 26, 2025 • 4

ArtusDev/TheDrummer_Rivermind-12B-v1_EXL3_7.0bpw_H6

6B • Updated May 26, 2025 • 3

ArtusDev/TheDrummer_Rivermind-Lux-12B-v1_EXL3_7.0bpw_H6

6B • Updated May 28, 2025 • 4

stellaglow1122/llama3.2-1B-lora-exl2-q7

Updated Jun 4, 2025 • 5

SicariusSicariiStuff/Impish_Magic_24B_EXL2_7.0bpw

Text Generation • Updated Jun 21, 2025 • 2

CuriousCat29/l3-stack-mocha-2-8bit

Text Generation • Updated Jun 30, 2025 • 2

SicariusSicariiStuff/Impish_LLAMA_4B_EXL3_7.0bpw

Text Generation • 2B • Updated Jul 5, 2025 • 3

SicariusSicariiStuff/Impish_Nemo_12B_EXL3_7.0bpw

Text Generation • 6B • Updated Aug 10, 2025 • 11

SicariusSicariiStuff/Impish_Longtail_12B_EXL3_7.0bpw

Text Generation • 6B • Updated Aug 16, 2025 • 9

bylukeio/Huihui-Qwen3-VL-32B-Thinking-abliterated-exl3-7.0bpw

Image-Text-to-Text • 15B • Updated Dec 9, 2025 • 16 • 1

bylukeio/Huihui-Qwen3-VL-30B-A3B-Instruct-abliterated-exl3-7.0bpw

Image-Text-to-Text • 14B • Updated Dec 9, 2025 • 4

TheCluster/Gemma-4-26B-A4B-Heretic-MLX-7bit

Image-Text-to-Text • 27B • Updated Apr 7 • 50

TheCluster/Gemma-4-26B-A4B-MLX-mixed-7bit

Image-Text-to-Text • 27B • Updated Apr 9 • 23

TheCluster/Qwen3.6-27B-MLX-mixed-7.6bit

Image-Text-to-Text • 28B • Updated Apr 22 • 19

TheCluster/Qwen3.6-27B-Heretic-MLX-mixed-7.6bit

Image-Text-to-Text • 28B • Updated Apr 27 • 37

TheCluster/Qwen3.6-27B-Heretic2-Uncensored-Finetune-Thinking-MLX-mixed-7.6bit

Image-Text-to-Text • 28B • Updated Apr 29 • 149

TheCluster/Huihui-Qwen3.6-27B-Abliterated-MLX-mixed-7.6bit

Image-Text-to-Text • 28B • Updated Apr 29 • 249 • 1

anthonyw448/DeepSeek-R1-Distill-Llama-70B_EXL2_7.0bpw_h6

Updated May 5 • 7 • 1

anthonyw448/Llama-3.3-70B-Instruct-EXL3-7.0bpw-h6

Text Generation • 32B • Updated May 6 • 9