Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,549

Base only

Active filters: 2-bit

MaziyarPanahi/Deductive-Reasoning-Qwen-32B-GGUF

Text Generation • Updated Mar 11, 2025 • 124 • 1

MaziyarPanahi/Deductive-Reasoning-Qwen-14B-GGUF

Text Generation • Updated Mar 11, 2025 • 56 • 1

MaziyarPanahi/s1.1-7B-GGUF

Text Generation • 8B • Updated Mar 11, 2025 • 50 • 1

Koutouzov1973/Falcon3-Mamba-7B-Instruct-2bits_generex

1B • Updated Mar 11, 2025 • 1

MaziyarPanahi/gemma-3-1b-it-GGUF

Text Generation • 1.0B • Updated Mar 12, 2025 • 163k • 13

MaziyarPanahi/gemma-3-4b-it-GGUF

Text Generation • 4B • Updated Mar 12, 2025 • 177k • 18

MaziyarPanahi/gemma-3-12b-it-GGUF

Text Generation • 12B • Updated Mar 12, 2025 • 161k • 19

MaziyarPanahi/gemma-3-27b-it-GGUF

Text Generation • 27B • Updated Mar 16, 2025 • 159k • 8

alexgusevski/OlympicCoder-32B-mlx-2Bit

Text Generation • 3B • Updated Mar 13, 2025 • 5

alexgusevski/OlympicCoder-7B-mlx-2Bit

Text Generation • 0.7B • Updated Mar 13, 2025 • 4

alexgusevski/Goppa-LogiLlama-mlx-2Bit

Text Generation • 0.1B • Updated Mar 13, 2025 • 4

alexgusevski/Fallen-Llama-3.3-R1-70B-v1-mlx-2Bit

7B • Updated Mar 13, 2025 • 7

nhe-ai/QwQ-32B-mlx-2Bit

Text Generation • 3B • Updated Mar 13, 2025 • 1

MaziyarPanahi/c4ai-command-a-03-2025-GGUF

Text Generation • 111B • Updated Mar 15, 2025 • 175 • 1

Hjgugugjhuhjggg/xddd-mlx-2Bit

Text Generation • 0.3B • Updated Mar 15, 2025 • 1

MaziyarPanahi/OLMo-2-0325-32B-Instruct-GGUF

Text Generation • 32B • Updated Mar 15, 2025 • 55 • 1

Hjgugugjhuhjggg/Jaja-small-mlx-2Bit

Text Generation • 8.44M • Updated Mar 16, 2025

Kfjjdjdjdhdhd/xddd-mlx-2Bit

Text Generation • 0.3B • Updated Mar 17, 2025 • 1

MaziyarPanahi/mistral-small-3.1-24b-instruct-2503-hf-GGUF

Text Generation • 24B • Updated Mar 18, 2025 • 159k • 2

MaziyarPanahi/amoral-gemma3-4B-GGUF

Text Generation • 4B • Updated Mar 20, 2025 • 35

MaziyarPanahi/ByteCraft-GGUF

Text Generation • 8B • Updated Mar 20, 2025 • 45 • 1

MaziyarPanahi/DeepHermes-3-Llama-3-3B-Preview-abliterated-GGUF

Text Generation • 3B • Updated Mar 20, 2025 • 51 • 1

MaziyarPanahi/Ice0.101-20.03-RP-GGUF

Text Generation • 7B • Updated Mar 21, 2025 • 28

MaziyarPanahi/Qwen2.5-1.5B-YOYO-GGUF

Text Generation • 2B • Updated Mar 21, 2025 • 44

MaziyarPanahi/Qwen2.5-3B-YOYO-GGUF

Text Generation • 3B • Updated Mar 21, 2025 • 20

MaziyarPanahi/Qwen2.5-7B-YOYO-GGUF

Text Generation • 8B • Updated Mar 21, 2025 • 28

MaziyarPanahi/gemma-3-1b-it-abliterated-GGUF

Text Generation • 1.0B • Updated Mar 21, 2025 • 86 • 1

MaziyarPanahi/Qwen2.5-14B-YOYO-GGUF

Text Generation • 15B • Updated Mar 21, 2025 • 51

MaziyarPanahi/Qwen2.5-Coder-14B-YOYO-GGUF

Text Generation • 15B • Updated Mar 21, 2025 • 50

MaziyarPanahi/UnslopNemo-Mag-Mell_T-2-GGUF

Text Generation • 12B • Updated Mar 21, 2025 • 42