Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

11,656

Base only

Active filters: quantized

MaziyarPanahi/Mistral-CyberLawyer-7B-GGUF

Text Generation • 7B • Updated Feb 22, 2025 • 18

jhu-clsp/rank1-32b-awq

Text Generation • 33B • Updated Feb 26, 2025 • 5

jhu-clsp/rank1-llama3-8b-awq

Text Generation • 8B • Updated Feb 26, 2025 • 4

jhu-clsp/rank1-mistral-2501-24b-awq

Text Generation • 24B • Updated Feb 26, 2025 • 4

MaziyarPanahi/Llama_3.2_1b_RandomLego_RP_R1_0.1-GGUF

Text Generation • 1B • Updated Feb 22, 2025 • 29

sgedela/opt-125m-quantized

Text Generation • Updated Feb 22, 2025 • 1

MaziyarPanahi/Lamarck-14B-v0.7-Fusion-GGUF

Text Generation • 15B • Updated Feb 23, 2025 • 100 • 1

MaziyarPanahi/Llama-3.1-TAIDE-R1-8B-Chat-GGUF

Text Generation • 9B • Updated Feb 23, 2025 • 13

MaziyarPanahi/Viper-Coder-HybridMini-v1.3-GGUF

Text Generation • 8B • Updated Feb 23, 2025 • 120 • 1

MaziyarPanahi/Qwen2.5-14B-CIC-ACLARC-GGUF

Text Generation • 15B • Updated Feb 24, 2025 • 13

MaziyarPanahi/Qwen2.5-14B-CIC-SciCite-GGUF

Text Generation • 15B • Updated Feb 24, 2025 • 6

MaziyarPanahi/Clarus-7B-v0.1-GGUF

Text Generation • 8B • Updated Feb 24, 2025 • 36

MaziyarPanahi/DeepSeek-R1-Distill-Llama-3B-GGUF

Text Generation • 3B • Updated Feb 24, 2025 • 222 • 1

MaziyarPanahi/ZYH-LLM-Qwen2.5-14B-V3-GGUF

Text Generation • 15B • Updated Feb 24, 2025 • 33

MaziyarPanahi/LLaMA-3-8B-GRPO-Finance-Math-TR-GGUF

Text Generation • 8B • Updated Feb 24, 2025 • 25

MaziyarPanahi/Sombrero-Opus-14B-Elite6-GGUF

Text Generation • 15B • Updated Feb 24, 2025 • 12

Deepak7376/DeepSeek-R1-Distill-Qwen-1.5B-bnb-4bit

Text Generation • 2B • Updated Feb 25, 2025 • 6 • 1

Deepak7376/DeepSeek-R1-Distill-Qwen-1.5B-bnb-8bit

Text Generation • 2B • Updated Feb 26, 2025 • 6 • 1

Tonic/GemmaX2-28-2B-4bit

Translation • 3B • Updated Feb 26, 2025 • 7 • 5

Tonic/GemmaX2-28-2B-8bit

Translation • 3B • Updated Feb 26, 2025 • 4 • 1

Tonic/GemmaX2-28-2B-gguf

Translation • 3B • Updated Mar 2, 2025 • 217 • 7

MaziyarPanahi/Llama_3.1_8b_DoberWild_v2.03-GGUF

Text Generation • 8B • Updated Feb 28, 2025 • 29

MaziyarPanahi/Llama_3.1_8b_DodoWild_v2.03-GGUF

Text Generation • 8B • Updated Feb 28, 2025 • 11

MaziyarPanahi/cursa-o1-7b-v1.1-GGUF

Text Generation • 8B • Updated Feb 28, 2025 • 12

MaziyarPanahi/Llama_3.1_8b_DodoWild_v2.02-GGUF

Text Generation • 8B • Updated Feb 28, 2025 • 15

MaziyarPanahi/Llama_3.1_8b_DoberWild_v2.02-GGUF

Text Generation • 8B • Updated Feb 28, 2025 • 15

MaziyarPanahi/Llama_3.1_8b_Dolermed_R1_V1.01-GGUF

Text Generation • 8B • Updated Feb 28, 2025 • 11

MaziyarPanahi/Vikhr-YandexGPT-5-Lite-8B-it-GGUF

Text Generation • 8B • Updated Feb 28, 2025 • 46

MaziyarPanahi/Clarus-7B-v0.3-GGUF

Text Generation • 8B • Updated Feb 28, 2025 • 20

MaziyarPanahi/Llama_3.1_8b_Hermedive_R1_V1.01-GGUF

Text Generation • 8B • Updated Mar 1, 2025 • 22