Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

Mixture of Experts

4-bit precision

8-bit precision

Carbon Emissions

Models

20,898

Base only

Active filters: quantized

MaziyarPanahi/mathstral-7B-v0.1-GGUF

Text Generation • 7B • Updated Jul 16, 2024 • 31k • 8

legraphista/mathstral-7B-v0.1-IMat-GGUF

Text Generation • 7B • Updated Jul 16, 2024 • 342

MaziyarPanahi/Llama-3-Groq-8B-Tool-Use-GGUF

Text Generation • 8B • Updated Jul 17, 2024 • 2.89k • 21

MaziyarPanahi/Llama-3-Groq-70B-Tool-Use-GGUF

Text Generation • 71B • Updated Jul 17, 2024 • 248 • 4

KLMFOREVER/WizardLM-2-7B-q4f16_1-MLC

Text Generation • Updated Jul 18, 2024

MaziyarPanahi/Mistral-Nemo-Instruct-2407-GGUF

Text Generation • 12B • Updated Jul 22, 2024 • 34.3k • 55

ruslanmv/instructLab-granite-7b-lab-text-to-sql-4bits

7B • Updated Jul 19, 2024 • 9

pek111/llama-3-typhoon-v1.5-8b-instruct-GGUF

Text Generation • 8B • Updated Jul 24, 2024 • 380

legraphista/Athene-70B-IMat-GGUF

Text Generation • 71B • Updated Jul 28, 2024 • 2.21k • 3

MaziyarPanahi/SmolLM-135M-Instruct-GGUF

Text Generation • 0.1B • Updated Jul 22, 2024 • 745 • 3

MaziyarPanahi/SmolLM-360M-Instruct-GGUF

Text Generation • 0.4B • Updated Jul 22, 2024 • 522 • 1

MaziyarPanahi/SmolLM-1.7B-Instruct-GGUF

Text Generation • 2B • Updated Jul 22, 2024 • 1.04k • 4

legraphista/Mistral-Nemo-Instruct-2407-IMat-GGUF

Text Generation • 12B • Updated Jul 23, 2024 • 810 • 2

legraphista/Meta-Llama-3.1-8B-Instruct-IMat-GGUF

Text Generation • 8B • Updated Jul 27, 2024 • 1.26k • 6

MaziyarPanahi/Meta-Llama-3.1-8B-Instruct-GGUF

Text Generation • 8B • Updated Jul 23, 2024 • 33k • 40

MaziyarPanahi/Meta-Llama-3.1-70B-Instruct-GGUF

Text Generation • 71B • Updated Jul 29, 2024 • 31.1k • 41

glouriousgautam/llama-3-8b-instruct-bnb-4bit

Text Generation • 8B • Updated Jul 23, 2024 • 18 • 1

legraphista/Meta-Llama-3.1-70B-Instruct-IMat-GGUF

Text Generation • 71B • Updated Jul 27, 2024 • 2.11k • 11

legraphista/Llama-Guard-3-8B-IMat-GGUF

Text Generation • 8B • Updated Jul 23, 2024 • 3.75k • 5

MaziyarPanahi/Meta-Llama-3.1-405B-Instruct-GGUF

Text Generation • 410B • Updated Jul 29, 2024 • 28.6k • 15

pek111/Meta-Llama-3.1-8B-Instruct-GGUF

Text Generation • 8B • Updated Jul 26, 2024 • 313 • 7

legraphista/Mistral-Large-Instruct-2407-IMat-GGUF

Text Generation • 123B • Updated Jul 25, 2024 • 929 • 29

MaziyarPanahi/Mistral-Large-Instruct-2407-GGUF

Text Generation • 123B • Updated Jul 26, 2024 • 3.36k • 22

akshathmangudi/llama3.1-8b-quantized

Text Generation • 8B • Updated Jul 25, 2024 • 7

akshathmangudi/llama3.1-8b-gguf

Updated Jul 26, 2024

legraphista/Meta-Llama-3.1-8B-Instruct-abliterated-IMat-GGUF

Text Generation • 8B • Updated Jul 28, 2024 • 1.42k • 1

MaziyarPanahi/calme-2.1-llama3.1-70b-GGUF

Text Generation • 71B • Updated Jul 31, 2024 • 360 • 2

RedHatAI/Meta-Llama-3.1-8B-quantized.w8a8

Text Generation • 8B • Updated Aug 19 • 827 • 5

legraphista/gemma-2-2b-it-IMat-GGUF

Text Generation • 3B • Updated Jul 31, 2024 • 2.14k • 1

legraphista/gemma-2-2b-IMat-GGUF

Text Generation • 3B • Updated Jul 31, 2024 • 1.71k • 1