Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

15,064

Base only

Active filters: pt

LoneStriker/Meta-Llama-3.1-70B-Instruct-2.25bpw-h6-exl2

Text Generation • Updated Jul 24, 2024 • 3

adrlau/Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Jul 24, 2024 • 32

Quant-Cartel/mini-magnum-12b-v1.1-exl2-longcal

Updated Jul 24, 2024 • 3

rainjay/Meta-Llama-3.1-8B-Instruct-4bit

Text Generation • 8B • Updated Jul 24, 2024 • 9

NousResearch/Meta-Llama-3.1-8B

Text Generation • 8B • Updated Jul 25, 2024 • 28.4k • • 17

NousResearch/Meta-Llama-3.1-8B-Instruct

Text Generation • 8B • Updated Jul 24, 2024 • 438k • • 40

NousResearch/Meta-Llama-3.1-70B

Text Generation • 71B • Updated Jul 26, 2024 • 1.47k • • 7

NousResearch/Meta-Llama-3.1-70B-Instruct

Text Generation • 71B • Updated Jul 24, 2024 • 4.66k • • 13

Pranav102999/Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Jul 24, 2024 • 24

atcsecure/llama3.1-70b-instruct-8.0bpw-h8-exl2

Text Generation • Updated Jul 24, 2024 • 2

mistralai/Mistral-Large-Instruct-2407

123B • Updated Jul 28, 2025 • 4.98k • 865

hugging-quants/Meta-Llama-3.1-70B-Instruct-GPTQ-INT4

Text Generation • 71B • Updated Aug 7, 2024 • 3.48k • 23

hugging-quants/Meta-Llama-3.1-8B-Instruct-GPTQ-INT4

Text Generation • 8B • Updated Aug 7, 2024 • 9.13k • 42

joshnader/Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Jul 24, 2024 • 3.26k • 7

joshnader/Meta-Llama-3.1-8B-Instruct-Q8_0-GGUF

Text Generation • 8B • Updated Jul 24, 2024 • 31 • 1

Berly00/whisper-small-portuguese-1

Automatic Speech Recognition • 0.2B • Updated Jul 24, 2024 • 4

zak66/Meta-Llama-3.1-8B-Instruct-Q8_0-GGUF

Text Generation • 8B • Updated Jul 24, 2024 • 14

altomek/mini-magnum-12b-v1.1-8bpw-EXL2

Text Generation • Updated Aug 30, 2024 • 4

callitaclue/Meta-Llama-3.1-8B-Instruct-Q5_K_S-GGUF

Text Generation • 8B • Updated Jul 24, 2024 • 21

pek111/Meta-Llama-3.1-8B-Instruct-GGUF

Text Generation • 8B • Updated Jul 26, 2024 • 267 • 7

mlx-community/Mistral-Large-Instruct-2407-4bit

19B • Updated Jul 24, 2024 • 3.08k • 1

mlx-community/Mistral-Large-Instruct-2407-8bit

34B • Updated Jul 24, 2024 • 91 • 1

mlx-community/Mistral-Large-Instruct-2407-bf16

123B • Updated Jul 24, 2024 • 84 • 1

DeusImperator/mini-magnum-12b-v1.1_exl2_8bpw_max

Text Generation • Updated Jul 24, 2024 • 4

NousResearch/Meta-Llama-3.1-405B-FP8

Text Generation • 410B • Updated Jul 25, 2024 • 49 • 3

xyottax/Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Jul 24, 2024 • 19

Efficient-Large-Model/Meta-Llama-3.1-70B

Text Generation • 71B • Updated Jul 26, 2024 • 5

SillyTilly/Mistral-Large-Instruct-2407

Text Generation • 123B • Updated Jul 24, 2024 • 13 • 2

legraphista/Mistral-Large-Instruct-2407-IMat-GGUF

Text Generation • 123B • Updated Jul 25, 2024 • 256 • 29

mradermacher/mini-magnum-12b-v1.1-GGUF

12B • Updated Jul 29, 2024 • 466 • 12