Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

15,048

Base only

Active filters: pt

ek826/Meta-Llama-3.1-405B-Instruct-4.5bpw-gqa-exl2

Text Generation • Updated Aug 11, 2024 • 4

WGNW/Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Aug 12, 2024 • 11

UCLA-EMC/Meta-Llama-3.1-8B-ExLlamaV2-INT8

Text Generation • Updated Aug 12, 2024 • 4

anthracite-org/magnum-v2.5-12b-kto

Text Generation • 12B • Updated Aug 22, 2024 • 1.15k • • 57

anthracite-org/magnum-v2.5-12b-kto-exl2

Text Generation • Updated Aug 15, 2024 • 16 • 8

fakezeta/Meta-Llama-3.1-8B-Instruct-ov-int4

Text Generation • Updated Aug 12, 2024 • 11

fakezeta/Meta-Llama-3.1-8B-Instruct-ov-int8

Text Generation • Updated Aug 12, 2024 • 11

LemiSt/Mistral-Nemo-Instruct-2407-eetq-8bit

12B • Updated Aug 13, 2024 • 3

lucasdozie/Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Aug 12, 2024 • 8

VAGOsolutions/SauerkrautLM-gemma-2-9b-it

9B • Updated Aug 14, 2024 • 1.38k • 8

akjindal53244/Llama-3.1-Storm-8B

Text Generation • 8B • Updated Dec 5, 2024 • 1.86k • • 178

fakezeta/Meta-Llama-3.1-8B-Instruct-ov-awq

Text Generation • Updated Aug 12, 2024 • 3

pgurazada1/Meta-Llama-3.1-8B-Instruct-GGUF

Text Generation • 8B • Updated Aug 13, 2024 • 10

DaveLeongSG/Mistral-Nemo-Base-2407-Q4_K_M-GGUF

12B • Updated Aug 13, 2024 • 15

DaveLeongSG/Meta-Llama-3.1-8B-Q4_K_M-GGUF

Text Generation • 8B • Updated Aug 13, 2024 • 27

Mylaux/Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Aug 13, 2024 • 7

PamelaBorelli/bert-base-uncased-sentiment-pt-1

Text Classification • Updated Nov 20, 2025 • 17

erlanio/prisebot

7B • Updated Aug 13, 2024 • 24

akjindal53244/Llama-3.1-Storm-8B-FP8-Dynamic

Text Generation • 8B • Updated Aug 21, 2024 • 62 • 14

Alex156/Meta-Llama-3.1-8B-Q2_K-GGUF

Text Generation • 8B • Updated Aug 13, 2024 • 8

reach-vb/Meta-Llama-3.1-8B-Instruct-AWQ-INT4-fix

Text Generation • 8B • Updated Aug 14, 2024 • 4

fsaudm/Meta-Llama-3.1-70B-Instruct-INT8

Text Generation • 71B • Updated Aug 21, 2024 • 4

fsaudm/Meta-Llama-3.1-70B-Instruct-NF4

Text Generation • 73B • Updated Oct 5, 2024 • 5

Infomaniak-AI/onnx-xlm-roberta-base-language-detection

Text Classification • Updated Aug 14, 2024 • 11 • 5

ggml-org/Meta-Llama-3.1-8B-Instruct-Q4_0-GGUF

Text Generation • 8B • Updated Sep 2, 2024 • 1.84k • 15

winvoker/Meta-Llama-3.1-8B-Q8_0-GGUF

Text Generation • 8B • Updated Aug 14, 2024 • 4 • 1

VAGOsolutions/Llama-3.1-SauerkrautLM-8b-Instruct-awq

8B • Updated Aug 21, 2024 • 50 • 3

QuantFactory/magnum-v2-12b-GGUF

Text Generation • 12B • Updated Aug 14, 2024 • 167 • 3

sayi50/Mistral-Nemo-Instruct-2407-Q4_K_M-GGUF

12B • Updated Aug 14, 2024 • 5.43k

G2mp/Test

Updated Aug 14, 2024