Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

4,745

Base only

Active filters: meta

meta-llama/Llama-3.2-3B-Instruct-SpinQuant_INT4_EO8

Text Generation • Updated Nov 18, 2024 • 41 • 40

ibnzterrell/Nvidia-Llama-3.1-Nemotron-70B-Instruct-HF-AWQ-INT4

Text Generation • 71B • Updated Dec 7, 2024 • 367 • 6

AIDSC/llama2-13b-chat-hf

Text Generation • 13B • Updated Nov 13, 2024

Anthonyg5005/Llama-Guard-3-1B-exl2

Text Generation • Updated Mar 12, 2025 • 5

HizbullahIrshaad/Llama-3.1-8B-Instruct-Q8_0-GGUF

Text Generation • 8B • Updated Oct 24, 2024 • 4

Esperanto/llama-3.2-3B-Instruct-kvc-AWQ-int4-onnx

Text Generation • Updated Dec 12, 2024 • 9

Esperanto/llama-3.2-1B-Instruct-kvc-AWQ-int4-onnx

Text Generation • Updated Dec 12, 2024

besimray/test-model

Text Generation • 3B • Updated Oct 24, 2024 • 6

besimray/test-llama

Text Generation • 1B • Updated Oct 24, 2024 • 10

besimray/miner_id_1_383a850e-bb15-45a2-8f4b-fc96eb001a75_1729787003

Text Generation • 1B • Updated Oct 24, 2024 • 8

besimray/miner_id_1_383a850e-bb15-45a2-8f4b-fc96eb001a75_1729787147

Text Generation • 1B • Updated Oct 24, 2024 • 8

besimray/miner_id_1_383a850e-bb15-45a2-8f4b-fc96eb001a75_1729787410

Text Generation • 1B • Updated Oct 24, 2024 • 8

ijohn07/Llama-3.2-1B-Q8_0-GGUF

Text Generation • 1B • Updated Oct 24, 2024 • 8

ijohn07/Llama-3.2-1B-Instruct-Q8_0-GGUF

Text Generation • 1B • Updated Oct 24, 2024 • 4

ijohn07/Llama-3.2-3B-Q8_0-GGUF

Text Generation • 3B • Updated Oct 24, 2024 • 9

Bradarr/Llama-3.2-1B-Q8_0-GGUF

Text Generation • 1B • Updated Oct 24, 2024 • 11

Bradarr/Llama-3.2-3B-Q8_0-GGUF

Text Generation • 3B • Updated Oct 24, 2024 • 12

ijohn07/Llama-3.2-3B-Instruct-Q8_0-GGUF

Text Generation • 3B • Updated Oct 24, 2024 • 3

Bradarr/Llama-3.2-1B-Instruct-Q8_0-GGUF

Text Generation • 1B • Updated Oct 24, 2024 • 5

gohsyi/Llama-3.2-1B

Text Generation • 1B • Updated Oct 24, 2024 • 5

gohsyi/Llama-3.2-3B

Text Generation • 3B • Updated Oct 24, 2024 • 4

besimray/miner_id_2_56d9075c-cf98-498b-8ad6-84bc66fb6ee2_1729801840

Text Generation • 1B • Updated Oct 24, 2024 • 6

besimray/miner_id_3_56d9075c-cf98-498b-8ad6-84bc66fb6ee2_1729801842

Text Generation • 1B • Updated Oct 24, 2024 • 7

besimray/miner_id_1_56d9075c-cf98-498b-8ad6-84bc66fb6ee2_1729801843

Text Generation • 1B • Updated Oct 24, 2024 • 6

besimray/miner_id_3_72df7d62-e0d6-41b2-9153-9843320d6b82_1729802122

Text Generation • 1B • Updated Oct 24, 2024 • 6

besimray/miner_id_2_72df7d62-e0d6-41b2-9153-9843320d6b82_1729802124

Text Generation • 1B • Updated Oct 24, 2024 • 11

besimray/miner_id_1_e0133dc7-d8f1-4a3d-b487-a48a7ef3227b_1729802815

Text Generation • 3B • Updated Oct 24, 2024 • 5

besimray/miner_id_2_e0133dc7-d8f1-4a3d-b487-a48a7ef3227b_1729802816

Text Generation • 3B • Updated Oct 24, 2024 • 7

besimray/miner_id_3_e0133dc7-d8f1-4a3d-b487-a48a7ef3227b_1729802817

Text Generation • 3B • Updated Oct 24, 2024 • 6

besimray/miner_id_3_53482eaf-613d-40b1-a3b3-eb83714b00c8_1729803098

Text Generation • 3B • Updated Oct 24, 2024 • 5