Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

4,551

Full-text search

Active filters: meta

dnaney/Llama-3.2-3B-Instruct-Q4_K_M-GGUF

Text Generation • 3B • Updated Oct 22, 2024 • 2

parthagorai/Llama-3.2-1B-Instruct-Q4_K_M-GGUF

Text Generation • 1B • Updated Oct 22, 2024 • 2

impactframes/layerskip-llama3.2-1B-Q4_K_M-GGUF

Text Generation • 1B • Updated Oct 22, 2024 • 4 • 2

AIDSC/llama2-7b-hf

Text Generation • 7B • Updated Oct 23, 2024 • 2

davidrpugh/Llama-3.1-8B-Instruct-GGUF

Text Generation • 8B • Updated Oct 23, 2024 • 3

Kam1k4dze/Llama-3.2-3B-Q4_K_M-GGUF

Text Generation • 3B • Updated Oct 22, 2024 • 142

swpranta/Llama-3.2-1B-Q4_K_M-GGUF

Text Generation • 1B • Updated Oct 22, 2024

Kam1k4dze/Llama-3.2-3B-Q8_0-GGUF

Text Generation • 3B • Updated Oct 22, 2024 • 6

lahirum/Llama-3.2-3B-Instruct-Q4_0-GGUF

Text Generation • 3B • Updated Oct 23, 2024 • 838

AIDSC/llama2-7b-chat-hf

Text Generation • 7B • Updated Oct 23, 2024 • 1

AIDSC/llama2-13b-hf

Text Generation • 13B • Updated Nov 13, 2024

longtc/llama3.2-1B

Text Generation • 1B • Updated Oct 23, 2024 • 2

meta-llama/Llama-3.2-1B-Instruct-QLORA_INT4_EO8

Text Generation • Updated Nov 18, 2024 • 226 • 48

meta-llama/Llama-3.2-1B-Instruct-SpinQuant_INT4_EO8

Text Generation • Updated Nov 18, 2024 • 71 • 38

meta-llama/Llama-3.2-3B-Instruct-QLORA_INT4_EO8

Text Generation • Updated Nov 18, 2024 • 37 • 71

meta-llama/Llama-3.2-3B-Instruct-SpinQuant_INT4_EO8

Text Generation • Updated Nov 18, 2024 • 29 • 37

ibnzterrell/Nvidia-Llama-3.1-Nemotron-70B-Instruct-HF-AWQ-INT4

Text Generation • 71B • Updated Dec 7, 2024 • 653 • 6

mav23/Meta-Llama-3-70B-GGUF

Text Generation • 71B • Updated Oct 24, 2024 • 1

AIDSC/llama2-13b-chat-hf

Text Generation • 13B • Updated Nov 13, 2024

Anthonyg5005/Llama-Guard-3-1B-exl2

Text Generation • Updated Mar 12, 2025

HizbullahIrshaad/Llama-3.1-8B-Instruct-Q8_0-GGUF

Text Generation • 8B • Updated Oct 24, 2024

Esperanto/llama-3.2-3B-Instruct-kvc-AWQ-int4-onnx

Text Generation • Updated Dec 12, 2024 • 1

Esperanto/llama-3.2-1B-Instruct-kvc-AWQ-int4-onnx

Text Generation • Updated Dec 12, 2024

besimray/test-model

Text Generation • 3B • Updated Oct 24, 2024 • 2

besimray/test-llama

Text Generation • 1B • Updated Oct 24, 2024 • 4 •

besimray/miner_id_1_383a850e-bb15-45a2-8f4b-fc96eb001a75_1729787003

Text Generation • 1B • Updated Oct 24, 2024 • 8 •

besimray/miner_id_1_383a850e-bb15-45a2-8f4b-fc96eb001a75_1729787147

Text Generation • 1B • Updated Oct 24, 2024 • 9 •

besimray/miner_id_1_383a850e-bb15-45a2-8f4b-fc96eb001a75_1729787410

Text Generation • 1B • Updated Oct 24, 2024 • 7 •

ijohn07/Llama-3.2-1B-Q8_0-GGUF

Text Generation • 1B • Updated Oct 24, 2024 • 2

ijohn07/Llama-3.2-1B-Instruct-Q8_0-GGUF

Text Generation • 1B • Updated Oct 24, 2024