Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

4,745

Base only

Active filters: meta

tensorblock/h2ogpt-4096-llama2-13b-chat-GGUF

Text Generation • 13B • Updated Jan 27 • 18

tensorblock/Llama-3.2-3B-Instruct-GGUF

Text Generation • 3B • Updated Jan 27 • 389

cmchenry66/Llama-3.1-8B-Instruct-Q5_K_S-GGUF

Text Generation • 8B • Updated Nov 10, 2024 • 17

tensorblock/Llama-3.1-Storm-8B-GGUF

8B • Updated Jan 27 • 78

happylife39/Llama-3.2-1B-Q4_0-GGUF

Text Generation • 1B • Updated Nov 11, 2024 • 11

tensorblock/Meta-Llama-3-8B-Instruct-GGUF

Text Generation • 8B • Updated Jan 27 • 12

tensorblock/Llama-3.2-1B-GGUF

Text Generation • 1B • Updated Jan 27 • 183 • 1

tensorblock/h2ogpt-4096-llama2-7b-chat-GGUF

Text Generation • 7B • Updated Jan 27 • 25

tensorblock/llama-2-ko-7b-GGUF

Text Generation • 7B • Updated Jan 27 • 53

tensorblock/CodeLlama-34b-hf-GGUF

Text Generation • 34B • Updated Jan 27 • 45

MAGKEN/Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Nov 11, 2024 • 4

fbaldassarri/meta-llama_Llama-3.2-1B-Instruct-auto_gptq-int4-gs128-asym

Text Generation • 1B • Updated Nov 11, 2024 • 7

fbaldassarri/meta-llama_Llama-3.2-1B-Instruct-auto_gptq-int4-gs128-sym

Text Generation • 1B • Updated Nov 11, 2024 • 38

fbaldassarri/meta-llama_Llama-3.2-3B-Instruct-auto_gptq-int4-gs128-asym

Text Generation • 3B • Updated Nov 11, 2024 • 7

fbaldassarri/meta-llama_Llama-3.2-3B-Instruct-auto_gptq-int4-gs128-sym

Text Generation • 3B • Updated Nov 11, 2024 • 37

BatirayErbayVodafone/testl

Text Generation • 8B • Updated Nov 12, 2024 • 11 •

tensorblock/CodeLlama-13b-hf-GGUF

Text Generation • 13B • Updated Jan 27 • 35

tensorblock/Llama-3.2-3B-GGUF

Text Generation • 3B • Updated Jan 27 • 114

tensorblock/CodeLlama-7b-Python-hf-GGUF

Text Generation • 7B • Updated Jan 27 • 34

Jaelin/Llama-3.2-3B-Instruct-Q4_K_M-GGUF

Text Generation • 3B • Updated Nov 12, 2024 • 5

Jaelin/Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Nov 12, 2024 • 19

Jaelin/Llama-3.2-1B-Instruct-Q4_K_M-GGUF

Text Generation • 1B • Updated Nov 12, 2024 • 7

pt-sk/ll-3.2-1B_Instruct

Text Generation • 1B • Updated Nov 12, 2024 • 8

BitSnake88/Llama-3.2-1B-Q4_K_M-GGUF

Text Generation • 1B • Updated Nov 12, 2024 • 8

Jaelin/Llama-3.2-1B-Instruct-Q2_K-GGUF

Text Generation • 1B • Updated Nov 12, 2024 • 4

Hazem2024/Llama-3.2-1B-Q4_0-GGUF

Text Generation • 1B • Updated Nov 12, 2024 • 11

klgchanu/Llama-3.2-1B-Instruct-Q4_K_M-GGUF

Text Generation • 1B • Updated Nov 12, 2024 • 11

Hazem2024/Llama-3.1-8B-Q4_0-GGUF

Text Generation • 8B • Updated Nov 12, 2024 • 5

tensorblock/Llama-2-7B-Chat-fp16-GGUF

Text Generation • 7B • Updated Jan 27 • 74

rnd7/Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Nov 13, 2024 • 5