Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

4,550

Full-text search

Active filters: meta

Triangle104/Unsloth_Llama-3.2-1B-Instruct-Q5_K_S-GGUF

1B • Updated Feb 17, 2025

Triangle104/Unsloth_Llama-3.2-1B-Instruct-Q5_K_M-GGUF

1B • Updated Feb 17, 2025

Triangle104/Unsloth_Llama-3.2-1B-Instruct-Q6_K-GGUF

1B • Updated Feb 17, 2025 • 8

Triangle104/Unsloth_Llama-3.2-1B-Instruct-Q8_0-GGUF

1B • Updated Feb 17, 2025 • 21

Triangle104/Unsloth_Llama-3.2-1B-Q4_K_S-GGUF

1B • Updated Feb 17, 2025

Triangle104/Unsloth_Llama-3.2-1B-Q4_K_M-GGUF

1B • Updated Feb 17, 2025 • 1

Triangle104/Unsloth_Llama-3.2-1B-Q5_K_S-GGUF

1B • Updated Feb 17, 2025

Triangle104/Unsloth_Llama-3.2-1B-Q5_K_M-GGUF

1B • Updated Feb 17, 2025 • 2

Triangle104/Unsloth_Llama-3.2-1B-Q6_K-GGUF

1B • Updated Feb 17, 2025

Triangle104/Unsloth_Llama-3.2-1B-Q8_0-GGUF

1B • Updated Feb 17, 2025 • 8

happylife39/Llama-3.2-1B-Q4_0-GGUF

Text Generation • 1B • Updated Nov 11, 2024 • 8

tensorblock/Meta-Llama-3-8B-Instruct-GGUF

Text Generation • 8B • Updated Jan 27 • 8

tensorblock/Llama-3.2-1B-GGUF

Text Generation • 1B • Updated Jan 27 • 100 • 1

mav23/Meta-Llama-Guard-2-8B-GGUF

Text Generation • 8B • Updated Nov 11, 2024 • 122

mav23/Llama-3-Open-Ko-8B-GGUF

Text Generation • 8B • Updated Nov 11, 2024 • 1

tensorblock/h2ogpt-4096-llama2-7b-chat-GGUF

Text Generation • 7B • Updated Jan 27 • 29

tensorblock/llama-2-ko-7b-GGUF

Text Generation • 7B • Updated Jan 27 • 19

mav23/Llama-3-8B-Instruct-Gradient-4194k-GGUF

Text Generation • 8B • Updated Nov 11, 2024

tensorblock/CodeLlama-34b-hf-GGUF

Text Generation • 34B • Updated Jan 27 • 27

MAGKEN/Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Nov 11, 2024

fbaldassarri/meta-llama_Llama-3.2-1B-Instruct-auto_gptq-int4-gs128-asym

Text Generation • 1B • Updated Nov 11, 2024 • 2

fbaldassarri/meta-llama_Llama-3.2-1B-Instruct-auto_gptq-int4-gs128-sym

Text Generation • 1B • Updated Nov 11, 2024 • 1

fbaldassarri/meta-llama_Llama-3.2-3B-Instruct-auto_gptq-int4-gs128-asym

Text Generation • 3B • Updated Nov 11, 2024 • 5

fbaldassarri/meta-llama_Llama-3.2-3B-Instruct-auto_gptq-int4-gs128-sym

Text Generation • 3B • Updated Nov 11, 2024

BatirayErbayVodafone/testl

Text Generation • 8B • Updated Nov 12, 2024 • 4

tensorblock/CodeLlama-13b-hf-GGUF

Text Generation • 13B • Updated Jan 27 • 36

tensorblock/Llama-3.2-3B-GGUF

Text Generation • 3B • Updated Jan 27 • 121

tensorblock/CodeLlama-7b-Python-hf-GGUF

Text Generation • 7B • Updated Jan 27 • 100

Jaelin/Llama-3.2-3B-Instruct-Q4_K_M-GGUF

Text Generation • 3B • Updated Nov 12, 2024 • 1

Jaelin/Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Nov 12, 2024