Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

7,685

Base only

Active filters: th

Poonawala/Llama-3.2-1B

Text Generation • 1B • Updated Dec 30, 2024 • 12 •

suayptalha/FastLlama-3.2-3B-Instruct

Text Generation • 3B • Updated Jan 8, 2025 • 5 • 4

jsbaicenter/Llama-3.2-3b-Instruct-AWQ-4bit-GEMM

Text Generation • 3B • Updated May 4, 2025

skarmani/Llama-3.1-8B-Instruct-Q5_K_M-GGUF

Text Generation • 8B • Updated Dec 31, 2024 • 3

yhkim96/Llama-3.2-3B-Instruct-Q4_K_M-GGUF

Text Generation • 3B • Updated Dec 31, 2024 • 5

yhkim96/Llama-3.2-3B-Q4_K_M-GGUF

Text Generation • 3B • Updated Dec 31, 2024 • 7

prithivMLmods/Triangulum-5B

Text Generation • 5B • Updated Jan 4, 2025 • 20 • 2

prithivMLmods/Triangulum-5B-GGUF

Text Generation • 5B • Updated Jan 1, 2025 • 76 • 2

ToxicityPrompts/PolyGuard-Qwen

Text Generation • 8B • Updated Jun 23, 2025 • 696 • • 3

abdulmannan-01/llama3.1-8b-full-finetuned-rag-alpaca-data

Text Generation • 8B • Updated Dec 31, 2024 • 1

VinayHajare/Llama-3.2-1B-Instruct-Q4_K_M-GGUF

Text Generation • 1B • Updated Dec 31, 2024 • 12

itlwas/SeaLLM-7B-v2.5-Q4_K_M-GGUF

9B • Updated Dec 31, 2024 • 13

Novaciano/Llama-3.2-1b_DeepSync_Aesir-GGUF

Text Generation • 1B • Updated Jan 1, 2025 • 8

itlwas/SeaLLMs-v3-1.5B-Q4_K_M-GGUF

2B • Updated Dec 31, 2024 • 16

itlwas/SeaLLMs-v3-1.5B-Chat-Q4_K_M-GGUF

2B • Updated Dec 31, 2024 • 11

itlwas/SeaLLMs-v3-7B-Q4_K_M-GGUF

8B • Updated Dec 31, 2024 • 4

itlwas/SeaLLMs-v3-7B-Chat-Q4_K_M-GGUF

8B • Updated Dec 31, 2024 • 11

tensorblock/FastLlama-3.2-1B-Instruct-GGUF

1B • Updated Jan 27 • 5

tssst/MN-12B-Starcannon-v5.5-unofficial-EXL2

Text Generation • Updated Jan 19, 2025

prithivMLmods/Triangulum-1B

Text Generation • 1B • Updated Jan 1, 2025 • 8 • 2

prithivMLmods/Triangulum-1B-GGUF

Text Generation • 1B • Updated Jan 1, 2025 • 45 • 1

mradermacher/Triangulum-5B-GGUF

5B • Updated Jul 31, 2025 • 55

mradermacher/Triangulum-5B-i1-GGUF

5B • Updated Jan 3, 2025 • 159

mradermacher/Triangulum-10B-GGUF

10B • Updated Jul 31, 2025 • 53

mradermacher/Triangulum-10B-i1-GGUF

10B • Updated Jan 5, 2025 • 73

ddsbg/Llama-3.2-3B-Instruct-Q4_K_M-GGUF

Text Generation • 3B • Updated Jan 1, 2025 • 7

tensorblock/Llama-3.3-70B-Instruct-abliterated-GGUF

71B • Updated Jan 27 • 37 • 2

tensorblock/Llama3.2-1B-Instruct-GGUF

Text Generation • 1B • Updated Jan 27 • 33

herbertneutron/llama3.1

Text Generation • Updated Jan 2, 2025 • 2

chg0901/llama3_2_3B_Instruct_alphaca_epoch_1

Text Generation • 3B • Updated Jan 2, 2025 • 2