Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

7,700

Base only

Active filters: th

vallabh001/xlm-roberta-base-multilingual-en-es

Sentence Similarity • 0.3B • Updated Dec 16, 2024 • 56

aisingapore/Llama-SEA-LION-v3-8B-IT-GGUF

Text Generation • 8B • Updated Jun 10 • 753

numen-tech/Hermes-3-Llama-3.2-3B-w4a16g128asym

Text Generation • Updated Dec 16, 2024

mlx-community/Llama-3.2-11B-Vision-Instruct-abliterated-4-bit

Image-Text-to-Text • 2B • Updated Dec 16, 2024 • 304 • 1

jncraton/multilingual-e5-small-ct2-int8

Sentence Similarity • Updated Dec 16, 2024 • 130

mlx-community/Llama-3.2-11B-Vision-Instruct-abliterated-8-bit

Image-Text-to-Text • 3B • Updated Dec 16, 2024 • 197 • 1

numen-tech/FuseChat-Llama-3.2-3B-Instruct-w4a16g128asym

Text Generation • Updated Dec 16, 2024

numen-tech/FuseChat-Llama-3.2-1B-Instruct-w4a16g128asym

Text Generation • Updated Dec 16, 2024

mlx-community/Llama-3.2-11B-Vision-Instruct-abliterated

Image-Text-to-Text • 11B • Updated Dec 16, 2024 • 764 • 7

aayanmishra-ml/Athena-3-14B

Text Generation • Updated Jun 9, 2025 • 8 • 3

numen-tech/FuseChat-Llama-3.2-1B-Instruct-q0f16

Text Generation • Updated Dec 17, 2024

mradermacher/han-llm-7b-v1-GGUF

7B • Updated Dec 17, 2024 • 19

numen-tech/EVA-LLaMA-3.33-70B-v0.0-w4a16g128sym

Text Generation • Updated Dec 17, 2024

itlwas/Llama-3.2-1B-Q4_K_M-GGUF

Text Generation • 1B • Updated Dec 17, 2024 • 36 • 1

itlwas/Llama-3.2-3B-Q4_K_M-GGUF

Text Generation • 3B • Updated Dec 17, 2024 • 13

itlwas/Llama-3.2-3B-Instruct-Q4_K_M-GGUF

Text Generation • 3B • Updated Dec 17, 2024 • 21

itlwas/Llama-3.2-1B-Instruct-Q4_K_M-GGUF

Text Generation • 1B • Updated Dec 17, 2024 • 47

itlwas/Llama-3.1-8B-Q4_K_M-GGUF

Text Generation • 8B • Updated Dec 17, 2024 • 23

itlwas/Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Dec 17, 2024 • 9

ankner/llama3.2_1b_instruct

Text Generation • 1B • Updated Dec 18, 2024 • 1

dkarunakaran/Llama-3.2-3B-Instruct-Q8_0-GGUF

Text Generation • 3B • Updated Dec 18, 2024 • 1

TheRains/Sailor2-8B-Q4_K_M-GGUF

9B • Updated Dec 18, 2024 • 1

mradermacher/Athena-1-14B-GGUF

15B • Updated Mar 17 • 32 • 1

mradermacher/Athena-1-14B-i1-GGUF

15B • Updated Feb 23 • 108 • 1

WueNLP/centurio_qwen

Image-Text-to-Text • 8B • Updated Jan 10, 2025 • 14 • 9

WueNLP/centurio_aya

Image-Text-to-Text • 8B • Updated Jan 10, 2025 • 26 • 4

mradermacher/han-llm-7b-v2-GGUF

7B • Updated Aug 1, 2025 • 19

jharis97/Llama-3.2-1B-Q2_K-GGUF

Text Generation • 1B • Updated Dec 19, 2024 • 3

jharis97/Llama-3.2-1B-Q3_K_S-GGUF

Text Generation • 1B • Updated Nov 12, 2025 • 25

cnfusion/Llama-3.3-70B-Instruct-abliterated-Q2-mlx

Text Generation • 7B • Updated Dec 19, 2024 • 353 • 1