Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

7,821

Base only

Active filters: th

w93163red/Llama-3.1-8B-Q6_K-GGUF

Text Generation • 8B • Updated Nov 4, 2024 • 4

aisingapore/Gemma-SEA-LION-v3-9B-IT-GGUF

9B • Updated Jun 10 • 3.74k • 1

PragmaticPete/llama3.2inst

Text Generation • 1B • Updated Nov 4, 2024 • 11 •

PragmaticPete/llama3.2inst-F32-GGUF

Text Generation • 90.2M • Updated Nov 4, 2024 • 9

slava177/Llama-3.2-3B-Instruct

Text Generation • 3B • Updated Nov 5, 2024 • 5

abhiramk6/whisper-large-v3-turbo

Automatic Speech Recognition • 0.8B • Updated Nov 5, 2024

yejingfu/nmagic-Meta-Llama-3.1-70B-Instruct-FP8

Text Generation • 71B • Updated Nov 5, 2024 • 8

ddsbg/Llama-3.2-1B-Q4_K_M-GGUF

Text Generation • 1B • Updated Nov 5, 2024 • 9

CISCai/jina-embeddings-v3-query-distilled

Feature Extraction • 64M • Updated Nov 5, 2024 • 6 • 1

CISCai/jina-embeddings-v3-passage-distilled

Feature Extraction • 64M • Updated Nov 5, 2024 • 6

CISCai/jina-embeddings-v3-separation-distilled

Feature Extraction • 64M • Updated Nov 5, 2024 • 10k • 2

CISCai/jina-embeddings-v3-classification-distilled

Feature Extraction • 64M • Updated Nov 5, 2024 • 5

CISCai/jina-embeddings-v3-matching-distilled

Feature Extraction • 64M • Updated Nov 5, 2024 • 4

suayptalha/Komodo-Llama-3.2-3B

Text Generation • 3B • Updated Dec 22, 2024 • 6 • 6

turboleg/Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Nov 6, 2024 • 6

andmev/Llama-3.1-8B-Instruct-CoreML

Text Generation • Updated Nov 6, 2024 • 3 • 3

andmev/Llama-3.2-3B-Instruct-CoreML

Text Generation • Updated Nov 9, 2024 • 16 • 5

apto-as/multilingual-e5-large-Q8_0-GGUF

Feature Extraction • 0.6B • Updated Nov 6, 2024 • 16

richiebailey/whisper-large-v3-turbo

Automatic Speech Recognition • 0.8B • Updated Nov 6, 2024 • 4

IntuitIntel/Llama-3.1-405B-Instruct-8bit

Text Generation • 114B • Updated Nov 6, 2024 • 11

mlx-community/Llama-3.1-405B-Instruct-8bit

Text Generation • 114B • Updated Nov 6, 2024 • 62 • 2

motexture/iTech-1B-Instruct

Text Generation • 1B • Updated Nov 8, 2024 • 8 •

ModelCloud/Llama-3.2-1B-Instruct-gptqmodel-4bit-vortex-v2.5

Text Generation • 1B • Updated Nov 11, 2024 • 112 • 5

mlx-community/Meta-Llama-3.1-8B-Instruct-4bit-fakenews

Text Generation • 1B • Updated Nov 7, 2024 • 14

kvrma/Llama-3.2-1B-Instruct-Q4_K_M-GGUF

Text Generation • 1B • Updated Nov 7, 2024 • 15

kvrma/Llama-3.2-1B-Instruct-Q5_K_M-GGUF

Text Generation • 1B • Updated Nov 7, 2024 • 4

QuantFactory/gemma2-9b-cpt-sea-lionv3-instruct-GGUF

Text Generation • 9B • Updated Nov 7, 2024 • 104 • 2

dieusangly/SeaLLMs-v3-7B-Chat-Q4_K_M-GGUF

8B • Updated Nov 7, 2024 • 6

AIFunOver/Llama-3.2-1B-Instruct-openvino-8bit

Text Generation • Updated Nov 7, 2024 • 4

AIFunOver/Llama-3.2-1B-Instruct-openvino-fp16

Text Generation • Updated Nov 7, 2024 • 39