Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

15,050

Base only

Active filters: pt

ek826/Meta-Llama-3.1-405B-Instruct-6.0bpw-exl2

Text Generation • Updated Aug 4, 2024 • 5 • 2

Nehal07/Mistral-Nemo-Instruct-2407-Q4_K_M-GGUF

12B • Updated Aug 4, 2024 • 30 • 1

FriendliAI/Meta-Llama-3.1-8B-Instruct-fp8

Text Generation • 8B • Updated Nov 3, 2024 • 7.73k

Vic0705/Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Aug 5, 2024 • 3

BrassLion/Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Aug 5, 2024 • 10

BrassLion/Meta-Llama-3.1-8B-Instruct-Q3_K_L-GGUF

Text Generation • 8B • Updated Aug 6, 2024 • 7

anthracite-org/magnum-v2-12b-gguf

Text Generation • 12B • Updated Aug 22, 2024 • 475 • 38

liqi03/whisper-large-v3-pt-fleurs

2B • Updated Aug 6, 2024 • 2

matiusX/lamma-legis-ufam

Updated Aug 6, 2024 • 2

Ya211/aya23-8b

Text Generation • 8B • Updated Aug 6, 2024 • 4

stanfm/LMA3.1

Text Generation • 8B • Updated Aug 6, 2024 • 7

jasonj2020/Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Aug 6, 2024 • 6

Alibaba-NLP/gte-multilingual-mlm-base

Fill-Mask • 0.3B • Updated Aug 6, 2024 • 5.89k • 16

liqi03/whisper-large-v3-pt-aug

2B • Updated Aug 6, 2024 • 3

jacky840327/Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Aug 6, 2024 • 20

mradermacher/Meta-Llama-3.1-405B-i1-GGUF

Updated Feb 3, 2025 • 1

utter-project/EuroLLM-1.7B-Instruct

Text Generation • 2B • Updated Dec 16, 2024 • 9.62k • 101

BookingCare/multilingual-e5-base-similarity-v1-onnx-quantized

Sentence Similarity • Updated Dec 5, 2024 • 91

MarsupialAI/Magnum-12b-v2_iMatrix_GGUF

Text Generation • 12B • Updated Aug 6, 2024 • 183

bartowski/magnum-12b-v2-GGUF

Text Generation • 12B • Updated Aug 6, 2024 • 4.96k • 18

Intel/whisper-small-openvino

Automatic Speech Recognition • Updated Nov 13, 2024 • 2

joshloecker/Mistral-Nemo-Instruct-2407-Q4_K_M-GGUF

12B • Updated Aug 6, 2024 • 22

joshloecker/Mistral-Nemo-Instruct-2407-Q3_K_M-GGUF

12B • Updated Aug 6, 2024 • 13

mradermacher/aya23-8b-GGUF

8B • Updated Jan 22, 2025 • 128

mradermacher/aya23-8b-i1-GGUF

8B • Updated Jan 22, 2025 • 299

redarmee/Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Aug 7, 2024 • 6

hanchungshin/Meta-Llama-3.1-8B-Instruct-IQ4_NL-GGUF

Text Generation • 8B • Updated Aug 7, 2024 • 3

BSC-LT/salamandra7b_rag_prompt_ca-en-es

Text Generation • 8B • Updated Aug 20, 2024 • 17 • 3

jimmywhite66/Meta_llama_3.1_8b

Text Generation • 8B • Updated Aug 7, 2024 • 3

joshloecker/Mistral-Nemo-Instruct-2407-Q2_K-GGUF

12B • Updated Aug 7, 2024 • 11