Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

3,786

Base only

Active filters: instruct

LiteLLMs/Llama3-OpenBioLLM-8B-GGUF

8B • Updated Apr 29, 2024 • 48 • 1

NousResearch/Hermes-2-Pro-Llama-3-8B

Text Generation • 8B • Updated Sep 14, 2024 • 5.06k • • 455

andreass123/gemma-2b-translation-v0.150-Q4_K_M-GGUF

Text Generation • 3B • Updated Apr 30, 2024 • 98

pek111/TC-instruct-DPO-GGUF

Text Generation • 7B • Updated Jul 20, 2024 • 385 • 1

rhaymison/Llama-3-portuguese-Tom-cat-8b-instruct

Text Generation • 8B • Updated Jun 2, 2024 • 13 • • 12

NousResearch/Hermes-2-Pro-Llama-3-8B-GGUF

8B • Updated May 3, 2024 • 1.67k • 163

blockblockblock/Hermes-2-Pro-Llama-3-8B-bpw2.25-exl2

Text Generation • Updated May 3, 2024 • 7

solidrust/Hermes-2-Pro-Llama-3-8B-AWQ

Text Generation • 8B • Updated Sep 3, 2024 • 9.85k • 11

noxinc/phi-3-portuguese-tom-cat-4k-instruct-Q5_K_M-GGUF-PTBR

Text Generation • 4B • Updated May 1, 2024 • 53 • 1

noxinc/phi-3-portuguese-tom-cat-4k-instruct-Q4_K_M-GGUF-PTBR

Text Generation • 4B • Updated May 1, 2024 • 45 • 1

noxinc/phi-3-portuguese-tom-cat-4k-instruct-Q4_0-GGUF-PTBR

Text Generation • 4B • Updated Feb 22, 2025 • 64

mgoin/Hermes-2-Pro-Llama-3-8B-Marlin

Text Generation • Updated May 2, 2024 • 12 • 1

mlx-community/Hermes-2-Pro-Llama-3-8B-4bit

1B • Updated May 2, 2024 • 71 • 1

mlx-community/Hermes-2-Pro-Llama-3-8B-8bit

2B • Updated May 2, 2024 • 22 • 1

qwp4w3hyb/Hermes-2-Pro-Llama-3-8B-iMat-GGUF

8B • Updated May 2, 2024 • 457 • 2

bartowski/Hermes-2-Pro-Llama-3-8B-exl2

Text Generation • Updated May 2, 2024 • 7 • 7

bartowski/Hermes-2-Pro-Llama-3-8B-GGUF

Text Generation • 8B • Updated May 2, 2024 • 906 • 8

vonjack/Nous-Hermes-2-Pro-Xtuner-LLaVA-v1_1-Llama-3-8B

Image-Text-to-Text • 8B • Updated May 2, 2024 • 8 • 2

fakezeta/Hermes-2-Pro-Llama-3-8B-ov-int8

Text Generation • Updated Jun 24, 2024 • 9 • 1

bartowski/Einstein-v6.1-Llama3-8B-GGUF

Text Generation • 8B • Updated May 2, 2024 • 743 • 8

mradermacher/Einstein-v6.1-Llama3-8B-GGUF

8B • Updated May 5, 2024 • 380

codys12/Hermes-2-Pro-Llama-3-8B

Text Generation • 8B • Updated May 2, 2024 • 9

blockblockblock/Hermes-2-Pro-Llama-3-8B-bpw3-exl2

Text Generation • Updated May 3, 2024 • 9

blockblockblock/Hermes-2-Pro-Llama-3-8B-bpw4-exl2

Text Generation • Updated May 3, 2024 • 7

blockblockblock/Hermes-2-Pro-Llama-3-8B-bpw4.4-exl2

Text Generation • Updated May 3, 2024 • 9

blockblockblock/Hermes-2-Pro-Llama-3-8B-bpw4.8-exl2

Text Generation • Updated May 3, 2024 • 8

blockblockblock/Hermes-2-Pro-Llama-3-8B-bpw5-exl2

Text Generation • Updated May 3, 2024 • 6

blockblockblock/Hermes-2-Pro-Llama-3-8B-bpw5.5-exl2

Text Generation • Updated May 3, 2024 • 9

blockblockblock/Hermes-2-Pro-Llama-3-8B-bpw6-exl2

Text Generation • Updated May 3, 2024 • 7

batmac/Hermes-2-Pro-Llama-3-8B-mlx-4bit

1B • Updated May 3, 2024 • 21