Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

3,559

Base only

Active filters: instruct

quanthunter/Hermes-2-Pro-Llama-3-8B-Q6_K-GGUF

8B • Updated May 14, 2024 • 2

quanthunter/Hermes-2-Pro-Llama-3-8B-Q5_K_M-GGUF

8B • Updated May 14, 2024 • 22

quanthunter/Hermes-2-Pro-Llama-3-8B-Q4_K_M-GGUF

8B • Updated May 14, 2024 • 32

NikolayKozloff/Llama-3-portuguese-Tom-cat-8b-instruct-Q6_K-GGUF

Text Generation • 8B • Updated May 14, 2024 • 4 • 1

NikolayKozloff/phi-3-portuguese-tom-cat-4k-instruct-Q8_0-GGUF

Text Generation • 4B • Updated May 14, 2024 • 9 • 1

Ayush-1722/Meta-Llama-3-8B-Instruct-Summarize-v0.2-16K-LoRANET-Merged

Text Generation • 8B • Updated Jun 19, 2024 • 11 • 2

Ayush-1722/Meta-Llama-3-8B-Instruct-Summarize-v0.2-24K-LoRANET-Merged

Text Generation • 8B • Updated Jun 19, 2024 • 10 • 2

unsloth/mistral-7b-instruct-v0.2

Text Generation • 7B • Updated Sep 11, 2024 • 1.64k •

bartowski/Hermes-2-Theta-Llama-3-8B-exl2

Text Generation • Updated May 15, 2024 • 1 • 2

bartowski/Hermes-2-Theta-Llama-3-8B-GGUF

Text Generation • Updated May 18, 2024 • 432 • 15

NikolayKozloff/Llama-2-7b-dolphin-open_platypus-Q8_0-GGUF

Text Generation • 7B • Updated May 15, 2024 • 6 • 1

typealias/Hermes-2-Theta-Llama-3-8B-mlx-4bit

1B • Updated May 16, 2024 • 22 • 1

mpasila/Hermes-2-Theta-Llama-3-8B-exl2-4.75bpw

Text Generation • Updated May 16, 2024 • 3

qwp4w3hyb/SFR-Iterative-DPO-LLaMA-3-8B-R-iMat-GGUF

Text Generation • 8B • Updated May 16, 2024 • 2 • 2

Writer/Palmyra-56B-Instruct

Text Generation • Updated Oct 24, 2024 • 3

e2jhiubyiiyvw/Pantheon-RP-1.0-8b-Llama-3-Q5_K_M-GGUF

8B • Updated May 16, 2024 • 3

OpenPipe/Hermes-2-Pro-Llama-3-8B-32k

Text Generation • 8B • Updated May 17, 2024 • 2 • 1

OpenPipe/Hermes-2-Theta-Llama-3-8B-32k

Text Generation • 8B • Updated May 18, 2024 • 80 • • 9

thesven/Hermes-2-Theta-Llama-3-8B-GGUF

8B • Updated May 22, 2024 • 77

acecalisto3/PhiCo-D-Instruck

Text Generation • Updated Jul 5, 2024 • 6 • 2

afrideva/phi-3-portuguese-tom-cat-4k-instruct-GGUF

Text Generation • 4B • Updated May 18, 2024 • 54 • 1

cminja/Llama-3-8B-Lexi-Uncensored-Q8_0-GGUF

8B • Updated May 19, 2024 • 20 • 1

rhaymison/portuguese-tom-cat-13b

Text Generation • 13B • Updated May 21, 2024 • 2

transcenderningning/Llama3-OpenBioLLM-8B

Text Generation • 8B • Updated May 20, 2024 • 2

NikolayKozloff/llama-3-typhoon-v1.5-8b-instruct-Q6_K-GGUF

Text Generation • 8B • Updated May 20, 2024 • 3 • 1

qwp4w3hyb/Yi-1.5-9B-Chat-16K-iMat-GGUF

Text Generation • 9B • Updated May 20, 2024 • 21

octoai/hermes-2-theta-llama-3-8b-rope-theta

Text Generation • 8B • Updated May 20, 2024 • 8 • 1

qwp4w3hyb/Phi-3-medium-128k-instruct-iMat-GGUF

Text Generation • 14B • Updated May 22, 2024 • 196 • 4

typhoon-ai/llama-3-typhoon-v1.5-8b-instruct-gguf

8B • Updated Mar 31, 2025 • 142 • 3

unsloth/mistral-7b-v0.3

Text Generation • 7B • Updated Sep 11, 2024 • 1.24k • • 8