Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

3,785

Base only

Active filters: instruct

NovusResearch/Thestral7b-v0.1

Updated Mar 13, 2024

FoxEngineAi/Hermes-2-Pro-Mistral-7B_AWQ-GEMM_4_128_True

Text Generation • 7B • Updated Mar 13, 2024 • 15 • 2

bartowski/Hermes-2-Pro-Mistral-7B-exl2

Text Generation • Updated Mar 14, 2024 • 4

bartowski/Hermes-2-Pro-Mistral-7B-GGUF

Text Generation • 7B • Updated Mar 14, 2024 • 1.71k • 4

solidrust/Hermes-2-Pro-Mistral-7B-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 224 • 2

mlx-community/Hermes-2-Pro-Mistral-7B-4bit

1B • Updated Mar 14, 2024 • 209 • 6

NovusResearch/Thestral-0.1-tr-chat-7B

Text Generation • 7B • Updated Mar 21, 2024 • 22 • • 3

RedHatAI/Llama-2-7b-dolphin-open_platypus

Text Generation • 7B • Updated May 15, 2024 • 24

RedHatAI/Llama-2-7b-dolphin-open_platypus-pruned_50

Text Generation • 7B • Updated May 15, 2024 • 53

RedHatAI/Llama-2-7b-dolphin-open_platypus-pruned_70

Text Generation • 7B • Updated May 15, 2024 • 22

RedHatAI/Llama-2-7b-dolphin-open_platypus-pruned_50-quantized-deepsparse

Text Generation • Updated May 16, 2024 • 22

RedHatAI/Llama-2-7b-dolphin-open_platypus-pruned_70-quantized-deepsparse

Text Generation • Updated May 16, 2024 • 21 • 1

abideen/AlphaMonarch-daser

Text Generation • 7B • Updated Mar 22, 2024 • 15 • 11

mlx-community/Hermes-2-Pro-Mistral-7B-8bit

2B • Updated Mar 16, 2024 • 356 • 8

Weyaxi/Einstein-v5-v0.2-7B

Text Generation • 7B • Updated Apr 4, 2024 • 13 • 10

backyardai/Hermes-2-Pro-Mistral-7B-GGUF

7B • Updated May 22, 2024 • 1.15k • 1

Hemanth-thunder/Tamil-Mistral-7B-Instruct-v0.1

Text Generation • 7B • Updated Apr 14, 2024 • 339 • 14

Nekochu/Luminia-13B-v3

Text Generation • 13B • Updated Mar 20, 2024 • 53 • • 6

blockblockblock/Hermes-2-Pro-Mistral-7B-bpw2.5

Text Generation • Updated Mar 19, 2024 • 8

blockblockblock/Hermes-2-Pro-Mistral-7B-bpw3

Text Generation • Updated Mar 19, 2024 • 14

blockblockblock/Hermes-2-Pro-Mistral-7B-bpw3.5

Text Generation • Updated Mar 19, 2024 • 7

blockblockblock/Hermes-2-Pro-Mistral-7B-bpw3.7

Text Generation • Updated Mar 19, 2024 • 8

blockblockblock/Hermes-2-Pro-Mistral-7B-bpw4

Text Generation • Updated Mar 19, 2024 • 6

cogbuji/OpenHermes-2.5-Mistral-7B-mlx-4bit

1B • Updated Mar 19, 2024 • 24 • 1

blockblockblock/Hermes-2-Pro-Mistral-7B-bpw4.2

Text Generation • Updated Mar 19, 2024 • 7

blockblockblock/Hermes-2-Pro-Mistral-7B-bpw4.4

Text Generation • Updated Mar 19, 2024 • 7

blockblockblock/Hermes-2-Pro-Mistral-7B-bpw4.6

Text Generation • Updated Mar 19, 2024 • 6

blockblockblock/Hermes-2-Pro-Mistral-7B-bpw4.8

Text Generation • Updated Mar 19, 2024 • 8

blockblockblock/Hermes-2-Pro-Mistral-7B-bpw5

Text Generation • Updated Mar 19, 2024 • 6

blockblockblock/Hermes-2-Pro-Mistral-7B-bpw5.5

Text Generation • Updated Mar 19, 2024 • 8