Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

3,787

Base only

Active filters: instruct

GPT4All-Community/Hermes-2-Pro-Llama-3-8B-GGUF

8B • Updated Aug 12, 2024 • 69 • 1

genevera/Medical-Llama3-8B-Q5_K_M-GGUF

8B • Updated Jul 30, 2024 • 30

genevera/Medical-Llama3-8B-Q6_K-GGUF

8B • Updated Jul 30, 2024 • 13

ModelCloud/Meta-Llama-3.1-405B-Instruct-gptq-4bit

Text Generation • 410B • Updated Jul 30, 2024 • 10 • 2

justinthelaw/Hermes-2-Pro-Mistral-7B-4bit-32g-GPTQ

Text Generation • 7B • Updated Aug 2, 2024 • 8 • 1

monsterapi/Llama-3_1-8B-Instruct-orca-ORPO

Updated Aug 9, 2024 • 15 • 2

hierholzer/Llama-3.1-70B-Instruct-GGUF

Text Generation • 71B • Updated Dec 11, 2024 • 4.54k • 3

pszemraj/nanoT5-mid-2k-instruct

Text Generation • 0.6B • Updated Dec 29, 2025 • 7

legraphista/Palmyra-Fin-70B-32K-IMat-GGUF

Text Generation • 71B • Updated Aug 2, 2024 • 1.31k • 10

bartowski/Palmyra-Med-70B-32K-GGUF

Text Generation • 71B • Updated Aug 5, 2024 • 1.29k • 4

defenseunicorns/Hermes-2-Pro-Mistral-7B-4bit-32g-GPTQ

Text Generation • 7B • Updated Aug 2, 2024 • 7

bartowski/Palmyra-Fin-70B-32K-GGUF

Text Generation • 71B • Updated Aug 5, 2024 • 1.22k • 5

mlx-community/Writer-Palmyra-Fin-70B-32K

11B • Updated Aug 4, 2024 • 22 • 1

mradermacher/Meta-Llama-3.1-8B-openhermes-2.5-GGUF

8B • Updated Aug 4, 2024 • 514

Pterko/llama-3-12b-instruct-Q8_0-GGUF

Text Generation • 12B • Updated Aug 4, 2024 • 12

mradermacher/Pantheon-RP-1.5-12b-Nemo-GGUF

12B • Updated Aug 4, 2024 • 285 • 3

mradermacher/Pantheon-RP-1.5-12b-Nemo-i1-GGUF

12B • Updated Aug 4, 2024 • 171 • 1

Ransss/Pantheon-RP-1.5-12b-Nemo-Q8_0-GGUF

12B • Updated Aug 4, 2024 • 9 • 1

bartowski/Pantheon-RP-1.5-12b-Nemo-GGUF

Text Generation • 12B • Updated Aug 5, 2024 • 1.93k • 3

bartowski/Pantheon-RP-1.5-12b-Nemo-exl2

Text Generation • Updated Aug 4, 2024 • 15

NousResearch/Hermes-3-Llama-3.1-70B-GGUF

71B • Updated Aug 23, 2024 • 2.06k • 52

ValiantLabs/Llama3.1-8B-ShiningValiant2

Text Generation • 8B • Updated Mar 12, 2025 • 58 • • 17

monsterapi/gemma-2-2b-hindi-translator

Translation • Updated Aug 7, 2024 • 11 • 1

NousResearch/Hermes-3-Llama-3.1-70B-FP8

71B • Updated Sep 8, 2024 • 1.26k • 27

QuantFactory/Pantheon-RP-1.5-12b-Nemo-GGUF

12B • Updated Aug 7, 2024 • 463 • 4

ModelCloud/EXAONE-3.0-7.8B-Instruct-gptq-4bit

8B • Updated Aug 9, 2024 • 10 • 3

GPT4All-Community/Qwen2-7B-Instruct-GGUF

Text Generation • 8B • Updated Aug 20, 2024 • 121 • 1

ValiantLabs/Llama3.1-8B-Enigma

Text Generation • 8B • Updated Mar 12, 2025 • 28 • 10

zelias/BgGPT-7B-Instruct-v0.2_exl2_8bpw

Text Generation • Updated Aug 11, 2024 • 6

UCLA-EMC/Meta-Llama-3.1-8B-Instruct-AWQ-INT4-32-2.17B

Text Generation • 8B • Updated Aug 30, 2024 • 192 • 1