Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

3,570

Base only

Active filters: instruct

prithivMLmods/SmolLM2-Math-IIO-1.7B-Instruct

Text Generation • Updated Dec 3, 2024 • 83 • 2

NousResearch/Hermes-3-Llama-3.2-3B

Text Generation • 3B • Updated Dec 18, 2024 • 4.51k • • 182

tensorblock/Hermes-3-Llama-3.1-70B-GGUF

71B • Updated Jan 27 • 124 • 2

mradermacher/SmolLM2-Math-IIO-1.7B-Instruct-GGUF

2B • Updated Dec 4, 2024 • 98

tensorblock/Llama3-70B-ShiningValiant2-GGUF

Text Generation • 71B • Updated Jan 27 • 1

zheyushen/Llama-3_1-8B-Instruct-orca-ORPO-F32-GGUF

27.3M • Updated Dec 6, 2024 • 3

tensorblock/Llama3-70B-Fireplace-GGUF

Text Generation • 71B • Updated Jan 27 • 19

sapienzanlp/Minerva-7B-instruct-v1.0-GGUF

Text Generation • 7B • Updated Dec 7, 2024 • 272 • 5

zheyushen/Llama-3_1-8B-Instruct-orca-ORPO-Q8_0-GGUF

27.3M • Updated Dec 7, 2024 • 3

mradermacher/Novus-7b-tr_v1-GGUF

7B • Updated Dec 7, 2024 • 24 • 1

mradermacher/Novus-7b-tr_v1-i1-GGUF

7B • Updated Dec 7, 2024 • 18 • 1

mradermacher/Genstruct-10.7B-GGUF

11B • Updated Dec 8, 2024 • 21

Lucy-in-the-Sky/pygmalion-2-13b-Q2_K-GGUF

Text Generation • 13B • Updated Dec 8, 2024 • 10

Lucy-in-the-Sky/pygmalion-2-13b-Q8_0-GGUF

Text Generation • 13B • Updated Dec 8, 2024 • 9

mradermacher/Genstruct-10.7B-i1-GGUF

11B • Updated Dec 8, 2024 • 31

SYNERDATA/SYNERDATA-Hermes-3-LLaMA-3.1-8b-Q8_0.GGUF

8B • Updated Dec 9, 2024 • 4 • 1

mradermacher/Llama3-OpenBioLLM-70B-i1-GGUF

71B • Updated Dec 12, 2024 • 417 • 1

hierholzer/Llama-3.3-70B-Instruct-GGUF

Text Generation • 71B • Updated Dec 11, 2024 • 127 • 1

lianghsun/Llama-3.2-Taiwan-1B-Instruct

Text Generation • 1B • Updated May 4 • 3

bartowski/Hermes-3-Llama-3.2-3B-GGUF

Text Generation • Updated Dec 11, 2024 • 12.8k • 14

mlx-community/Hermes-3-Llama-3.2-3B-4bit

Text Generation • 0.5B • Updated Dec 11, 2024 • 304 • 1

mlx-community/Hermes-3-Llama-3.2-3B-8bit

Text Generation • 0.9B • Updated Dec 11, 2024 • 68 • 1

mlx-community/Hermes-3-Llama-3.2-3B-bf16

Text Generation • 3B • Updated Dec 11, 2024 • 20

tensorblock/BgGPT-7B-Instruct-v0.1-GGUF

7B • Updated Jan 27 • 14

mradermacher/Llama3-OpenBioLLM-70B-GGUF

71B • Updated Dec 12, 2024 • 65 • 1

NikolayKozloff/Hermes-3-Llama-3.2-3B-Q8_0-GGUF

3B • Updated Dec 12, 2024 • 11 • 2

namelessai/mythalion-13b-Q4_K_M-GGUF

Text Generation • 13B • Updated Dec 16, 2024 • 58 • 2

mradermacher/Hermes-3-Llama-3.2-3B-GGUF

3B • Updated Dec 13, 2024 • 147 • 2

mradermacher/Hermes-3-Llama-3.2-3B-i1-GGUF

3B • Updated Dec 13, 2024 • 117 • 1

QuantFactory/Hermes-3-Llama-3.2-3B-GGUF

4B • Updated Dec 19, 2024 • 140 • 3