Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

Mixture of Experts

4-bit precision

8-bit precision

Carbon Emissions

Models

4,015

Base only

Active filters: instruct

mradermacher/OpenHermes-Mixtral-8x7B-GGUF

47B • Updated Nov 26, 2024 • 232

mradermacher/OpenHermes-Mixtral-8x7B-i1-GGUF

47B • Updated Nov 27, 2024 • 374 • 1

bartowski/Open-Insurance-LLM-Llama3-8B-GGUF

Text Generation • 8B • Updated Nov 26, 2024 • 2.05k • 6

QuantFactory/BgGPT-Gemma-2-2.6B-IT-v1.0-GGUF

Text Generation • 3B • Updated Nov 27, 2024 • 220 • 2

tensorblock/Meta-Llama-3.1-8B-openhermes-2.5-GGUF

8B • Updated Jan 27 • 20

ModelCloud/QwQ-32B-Preview-gptqmodel-4bit-vortex-v1

Text Generation • 33B • Updated Dec 18, 2024 • 39 • 51

tensorblock/Llama3-OpenBioLLM-8B-GGUF

8B • Updated Jan 27 • 195

Fluxter/OpenHermes-2.5-Mistral-7B-Q8_0-GGUF

7B • Updated Nov 29, 2024 • 23 • 1

QuantFactory/Open-Insurance-LLM-Llama3-8B-GGUF

Text Generation • 8B • Updated Dec 2, 2024 • 879 • 6

QuantFactory/Qwen2.5-7B-HomerAnvita-NerdMix-GGUF

Text Generation • 8B • Updated Dec 3, 2024 • 316 • 7

tensorblock/BgGPT-Gemma-2-2.6B-IT-v1.0-GGUF

Text Generation • 3B • Updated Jan 27 • 131

prithivMLmods/SmolLM2-Math-IIO-1.7B-Instruct

Text Generation • Updated Dec 3, 2024 • 35 • 2

NousResearch/Hermes-3-Llama-3.2-3B

Text Generation • 3B • Updated Dec 18, 2024 • 5.19k • • 185

tensorblock/Hermes-3-Llama-3.1-70B-GGUF

71B • Updated Jan 27 • 36 • 2

mradermacher/SmolLM2-Math-IIO-1.7B-Instruct-GGUF

2B • Updated Dec 4, 2024 • 397

tensorblock/Llama3-70B-ShiningValiant2-GGUF

Text Generation • 71B • Updated Jan 27 • 178

zheyushen/Llama-3_1-8B-Instruct-orca-ORPO-F32-GGUF

27.3M • Updated Dec 6, 2024 • 10

tensorblock/Llama3-70B-Fireplace-GGUF

Text Generation • 71B • Updated Jan 27 • 66

sapienzanlp/Minerva-7B-instruct-v1.0-GGUF

Text Generation • 7B • Updated Dec 7, 2024 • 305 • 6

zheyushen/Llama-3_1-8B-Instruct-orca-ORPO-Q8_0-GGUF

27.3M • Updated Dec 7, 2024 • 13

mradermacher/Novus-7b-tr_v1-GGUF

7B • Updated Dec 7, 2024 • 141 • 1

mradermacher/Novus-7b-tr_v1-i1-GGUF

7B • Updated Dec 7, 2024 • 472 • 1

mradermacher/Genstruct-10.7B-GGUF

11B • Updated Dec 8, 2024 • 55

Lucy-in-the-Sky/pygmalion-2-13b-Q2_K-GGUF

Text Generation • 13B • Updated Dec 8, 2024 • 24

Lucy-in-the-Sky/pygmalion-2-13b-Q8_0-GGUF

Text Generation • 13B • Updated Dec 8, 2024 • 17

mradermacher/Genstruct-10.7B-i1-GGUF

11B • Updated Dec 8, 2024 • 516

SYNERDATA/SYNERDATA-Hermes-3-LLaMA-3.1-8b-Q8_0.GGUF

8B • Updated Dec 9, 2024 • 26 • 1

mradermacher/Llama3-OpenBioLLM-70B-i1-GGUF

71B • Updated Dec 12, 2024 • 1.55k • 1

hierholzer/Llama-3.3-70B-Instruct-GGUF

Text Generation • 71B • Updated Dec 11, 2024 • 201 • 1

NousResearch/Hermes-3-Llama-3.2-3B-GGUF

3B • Updated Dec 18, 2024 • 7.47k • 75