Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

842

Base only

Active filters: 7b

Manel/Llama-2-7b-chat-hf-Q2_K-GGUF

Text Generation • 7B • Updated Nov 3, 2024 • 2

mradermacher/Mistral-7B-Instruct-Aya-101-GGUF

7B • Updated Nov 5, 2024 • 294

Manel/Llama-2-13b-chat-hf-Q2_K-GGUF

Text Generation • 13B • Updated Nov 5, 2024 • 6

mradermacher/jaskier-7b-dpo-v5.6-GGUF

7B • Updated Nov 9, 2024 • 39

mradermacher/jaskier-7b-dpo-v5.6-i1-GGUF

7B • Updated Nov 9, 2024 • 164

mradermacher/Naberius-7B-GGUF

7B • Updated Nov 15, 2024 • 99

mradermacher/Naberius-7B-i1-GGUF

7B • Updated Nov 15, 2024 • 96

mradermacher/Calme-4x7B-MoE-v0.1-GGUF

24B • Updated Nov 21, 2024 • 170

mradermacher/Calme-4x7B-MoE-v0.1-i1-GGUF

24B • Updated Nov 21, 2024 • 195

mradermacher/Calme-4x7B-MoE-v0.2-GGUF

24B • Updated Nov 25, 2024 • 116

mradermacher/Calme-4x7B-MoE-v0.2-i1-GGUF

24B • Updated Nov 26, 2024 • 113 • 1

mradermacher/Mistral-7B-Instruct-KhanAcademy-v0.2-GGUF

7B • Updated Nov 28, 2024 • 45 • 1

mradermacher/Mistral-7B-Instruct-KhanAcademy-v0.2-i1-GGUF

7B • Updated Nov 28, 2024 • 203 • 1

mradermacher/jaskier-7b-dpo-v6.1-GGUF

7B • Updated Nov 30, 2024 • 40

mradermacher/jaskier-7b-dpo-v6.1-i1-GGUF

7B • Updated Dec 1, 2024 • 121 • 1

mradermacher/Calme-7B-Instruct-v0.1.1-GGUF

7B • Updated Dec 10, 2024 • 102

mradermacher/Calme-7B-Instruct-v0.1-i1-GGUF

7B • Updated Dec 12, 2024 • 229

mradermacher/Calme-7B-Instruct-v0.1.1-i1-GGUF

7B • Updated Dec 10, 2024 • 220

mradermacher/Llama-portuguese-13b-Luana-v0.2-GGUF

13B • Updated Dec 11, 2024 • 365

mradermacher/Llama-portuguese-13b-Luana-v0.2-i1-GGUF

13B • Updated Dec 11, 2024 • 334 • 1

mradermacher/Calme-7B-Instruct-v0.1-GGUF

7B • Updated Dec 12, 2024 • 78

tensorblock/starcoder2-chat-GGUF

Text Generation • 7B • Updated Jan 27 • 97

tensorblock/MadMix-v0.2-GGUF

7B • Updated Jan 27 • 18

mradermacher/Draig-Fach-v0.1-GGUF

7B • Updated Dec 17, 2024 • 38 • 1

mradermacher/Draig-Fach-v0.1-i1-GGUF

7B • Updated Dec 17, 2024 • 37 • 1

mradermacher/Calme-7B-Instruct-v0.9-GGUF

7B • Updated Jan 26, 2025 • 19

mradermacher/Calme-7B-Instruct-v0.9-i1-GGUF

7B • Updated Jan 26, 2025 • 128 • 1

tensorblock/NSFW_DPO_Noromaid-7b-Mistral-7B-Instruct-v0.1-GGUF

Text Generation • 7B • Updated Jan 27 • 100 • 1

prithivMLmods/Deepthink-Reasoning-7B

Text Generation • 8B • Updated Dec 29, 2024 • 18 • • 12

prithivMLmods/Deepthink-Reasoning-7B-GGUF

Text Generation • 8B • Updated Dec 29, 2024 • 81 • 5