Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

3,482

Base only

Active filters: 3-bit

MaziyarPanahi/Hercules-1.0-Mistral-7B-GGUF

Text Generation • 7B • Updated Feb 4, 2024 • 250 • 3

MaziyarPanahi/UltraQwen-7B-GGUF

Text Generation • 8B • Updated Feb 4, 2024 • 72 • 2

MaziyarPanahi/Sensei-7B-V1-GGUF

Text Generation • 7B • Updated Feb 4, 2024 • 161 • 5

MaziyarPanahi/distilabeled-Marcoro14-7B-slerp-GGUF

Text Generation • 7B • Updated Feb 4, 2024 • 91

MaziyarPanahi/distilabeled-OpenHermes-2.5-Mistral-7B-GGUF

Text Generation • 7B • Updated Feb 4, 2024 • 367 • 1

MaziyarPanahi/notux-8x7b-v1-GGUF

Text Generation • 47B • Updated Feb 4, 2024 • 63

MaziyarPanahi/MixTAO-7Bx2-MoE-Instruct-v7.0-GGUF

Text Generation • 13B • Updated Feb 4, 2024 • 430 • 10

MaziyarPanahi/MetaMath-Bagel-DPO-34B-GGUF

Text Generation • 34B • Updated Feb 5, 2024 • 54 • 3

MaziyarPanahi/LongAlign-13B-64k-GGUF

Text Generation • 13B • Updated Feb 11, 2024 • 48 • 3

MaziyarPanahi/samantha-1.1-westlake-7b-GGUF

Text Generation • 7B • Updated Feb 13, 2024 • 348 • 3

MaziyarPanahi/natural-sql-7b-GGUF

Text Generation • 7B • Updated Feb 13, 2024 • 93 • 2

MaziyarPanahi/sqlcoder-7b-GGUF

Text Generation • 7B • Updated Feb 13, 2024 • 252

MaziyarPanahi/sqlcoder-7b-2-GGUF

Text Generation • 7B • Updated Feb 13, 2024 • 468 • 12

MaziyarPanahi/deepseek-math-7b-instruct-GGUF

Text Generation • 7B • Updated Feb 13, 2024 • 532 • 1

MaziyarPanahi/WhiteRabbitNeo-13B-v1-GGUF

Text Generation • 13B • Updated Feb 13, 2024 • 1.01k • 2

MaziyarPanahi/LWM-Text-256K-GGUF

Text Generation • 7B • Updated Feb 14, 2024 • 121 • 6

MaziyarPanahi/WestSeverus-7B-DPO-v2-GGUF

Text Generation • 7B • Updated Feb 14, 2024 • 188 • 1

MaziyarPanahi/OGNO-7B-GGUF

Text Generation • 7B • Updated Feb 14, 2024 • 129 • 2

MaziyarPanahi/DARE_TIES_13B-GGUF

Text Generation • 13B • Updated Feb 17, 2024 • 105 • 4

MaziyarPanahi/Llama-2-7b-chat-hf-function-calling-v3-GGUF

Text Generation • 7B • Updated Feb 17, 2024 • 266 • 2

MaziyarPanahi/Llama-2-7b-chat-hf-function-calling-v2-GGUF

Text Generation • 7B • Updated Feb 17, 2024 • 233 • 4

MaziyarPanahi/Valor-7B-v0.1-GGUF

Text Generation • 7B • Updated Feb 18, 2024 • 193 • 4

MaziyarPanahi/NeuralOmniBeagle-7B-GGUF

Text Generation • 7B • Updated Feb 19, 2024 • 109 • 1

MaziyarPanahi/BioMistral-7B-GGUF

Text Generation • 7B • Updated Feb 19, 2024 • 2.9k • 58

MaziyarPanahi/BioMistral-7B-SLERP-GGUF

Text Generation • 7B • Updated Feb 19, 2024 • 126 • 4

MaziyarPanahi/BioMistral-7B-DARE-GGUF

Text Generation • 7B • Updated Feb 19, 2024 • 269 • 2

MaziyarPanahi/BioMistral-7B-TIES-GGUF

Text Generation • 7B • Updated Feb 19, 2024 • 198

MaziyarPanahi/Mistral-7B-Alpaca-52k-v0.1-GGUF

Text Generation • 7B • Updated Feb 19, 2024 • 335 • 3

MaziyarPanahi/TheTop-5x7B-Instruct-S2-v0.1-GGUF

Text Generation • 7B • Updated Feb 19, 2024 • 310

MaziyarPanahi/TheTop-5x7B-Instruct-S3-v0.1-GGUF

Text Generation • 7B • Updated Feb 19, 2024 • 160