Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

4,563

Base only

Active filters: 6-bit

MaziyarPanahi/WavGPT-1.5-GGUF

Text Generation • 3B • Updated Oct 30, 2024 • 71

MaziyarPanahi/Qwen2.5-Coder-7B-3x-Instruct-TIES-v1.1-GGUF

Text Generation • 8B • Updated Oct 30, 2024 • 135

MaziyarPanahi/chinese-text-correction-7b-GGUF

Text Generation • 8B • Updated Oct 30, 2024 • 35

MaziyarPanahi/chinese-text-correction-1.5b-GGUF

Text Generation • 2B • Updated Oct 30, 2024 • 46

MaziyarPanahi/Qwen2.5-7B-Gutenberg-KTO-GGUF

Text Generation • 8B • Updated Oct 30, 2024 • 32

MaziyarPanahi/Arch-Function-7B-GGUF

Text Generation • 8B • Updated Oct 30, 2024 • 21

MaziyarPanahi/Qwen2.5-Coder-7B-Instruct-abliterated-GGUF

Text Generation • 8B • Updated Oct 30, 2024 • 355 • 2

MaziyarPanahi/Rombos-LLM-V2.5-Qwen-7b-GGUF

Text Generation • 8B • Updated Oct 30, 2024 • 122

MaziyarPanahi/raspberry-3B-GGUF

Text Generation • 3B • Updated Oct 30, 2024 • 67

MaziyarPanahi/CursorCore-QW2.5-7B-GGUF

Text Generation • 8B • Updated Oct 30, 2024 • 133

MaziyarPanahi/Vi-Qwen2-7B-RAG-GGUF

Text Generation • 8B • Updated Oct 30, 2024 • 119

MaziyarPanahi/WhiteRabbitNeo-2.5-Qwen-2.5-Coder-7B-GGUF

Text Generation • 8B • Updated Oct 30, 2024 • 134

MaziyarPanahi/Arch-Function-3B-GGUF

Text Generation • 3B • Updated Oct 30, 2024 • 97

MaziyarPanahi/Qwen2.5-7B-Instruct-abliterated-v2-GGUF

Text Generation • 8B • Updated Oct 30, 2024 • 747 • 3

MaziyarPanahi/Qwen2.5-Math-7B-Instruct-GGUF

Text Generation • 8B • Updated Oct 30, 2024 • 65

MaziyarPanahi/Llama-3.1-Hawkish-8B-GGUF

Text Generation • 8B • Updated Oct 30, 2024 • 62

MaziyarPanahi/sarvam-1-GGUF

Text Generation • 3B • Updated Oct 30, 2024 • 79

MaziyarPanahi/L3-8B-Everything-COT-GGUF

Text Generation • 8B • Updated Oct 30, 2024 • 49

MaziyarPanahi/llama3-8B-DarkIdol-2.2-Uncensored-1048K-GGUF

Text Generation • 8B • Updated Oct 30, 2024 • 77

MaziyarPanahi/llama3-8B-DarkIdol-2.1-Uncensored-1048K-GGUF

Text Generation • 8B • Updated Oct 30, 2024 • 52

MaziyarPanahi/llama3-8B-DarkIdol-2.1-Uncensored-32K-GGUF

Text Generation • 8B • Updated Oct 31, 2024 • 50

MaziyarPanahi/llama3-8B-DarkIdol-1.2-GGUF

Text Generation • 8B • Updated Oct 31, 2024 • 66

MaziyarPanahi/llama3-8B-DarkIdol-1.1-GGUF

Text Generation • 8B • Updated Oct 31, 2024 • 24

Statuo/Starcannon-Unleashed-12b-EXL2-6bpw

Text Generation • Updated Oct 31, 2024 • 8

MaziyarPanahi/llama3-8B-DarkIdol-1.0-GGUF

Text Generation • 8B • Updated Oct 31, 2024 • 16

MaziyarPanahi/Llama-3-8B-Sydney-GGUF

Text Generation • 8B • Updated Oct 31, 2024 • 30

MaziyarPanahi/llama3-8B-cn-rochat-v1-GGUF

Text Generation • 8B • Updated Oct 31, 2024 • 1.61k

MaziyarPanahi/Colibri_8b_v0.1-GGUF

Text Generation • 8B • Updated Oct 31, 2024 • 641 • 1

MaziyarPanahi/openchat-3.6-8b-20240522-GGUF

Text Generation • 8B • Updated Oct 31, 2024 • 112

MaziyarPanahi/llama-3-8b-instruct-262k-chinese-GGUF

Text Generation • 8B • Updated Oct 31, 2024 • 60