Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

3,487

Base only

Active filters: 3-bit

MaziyarPanahi/Qwen2.5-7B-Instruct-abliterated-v3-GGUF

Text Generation • 8B • Updated Oct 30, 2024 • 90

MaziyarPanahi/SuperCorrect-7B-GGUF

Text Generation • 8B • Updated Oct 30, 2024 • 44

MaziyarPanahi/WavGPT-1.5-GGUF

Text Generation • 3B • Updated Oct 30, 2024 • 67

MaziyarPanahi/Qwen2.5-Coder-7B-3x-Instruct-TIES-v1.1-GGUF

Text Generation • 8B • Updated Oct 30, 2024 • 137

Jacoby746/Behemoth-123B-v1.1-exl2-3.0bpw

Updated Oct 30, 2024 • 4

MaziyarPanahi/chinese-text-correction-7b-GGUF

Text Generation • 8B • Updated Oct 30, 2024 • 24

MaziyarPanahi/chinese-text-correction-1.5b-GGUF

Text Generation • 2B • Updated Oct 30, 2024 • 39

MaziyarPanahi/Qwen2.5-7B-Gutenberg-KTO-GGUF

Text Generation • 8B • Updated Oct 30, 2024 • 36

MaziyarPanahi/Arch-Function-7B-GGUF

Text Generation • 8B • Updated Oct 30, 2024 • 26

MaziyarPanahi/Qwen2.5-Coder-7B-Instruct-abliterated-GGUF

Text Generation • 8B • Updated Oct 30, 2024 • 353 • 2

MaziyarPanahi/Rombos-LLM-V2.5-Qwen-7b-GGUF

Text Generation • 8B • Updated Oct 30, 2024 • 102

MaziyarPanahi/raspberry-3B-GGUF

Text Generation • 3B • Updated Oct 30, 2024 • 61

MaziyarPanahi/CursorCore-QW2.5-7B-GGUF

Text Generation • 8B • Updated Oct 30, 2024 • 111

MaziyarPanahi/Vi-Qwen2-7B-RAG-GGUF

Text Generation • 8B • Updated Oct 30, 2024 • 105

MaziyarPanahi/WhiteRabbitNeo-2.5-Qwen-2.5-Coder-7B-GGUF

Text Generation • 8B • Updated Oct 30, 2024 • 102

MaziyarPanahi/Arch-Function-3B-GGUF

Text Generation • 3B • Updated Oct 30, 2024 • 91

MaziyarPanahi/Qwen2.5-7B-Instruct-abliterated-v2-GGUF

Text Generation • 8B • Updated Oct 30, 2024 • 719 • 3

MaziyarPanahi/Qwen2.5-Math-7B-Instruct-GGUF

Text Generation • 8B • Updated Oct 30, 2024 • 79

MaziyarPanahi/Llama-3.1-Hawkish-8B-GGUF

Text Generation • 8B • Updated Oct 30, 2024 • 57

MaziyarPanahi/sarvam-1-GGUF

Text Generation • 3B • Updated Oct 30, 2024 • 76

MaziyarPanahi/L3-8B-Everything-COT-GGUF

Text Generation • 8B • Updated Oct 30, 2024 • 49

MaziyarPanahi/llama3-8B-DarkIdol-2.2-Uncensored-1048K-GGUF

Text Generation • 8B • Updated Oct 30, 2024 • 66

MaziyarPanahi/llama3-8B-DarkIdol-2.1-Uncensored-1048K-GGUF

Text Generation • 8B • Updated Oct 30, 2024 • 52

MaziyarPanahi/llama3-8B-DarkIdol-2.1-Uncensored-32K-GGUF

Text Generation • 8B • Updated Oct 31, 2024 • 43

MaziyarPanahi/llama3-8B-DarkIdol-1.2-GGUF

Text Generation • 8B • Updated Oct 31, 2024 • 56

MaziyarPanahi/llama3-8B-DarkIdol-1.1-GGUF

Text Generation • 8B • Updated Oct 31, 2024 • 21

MaziyarPanahi/llama3-8B-DarkIdol-1.0-GGUF

Text Generation • 8B • Updated Oct 31, 2024 • 16

MaziyarPanahi/Llama-3-8B-Sydney-GGUF

Text Generation • 8B • Updated Oct 31, 2024 • 29

MaziyarPanahi/llama3-8B-cn-rochat-v1-GGUF

Text Generation • 8B • Updated Oct 31, 2024 • 1.6k

MaziyarPanahi/Colibri_8b_v0.1-GGUF

Text Generation • 8B • Updated Oct 31, 2024 • 702 • 1