Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,892

Base only

Active filters: 5-bit

MaziyarPanahi/Vi-Qwen2-7B-RAG-GGUF

Text Generation • 8B • Updated Oct 30, 2024 • 119

MaziyarPanahi/WhiteRabbitNeo-2.5-Qwen-2.5-Coder-7B-GGUF

Text Generation • 8B • Updated Oct 30, 2024 • 134

MaziyarPanahi/Arch-Function-3B-GGUF

Text Generation • 3B • Updated Oct 30, 2024 • 97

MaziyarPanahi/Qwen2.5-7B-Instruct-abliterated-v2-GGUF

Text Generation • 8B • Updated Oct 30, 2024 • 747 • 3

MaziyarPanahi/Qwen2.5-Math-7B-Instruct-GGUF

Text Generation • 8B • Updated Oct 30, 2024 • 65

zetasepic/Qwen2.5-72B-Instruct-abliterated-v2-5.0bpw-exl2

Text Generation • Updated Oct 30, 2024 • 9

MaziyarPanahi/Llama-3.1-Hawkish-8B-GGUF

Text Generation • 8B • Updated Oct 30, 2024 • 62

MaziyarPanahi/sarvam-1-GGUF

Text Generation • 3B • Updated Oct 30, 2024 • 79

MaziyarPanahi/L3-8B-Everything-COT-GGUF

Text Generation • 8B • Updated Oct 30, 2024 • 49

MaziyarPanahi/llama3-8B-DarkIdol-2.2-Uncensored-1048K-GGUF

Text Generation • 8B • Updated Oct 30, 2024 • 77

MaziyarPanahi/llama3-8B-DarkIdol-2.1-Uncensored-1048K-GGUF

Text Generation • 8B • Updated Oct 30, 2024 • 52

MaziyarPanahi/llama3-8B-DarkIdol-2.1-Uncensored-32K-GGUF

Text Generation • 8B • Updated Oct 31, 2024 • 50

MaziyarPanahi/llama3-8B-DarkIdol-1.2-GGUF

Text Generation • 8B • Updated Oct 31, 2024 • 66

MaziyarPanahi/llama3-8B-DarkIdol-1.1-GGUF

Text Generation • 8B • Updated Oct 31, 2024 • 24

MaziyarPanahi/llama3-8B-DarkIdol-1.0-GGUF

Text Generation • 8B • Updated Oct 31, 2024 • 16

MaziyarPanahi/Llama-3-8B-Sydney-GGUF

Text Generation • 8B • Updated Oct 31, 2024 • 30

MaziyarPanahi/llama3-8B-cn-rochat-v1-GGUF

Text Generation • 8B • Updated Oct 31, 2024 • 1.61k

MaziyarPanahi/Colibri_8b_v0.1-GGUF

Text Generation • 8B • Updated Oct 31, 2024 • 641 • 1

MaziyarPanahi/openchat-3.6-8b-20240522-GGUF

Text Generation • 8B • Updated Oct 31, 2024 • 112

MaziyarPanahi/llama-3-8b-instruct-262k-chinese-GGUF

Text Generation • 8B • Updated Oct 31, 2024 • 60

MaziyarPanahi/Llama-3-8B-LexiFun-Uncensored-V1-GGUF

Text Generation • 8B • Updated Oct 31, 2024 • 99

MaziyarPanahi/Llama-3-KafkaLM-8B-v0.1-GGUF

Text Generation • 8B • Updated Oct 31, 2024 • 78

MaziyarPanahi/Llama-3-8B-Lexi-Uncensored-GGUF

Text Generation • 8B • Updated Oct 31, 2024 • 229

denru/Behemoth-v1.1-Magnum-v4-123B-5_0bpw-h6-exl2-pippa

Text Generation • Updated Oct 31, 2024 • 15

MaziyarPanahi/Llama3-Chinese-8B-Instruct-GGUF

Text Generation • 8B • Updated Oct 31, 2024 • 88

MaziyarPanahi/Mistral-NeMo-Minitron-8B-Instruct-GGUF

Text Generation • 8B • Updated Oct 31, 2024 • 81

MaziyarPanahi/IceWhiskeyRP-7b-GGUF

Text Generation • 7B • Updated Oct 31, 2024 • 34

async0x42/MS-Schisandra-22B-v0.1-exl2_5.0bpw

Text Generation • Updated Oct 31, 2024 • 9

MaziyarPanahi/uncertain_mistral_7b-GGUF

Text Generation • 7B • Updated Oct 31, 2024 • 86 • 1

MaziyarPanahi/BADMISTRAL-1.5B-GGUF

Text Generation • 2B • Updated Oct 31, 2024 • 60