Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,569

Base only

Active filters: 2-bit

MaziyarPanahi/Vi-Qwen2-7B-RAG-GGUF

Text Generation • 8B • Updated Oct 30, 2024 • 66

MaziyarPanahi/WhiteRabbitNeo-2.5-Qwen-2.5-Coder-7B-GGUF

Text Generation • 8B • Updated Oct 30, 2024 • 91

MaziyarPanahi/Arch-Function-3B-GGUF

Text Generation • 3B • Updated Oct 30, 2024 • 49

MaziyarPanahi/Qwen2.5-7B-Instruct-abliterated-v2-GGUF

Text Generation • 8B • Updated Oct 30, 2024 • 240 • 3

MaziyarPanahi/Qwen2.5-Math-7B-Instruct-GGUF

Text Generation • 8B • Updated Oct 30, 2024 • 70

MaziyarPanahi/Llama-3.1-Hawkish-8B-GGUF

Text Generation • 8B • Updated Oct 30, 2024 • 25

MaziyarPanahi/sarvam-1-GGUF

Text Generation • 3B • Updated Oct 30, 2024 • 112

MaziyarPanahi/L3-8B-Everything-COT-GGUF

Text Generation • 8B • Updated Oct 30, 2024 • 24

MaziyarPanahi/llama3-8B-DarkIdol-2.2-Uncensored-1048K-GGUF

Text Generation • 8B • Updated Oct 30, 2024 • 95

MaziyarPanahi/llama3-8B-DarkIdol-2.1-Uncensored-1048K-GGUF

Text Generation • 8B • Updated Oct 30, 2024 • 65

MaziyarPanahi/llama3-8B-DarkIdol-2.1-Uncensored-32K-GGUF

Text Generation • 8B • Updated Oct 31, 2024 • 49

MaziyarPanahi/llama3-8B-DarkIdol-1.2-GGUF

Text Generation • 8B • Updated Oct 31, 2024 • 34

MaziyarPanahi/llama3-8B-DarkIdol-1.1-GGUF

Text Generation • 8B • Updated Oct 31, 2024 • 43

MaziyarPanahi/llama3-8B-DarkIdol-1.0-GGUF

Text Generation • 8B • Updated Oct 31, 2024 • 35

MaziyarPanahi/Llama-3-8B-Sydney-GGUF

Text Generation • 8B • Updated Oct 31, 2024 • 58

MaziyarPanahi/llama3-8B-cn-rochat-v1-GGUF

Text Generation • 8B • Updated Oct 31, 2024 • 44

MaziyarPanahi/Colibri_8b_v0.1-GGUF

Text Generation • 8B • Updated Oct 31, 2024 • 63 • 1

MaziyarPanahi/openchat-3.6-8b-20240522-GGUF

Text Generation • 8B • Updated Oct 31, 2024 • 40

MaziyarPanahi/llama-3-8b-instruct-262k-chinese-GGUF

Text Generation • 8B • Updated Oct 31, 2024 • 14

MaziyarPanahi/Llama-3-8B-LexiFun-Uncensored-V1-GGUF

Text Generation • 8B • Updated Oct 31, 2024 • 177

MaziyarPanahi/Llama-3-KafkaLM-8B-v0.1-GGUF

Text Generation • 8B • Updated Oct 31, 2024 • 58

MaziyarPanahi/Llama-3-8B-Lexi-Uncensored-GGUF

Text Generation • 8B • Updated Oct 31, 2024 • 181

MaziyarPanahi/Llama3-Chinese-8B-Instruct-GGUF

Text Generation • 8B • Updated Oct 31, 2024 • 51

MaziyarPanahi/Mistral-NeMo-Minitron-8B-Instruct-GGUF

Text Generation • 8B • Updated Oct 31, 2024 • 30

MaziyarPanahi/IceWhiskeyRP-7b-GGUF

Text Generation • 7B • Updated Oct 31, 2024 • 70

MaziyarPanahi/uncertain_mistral_7b-GGUF

Text Generation • 7B • Updated Oct 31, 2024 • 59 • 1

MaziyarPanahi/BADMISTRAL-1.5B-GGUF

Text Generation • 2B • Updated Oct 31, 2024 • 24

MaziyarPanahi/MistralNemoTiny-GGUF

Text Generation • 5B • Updated Oct 31, 2024 • 95 • 2

MaziyarPanahi/Flammades-Mistral-7B-GGUF

Text Generation • 7B • Updated Oct 31, 2024 • 32

MaziyarPanahi/Hermes2-Gutenberg2-Mistral-7B-GGUF

Text Generation • 7B • Updated Oct 31, 2024 • 31