Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

11,878

Base only

Active filters: quantized

Lewdiculous/Eris_PrimeV3.05-Vision-7B-GGUF-IQ-Imatrix

7B • Updated Mar 23, 2024 • 154 • 5

Lewdiculous/RP_Vision_7B-GGUF-IQ-Imatrix

7B • Updated Mar 23, 2024 • 246 • 7

Lewdiculous/DaturaCookie_7B-GGUF-IQ-Imatrix

7B • Updated Mar 23, 2024 • 132 • 6

alokabhishek/Llama-2-7b-chat-hf-4bit-AWQ

Text Generation • 7B • Updated Mar 24, 2024 • 4 • 1

solidrust/Starling-LM-7B-beta-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 67 • 3

solidrust/Hyperion-3.0-Mistral-7B-DPO-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 3

alokabhishek/Mistral-7B-Instruct-v0.2-4bit-AWQ

Text Generation • 7B • Updated Mar 24, 2024 • 3 • 1

Lewdiculous/Erosumika-7B-v2-GGUF-IQ-Imatrix

Text Generation • 7B • Updated Mar 26, 2024 • 140 • 4

Lewdiculous/DarkSapling-7B-v2.0-GGUF-IQ-Imatrix

7B • Updated Mar 25, 2024 • 338 • 4

Lewdiculous/flammen13-mistral-7B-GGUF-IQ-Imatrix

7B • Updated Mar 25, 2024 • 25 • 3

afrideva/tau-0.5B-GGUF

Text Generation • 0.6B • Updated Mar 25, 2024 • 90

afrideva/tau-0.5B-instruct-GGUF

Text Generation • 0.6B • Updated Mar 25, 2024 • 44

solidrust/Mistral-7B-v0.2-OpenHermes-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 4

Lewdiculous/Eris_PrimeV4-Vision-7B-GGUF-IQ-Imatrix

7B • Updated Mar 26, 2024 • 206 • 5

afrideva/NeuralReyna-Mini-1.8B-v0.3-GGUF

Text Generation • 2B • Updated Mar 25, 2024 • 156 • 1

solidrust/Tess-7B-v2.0-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 1 • 1

solidrust/LewdMistral-7B-0.2-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 3

solidrust/WhiteRabbitNeo-7B-v1.5a-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 15

solidrust/mistral-7b-v0.2-layla-v4-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 5

MaziyarPanahi/Hermes-2-Pro-11B-GGUF

Text Generation • 11B • Updated Mar 26, 2024 • 143 • 4

MaziyarPanahi/Truthful_DPO_TomGrc_FusionNet_7Bx2_MoE_13B-AWQ

Text Generation • 13B • Updated Mar 26, 2024 • 5 • 3

solidrust/Hercules-4.0-Mistral-v0.2-7B-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 1 • 1

ilsp/Meltemi-7B-Instruct-v1-GGUF

Updated Apr 18, 2024 • 72 • 16

Lewdiculous/Eris_PrimeV4.20-Vision-32k-7B-GGUF-IQ-Imatrix

7B • Updated Mar 27, 2024 • 160 • 7

solidrust/OpenCerebrum-1.0-7b-DPO-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 2

solidrust/Kunoichi-DPO-v2-7B-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 1 • 2

solidrust/Einstein-v5-v0.2-7B-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 3

solidrust/CerebrumHyperion-7B-DPO-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 3

MaziyarPanahi/Mistral-7B-v0.2-GGUF

Text Generation • 7B • Updated Mar 28, 2024 • 309 • 3

solidrust/dolphin-2.8-mistral-7b-v02-AWQ

Text Generation • 7B • Updated Sep 4, 2024 • 371 • 2