Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

16,162

Base only

Active filters: quantized

solidrust/Tess-7B-v2.0-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 10 • 1

solidrust/LewdMistral-7B-0.2-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 11

solidrust/WhiteRabbitNeo-7B-v1.5a-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 18

solidrust/mistral-7b-v0.2-layla-v4-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 12

MaziyarPanahi/Hermes-2-Pro-11B-GGUF

Text Generation • 11B • Updated Mar 26, 2024 • 1.12k • 4

MaziyarPanahi/Truthful_DPO_TomGrc_FusionNet_7Bx2_MoE_13B-AWQ

Text Generation • 13B • Updated Mar 26, 2024 • 13 • 3

Lewdiculous/Eris_PrimeV4-Vision-32k-7B-GGUF-IQ-Imatrix

7B • Updated Mar 27, 2024 • 951 • 15

solidrust/Hercules-4.0-Mistral-v0.2-7B-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 11 • 1

ilsp/Meltemi-7B-Instruct-v1-GGUF

Updated Apr 18, 2024 • 114 • 16

Lewdiculous/Eris_PrimeV4.20-Vision-32k-7B-GGUF-IQ-Imatrix

7B • Updated Mar 27, 2024 • 425 • 7

solidrust/OpenCerebrum-1.0-7b-DPO-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 13

solidrust/Kunoichi-DPO-v2-7B-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 12 • 2

solidrust/Einstein-v5-v0.2-7B-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 16

solidrust/CerebrumHyperion-7B-DPO-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 9

MaziyarPanahi/Mistral-7B-v0.2-GGUF

Text Generation • 7B • Updated Mar 28, 2024 • 729 • 3

solidrust/dolphin-2.8-mistral-7b-v02-AWQ

Text Generation • 7B • Updated Sep 4, 2024 • 94 • 2

ilsp/Meltemi-7B-Instruct-v1-AWQ

Text Generation • 7B • Updated Apr 8, 2024 • 9 • 6

MaziyarPanahi/Starling-LM-7B-beta-GPTQ

Text Generation • 7B • Updated Mar 29, 2024 • 12 • 4

DisOOM/Faro-Yi-9B-200k-GGUF

Text Generation • 9B • Updated Mar 30, 2024 • 39 • 1

MaziyarPanahi/OgnoExperiment27-7B-GGUF

Text Generation • 7B • Updated Mar 30, 2024 • 593

MaziyarPanahi/ShadowYam-7B-GGUF

Text Generation • 7B • Updated Mar 30, 2024 • 190

MaziyarPanahi/Experiment27Neuralsirkrishna-7B-GGUF

Text Generation • 7B • Updated Mar 30, 2024 • 572

MaziyarPanahi/YamShadow-7B-GGUF

Text Generation • 7B • Updated Mar 30, 2024 • 311 • 1

MaziyarPanahi/NeuralsirkrishnaExperiment26-7B-GGUF

Text Generation • 7B • Updated Mar 30, 2024 • 530

MaziyarPanahi/Strangemerges_32Yamshadow-7B-GGUF

Text Generation • 7B • Updated Mar 30, 2024 • 208

MaziyarPanahi/Experiment26Experiment26-7B-GGUF

Text Generation • 7B • Updated Mar 30, 2024 • 268

MaziyarPanahi/YamStrangemerges_32-7B-GGUF

Text Generation • 7B • Updated Mar 30, 2024 • 224

MaziyarPanahi/Experiment28Experiment29-7B-GGUF

Text Generation • 7B • Updated Mar 30, 2024 • 899

MaziyarPanahi/Experiment26Experiment28-7B-GGUF

Text Generation • 7B • Updated Mar 30, 2024 • 184

MaziyarPanahi/NeuralsirkrishnaExperiment28-7B-GGUF

Text Generation • 7B • Updated Mar 30, 2024 • 398