Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

32,581

Base only

Active filters: 8-bit

RichardErkhov/Changgil_-_K2S3-SOLAR-11b-v4.0-8bits

Text Generation • 11B • Updated May 21, 2024 • 4

MaziyarPanahi/Inex12Multiverseex26-7B-GGUF

Text Generation • 7B • Updated May 21, 2024 • 273

MaziyarPanahi/NeuralsynthesisMeliodas-7B-GGUF

Text Generation • 7B • Updated May 21, 2024 • 689

MaziyarPanahi/Multi_verse_modelExperiment26-7B-GGUF

Text Generation • 7B • Updated May 21, 2024 • 604

MaziyarPanahi/T3qInex12-7B-GGUF

Text Generation • 7B • Updated May 21, 2024 • 263

MaziyarPanahi/Experiment27pasticheYamshadowexperiment28-7B-GGUF

Text Generation • 7B • Updated May 21, 2024 • 58

MaziyarPanahi/Yamshadowexperiment28M7-7B-GGUF

Text Generation • 7B • Updated May 21, 2024 • 492

DeusImperator/L3-8B-Stheno-v3.1_exl2_8bpw_rpcal_mk2

Text Generation • Updated May 21, 2024 • 10 • 1

RichardErkhov/CallComply_-_Starling-LM-11B-alpha-8bits

Text Generation • 11B • Updated May 21, 2024 • 4

MaziyarPanahi/CalmexperimentMeliodas-7B-GGUF

Text Generation • 7B • Updated May 21, 2024 • 280

MaziyarPanahi/MeliodasM7-7B-GGUF

Text Generation • 7B • Updated May 21, 2024 • 164

Zoyd/TIGER-Lab_MAmmoTH2-7B-8_0bpw_exl2

Text Generation • Updated May 21, 2024 • 4

RichardErkhov/Ba2han_-_BruinsV2-OpHermesNeu-11B-8bits

Text Generation • 11B • Updated May 21, 2024 • 4

MaziyarPanahi/T3qm7xpMultiverseex26-7B-GGUF

Text Generation • 7B • Updated May 21, 2024 • 145

MaziyarPanahi/Inex12M7-7B-GGUF

Text Generation • 7B • Updated May 21, 2024 • 157

Zoyd/TIGER-Lab_MAmmoTH2-8B-Plus-8_0bpw_exl2

Text Generation • Updated May 21, 2024 • 4

MaziyarPanahi/Inex12Mergerix-7B-GGUF

Text Generation • 7B • Updated May 21, 2024 • 104

MaziyarPanahi/Inex12Yamshadowexperiment28-7B-GGUF

Text Generation • 7B • Updated May 21, 2024 • 33

MaziyarPanahi/NeuralsynthesisCalmexperiment-7B-GGUF

Text Generation • 7B • Updated May 21, 2024 • 439

MaziyarPanahi/Multi_verse_modelInex12-7B-GGUF

Text Generation • 7B • Updated May 21, 2024 • 643

LoneStriker/Phi-3-medium-4k-instruct-8.0bpw-h8-exl2

Text Generation • Updated May 21, 2024 • 3

MaziyarPanahi/Ognoexperiment27multi_verse_modelNeuralsynthesis-7B-GGUF

Text Generation • 7B • Updated May 21, 2024 • 337

LoneStriker/Phi-3-medium-128k-instruct-8.0bpw-h8-exl2

Text Generation • Updated May 21, 2024 • 6 • 4

MaziyarPanahi/Experiment27pasticheT3qm7xp-7B-GGUF

Text Generation • 7B • Updated May 21, 2024 • 374

RichardErkhov/macadeliccc_-_OmniCorso-7B-8bits

Text Generation • 7B • Updated May 21, 2024 • 6

MaziyarPanahi/MergerixShadowm7exp-7B-GGUF

Text Generation • 7B • Updated May 21, 2024 • 63

RichardErkhov/tourist800_-_mistral_2X7b-8bits

Text Generation • 7B • Updated May 21, 2024 • 5

MaziyarPanahi/CalmexperimentPercival_01-7B-GGUF

Text Generation • 7B • Updated May 21, 2024 • 285

Hazzzardous/rwkvserver

8B • Updated May 21, 2024

MaziyarPanahi/NeuralsynthesisMultiverseex26-7B-GGUF

Text Generation • 7B • Updated May 21, 2024 • 397