Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

32,596

Base only

Active filters: 8-bit

Zoyd/01-ai_Yi-1.5-9B-32K-8_0bpw_exl2

Text Generation • Updated May 20, 2024 • 4

ZhenyaPav/llama3-daybreak-lumimaid0.1-8b-exl2-8bpw

Text Generation • Updated May 20, 2024 • 4

deepak2009thakur/Llama-2-7b-chat-finetune_ITticket

Text Generation • Updated May 20, 2024 • 6

Zoyd/01-ai_Yi-1.5-34B-32K-8_0bpw_exl2

Text Generation • Updated May 20, 2024 • 3

MaziyarPanahi/T3qm7Mergerix-7B-GGUF

Text Generation • 7B • Updated May 20, 2024 • 336

LoneStriker/Yi-1.5-34B-32K-8.0bpw-h8-exl2

Text Generation • Updated May 20, 2024 • 6

MaziyarPanahi/T3qm7Neuralsynthesis-7B-GGUF

Text Generation • 7B • Updated May 20, 2024 • 119

MaziyarPanahi/Experiment26Percival_01-7B-GGUF

Text Generation • 7B • Updated May 20, 2024 • 154

MaziyarPanahi/Experiment26Mergerix-7B-GGUF

Text Generation • 7B • Updated May 20, 2024 • 344

MaziyarPanahi/Ognoexperiment27multi_verse_modelExperiment27pastiche-7B-GGUF

Text Generation • 7B • Updated May 20, 2024 • 127

MaziyarPanahi/Shadowm7expMeliodaspercival_01_experiment26t3q-7B-GGUF

Text Generation • 7B • Updated May 21, 2024 • 631

Zoyd/01-ai_Yi-1.5-34B-Chat-16K-8_0bpw_exl2

Text Generation • Updated May 21, 2024 • 4

MaziyarPanahi/Shadowm7expMergerix-7B-GGUF

Text Generation • 7B • Updated May 21, 2024 • 347

MaziyarPanahi/Yamshadowexperiment28T3qm7xp-7B-GGUF

Text Generation • 7B • Updated May 21, 2024 • 260

MaziyarPanahi/CalmexperimentT3qm7-7B-GGUF

Text Generation • 7B • Updated May 21, 2024 • 229

MaziyarPanahi/T3qStrangemerges_32-7B-GGUF

Text Generation • 7B • Updated May 21, 2024 • 485

MaziyarPanahi/T3qm7xpNeuralsynthesis-7B-GGUF

Text Generation • 7B • Updated May 21, 2024 • 205

MaziyarPanahi/M7Neuralsynthesis-7B-GGUF

Text Generation • 7B • Updated May 21, 2024 • 101

Zoyd/TIGER-Lab_MAmmoTH2-7B-Plus-8_0bpw_exl2

Text Generation • Updated May 21, 2024 • 5

MaziyarPanahi/NeuralsynthesisT3qm7-7B-GGUF

Text Generation • 7B • Updated May 21, 2024 • 206

MaziyarPanahi/CalmexperimentOgnoexperiment27multi_verse_model-7B-GGUF

Text Generation • 7B • Updated May 21, 2024 • 448

Zoyd/TIGER-Lab_MAmmoTH2-8B-8_0bpw_exl2

Text Generation • Updated May 21, 2024 • 5

MaziyarPanahi/T3qm7Strangemerges_32-7B-GGUF

Text Generation • 7B • Updated May 21, 2024 • 287

MaziyarPanahi/Ognoexperiment27multi_verse_modelCalmexperiment-7B-GGUF

Text Generation • 7B • Updated May 21, 2024 • 280

RichardErkhov/vicgalle_-_CarbonBeagle-11B-truthy-8bits

Text Generation • 11B • Updated May 21, 2024 • 4

RichardErkhov/Changgil_-_K2S3-SOLAR-11b-v3.0-8bits

Text Generation • 11B • Updated May 21, 2024 • 4

RichardErkhov/Changgil_-_K2S3-SOLAR-11b-v1.0-8bits

Text Generation • 11B • Updated May 21, 2024 • 4

MaziyarPanahi/Experiment27pasticheT3q-7B-GGUF

Text Generation • 7B • Updated May 21, 2024 • 90

RichardErkhov/Changgil_-_K2S3-SOLAR-11b-v2.0-8bits

Text Generation • 11B • Updated May 21, 2024 • 4 • 1

RichardErkhov/Changgil_-_K2S3-SOLAR-11b-v4.0-8bits

Text Generation • 11B • Updated May 21, 2024 • 4