Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

32,547

Base only

Active filters: 8-bit

TeeZee/BigMaid-20B-v2.0-bpw8.0-h8-exl2

Text Generation • Updated Jun 15, 2024 • 4

robertgshaw2/llama-3-w8a8-static-per-tensor-test

Text Generation • 8B • Updated Jun 15, 2024 • 6

robertgshaw2/llama-3-w8a8-dynamic-per-token-test

Text Generation • 8B • Updated Jun 15, 2024 • 6

grimjim/Llama-3-Oasis-v1-OAS-8B-8bpw_h8_exl2

Text Generation • Updated Aug 27, 2024 • 7

MaziyarPanahi/mergekit-slerp-oztfijl-GGUF

Text Generation • 7B • Updated Jun 15, 2024 • 481

MaziyarPanahi/EvoluzioneRed-GGUF

Text Generation • 7B • Updated Jun 15, 2024 • 11

MaziyarPanahi/mergekit-slerp-zwbosgo-GGUF

Text Generation • 8B • Updated Jun 15, 2024 • 10

MaziyarPanahi/Fimburs11V3-GGUF

Text Generation • 11B • Updated Jun 15, 2024 • 25

MaziyarPanahi/mergekit-passthrough-zpfenfn-GGUF

Text Generation • 23B • Updated Jun 15, 2024 • 107

TeeZee/DarkForest-20B-v3.0-bpw8.0-h8-exl2

Text Generation • Updated Jun 15, 2024 • 4

MaziyarPanahi/TopEvolution7RAG-GGUF

Text Generation • 7B • Updated Jun 15, 2024 • 41

KakaoL0L/Llama38B_CVetOFFRE2_4bit

Text Generation • 5B • Updated Jun 15, 2024 • 4

MaziyarPanahi/TopEvolutionWiz-GGUF

Text Generation • 7B • Updated Jun 15, 2024 • 31

MaziyarPanahi/TopEvolution-DPO-32K-GGUF

Text Generation • 7B • Updated Jun 15, 2024 • 531

strickvl/isafpr-mistral-lora-templatefree

Updated Jun 16, 2024 • 5

MaziyarPanahi/mergekit-slerp-jovftfd-GGUF

Text Generation • 7B • Updated Jun 15, 2024 • 169

MaziyarPanahi/Superevolution-GGUF

Text Generation • 7B • Updated Jun 15, 2024 • 13

MaziyarPanahi/TopEvolution16-GGUF

Text Generation • 7B • Updated Jun 15, 2024 • 40

MaziyarPanahi/nMer1-GGUF

Text Generation • 7B • Updated Jun 15, 2024 • 12

MaziyarPanahi/Evolver-GGUF

Text Generation • 7B • Updated Jun 15, 2024 • 67

MaziyarPanahi/TopEvolution-GGUF

Text Generation • 7B • Updated Jun 15, 2024 • 177

MaziyarPanahi/mergekit-passthrough-yqhuxcv-GGUF

Text Generation • 45B • Updated Jun 15, 2024 • 17

MaziyarPanahi/Hermes-2-Pro-Llama-3-13B-GGUF

Text Generation • 12B • Updated Jun 15, 2024 • 179 • 1

MaziyarPanahi/TopStarClaudioArena-GGUF

Text Generation • 7B • Updated Jun 15, 2024 • 18

MaziyarPanahi/mergekit-slerp-jxmncon-GGUF

Text Generation • 7B • Updated Jun 15, 2024 • 20

MaziyarPanahi/Topsecret-GGUF

Text Generation • 5B • Updated Jun 15, 2024 • 359

MaziyarPanahi/YorkShire11-GGUF

Text Generation • 7B • Updated Jun 15, 2024 • 189

MaziyarPanahi/Llama-3-8B-666-GGUF

Text Generation • 12B • Updated Jun 16, 2024 • 18

MaziyarPanahi/JackRussell-GGUF

Text Generation • 9B • Updated Jun 16, 2024 • 369

MaziyarPanahi/Llama3-13B-ku-GGUF

Text Generation • 23B • Updated Jun 16, 2024 • 121