Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

32,769

Base only

Active filters: 8-bit

MaziyarPanahi/mergekit-slerp-jeyctse-GGUF

Text Generation • 7B • Updated Jun 18, 2024 • 357

MaziyarPanahi/mergekit-ties-kkhkcqw-GGUF

Text Generation • 7B • Updated Jun 18, 2024 • 492

MaziyarPanahi/mergekit-slerp-kxzcrwh-GGUF

Text Generation • 7B • Updated Jun 18, 2024 • 201 • 1

MaziyarPanahi/mergekit-slerp-zzizhry-GGUF

Text Generation • 7B • Updated Jun 18, 2024 • 576 • 1

MaziyarPanahi/mergekit-slerp-fcxoywi-GGUF

Text Generation • 7B • Updated Jun 18, 2024 • 61 • 1

MaziyarPanahi/mergekit-slerp-gpprpds-GGUF

Text Generation • 7B • Updated Jun 18, 2024 • 487 • 1

nm-testing/tinyllama-oneshot-w8-channel-a8-tensor

Text Generation • 1B • Updated Oct 9, 2024 • 880

RyanJT/quantized-granite-3b-code-instruct

Text Generation • 3B • Updated Jun 19, 2024 • 4

AlekseyElygin/mistral-7b-instruct-v0.3-4bit

Text Generation • 4B • Updated Jun 20, 2024 • 5

MaziyarPanahi/firefunction-v2-GGUF

Text Generation • 71B • Updated Jun 20, 2024 • 112k • 19

BigHuggyD/BigHuggyD-Grey-WizardLM-2-8x22B_exl2_8.0bpw_h8

Text Generation • Updated Jun 19, 2024 • 5

q18/alpindale-magnum-72b-v1-exl-8.0bpw-h8

Text Generation • Updated Jun 19, 2024 • 4

lucyknada/alpindale-magnum-72b-v1-8.0bpw

Text Generation • Updated Jun 19, 2024 • 5 • 1

RyanJT/quantized-granite-8bit-3b-code-instruct

Text Generation • 3B • Updated Jun 19, 2024 • 4

IEITYuan/Yuan2-M32-hf-int8

Text Generation • Updated Jun 20, 2024 • 8

sealai/sdxl-turbo-int8

Text-to-Image • 3B • Updated Jun 20, 2024 • 1

sealai/stable-diffusion-xl-base-1.0-int8

Text-to-Image • 3B • Updated Jun 20, 2024 • 1

ismailpubg5/v2_model

Text Generation • 7B • Updated Jun 20, 2024 • 7

bullerwins/L3-8B-Stheno-v3.2-exl2_8.0bpw

Text Generation • Updated Jun 20, 2024 • 4

booksouls/summarization-endpoint

0.4B • Updated Jun 26, 2024 • 3

Manu1507/Llama-2-7b-quantize

Text Generation • 7B • Updated Jun 21, 2024 • 4

SotiriosKastanas/lmsys-vicuna-7b-v1.5-8-bit-bnb

Text Generation • 7B • Updated Jun 21, 2024 • 6

SotiriosKastanas/lmsys-vicuna-13b-v1.5-8-bit-bnb

Text Generation • 13B • Updated Jun 21, 2024 • 10

ByteForge/Llama_3_8b_Instruct_Text2Sql_Finetuned

Text Generation • 8B • Updated Jun 21, 2024 • 9

NimaZahedinameghi/nimaAxolotl

Updated Jun 21, 2024 • 1

RyanJT/quantized-tinyllama-8bit-1.1b-chat2

Text Generation • 3B • Updated Jun 22, 2024 • 4

RyanJT/quantized-4bit-TinyLlama-1.1B-Chat-v1.0

Text Generation • 3B • Updated Jun 22, 2024 • 4

DFofanov78/llama-3-8b-Instruct-bnb-4bit

Text Generation • 5B • Updated Jun 22, 2024 • 3

Wsassi/whisper_minds_14_merged

Automatic Speech Recognition • 0.2B • Updated Jun 22, 2024 • 2

nm-testing/llama-3-instruct-w8a8-dyn-per-token-test

Text Generation • 8B • Updated Oct 9, 2024 • 10