Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

27,427

Full-text search

Active filters: 8-bit

RyanJT/quantized-4bit-TinyLlama-1.1B-Chat-v1.0

Text Generation • 3B • Updated Jun 22, 2024

DFofanov78/llama-3-8b-Instruct-bnb-4bit

Text Generation • 5B • Updated Jun 22, 2024

Wsassi/whisper_minds_14_merged

Automatic Speech Recognition • Updated Jun 22, 2024

nm-testing/llama-3-instruct-w8a8-dyn-per-token-test

Text Generation • 8B • Updated Oct 9, 2024

bdambrosio/Hermes-2-Theta-Llama-3-70B-8.0bpw-exl2

Text Generation • Updated Jun 22, 2024 • 1

Sinensis/DarkForest-20B-v3.0-bpw8.0-h8-exl2

Text Generation • Updated Jun 26, 2025 • 1

SicariusSicariiStuff/LLAMA-3_8B_Unaligned_Alpha_RP_Soup_EXL2_8.0bpw

Text Generation • Updated Jul 25, 2025 • 3

Pyroserenus/L3-8B-Stheno-v3.3-32K-8.0bpw-h8-exl2

Text Generation • Updated Jun 24, 2024 • 3 • 3

Litzy619/MIS0623T1

4B • Updated Jun 23, 2024

SicariusSicariiStuff/LLAMA-3_8B_Unaligned_Alpha_EXL2_8.0bpw

Text Generation • Updated Jul 25, 2025 • 6

RyanJT/trained-quant-8bit

3B • Updated Jun 23, 2024

bigstorm/Hermes-2-Theta-Llama-3-8B-8.0bpw-8hb-exl2

Text Generation • Updated Jun 23, 2024 • 5

q18/sophosympatheia-New-Dawn-Llama-3-70B-32K-v1.0-exl2-8.0bpw-h8

Text Generation • Updated Jun 23, 2024 • 1 • 1

bigstorm/Codestral-22B-v0.1-8.0bpw-8hb-exl2

Text Generation • Updated Jun 23, 2024 • 2

nm-testing/Meta-Llama-3-8B-Instruct-W8A8-Dyn-Per-Token

Text Generation • 8B • Updated Oct 9, 2024 • 1

nm-testing/Meta-Llama-3-8B-Instruct-W8A8-Dyn-Per-Token-2048-Samples

Text Generation • 8B • Updated Oct 9, 2024 • 27

bigstorm/Yi-1.5-34B-Chat-16K-8.0bpw-8hb-exl2

Text Generation • Updated Jun 24, 2024 • 1

Bighost/Charpoet_8bit

Text Generation • 8B • Updated Jun 24, 2024 • 1

farshadafx/Phi3VisionX

Text Generation • Updated Feb 4, 2025 • 7 • 1

saicharan8/8-bit-telugu-bert

Feature Extraction • 0.1B • Updated Jun 24, 2024

bjaidi/Meta-Llama-3-8B-Instruct-GPTQ-8-bit

Text Generation • 8B • Updated Jun 24, 2024 • 3

bjaidi/Hermes-2-Theta-Llama-3-8B-GPTQ-8-bit

Text Generation • 8B • Updated Jun 24, 2024 • 2

bjaidi/Phi-3-medium-128k-instruct-GPTQ-8-bit

Text Generation • 14B • Updated Jun 25, 2024 • 3

QuantiPhy/aya-23-8B-8bq

Text Generation • 8B • Updated Jun 25, 2024 • 1

acl-srw-2024/mistral-7b-unsloth-gptq-8bit

Text Generation • Updated Jun 26, 2024 • 1

BigHuggyD/sophosympatheia_New-Dawn-Llama-3-70B-32K-v1.0_exl2_8.0bpw_h8

Text Generation • Updated Jun 25, 2024 • 1

nm-testing/Meta-Llama-3-8B-Instruct-W8-Channel-A8-Dynamic-Per-Token-Test

Text Generation • 8B • Updated Oct 9, 2024 • 66

BornSaint/open_cabra-pt-br-3B_v2_base_model

Text Generation • 3B • Updated Jun 25, 2024

BigHuggyD/alpindale_magnum-72b-v1_exl2_8.0bpw_h8

Text Generation • Updated Jun 26, 2024 • 1

Truepeak/ORPO-PM01-0.4-full

Feature Extraction • 8B • Updated Jun 26, 2024