Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,920

Base only

Active filters: int8

taurusduan/Qwen3-VL-32B-Ultra-Heretic-H3-ComfyUI-INT8-ConvRot

Image-Text-to-Text • Updated 3 days ago • 1

deAPI-ai/minimax-h3-33b-int8

Text-to-Video • Updated 2 days ago • 1

Captain1Q/gemma-4-31B-it-scotoma-2-GPTQ-W8A16

Text Generation • 31B • Updated 1 day ago • 1

prithivMLmods/Qwen3.5-9B-Uncensored-ComfyUI

Image-Text-to-Text • Updated about 12 hours ago • 1

nuvaidev/all-MiniLM-L6-v2-onnx-quantized

Feature Extraction • Updated about 11 hours ago • 1

Intel/distilbert-base-uncased-finetuned-sst-2-english-int8-static-inc

Text Classification • Updated Jun 27, 2023 • 1.13k • 6

INC4AI/bert-base-uncased-mrpc-int8-qat-inc

Text Classification • Updated Mar 21, 2024 • 11 • 1

INC4AI/albert-base-v2-sst2-int8-static-inc

Text Classification • Updated Mar 22, 2024 • 13

INC4AI/bert-base-uncased-mrpc-int8-static-inc

Text Classification • Updated Mar 21, 2024 • 6

INC4AI/roberta-base-mrpc-int8-static-inc

Text Classification • Updated Mar 21, 2024 • 11

echarlaix/distilbert-sst2-inc-dynamic-quantization-magnitude-pruning-0.1

Text Classification • Updated Jun 13, 2023 • 7

echarlaix/t5-small-int8-dynamic

Translation • Updated Oct 26, 2023 • 6 • 4

echarlaix/distilbert-base-uncased-finetuned-sst-2-english-int8-dynamic

Text Classification • Updated Jun 13, 2023 • 2.27k • 1

INC4AI/distilbert-base-uncased-finetuned-sst-2-english-int8-dynamic-inc

Text Classification • Updated Mar 21, 2024 • 1.69k • 1

Intel/distilbert-base-uncased-distilled-squad-int8-static-inc

Question Answering • Updated Mar 29, 2024 • 1.46k • • 5

INC4AI/vit-base-patch16-224-int8-static-inc

Image Classification • Updated Sep 6, 2022 • 21 • 1

Intel/t5-small-xsum-int8-dynamic-inc

Updated Mar 21, 2024 • 1.56k • 1

AlexKoff88/bert_nm_mnli_sparse_quantized_90

Text Classification • Updated Nov 25, 2022 • 8

echarlaix/vit-food101-int8

Image Classification • Updated Nov 22, 2022 • 6

Intel/roberta-base-mrpc-int8-dynamic-inc

Text Classification • Updated Dec 28, 2022 • 4

INC4AI/albert-base-v2-sst2-int8-dynamic-inc

Text Classification • Updated Jun 27, 2023 • 9

Intel/MiniLM-L12-H384-uncased-mrpc-int8-dynamic-inc

Text Classification • Updated Dec 28, 2022 • 4

INC4AI/gpt-j-6B-int8-dynamic-inc

Text Generation • Updated Apr 19, 2023 • 10 • 16

INC4AI/gpt-j-6B-int8-static-inc

Text Generation • Updated Apr 19, 2023 • 14 • 9

DataAgent/llama-7b-alpaca-zh-20k

Updated Apr 8, 2023

ENOT-AutoDL/gpt-j-6B-tensorrt-int8

Text Generation • Updated Jun 8, 2023 • 7

INC4AI/gpt-j-6B-pytorch-int8-static-inc

Text Generation • Updated Jan 18, 2024 • 9

DataAgent/llama-7b-alpaca-zh-120k

Updated Apr 8, 2023 • 1

michaelfeil/ct2fast-gpt-j-6b

Updated May 19, 2023 • 4 • 2

michaelfeil/ct2fast-pythia-12b

Updated May 21, 2023 • 4