Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

380

Base only

Active filters: 8bit

trucnhi160703/ft-phi3-4k-8bit

Text Generation • Updated Oct 3, 2024

NaomiBTW/L3-8B-Lunaris-v1-GPTQ

Text Generation • Updated Nov 11, 2024

llk010502/llama3.1-8B-financial_sentiment

Text Generation • Updated Dec 11, 2024 • 1

danlou/relay-v0.1-Mistral-Nemo-2407-8bit

Text Generation • 12B • Updated Dec 14, 2024 • 1

John6666/lilly-pixel-v10-sdxl

Text-to-Image • Updated Dec 23, 2024 • 1

vitekkor/T-pro-it-1.0-bnb-8bit

33B • Updated Dec 16, 2024 • 1 • 1

mlx-community/Qwen2.5-7B-Instruct-kowiki-qa-8bit

Text Generation • Updated Dec 20, 2024 • 15

adriabama06/DeepSeek-R1-Distill-Qwen-1.5B-GPTQ-8bit

Text Generation • Updated Jan 22, 2025 • 15 • 1

adricohen/mistral-7B-medqa-lora-8bit-v1

Updated Feb 13, 2025

Deepak7376/DeepSeek-R1-Distill-Qwen-1.5B-bnb-8bit

Text Generation • 2B • Updated Feb 26, 2025 • 6 • 1

Lowkey-Loki/OlympicCoder-7B-mlx-8bit

2B • Updated Mar 12, 2025 • 5

Tonic/c4ai-command-a-03-2025-4bit_nf4_double

Text Generation • 114B • Updated Mar 13, 2025 • 8

Tonic/c4ai-command-a-03-2025-4bit_fp4

Text Generation • 113B • Updated Mar 13, 2025 • 8

Tonic/c4ai-command-a-03-2025-4bit_nf4_no_double

Text Generation • 113B • Updated Mar 13, 2025 • 12

adriabama06/ReaderLM-v2-GPTQ-8bit

Text Generation • Updated Mar 18, 2025 • 6 • 1

TheCluster/gemma-3-27b-it-uncensored-mlx-8bit

Image-Text-to-Text • 8B • Updated Apr 16, 2025 • 39 • 1

btbtyler09/Llama-3.3-70B-Instruct-gptq-8bit

Text Generation • 71B • Updated Apr 12, 2025 • 3

adriabama06/Llama-OuteTTS-1.0-1B-GPTQ-8bit

Text-to-Speech • Updated Apr 7, 2025 • 2 • 1

btbtyler09/cogito-v1-preview-qwen-32B-gptq-8bit

Text Generation • 33B • Updated Apr 12, 2025 • 12 • 1

adriabama06/DeepCoder-1.5B-Preview-GPTQ-8bit

Text Generation • Updated Apr 13, 2025 • 8 • 1

JWMD/cogito-v1-preview-qwen-32B-GPTQ-8bit-fixed-tokenizer

Text Generation • 33B • Updated Apr 19, 2025 • 10

TheCluster/amoral-gemma-3-4B-v2-mlx-8bit

Image-Text-to-Text • 2B • Updated Apr 16, 2025 • 31 • 2

TheCluster/amoral-gemma-3-12B-v2-mlx-8bit

Image-Text-to-Text • Updated Apr 16, 2025 • 9 • 1

TheCluster/amoral-gemma-3-27B-v2-mlx-8bit

Image-Text-to-Text • Updated Apr 16, 2025 • 24 • 2

btbtyler09/Qwen3-30B-A3B-gptq-8bit

Text Generation • 31B • Updated May 2, 2025 • 17 • 3

speakleash/Bielik-1.5B-v3.0-Instruct-FP8-Dynamic

Text Generation • 2B • Updated Jan 28 • 255 • 2

speakleash/Bielik-4.5B-v3.0-Instruct-FP8-Dynamic

Text Generation • 5B • Updated Jan 28 • 439 • 5

Jayway0910/clip-lora-multilabel

Image Classification • Updated May 24, 2025 • 1

martinctl/MNLP_M2_quantized_model

Text Generation • 0.6B • Updated May 27, 2025 • 5

speakleash/Bielik-11B-v2.6-Instruct-FP8-Dynamic

Text Generation • 11B • Updated Jul 10, 2025 • 120 • 4