Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up
inference-optimization 's Collections
Granite 4 Small and Tiny Quantized Models
NVIDIA-Nemotron-3-Nano-30B-A3B Quantized Models
Qwen3-Next-80B-A3B Quantized Models
Mixed Precision Models
KV Cache Quantization

Qwen3-Next-80B-A3B Quantized Models

updated 23 days ago

FP8-dynamic, FP8-block, NVFP4, INT4, INT8 versions of Qwen3-Next-80B-A3B-Instruct and Qwen3-Next-80B-A3B-Thinking Models

Upvote
-

  • inference-optimization/Qwen3-Next-80B-A3B-Instruct-FP8

    Text Generation • 81B • Updated 23 days ago • 12

  • inference-optimization/Qwen3-Next-80B-A3B-Thinking-FP8

    Text Generation • 81B • Updated 23 days ago • 6

  • RedHatAI/Qwen3-Next-80B-A3B-Thinking-FP8-block

    Text Generation • 80B • Updated 27 days ago • 31

  • RedHatAI/Qwen3-Next-80B-A3B-Thinking-FP8-dynamic

    Text Generation • 80B • Updated 18 days ago • 83

  • RedHatAI/Qwen3-Next-80B-A3B-Thinking-quantized.w4a16

    Text Generation • Updated 18 days ago • 77
Upvote
-
  • Collection guide
  • Browse collections
Company
TOS Privacy About Careers
Website
Models Datasets Spaces Pricing Docs