Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
RedHatAI
/
Qwen3-Next-80B-A3B-Instruct-FP8-block
like
0
Follow
Red Hat AI
1.93k
Text Generation
Safetensors
qwen3_next
fp8
quantized
llm-compressor
compressed-tensors
red hat
conversational
License:
apache-2.0
Model card
Files
Files and versions
xet
Community
1
New discussion
New pull request
Resources
PR & discussions documentation
Code of Conduct
Hub documentation
All
Discussions
Pull requests
View closed (0)
Sort: Recently created
I'm getting an error running this with vllm/llm-d ghcr.io/llm-d/llm-d-cuda:v0.4.0
#1 opened about 1 month ago by
scondon