Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Website
Tasks
HuggingChat
Collections
Languages
Organizations
Community
Blog
Posts
Daily Papers
Learn
Discord
Forum
GitHub
Solutions
Team & Enterprise
Hugging Face PRO
Enterprise Support
Inference Providers
Inference Endpoints
Storage Buckets
Log In
Sign Up
RedHatAI
/
Qwen3-Next-80B-A3B-Instruct-FP8-block
like
0
Follow
Red Hat AI
2.59k
Text Generation
Safetensors
qwen3_next
fp8
quantized
llm-compressor
compressed-tensors
red hat
conversational
License:
apache-2.0
Model card
Files
Files and versions
xet
Community
1
Copy to bucket
new
New discussion
New pull request
Resources
PR & discussions documentation
Code of Conduct
Hub documentation
All
Discussions
Pull requests
View closed (0)
Sort: Recently created
I'm getting an error running this with vllm/llm-d ghcr.io/llm-d/llm-d-cuda:v0.4.0
#1 opened 5 months ago by
scondon