FP8 static quantized model with compressored tensors. per-tensor weight and per-tensor activation.
- Downloads last month
- -
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support
FP8 static quantized model with compressored tensors. per-tensor weight and per-tensor activation.