Foundation-Sec-8B-Reasoning-INT8-W8A16

8-bit W8A16 (GPTQ / compressed-tensors) quantization of fdtn-ai/Foundation-Sec-8B-Reasoning.

Downloads last month
-
Safetensors
Model size
8B params
Tensor type
I32
·
BF16
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for Varadrajan/Foundation-Sec-8B-Reasoning-INT8-W8A16

Quantized
(11)
this model