Hugging Face's logo

guerilla7
/
Foundation-Sec-8B-Instruct-NVFP4-quantized

TensorRT
Safetensors
llama
quantized
nvfp4
foundation-sec-8b-instruct
cybersecurity
8-bit precision
modelopt
Model card Files
xet
 Community
guerilla7 commited on
Commit
f489f2b
·
verified ·
1 Parent(s): 7dcafb6

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -23,7 +23,7 @@ Read more about NVFP4 at NVIDIA (https://developer.nvidia.com/blog/introducing-n
23
  - Quantization Method: NVFP4
24
  - Base Model: [fdtn-ai/Foundation-Sec-8B-Instruct](https://huggingface.co/fdtn-ai/Foundation-Sec-8B-Instruct)
25
  - Tool: NVIDIA TensorRT Model Optimizer
26
- - Environment: NVIDIA Spark
27
 
28
  ## Loading
29
  Refer to TensorRT-LLM or your deployment stack for loading NVFP4 artifacts.
 
23
  - Quantization Method: NVFP4
24
  - Base Model: [fdtn-ai/Foundation-Sec-8B-Instruct](https://huggingface.co/fdtn-ai/Foundation-Sec-8B-Instruct)
25
  - Tool: NVIDIA TensorRT Model Optimizer
26
+ - Environment: NVIDIA DGX Spark | NVIDIA-SMI 580.95.05 | Driver Version: 580.95.05 | CUDA Version: 13.0 |
27
 
28
  ## Loading
29
  Refer to TensorRT-LLM or your deployment stack for loading NVFP4 artifacts.