DeepSeek-V3-FP4 / README.md
alphatozeta's picture
Upload folder using huggingface_hub
874c3a0 verified
---
license: mit
---
This is the quantized version of the DeepSeek AI's DeepSeek-V3-0324 model,
which quantized with [TensorRT Model Optimizer](https://github.com/NVIDIA/TensorRT-Model-Optimizer).