This is the official MatGPTQ checkpoint of `microsoft/Phi-3-medium-128k-instruct`, produced as described in the [**"MatGPTQ: Accurate and Efficient Post-Training Matryoshka Quantization"**](https://arxiv.org/abs/2602.03537) paper.

This model can be run via vLLM. Checkout our integration at [IST-DASLab/MatGPTQ](https://github.com/IST-DASLab/MatGPTQ)