File size: 317 Bytes
0234a35 b27b76e 305f804 96a1d82 0234a35 | 1 2 3 4 5 6 7 8 9 10 | ---
license: unknown
---
This is a model for testing the effect of quantization.
Part of the UCSD 23Fall 240D course project.
The model is a pretrained model from facebook.
Model name is opt-350m.
We quantize it with 8 bit quantization provided by bitsandbytes.
It is a quantization technique proposed in a paper.
--- |