File size: 271 Bytes
e86a095
 
 
 
1
2
3
4
5
# Activation Channel Scales

We provide the activation channel scales for OPT and BLOOM models. We get those scales with 512 random sentences in the Pile validation set. You can use `../examples/smoothquant_opt_demo.ipynb` to test smoothing and quantizing those models.