parakeet-ctc-0.6b-coreml-4bit / quantization_summary.json
Jarbas's picture
Re-export with compute_precision=FLOAT32 to fix NaN bug on 0.6b conformer
c0aada3 verified
raw
history blame contribute delete
208 Bytes
{
"parakeet_ctc_decoder": {
"original_mb": 4.0,
"4bit_mb": 0.5,
"compression": 7.9
},
"parakeet_mel_encoder": {
"original_mb": 2259.6,
"4bit_mb": 285.6,
"compression": 7.91
}
}