v0.31.0
Browse filesSee https://github.com/quic/ai-hub-models/releases/v0.31.0 for changelog.
README.md
CHANGED
|
@@ -34,7 +34,7 @@ Please contact us to purchase this model. More details on model performance acro
|
|
| 34 |
|
| 35 |
| Model | Precision | Device | Chipset | Target Runtime | Response Rate (tokens per second) | Time To First Token (range, seconds)
|
| 36 |
|---|---|---|---|---|---|
|
| 37 |
-
| PLaMo-1B | w4a16 | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile |
|
| 38 |
|
| 39 |
## Deploying PLaMo-1B on-device
|
| 40 |
|
|
|
|
| 34 |
|
| 35 |
| Model | Precision | Device | Chipset | Target Runtime | Response Rate (tokens per second) | Time To First Token (range, seconds)
|
| 36 |
|---|---|---|---|---|---|
|
| 37 |
+
| PLaMo-1B | w4a16 | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | QNN_CONTEXT_BINARY | 68.21 | 0.031448000000000004 - 1.0063360000000001 | -- | -- |
|
| 38 |
|
| 39 |
## Deploying PLaMo-1B on-device
|
| 40 |
|