qaihm-bot commited on
Commit
a40d3bd
·
verified ·
1 Parent(s): bb02565

See https://github.com/quic/ai-hub-models/releases/v0.31.0 for changelog.

Files changed (1) hide show
  1. README.md +2 -2
README.md CHANGED
@@ -50,8 +50,8 @@ This model is an implementation of Qwen2.5-7B-Instruct found [here](https://gith
50
 
51
  | Model | Precision | Device | Chipset | Target Runtime | Response Rate (tokens per second) | Time To First Token (range, seconds)
52
  |---|---|---|---|---|---|
53
- | Qwen2.5-3B-Instruct | w4a16 | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | QNN | 15.40274 | 0.1356538 - 4.3409216 | -- | Use Export Script |
54
- | Qwen2.5-3B-Instruct | w4a16 | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN | 12.33811 | 0.1749494 - 5.5983808 | -- | Use Export Script |
55
 
56
  ## Deploying Qwen2.5-7B-Instruct on-device
57
 
 
50
 
51
  | Model | Precision | Device | Chipset | Target Runtime | Response Rate (tokens per second) | Time To First Token (range, seconds)
52
  |---|---|---|---|---|---|
53
+ | Qwen2.5-3B-Instruct | w4a16 | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | QNN_CONTEXT_BINARY | 15.40274 | 0.1356538 - 4.3409216 | -- | Use Export Script |
54
+ | Qwen2.5-3B-Instruct | w4a16 | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_CONTEXT_BINARY | 12.33811 | 0.1749494 - 5.5983808 | -- | Use Export Script |
55
 
56
  ## Deploying Qwen2.5-7B-Instruct on-device
57