OpenExplorer
/

InternVL2_5-1B

weepps commited on Sep 21

Commit

dec516d

verified ·

1 Parent(s): 92fd157

Update performance metrics

Files changed (1) hide show

README.md CHANGED Viewed

@@ -29,6 +29,6 @@ Parameter counts are calculated from the tensors stored in the upstream checkpoi
 | Chips | Data Type | ViT Image Size | Sequence Length (tokens) | Maximum Context Length (tokens) | BPU Cores (ViT / Prefill / Decode) | ViT Latency (ms) | TTFT (ms) | Prefill TPS (token/s) | Decode TPS (token/s) | BPU Memory (GB) | CPU Memory (GB) |
 |---|---|---:|---:|---:|---:|---:|---:|---:|---:|---:|---:|
-| Matrix6P | W8A8 | 448 × 448 | 512 | 1024 | 4 / 4 / 4 | 29.323 | 58.925 | 25,026.701 | 179.537 | 1.01 | 0.68 |
 > **Note:** TTFT includes preprocessing and ViT latency. Memory values represent the peak memory usage measured during the specified performance test.

 | Chips | Data Type | ViT Image Size | Sequence Length (tokens) | Maximum Context Length (tokens) | BPU Cores (ViT / Prefill / Decode) | ViT Latency (ms) | TTFT (ms) | Prefill TPS (token/s) | Decode TPS (token/s) | BPU Memory (GB) | CPU Memory (GB) |
 |---|---|---:|---:|---:|---:|---:|---:|---:|---:|---:|---:|
+| Matrix6P | W8A8 | 448 × 448 | 512 | 1024 | 4 / 4 / 4 | 29.323 | 58.925 | 19,982.194 | 157.002 | 1.01 | 0.68 |
 > **Note:** TTFT includes preprocessing and ViT latency. Memory values represent the peak memory usage measured during the specified performance test.