cortexelus commited on
Commit
d593f74
·
verified ·
1 Parent(s): 4168236

Add sm_90 TRT engines (wide profile) for the quantized tiers

Browse files
tensorRT/sm_90/same-l/dec_fp8.trt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:596b4d90afe81eea84215532dd74167e62211dd97d339dc027d101b331e7851c
3
+ size 943651476
tensorRT/sm_90/same-l/dec_w8_bf16.trt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3017f3e8876166ce4b895b080ebc577fae2fba683cc740492ab7823db51f7d4c
3
+ size 1199676940
tensorRT/sm_90/same-l/enc_fp8.trt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a5323e2b0e0a6fdaad9d5a3839794c1cf8c1f2a14b431b47b51661df9e31c91a
3
+ size 943096956
tensorRT/sm_90/same-l/enc_w8_bf16.trt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:998d3babc4c9f6b4656ab57df4e4883ab65a6816bb09432600a60fd415125e98
3
+ size 1198821036
tensorRT/sm_90/same-s/dec_fp8.trt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:73e2eada74571299b2dc8f906c6561353473560ca6daa6eb8f5df472c7dfba7f
3
+ size 81481668
tensorRT/sm_90/same-s/dec_fp8_fast.trt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ba18f7f4dafde8fe0160e63b45245ee84164fc9776ecc5363cd5823538f22a30
3
+ size 60372892
tensorRT/sm_90/same-s/dec_w8_bf16.trt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:178631435baaa71a8916ebc90763342ff1e9f6e5ddb7748ba3836559ec08e097
3
+ size 115030316
tensorRT/sm_90/same-s/enc_fp8.trt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d72701458f87091a380837e07ca40b873e90d140914cc644eb2b21948cbda3e8
3
+ size 78199220
tensorRT/sm_90/same-s/enc_fp8_fast.trt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1032b2c393f5f0634d21a40a51b56062e2e2e0b154994a76440db2ea7d04340b
3
+ size 57089148
tensorRT/sm_90/same-s/enc_w8_bf16.trt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0c7bc8efe419847d0fdf15b88cf885a70ab7c28959c89db9d414217cae18706f
3
+ size 111767564