cortexelus commited on
Commit
4e8cc21
·
verified ·
1 Parent(s): be8ab06

Add sm_120 TRT engines (AOT SWA, wide profile) for the quantized tiers

Browse files
tensorRT/sm_120/same-l/dec_fp8.trt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:63c1ec99ef495f31a2ae15da6318986b96cef9ee7c2c4c430a726819edbacc12
3
+ size 941490268
tensorRT/sm_120/same-l/dec_w8_bf16.trt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fd079989787561d36cb7fc0aeabaf316a2500cfdc2011eb0389ab594bbf5c35c
3
+ size 1196396924
tensorRT/sm_120/same-l/enc_fp8.trt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c6ffeb479cc5abdbef5031b2e92237ba038d757302496cadf2be15acc382acca
3
+ size 941557524
tensorRT/sm_120/same-l/enc_w8_bf16.trt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:76d6975823623fbafea32f8330d3cb09928b15d3a93a49e2f0271e38c91b74ff
3
+ size 1196392484
tensorRT/sm_120/same-s/dec_fp8.trt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:67280d367d7e78f4f4e066d93c251c2e727d5be1ef34598ae437a22fd0c5222f
3
+ size 82186988
tensorRT/sm_120/same-s/dec_fp8_fast.trt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0fca37ece9d9563be81112710a0a202c6cdebb38348681aff5183c87a0e148c3
3
+ size 61083364
tensorRT/sm_120/same-s/dec_w8_bf16.trt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f1d690b3c9a49095960f52c721c9cbc0a93a76cc5b4787b483ec079178b144a0
3
+ size 115347364
tensorRT/sm_120/same-s/enc_fp8.trt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a5b4ca020906abfd3235f81dbe0890807b22fd36ea496fc1f93b18175b873081
3
+ size 78675460
tensorRT/sm_120/same-s/enc_fp8_fast.trt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cdfeaa2b04837ab0f59ed4a1e28b342b6c9f64521928b0be5c8ce966cc0dcdab
3
+ size 57504516
tensorRT/sm_120/same-s/enc_w8_bf16.trt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:279be27cbc262d009b44ad2145ed3bcbe6a1be5a9e5c92d2b4d37909c691ed5e
3
+ size 111155196