infinitetalk_onnx / export.sh
cenahwang's picture
Upload folder using huggingface_hub
33c1c1f verified
/root/TensorRT-10.10.0.31/targets/x86_64-linux-gnu/bin/trtexec --onnx=checkpoints/wan2.1_i2v_14b_720p_infinite_lora_v11.onnx --minShapes=context:1x4096,x:16x21x40x40,y:1x20x21x40x40,ref_target_masks:3x40x40 --optShapes=context:12x4096,x:16x21x80x48,y:1x20x21x80x48,ref_target_masks:3x80x48 --maxShapes=context:512x4096,x:16x21x160x152,y:1x20x21x160x152,ref_target_masks:3x160x152 --memPoolSize=workspace:2048 --noCompilationCache --noBuilderCache --builderOptimizationLevel=3 --bf16 --precisionConstraints=prefer --saveEngine=checkpoints/wan2.1_i2v_14b_720p_v11_dyna_a100_bf16_opt_384x640.plan
/root/TensorRT-10.10.0.31/targets/x86_64-linux-gnu/bin/trtexec --onnx=checkpoints/vae_decoder.opt.onnx --minShapes=z:1x16x21x48x48 --optShapes=z:1x16x21x104x104 --maxShapes=z:1x16x21x120x112 --memPoolSize=workspace:4096 --builderOptimizationLevel=5 --fp16 --saveEngine=checkpoints/vae_de_fp16.plan
/root/TensorRT-10.10.0.31/targets/x86_64-linux-gnu/bin/trtexec --onnx=checkpoints/t5.onnx --bf16 --builderOptimizationLevel=5 --saveEngine=checkpoints/t5_bf16.plan