SenseVoiceSmall Q4_K inference runtimes

Prebuilt ARM64 Docker runtime archives for the AI Pod SenseVoice LPK. Use runtime-orin-0.1.4.tar.gz on AGX Orin and runtime-thor-0.1.4.tar.gz on AGX Thor. These contain inference programs and their runtime dependencies; model weights are downloaded separately and mounted read-only.

Verify the size and SHA256 in checksums.json, then import with docker load -i runtime-orin-0.1.4.tar.gz (or the Thor archive). Verify the imported image identity against checksums.json. Third-party license notices are retained in the archives.

Downloads last month: -; Downloads are not tracked for this model. How to track

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support