Post
1294
Cosmos-Reason2-2B on Nano Super
Hi! Today, me and my team is releasing a version of Cosmos-Reason2-2B that is quantized so that it fits on the NVIDIA Jetson Orin Nano Super.
We managed to find a mixed precision configuration such that it maintains virtually the same accuracy as the unquantized model while being able to run really efficiently on the Nano Super and other edge devices :)
embedl/Cosmos-Reason2-2B-W4A16-Edge2
Hi! Today, me and my team is releasing a version of Cosmos-Reason2-2B that is quantized so that it fits on the NVIDIA Jetson Orin Nano Super.
We managed to find a mixed precision configuration such that it maintains virtually the same accuracy as the unquantized model while being able to run really efficiently on the Nano Super and other edge devices :)
embedl/Cosmos-Reason2-2B-W4A16-Edge2