Update README.md
Browse files
README.md
CHANGED
|
@@ -1,35 +1,62 @@
|
|
| 1 |
-
|
| 2 |
-
|
| 3 |
-
|
| 4 |
-
|
| 5 |
-
|
| 6 |
-
|
| 7 |
-
|
| 8 |
-
|
|
|
|
|
|
|
|
|
|
| 9 |
---
|
| 10 |
|
| 11 |
-
#
|
| 12 |
|
| 13 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
| 14 |
|
| 15 |
-
|
|
|
|
|
|
|
| 16 |
|
| 17 |
-
|
| 18 |
-
Native C++ inference runtime for Vision-Language-Action models, built for low-latency robotic deployment.
|
| 19 |
|
| 20 |
-
|
| 21 |
-
|
|
|
|
|
|
|
| 22 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 23 |
|
| 24 |
-
|
| 25 |
-
|
| 26 |
-
|
| 27 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 28 |
|
| 29 |
-
|
| 30 |
-
|
| 31 |
-
|
| 32 |
-
|
| 33 |
|
| 34 |
-
|
| 35 |
-
Optimization = **model + runtime + system**
|
|
|
|
| 1 |
+
# VinRobotics, Foundation AI
|
| 2 |
+
|
| 3 |
+
**We make robotics foundation models fit.**
|
| 4 |
+
|
| 5 |
+
Our work grounds robot learning in the parallel-computing paradigm: one policy, expressed so it
|
| 6 |
+
executes on a server GPU, a Jetson-class board, an NPU, or a bare CPU, at the control rate the
|
| 7 |
+
task demands and inside the power budget the robot carries. Everything published here is one
|
| 8 |
+
half of that, either the runtime that executes a policy or the model that runs on it.
|
| 9 |
+
|
| 10 |
+
Built and deployed on VR humanoids at [VinRobotics](https://vinrobotics.net) (Vingroup, Vietnam).
|
| 11 |
+
|
| 12 |
---
|
| 13 |
|
| 14 |
+
## Runtime: [`vla.cpp`](https://github.com/VinRobotics/vla.cpp)
|
| 15 |
|
| 16 |
+
A C++/ggml inference engine for Vision-Language-Action models, built on
|
| 17 |
+
[`llama.cpp`](https://github.com/ggml-org/llama.cpp). SmolVLA, 蟺0 / 蟺0.5, BitVLA, Evo-1 and
|
| 18 |
+
GR00T N1.5/1.6/1.7 run under one runtime, each packaged as a single self-contained GGUF, with no
|
| 19 |
+
Python and no PyTorch at inference time. Backends: CPU (AVX/NEON), Apple Silicon, CUDA from
|
| 20 |
+
consumer GPUs down to Jetson, and Intel GPU via SYCL.
|
| 21 |
|
| 22 |
+
[arXiv:2606.08094](http://arxiv.org/abs/2606.08094) 路
|
| 23 |
+
[Learn vla.cpp](https://fai-modelopt-tech.github.io/learn-vla-cpp/) 路
|
| 24 |
+
[model bundles](https://huggingface.co/collections/vrfai/vlacpp-model-bundles-6a1e7e487bb2d85de81601a8)
|
| 25 |
|
| 26 |
+
## Compression: quantized checkpoints, and the recipes behind them
|
|
|
|
| 27 |
|
| 28 |
+
Just landed: **Qwen3.8-27B** quantized three ways, ready to serve,
|
| 29 |
+
[NVFP4](https://huggingface.co/vrfai/Qwen3.8-27B-NVFP4),
|
| 30 |
+
[FP8](https://huggingface.co/vrfai/Qwen3.8-27B-FP8) and
|
| 31 |
+
[FP8-dynamic](https://huggingface.co/vrfai/Qwen3.8-27B-FP8-dynamic).
|
| 32 |
|
| 33 |
+
Deployment-validated NVFP4, FP8 and FP8-dynamic checkpoints for VLM, ASR and world models:
|
| 34 |
+
[Qwen3.6](https://huggingface.co/collections/vrfai/qwen36-optimized-69e5d535c4b1465fd3afd611),
|
| 35 |
+
[Qwen3-ASR](https://huggingface.co/collections/vrfai/qwen3-asr-optimized-69d8c8bd4cbad9c07b2cfbdb),
|
| 36 |
+
[Gemma 4](https://huggingface.co/collections/vrfai/gemma-4-optimized-69e059ecb1c000d133d04694),
|
| 37 |
+
[Cosmos](https://huggingface.co/collections/vrfai/cosmos-optimized-69f95c4177f946f2575fd48f).
|
| 38 |
+
The method is open too:
|
| 39 |
+
[model-quantization-recipes](https://github.com/VinRobotics/model-quantization-recipes) covers
|
| 40 |
+
preparation through deployment-oriented validation, so a number can be reproduced rather than
|
| 41 |
+
believed.
|
| 42 |
|
| 43 |
+
---
|
| 44 |
+
|
| 45 |
+
## Maintainers and contributors
|
| 46 |
+
|
| 47 |
+
- Khanh Nguyen, [GitHub](https://github.com/khanhnd61-vr) 路 [HF](https://huggingface.co/khanhnd61)
|
| 48 |
+
- Hung Ho, [GitHub](https://github.com/hungho77) 路 [HF](https://huggingface.co/hungho77)
|
| 49 |
+
- Duc Minh Nguyen, [GitHub](https://github.com/ducido) 路 [HF](https://huggingface.co/ducido)
|
| 50 |
+
- Quang Nguyen, [HF](https://huggingface.co/quangnd58)
|
| 51 |
+
- Anh Huynh, [HF](https://huggingface.co/hqanh308)
|
| 52 |
+
- Pham Tri Quang, [HF](https://huggingface.co/twanghcmut)
|
| 53 |
+
- An Thai Le, Director of Foundation AI, [GitHub](https://github.com/anindex) 路 [HF](https://huggingface.co/anindex)
|
| 54 |
+
|
| 55 |
+
---
|
| 56 |
|
| 57 |
+
[vinrobotics.net](https://vinrobotics.net) 路
|
| 58 |
+
[github.com/VinRobotics](https://github.com/VinRobotics) 路
|
| 59 |
+
[LinkedIn](https://www.linkedin.com/in/vinrobotics) 路
|
| 60 |
+
[support@vinrobotics.net](mailto:support@vinrobotics.net)
|
| 61 |
|
| 62 |
+
Issues and PRs on the GitHub repos. Model-specific questions in the discussion tab of each repo here.
|
|
|