qaihm-bot commited on
Commit
be3cf9f
·
verified ·
1 Parent(s): 3e518a1

See https://github.com/qualcomm/ai-hub-models/releases/v0.54.0 for changelog.

Files changed (3) hide show
  1. LICENSE +1 -0
  2. README.md +96 -0
  3. release_assets.json +17 -0
LICENSE ADDED
@@ -0,0 +1 @@
 
 
1
+ The license of the original trained model can be found at https://github.com/Physical-Intelligence/openpi/blob/main/LICENSE.
README.md ADDED
@@ -0,0 +1,96 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ library_name: pytorch
3
+ license: other
4
+ tags:
5
+ - generative_ai
6
+ - android
7
+ pipeline_tag: robotics
8
+
9
+ ---
10
+
11
+ ![](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/pi05/web-assets/model_demo.png)
12
+
13
+ # Pi0.5: Optimized for Qualcomm Devices
14
+
15
+ Pi0.5 is a vision-language-action model that co-trains on diverse data sources (robot demos, web data, semantic subtasks) to enable open-world generalization for long-horizon robotic manipulation.
16
+
17
+ This is based on the implementation of Pi0.5 found [here](https://github.com/Physical-Intelligence/openpi).
18
+ This repository contains pre-exported model files optimized for Qualcomm® devices. You can use the [Qualcomm® AI Hub Models](https://github.com/qualcomm/ai-hub-models/blob/main/src/qai_hub_models/models/pi05) library to export with custom configurations. More details on model performance across various devices, can be found [here](#performance-summary).
19
+
20
+ Qualcomm AI Hub Models uses [Qualcomm AI Hub Workbench](https://workbench.aihub.qualcomm.com) to compile, profile, and evaluate this model. [Sign up](https://myaccount.qualcomm.com/signup) to run these models on a hosted Qualcomm® device.
21
+
22
+ ## Getting Started
23
+ There are two ways to deploy this model on your device:
24
+
25
+ ### Option 1: Download Pre-Exported Models
26
+
27
+ Below are pre-exported model assets ready for deployment.
28
+
29
+ | Runtime | Precision | Chipset | SDK Versions | Download |
30
+ |---|---|---|---|---|
31
+ | QNN_CONTEXT_BINARY | mixed | Qualcomm® QCS9075 | QAIRT 2.45 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/pi05/releases/v0.54.0/pi05-qnn_context_binary-mixed-qualcomm_qcs9075.zip)
32
+
33
+ For more device-specific assets and performance metrics, visit **[Pi0.5 on Qualcomm® AI Hub](https://aihub.qualcomm.com/models/pi05)**.
34
+
35
+
36
+ ### Option 2: Export with Custom Configurations
37
+
38
+ Use the [Qualcomm® AI Hub Models](https://github.com/qualcomm/ai-hub-models/blob/main/src/qai_hub_models/models/pi05) Python library to compile and export the model with your own:
39
+ - Custom weights (e.g., fine-tuned checkpoints)
40
+ - Custom input shapes
41
+ - Target device and runtime configurations
42
+
43
+ This option is ideal if you need to customize the model beyond the default configuration provided here.
44
+
45
+ See our repository for [Pi0.5 on GitHub](https://github.com/qualcomm/ai-hub-models/blob/main/src/qai_hub_models/models/pi05) for usage instructions.
46
+
47
+ ## Model Details
48
+
49
+ **Model Type:** Model_use_case.robotics
50
+
51
+ **Model Stats:**
52
+ - Number of cameras: 3
53
+ - Action chunk size: 50
54
+ - Vision resolution: 224x224
55
+ - Quantization: Mixed (w4a16 backbone, w8a16 vision encoder and action expert)
56
+
57
+ ## Performance Summary
58
+ | Model | Runtime | Precision | Chipset | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit
59
+ |---|---|---|---|---|---|---
60
+ | action_expert | QNN_CONTEXT_BINARY | mixed | Qualcomm® QCS9075 | 30.99 ms | 34 - 70 MB | NPU
61
+ | backbone | QNN_CONTEXT_BINARY | mixed | Qualcomm® QCS9075 | 398.479 ms | 12 - 60 MB | NPU
62
+ | token_emb | QNN_CONTEXT_BINARY | mixed | Qualcomm® QCS9075 | 4.221 ms | 6 - 26 MB | NPU
63
+ | vision_encoder | QNN_CONTEXT_BINARY | mixed | Qualcomm® QCS9075 | 40.566 ms | 1 - 5 MB | NPU
64
+
65
+ ## License
66
+ * The license for the original implementation of Pi0.5 can be found
67
+ [here](https://github.com/Physical-Intelligence/openpi/blob/main/LICENSE).
68
+
69
+ ## References
70
+ * [Pi0.5: a Vision-Language-Action Model with Open-World Generalization](https://www.physicalintelligence.company/download/pi05.pdf)
71
+ * [Source Model Implementation](https://github.com/Physical-Intelligence/openpi)
72
+
73
+ ## Community
74
+ * Join [our AI Hub Slack community](https://aihub.qualcomm.com/community/slack) to collaborate, post questions and learn more about on-device AI.
75
+ * For questions or feedback please [reach out to us](mailto:ai-hub-support@qti.qualcomm.com).
76
+
77
+ ## Usage and Limitations
78
+
79
+ This model may not be used for or in connection with any of the following applications:
80
+
81
+ - Accessing essential private and public services and benefits;
82
+ - Administration of justice and democratic processes;
83
+ - Assessing or recognizing the emotional state of a person;
84
+ - Biometric and biometrics-based systems, including categorization of persons based on sensitive characteristics;
85
+ - Education and vocational training;
86
+ - Employment and workers management;
87
+ - Exploitation of the vulnerabilities of persons resulting in harmful behavior;
88
+ - General purpose social scoring;
89
+ - Law enforcement;
90
+ - Management and operation of critical infrastructure;
91
+ - Migration, asylum and border control management;
92
+ - Predictive policing;
93
+ - Real-time remote biometric identification in public spaces;
94
+ - Recommender systems of social media platforms;
95
+ - Scraping of facial images (from the internet or otherwise); and/or
96
+ - Subliminal manipulation
release_assets.json ADDED
@@ -0,0 +1,17 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "version": "0.54.0",
3
+ "precisions": {
4
+ "mixed": {
5
+ "chipset_assets": {
6
+ "qualcomm-qcs9075": {
7
+ "qnn_context_binary": {
8
+ "tool_versions": {
9
+ "qairt": "2.45.0.260326154327"
10
+ },
11
+ "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/pi05/releases/v0.54.0/pi05-qnn_context_binary-mixed-qualcomm_qcs9075.zip"
12
+ }
13
+ }
14
+ }
15
+ }
16
+ }
17
+ }