Image-to-3D
Sharp
qnn
qualcomm
htp
dlc
hexagon
gaussian-splatting
3d-reconstruction
single-image
on-device
android
sharp
Instructions to use kjcpc/ML-Sharp-QNN with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Sharp
How to use kjcpc/ML-Sharp-QNN with Sharp:
# No code snippets available yet for this library. # To use this model, check the repository files and the library's documentation. # Want to help? PRs adding snippets are welcome at: # https://github.com/huggingface/huggingface.js
- Notebooks
- Google Colab
- Kaggle
Upload README.md with huggingface_hub
Browse files
README.md
CHANGED
|
@@ -24,13 +24,13 @@ This is a **Qualcomm QNN (Qualcomm Neural Network)** conversion of [apple/Sharp]
|
|
| 24 |
|
| 25 |
**Converted models (5 DLC files):**
|
| 26 |
|
| 27 |
-
| File | Model | Description |
|
| 28 |
-
|------|-------|-------------|
|
| 29 |
-
| `pe.dlc` | Patch Encoder | Encodes 35 image patches (384×384) |
|
| 30 |
-
| `ie.dlc` | Image Encoder | Encodes the full image (1536×1536) |
|
| 31 |
-
| `rest_a.dlc` | REST Segment A | Feature Fusion (6 inputs → 6 outputs) |
|
| 32 |
-
| `rest_b.dlc` | REST Segment B | Disparity Estimation |
|
| 33 |
-
| `rest_c.dlc` | REST Segment C | Gaussian Delta Prediction |
|
| 34 |
|
| 35 |
---
|
| 36 |
|
|
@@ -45,7 +45,7 @@ This software project accompanies the research paper: _Sharp Monocular View Synt
|
|
| 45 |
by _Lars Mescheder, Wei Dong, Shiwei Li, Xuyang Bai, Marcel Santos, Peiyun Hu, Bruno Lecouat, Mingmin Zhen, Amaël Delaunoy,
|
| 46 |
Tian Fang, Yanghai Tsin, Stephan Richter and Vladlen Koltun_.
|
| 47 |
|
| 48 |
-

|
| 49 |
|
| 50 |
We present SHARP, an approach to photorealistic view synthesis from a single image. Given a single photograph, SHARP regresses the parameters of a 3D Gaussian representation of the depicted scene. This is done in less than a second on a standard GPU via a single feedforward pass through a neural network. The 3D Gaussian representation produced by SHARP can then be rendered in real time, yielding high-resolution photorealistic images for nearby views. The representation is metric, with absolute scale, supporting metric camera movements. Experimental results demonstrate that SHARP delivers robust zero-shot generalization across datasets. It sets a new state of the art on multiple datasets, reducing LPIPS by 25–34% and DISTS by 21–43% versus the best prior model, while lowering the synthesis time by three orders of magnitude.
|
| 51 |
|
|
|
|
| 152 |
|
| 153 |
## Usage with the Android App
|
| 154 |
|
| 155 |
+
1. Download all 5 `.dlc` files from `dlc/w8a16/` of this repository
|
| 156 |
2. Place them in the app's model directory under `dlc/`:
|
| 157 |
```
|
| 158 |
<modelRoot>/dlc/pe.dlc
|