|
|
--- |
|
|
license: mit |
|
|
language: |
|
|
- en |
|
|
base_model: |
|
|
- magic-leap-community/superpoint |
|
|
pipeline_tag: image-feature-extraction |
|
|
tags: |
|
|
- Axera |
|
|
- NPU |
|
|
- Pulsar2 |
|
|
- SuperPoint |
|
|
- Computer-Vision |
|
|
--- |
|
|
|
|
|
# SuperPoint |
|
|
|
|
|
This repository contains the **[SuperPoint](https://arxiv.org/abs/1712.07629)** model converted to run on the Axera NPU. SuperPoint is a self-supervised framework for training interest point detectors and descriptors, suitable for a large number of multiple-view geometry problems in computer vision. |
|
|
|
|
|
This version has been quantized using **w8a16** and is optimized for use with **Pulsar2 (version 4.2)**. |
|
|
|
|
|
## Convert Tools Links |
|
|
|
|
|
For developers interested in custom model conversion or optimization: |
|
|
- [AXera Platform GitHub Repo](https://github.com/AXERA-TECH/ax-samples): Comprehensive guides and sample code for AXera chips. |
|
|
- [Pulsar2 Documentation](https://pulsar2-docs.readthedocs.io/en/latest/pulsar2/introduction.html): Official guide on converting ONNX models to `.axmodel`. |
|
|
|
|
|
## Supported Platforms |
|
|
|
|
|
- AX650 |
|
|
- AX637 |
|
|
|
|
|
| Chips | SuperPoint (640x480) | |
|
|
|---|---| |
|
|
| AX650 | 27.443 ms | |
|
|
| AX637 | 96.118 ms | |
|
|
|
|
|
## How to Use |
|
|
|
|
|
Download the model files and the inference binary to your Axera-powered device: |
|
|
|
|
|
```bash |
|
|
root@ax650:~/SuperPoint-Demo# tree |
|
|
. |
|
|
|-- ax650 |
|
|
| `-- compiled.axmodel |
|
|
|-- infer.py |
|
|
|-- 1.ppm |
|
|
|-- 2.ppm |
|
|
`-- output.jpg |
|
|
``` |
|
|
# Inference |
|
|
|
|
|
```bash |
|
|
python3 infer.py --model ./ax650/compiled.axmodel --img1 1.ppm --img2 2.ppm --output output.jpg |
|
|
``` |
|
|
|
|
|
## Output image |
|
|
 |