|
|
--- |
|
|
license: bsd-3-clause |
|
|
language: |
|
|
- en |
|
|
base_model: |
|
|
- depth-anything/DA3-SMALL |
|
|
- depth-anything/DA3-BASE |
|
|
- depth-anything/DA3MONO-LARGE |
|
|
- depth-anything/DA3METRIC-LARGE |
|
|
pipeline_tag: depth-estimation |
|
|
tags: |
|
|
- Depth-Anything-3 |
|
|
--- |
|
|
|
|
|
# Depth-Anything-3 |
|
|
|
|
|
This version of Depth-Anything-3 has been converted to run on the Axera NPU using **w8a16** quantization. |
|
|
|
|
|
This model has been optimized with the following LoRA: |
|
|
|
|
|
Compatible with Pulsar2 version: 5.0-patch1 |
|
|
|
|
|
## Convert tools links: |
|
|
|
|
|
For those who are interested in model conversion, you can try to export axmodel through |
|
|
|
|
|
- [The repo of original](https://github.com/ByteDance-Seed/Depth-Anything-3) |
|
|
|
|
|
- [The repo of AXera Platform](https://github.com/AXERA-TECH/Depth-Anything-3.AXERA.git), which you can get the detial of guide |
|
|
|
|
|
- [Pulsar2 Link, How to Convert ONNX to axmodel](https://pulsar2-docs.readthedocs.io/en/latest/pulsar2/introduction.html) |
|
|
|
|
|
|
|
|
## Support Platform |
|
|
|
|
|
- AX650 |
|
|
- [M4N-Dock(爱芯派Pro)](https://wiki.sipeed.com/hardware/zh/maixIV/m4ndock/m4ndock.html) |
|
|
- [M.2 Accelerator card](https://axcl-docs.readthedocs.io/zh-cn/latest/doc_guide_hardware.html) |
|
|
- AX637 |
|
|
|
|
|
|Chips|Models |Time| |
|
|
|--|--|--| |
|
|
|AX650|da3-base|67.341 ms | |
|
|
|AX650|da3-small|22.768 ms | |
|
|
|AX650|da3metric-large|217.577 ms | |
|
|
|AX650|da3mono-large|217.615 ms | |
|
|
|AX637|da3-base|174.100 ms | |
|
|
|AX637|da3-small|75.802 ms | |
|
|
|AX637|da3metric-large|698.765 ms | |
|
|
|AX637|da3mono-large|697.891 ms | |
|
|
|
|
|
## How to use |
|
|
|
|
|
Download all files from this repository to the device |
|
|
|
|
|
|
|
|
### python env requirement |
|
|
|
|
|
#### pyaxengine |
|
|
|
|
|
https://github.com/AXERA-TECH/pyaxengine |
|
|
|
|
|
``` |
|
|
wget https://github.com/AXERA-TECH/pyaxengine/releases/download/0.1.3.rc2/axengine-0.1.3-py3-none-any.whl |
|
|
pip install axengine-0.1.3-py3-none-any.whl |
|
|
``` |
|
|
|
|
|
#### others |
|
|
|
|
|
Maybe None. |
|
|
|
|
|
#### Inference with AX650 Host, such as M4N-Dock(爱芯派Pro) |
|
|
|
|
|
Input image: |
|
|
|
|
|
 |
|
|
|
|
|
``` |
|
|
root@ax650:~/AXERA-TECH/Depth-Anything-3# python3 python/infer.py --model models/da3metric-large.axmodel --img examples/demo01.jpg |
|
|
[INFO] Available providers: ['AxEngineExecutionProvider'] |
|
|
[INFO] Using provider: AxEngineExecutionProvider |
|
|
[INFO] Chip type: ChipType.MC50 |
|
|
[INFO] VNPU type: VNPUType.DISABLED |
|
|
[INFO] Engine version: 2.12.0s |
|
|
[INFO] Model type: 2 (triple core) |
|
|
[INFO] Compiler version: 3.3 ae03a08f |
|
|
root@ax650:~/AXERA-TECH/Depth-Anything-3# ls |
|
|
``` |
|
|
|
|
|
Output image: |
|
|
|
|
|
 |
|
|
|
|
|
|
