heal
horizon
zacxr commited on
Commit
17d4c00
·
verified ·
1 Parent(s): ec588dc

Add README.md

Browse files
Files changed (1) hide show
  1. README.md +66 -0
README.md ADDED
@@ -0,0 +1,66 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: other
3
+ tags:
4
+ - heal
5
+ - horizon
6
+ ---
7
+
8
+ # Detr3D (EfficientNet-b3)
9
+
10
+ Detr3D brings the DETR paradigm to 3D detection: EfficientNet-b3 + BiFPN extract multi-scale image features; view transformation projects 2D features to 3D space; Detr3dTransformer iteratively samples multi-view features with learnable queries and predicts 3D detection boxes; Detr3dTarget performs Hungarian matching during training.
11
+
12
+ ---
13
+
14
+ ## Deployment Metrics
15
+
16
+ ### Model Parameters
17
+
18
+ | Model | Model Input | Backbone | Neck | Model Output |
19
+ |---|---|---|---|---|
20
+ | Detr3D | 6-camera multi-view images `(B,6,3,512,1408)` | EfficientNet-b3 | BiFPN | 3D detection boxes `(B,N,cls+reg)` |
21
+
22
+ ### Accuracy Metrics
23
+
24
+ | March | Metric | float | calibration | qat | hbm |
25
+ | --- | --- | --- | --- | --- | --- |
26
+ | J6M | NDS | 0.3357 | 0.3299 | 0.338 | 0.337 |
27
+ | | mAP | 0.2694 | 0.2618 | 0.2688 | 0.2683 |
28
+
29
+ > Results are based on `march = March.NASH_M` (J6M) configuration.
30
+ >
31
+ > HEAL version: heal 0.0.2 / hbdk4-compiler 4.11.11 / horizon_plugin_pytorch 3.3.10.
32
+
33
+ ### Performance Metrics
34
+
35
+ > **Performance measurement**: FPS is measured with single-core eight-thread; Latency is measured with single-core single-thread; Memory is peak DDR usage.
36
+
37
+ | March | latency (ms) | fps | Memory Usage |
38
+ |---|---|---|---|
39
+ | J6M | 21.88 | 46.43 | 97.60 |
40
+ | J6P | 15.22 | 253.24 | 94.60 |
41
+ | J6B | - | - | - |
42
+
43
+ J6B performance is not available for this model.
44
+
45
+ ---
46
+
47
+ ## Model Overview
48
+
49
+ ### Core Design
50
+
51
+ Detr3D brings the DETR paradigm to 3D detection: EfficientNet-b3 + BiFPN extract multi-scale image features; view transformation projects 2D features to 3D space; Detr3dTransformer iteratively samples multi-view features with learnable queries and predicts 3D detection boxes; Detr3dTarget performs Hungarian matching during training.
52
+
53
+ - **Task type**: BEV 3D object detection (BEV 3D Object Detection).
54
+ - **backbone**: EfficientNet-b3 (`efficientnet`, `model_type=b3`, `include_top=False`, `activation=relu`, `use_se_block=False`).
55
+ - **neck**: BiFPN (`BiFPN`, bidirectional feature pyramid, `stack=3`, `out_channels=256`, `num_outs=5`).
56
+ - **Detection head**: `Detr3dHead` + `Detr3dTransformer` + `Detr3dDecoder` (DETR-style 3D decoder).
57
+ - **Loss**: FocalLoss (cls) + L1Loss (bbox), via Detr3dTarget Hungarian matching.
58
+ - **Model input**: 6-camera multi-view images, `(B,6,3,512,1408)` (original `orig_shape=(3,900,1600)` → resize `(3,792,1408)` → crop `data_shape=(3,512,1408)`, `num_views=6`).
59
+ - **Model output**: 3D detection boxes (class + center + size + orientation), `num_query=900`, `num_classes=10`, decoded via `Detr3dPostProcess` (`max_num=300`).
60
+
61
+ ### Official Repo and Paper
62
+
63
+ Official repo: https://github.com/WangYueFt/detr3d
64
+ Paper: https://arxiv.org/abs/2110.06922
65
+
66
+ Note: backbone is EfficientNet-b3; official repo uses a different backbone.