Initial README
Browse files
README.md
ADDED
|
@@ -0,0 +1,32 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: apache-2.0
|
| 3 |
+
tags:
|
| 4 |
+
- multi-task
|
| 5 |
+
- object-detection
|
| 6 |
+
- semantic-segmentation
|
| 7 |
+
- depth-estimation
|
| 8 |
+
- frozen-backbone
|
| 9 |
+
- vision-transformer
|
| 10 |
+
library_name: pytorch
|
| 11 |
+
---
|
| 12 |
+
|
| 13 |
+
# Prism
|
| 14 |
+
|
| 15 |
+
One head architecture for all spatial vision tasks. The structure separates features by scale; the output weights select the task.
|
| 16 |
+
|
| 17 |
+
The cofiber decomposition (average pool, subtract, iterate) produces multi-scale feature bands from a frozen backbone's spatial output. Each band isolates information present at one spatial scale but absent from the next coarser scale. The decomposition is analytic β zero learned parameters. Task-specific prediction is a single linear layer per task on the shared decomposed features.
|
| 18 |
+
|
| 19 |
+
```
|
| 20 |
+
Frozen backbone β spatial features β cofiber decomposition (0 params)
|
| 21 |
+
β
|
| 22 |
+
scale band 0 (stride 16)
|
| 23 |
+
scale band 1 (stride 32)
|
| 24 |
+
scale band 2 (stride 64)
|
| 25 |
+
β
|
| 26 |
+
βββ Detection weights (768 β 80 classes + 4 box + 1 ctr)
|
| 27 |
+
βββ Segmentation weights (768 β 150 classes)
|
| 28 |
+
βββ Depth weights (768 β 256 bins)
|
| 29 |
+
βββ Any other spatial task (768 β N)
|
| 30 |
+
```
|
| 31 |
+
|
| 32 |
+
The architecture is the decomposition. The task is the last matrix multiply.
|