phanerozoic commited on
Commit
e8fb6fe
Β·
verified Β·
1 Parent(s): 91c8e18

Initial README

Browse files
Files changed (1) hide show
  1. README.md +32 -0
README.md ADDED
@@ -0,0 +1,32 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ tags:
4
+ - multi-task
5
+ - object-detection
6
+ - semantic-segmentation
7
+ - depth-estimation
8
+ - frozen-backbone
9
+ - vision-transformer
10
+ library_name: pytorch
11
+ ---
12
+
13
+ # Prism
14
+
15
+ One head architecture for all spatial vision tasks. The structure separates features by scale; the output weights select the task.
16
+
17
+ The cofiber decomposition (average pool, subtract, iterate) produces multi-scale feature bands from a frozen backbone's spatial output. Each band isolates information present at one spatial scale but absent from the next coarser scale. The decomposition is analytic β€” zero learned parameters. Task-specific prediction is a single linear layer per task on the shared decomposed features.
18
+
19
+ ```
20
+ Frozen backbone β†’ spatial features β†’ cofiber decomposition (0 params)
21
+ ↓
22
+ scale band 0 (stride 16)
23
+ scale band 1 (stride 32)
24
+ scale band 2 (stride 64)
25
+ ↓
26
+ β”Œβ”€β”€ Detection weights (768 β†’ 80 classes + 4 box + 1 ctr)
27
+ β”œβ”€β”€ Segmentation weights (768 β†’ 150 classes)
28
+ β”œβ”€β”€ Depth weights (768 β†’ 256 bins)
29
+ └── Any other spatial task (768 β†’ N)
30
+ ```
31
+
32
+ The architecture is the decomposition. The task is the last matrix multiply.