Gabriele commited on
Commit ·
47b7200
1
Parent(s): 2a2698d
Add navigation table linking all variants and DPT heads
Browse files
README.md
CHANGED
|
@@ -14,6 +14,13 @@ pipeline_tag: depth-estimation
|
|
| 14 |
|
| 15 |
DPT (Dense Prediction Transformer) heads for depth estimation, surface normal prediction, and semantic segmentation on top of the frozen [TIPSv2 B/14](https://huggingface.co/google/tipsv2-b14) backbone. The backbone is loaded automatically. The depth and normals heads are trained on the NYU Depth V2 dataset and segmentation is trained on the ADE20K dataset (150 classes).
|
| 16 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 17 |
## Usage
|
| 18 |
|
| 19 |
```bash
|
|
|
|
| 14 |
|
| 15 |
DPT (Dense Prediction Transformer) heads for depth estimation, surface normal prediction, and semantic segmentation on top of the frozen [TIPSv2 B/14](https://huggingface.co/google/tipsv2-b14) backbone. The backbone is loaded automatically. The depth and normals heads are trained on the NYU Depth V2 dataset and segmentation is trained on the ADE20K dataset (150 classes).
|
| 16 |
|
| 17 |
+
| Variant | Vision params | Text params | Embed dim | DPT Heads |
|
| 18 |
+
|---------|--------------|-------------|-----------|-----------|
|
| 19 |
+
| [B/14](https://huggingface.co/google/tipsv2-b14) | 86M | 110M | 768 | [B/14-dpt](https://huggingface.co/google/tipsv2-b14-dpt) |
|
| 20 |
+
| [L/14](https://huggingface.co/google/tipsv2-l14) | 303M | 184M | 1024 | [L/14-dpt](https://huggingface.co/google/tipsv2-l14-dpt) |
|
| 21 |
+
| [SO400m/14](https://huggingface.co/google/tipsv2-so400m14) | 412M | 448M | 1152 | [SO400m/14-dpt](https://huggingface.co/google/tipsv2-so400m14-dpt) |
|
| 22 |
+
| [g/14](https://huggingface.co/google/tipsv2-g14) | 1.1B | 389M | 1536 | [g/14-dpt](https://huggingface.co/google/tipsv2-g14-dpt) |
|
| 23 |
+
|
| 24 |
## Usage
|
| 25 |
|
| 26 |
```bash
|