File size: 1,426 Bytes
789eef1 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 |
# Sapiens: Depth Estimation
## Model Zoo
The depth estimation model checkpoints are available at,
| Model | Checkpoint Path
|---------------|--------------------------------------------------------------------------------------------------
| Sapiens-0.3B | `$SAPIENS_CHECKPOINT_ROOT/depth/checkpoints/sapiens_0.3b/sapiens_0.3b_render_people_epoch_100.pth`
| Sapiens-0.6B | `$SAPIENS_CHECKPOINT_ROOT/depth/checkpoints/sapiens_0.6b/sapiens_0.6b_render_people_epoch_70.pth`
| Sapiens-1B | `$SAPIENS_CHECKPOINT_ROOT/depth/checkpoints/sapiens_1b/sapiens_1b_render_people_epoch_88.pth`
| Sapiens-2B | `$SAPIENS_CHECKPOINT_ROOT/depth/checkpoints/sapiens_2b/sapiens_2b_render_people_epoch_25.pth`
## Inference Guide
- Navigate to your script directory:
```bash
cd $SAPIENS_ROOT/seg/scripts/demo/local
```
- For depth estimation (uncomment your model config line):
```bash
./depth.sh
```
Define `INPUT` for your image directory, `SEG_DIR` for the .npy foreground segmentation directory (obtained from body-part segmentation) and `OUTPUT` for results.\
The predictions will be visualized as (.jpg or .png) files to the `OUTPUT` directory as [image, depth as heatmap, surface normal from depth].\
Adjust `JOBS_PER_GPU`, `TOTAL_GPUS` and `VALID_GPU_IDS` for multi-GPU configurations.
<p align="center">
<img src="../assets/depth.gif" alt="Depth Prediction" width="1000" style="margin-right: 10px;"/>
</p>
|