Update README.md
Browse files
README.md
CHANGED
|
@@ -1,3 +1,86 @@
|
|
| 1 |
-
---
|
| 2 |
-
license: mit
|
| 3 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: mit
|
| 3 |
+
tags:
|
| 4 |
+
- pose-estimation
|
| 5 |
+
- 6d-pose
|
| 6 |
+
- vision-transformer
|
| 7 |
+
- spacecraft
|
| 8 |
+
- space
|
| 9 |
+
- vit
|
| 10 |
+
datasets:
|
| 11 |
+
- SPEED
|
| 12 |
+
pipeline_tag: image-classification
|
| 13 |
+
---
|
| 14 |
+
|
| 15 |
+
# FastPose-ViT: Pretrained Weights
|
| 16 |
+
|
| 17 |
+
Pretrained weights for **[FastPose-ViT](https://github.com/PierreAncey/FastPose-ViT)**, a Vision Transformer pipeline for real-time 6D spacecraft pose estimation.
|
| 18 |
+
|
| 19 |
+
## Available Weights
|
| 20 |
+
|
| 21 |
+
All models are trained on the **SPEED** dataset.
|
| 22 |
+
|
| 23 |
+
| File | Model | Task | Input Resolution |
|
| 24 |
+
|------|-------|------|-----------------|
|
| 25 |
+
| `vit_b_16_384.pth` | ViT-B/16-384 | Pose estimation (6D) | 384x384 |
|
| 26 |
+
| `vit_b_16.pth` | ViT-B/16 | Pose estimation (6D) | 224x224 |
|
| 27 |
+
| `small.pth` | LW-DETR Small | Object detection (bbox) | 512x512 |
|
| 28 |
+
|
| 29 |
+
## Usage
|
| 30 |
+
|
| 31 |
+
1. Clone the repository:
|
| 32 |
+
```bash
|
| 33 |
+
git clone https://github.com/PierreAncey/FastPose-ViT.git
|
| 34 |
+
cd FastPose-ViT
|
| 35 |
+
```
|
| 36 |
+
|
| 37 |
+
2. Download weights and place them in a `weights/` directory.
|
| 38 |
+
|
| 39 |
+
3. Run evaluation on the SPEED dataset:
|
| 40 |
+
```bash
|
| 41 |
+
DATASET=SPEED_FIXED && \
|
| 42 |
+
python3 src/evaluate.py \
|
| 43 |
+
--model_weights weights/vit_b_16_384.pth \
|
| 44 |
+
--rotation_format matrix \
|
| 45 |
+
--num_hidden_layers 0 \
|
| 46 |
+
--hidden_layer_dim 0 \
|
| 47 |
+
--nb_class_tokens 1 \
|
| 48 |
+
--batch_size 8 \
|
| 49 |
+
--vit_model vit_b_16_384 \
|
| 50 |
+
--dataset SPEED \
|
| 51 |
+
--dataset_root_dir $DATASET \
|
| 52 |
+
--num_workers 8 \
|
| 53 |
+
--merge_outputs \
|
| 54 |
+
--no_mlp
|
| 55 |
+
```
|
| 56 |
+
|
| 57 |
+
4. Run the object detector:
|
| 58 |
+
```bash
|
| 59 |
+
DATASET=SPEED_FIXED && \
|
| 60 |
+
python3 object_detector/evaluate.py \
|
| 61 |
+
--dataset_root_dir $DATASET \
|
| 62 |
+
--model_variant small \
|
| 63 |
+
--model_weights weights/small.pth
|
| 64 |
+
```
|
| 65 |
+
|
| 66 |
+
## Model Details
|
| 67 |
+
|
| 68 |
+
- **Pose estimator**: ViT backbone with direct 6D pose regression (rotation matrix + translation vector). Uses 6D continuous rotation representation with Gram-Schmidt orthogonalization.
|
| 69 |
+
- **Object detector**: LW-DETR (Lightweight DETR) fine-tuned from COCO-pretrained weights for single-class spacecraft detection. Provides bounding boxes as preprocessing for the pose estimator.
|
| 70 |
+
|
| 71 |
+
## Citation
|
| 72 |
+
|
| 73 |
+
```bibtex
|
| 74 |
+
@InProceedings{Ancey_2026_WACV,
|
| 75 |
+
author = {Ancey, Pierre and Price, Andrew and Javed, Saqib and Salzmann, Mathieu},
|
| 76 |
+
title = {FastPose-ViT: A Vision Transformer for Real-Time Spacecraft Pose Estimation},
|
| 77 |
+
booktitle = {Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision (WACV)},
|
| 78 |
+
month = {March},
|
| 79 |
+
year = {2026},
|
| 80 |
+
pages = {7873-7882}
|
| 81 |
+
}
|
| 82 |
+
```
|
| 83 |
+
|
| 84 |
+
## License
|
| 85 |
+
|
| 86 |
+
MIT License. See the [repository](https://github.com/PierreAncey/FastPose-ViT) for details.
|