Zhong
commited on
Update README.md
Browse files
README.md
CHANGED
|
@@ -1,10 +1,56 @@
|
|
| 1 |
---
|
| 2 |
license: apache-2.0
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 3 |
datasets:
|
| 4 |
- Zgogo0/simData-Dataset
|
| 5 |
-
|
| 6 |
-
- en
|
| 7 |
-
base_model:
|
| 8 |
-
- ANIYA673/bevformer
|
| 9 |
pipeline_tag: object-detection
|
| 10 |
-
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
---
|
| 2 |
license: apache-2.0
|
| 3 |
+
tags:
|
| 4 |
+
- autonomous-driving
|
| 5 |
+
- perception
|
| 6 |
+
- bevformer
|
| 7 |
+
- 3d-object-detection
|
| 8 |
+
- pytorch
|
| 9 |
+
- synthetic-data
|
| 10 |
datasets:
|
| 11 |
- Zgogo0/simData-Dataset
|
| 12 |
+
library_name: pytorch
|
|
|
|
|
|
|
|
|
|
| 13 |
pipeline_tag: object-detection
|
| 14 |
+
---
|
| 15 |
+
|
| 16 |
+
# BEVFormer-Tiny (Trained on SimData)
|
| 17 |
+
|
| 18 |
+
## Model Description
|
| 19 |
+
|
| 20 |
+
This repository contains model weights for **BEVFormer-tiny**, a camera-only 3D object detection model. These weights have been trained or fine-tuned on the synthetic **SimData dataset** (a NuScenes-format synthetic dataset containing Highway, Urban, and Parking scenarios).
|
| 21 |
+
|
| 22 |
+
- **Architecture**: BEVFormer (Tiny variant)
|
| 23 |
+
- **Input Modality**: Multi-view Camera (6 cameras)
|
| 24 |
+
- **Training Data**: [SimData-Dataset](https://huggingface.co/datasets/Zgogo0/simData-Dataset)
|
| 25 |
+
- **Framework**: PyTorch / MMDetection3D
|
| 26 |
+
|
| 27 |
+
## Model Zoo / Checkpoints
|
| 28 |
+
|
| 29 |
+
This repository provides three different variations of the trained model. Please select the weight file that best suits your testing needs.
|
| 30 |
+
|
| 31 |
+
| File Name | Training Strategy | Epochs | Description |
|
| 32 |
+
| :--- | :--- | :--- | :--- |
|
| 33 |
+
| **`epoch_24.pth`** | **Train from Scratch** | 24 | Trained directly on the SimData dataset from scratch for 24 epochs. |
|
| 34 |
+
| **`epoch_30.pth`** | **Train from Scratch** | 30 | Trained directly on the SimData dataset from scratch for 30 epochs (longer training schedule). |
|
| 35 |
+
| **`use_predcheckout_train_on_simdata.pth`** | **Fine-tuning (Transfer Learning)** | 24 | **Recommended**. Initialized from a model pre-trained on real-world NuScenes data (`bevformer_tiny_epoch_24.pth`), then fine-tuned on the SimData dataset for an additional 24 epochs. This model usually exhibits better convergence and domain adaptation capabilities. |
|
| 36 |
+
|
| 37 |
+
*(Note: If your file for the 30-epoch run is named differently, please check the file list in the 'Files' tab, but the logic remains as described above.)*
|
| 38 |
+
|
| 39 |
+
## How to Use
|
| 40 |
+
|
| 41 |
+
Since BEVFormer is a custom architecture based on `mmdetection3d`, you cannot load it directly using `AutoModel`. You need to use the original BEVFormer codebase and load these weights manually.
|
| 42 |
+
|
| 43 |
+
### 1. Download Weights
|
| 44 |
+
You can download the specific weight file using the `huggingface_hub` python library.
|
| 45 |
+
|
| 46 |
+
```python
|
| 47 |
+
from huggingface_hub import hf_hub_download
|
| 48 |
+
|
| 49 |
+
# Define the repository and the specific file you want
|
| 50 |
+
repo_id = "Zgogo0/Bevformer_Simdata" # Replace with your actual Repo ID
|
| 51 |
+
|
| 52 |
+
# Example: Downloading the fine-tuned model
|
| 53 |
+
filename = "use_predcheckout_train_on_simdata.pth"
|
| 54 |
+
|
| 55 |
+
checkpoint_path = hf_hub_download(repo_id=repo_id, filename=filename)
|
| 56 |
+
print(f"Model downloaded to: {checkpoint_path}")
|