Martin Tomov
commited on
Update README.md
Browse files
README.md
CHANGED
|
@@ -1,26 +1,22 @@
|
|
| 1 |
---
|
| 2 |
license: apache-2.0
|
| 3 |
-
pinned: true
|
| 4 |
---
|
| 5 |
|
| 6 |
# InsectSAM: Insect Segmentation and Monitoring
|
| 7 |
|
| 8 |
-
|
| 9 |
-
<a href="" rel="noopener">
|
| 10 |
-
<img width=200px height=200px src="https://i.imgur.com/hjWgAN9.png alt="Project logo"></a>
|
| 11 |
-
</p>
|
| 12 |
|
| 13 |
## Overview
|
| 14 |
|
| 15 |
-
InsectSAM is
|
| 16 |
|
| 17 |
## Purpose
|
| 18 |
|
| 19 |
-
|
| 20 |
|
| 21 |
## Model Architecture
|
| 22 |
|
| 23 |
-
|
| 24 |
|
| 25 |
## Quick Start
|
| 26 |
|
|
@@ -33,12 +29,13 @@ InsectSAM utilizes the advanced capabilities of the `segment-anything` architect
|
|
| 33 |
### Usage
|
| 34 |
|
| 35 |
#### Install
|
| 36 |
-
```
|
| 37 |
!pip install --upgrade -q git+https://github.com/huggingface/transformers
|
| 38 |
!pip install torch
|
| 39 |
```
|
| 40 |
-
|
| 41 |
-
|
|
|
|
| 42 |
from transformers import AutoProcessor, AutoModelForMaskGeneration
|
| 43 |
|
| 44 |
processor = AutoProcessor.from_pretrained("martintmv/InsectSAM")
|
|
@@ -47,10 +44,9 @@ model = AutoModelForMaskGeneration.from_pretrained("martintmv/InsectSAM")
|
|
| 47 |
|
| 48 |
### Notebooks
|
| 49 |
|
| 50 |
-
|
| 51 |
-
|
| 52 |
-
- **InsectSAM.ipynb
|
| 53 |
-
- **
|
| 54 |
-
- **Run_InsectSAM_Inference_Transformers.ipynb**: Run InsectSAM using Transformers.
|
| 55 |
|
| 56 |
-
|
|
|
|
| 1 |
---
|
| 2 |
license: apache-2.0
|
|
|
|
| 3 |
---
|
| 4 |
|
| 5 |
# InsectSAM: Insect Segmentation and Monitoring
|
| 6 |
|
| 7 |
+

|
|
|
|
|
|
|
|
|
|
| 8 |
|
| 9 |
## Overview
|
| 10 |
|
| 11 |
+
InsectSAM is a fine-tuned version of Meta AI's `segment-anything` model, optimized for insect segmentation and monitoring in the Netherlands. Designed for use with the [DIOPSIS](https://diopsis.eu) camera systems, algorithms and datasets, it enhances the accuracy of insect biodiversity segmentation from complex backgrounds.
|
| 12 |
|
| 13 |
## Purpose
|
| 14 |
|
| 15 |
+
Trained to segment insects against diverse backgrounds, InsectSAM adapts to changing environments, ensuring its long-term utility for the DIOPSIS datasets.
|
| 16 |
|
| 17 |
## Model Architecture
|
| 18 |
|
| 19 |
+
Built on the `segment-anything` architecture, InsectSAM is fine-tuned on an insect-specific dataset and integrated with GroundingDINO for improved detail recognition.
|
| 20 |
|
| 21 |
## Quick Start
|
| 22 |
|
|
|
|
| 29 |
### Usage
|
| 30 |
|
| 31 |
#### Install
|
| 32 |
+
```bash
|
| 33 |
!pip install --upgrade -q git+https://github.com/huggingface/transformers
|
| 34 |
!pip install torch
|
| 35 |
```
|
| 36 |
+
|
| 37 |
+
#### Load model via 🤗 Transformers
|
| 38 |
+
```python
|
| 39 |
from transformers import AutoProcessor, AutoModelForMaskGeneration
|
| 40 |
|
| 41 |
processor = AutoProcessor.from_pretrained("martintmv/InsectSAM")
|
|
|
|
| 44 |
|
| 45 |
### Notebooks
|
| 46 |
|
| 47 |
+
Explore InsectSAM's capabilities and integration with GroundingDINO through three Jupyter notebooks available on the RB-IBDM GitHub page:
|
| 48 |
+
- [**InsectSAM.ipynb**](https://github.com/martintmv-git/RB-IBDM/blob/main/InsectSAM/InsectSAM.ipynb): Training process
|
| 49 |
+
- [**InsectSAM_GroundingDINO.ipynb**](https://github.com/martintmv-git/RB-IBDM/blob/main/InsectSAM/InsectSAM_GroundingDINO.ipynb): Enhanced segmentation performance with GroundingDINO
|
| 50 |
+
- [**InsectSAM_script.ipynb**](https://github.com/martintmv-git/RB-IBDM/tree/main/Image%20Processing%20Scripts/InsectSAM): Image processing script
|
|
|
|
| 51 |
|
| 52 |
+
GitHub: https://github.com/martintmv-git/RB-IBDM/tree/main/InsectSAM
|