Update README.md
Browse files
README.md
CHANGED
|
@@ -1,3 +1,69 @@
|
|
| 1 |
-
---
|
| 2 |
-
license: mit
|
| 3 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: mit
|
| 3 |
+
language:
|
| 4 |
+
- en
|
| 5 |
+
base_model:
|
| 6 |
+
- Salesforce/blip-image-captioning-base
|
| 7 |
+
pipeline_tag: image-to-text
|
| 8 |
+
---
|
| 9 |
+
# ๐๏ธ BLIP Image Captioning for Municipality Use (Graduation Project)
|
| 10 |
+
|
| 11 |
+
This is a fine-tuned version of [Salesforce's BLIP base model](https://huggingface.co/Salesforce/blip-image-captioning-base), customized for generating captions on images related to street infrastructure and urban environments.
|
| 12 |
+
The model was developed as part of a **Graduation Project** at the College of Information Systems.
|
| 13 |
+
|
| 14 |
+
---
|
| 15 |
+
|
| 16 |
+
## ๐ Graduation Project Information
|
| 17 |
+
|
| 18 |
+
- **Project Title:** Smart Captioning for Urban Monitoring Using AI
|
| 19 |
+
- **Purpose:** This model aims to assist municipalities in automatically generating descriptive captions for street and infrastructure images using AI.
|
| 20 |
+
|
| 21 |
+
---
|
| 22 |
+
|
| 23 |
+
## ๐ง Model Overview
|
| 24 |
+
|
| 25 |
+
- **Base Model:** [Salesforce/blip-image-captioning-base](https://huggingface.co/Salesforce/blip-image-captioning-base)
|
| 26 |
+
- **Architecture:** BLIP (Bootstrapped Language Image Pretraining)
|
| 27 |
+
- **Task:** Image Captioning (with a focus on municipality-related data)
|
| 28 |
+
|
| 29 |
+
---
|
| 30 |
+
|
| 31 |
+
## ๐๏ธ Dataset
|
| 32 |
+
|
| 33 |
+
This model was fine-tuned on a **custom dataset** consisting of images captured in urban environments (e.g., roads, signs, sidewalks) for the purpose of city infrastructure monitoring.
|
| 34 |
+
|
| 35 |
+
> โ ๏ธ The dataset is not publicly released due to privacy and data ownership considerations.
|
| 36 |
+
|
| 37 |
+
---
|
| 38 |
+
|
| 39 |
+
## โ
Intended Use
|
| 40 |
+
|
| 41 |
+
This model is designed for:
|
| 42 |
+
|
| 43 |
+
- Generating captions for street-level and city infrastructure images.
|
| 44 |
+
- Assisting municipalities in monitoring, analyzing, and documenting visual data.
|
| 45 |
+
|
| 46 |
+
---
|
| 47 |
+
|
| 48 |
+
## โ Limitations
|
| 49 |
+
|
| 50 |
+
- May not generalize well to domains outside of urban/street imagery.
|
| 51 |
+
- Captions might be biased by the dataset or lack context in unfamiliar scenes.
|
| 52 |
+
- Does not include object detection โ focuses on captioning only.
|
| 53 |
+
|
| 54 |
+
---
|
| 55 |
+
|
| 56 |
+
## ๐ License
|
| 57 |
+
|
| 58 |
+
- This model is released under the **MIT License**.
|
| 59 |
+
- It is based on the [Salesforce BLIP model](https://huggingface.co/Salesforce/blip-image-captioning-base), which is licensed under the **BSD-3-Clause License**.
|
| 60 |
+
- Please ensure appropriate credit is given to the original authors when using or redistributing this model.
|
| 61 |
+
|
| 62 |
+
---
|
| 63 |
+
|
| 64 |
+
## ๐ค Acknowledgements
|
| 65 |
+
|
| 66 |
+
- Special thanks to **Salesforce Research** for the original BLIP model.
|
| 67 |
+
- Developed as part of a university graduation project with guidance from faculty members.
|
| 68 |
+
|
| 69 |
+
---
|