Update README.md
Browse files
README.md
CHANGED
|
@@ -1,35 +1,43 @@
|
|
| 1 |
-
#
|
| 2 |
|
| 3 |
-
|
| 4 |
|
| 5 |
-
|
| 6 |
|
| 7 |
-
|
| 8 |
-
- Automatically translates captions into Arabic using MarianMT (English β Arabic).
|
| 9 |
-
- Provides a simple web interface powered by [Gradio](https://gradio.app/).
|
| 10 |
|
| 11 |
-
|
|
|
|
|
|
|
|
|
|
| 12 |
|
| 13 |
-
|
| 14 |
|
| 15 |
-
##
|
| 16 |
|
| 17 |
1. Upload an image.
|
| 18 |
-
2.
|
| 19 |
-
3.
|
|
|
|
| 20 |
|
| 21 |
-
|
| 22 |
|
| 23 |
-
|
| 24 |
-
- **Translation Model**: `Helsinki-NLP/opus-mt-en-ar`
|
| 25 |
-
- **Custom Fine-Tuned Model**: [`saja003/MuniVis`](https://huggingface.co/saja003/MuniVis)
|
| 26 |
|
| 27 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
| 28 |
|
| 29 |
-
|
| 30 |
|
| 31 |
-
|
| 32 |
-
|
|
|
|
|
|
|
|
|
|
| 33 |
transformers
|
|
|
|
| 34 |
gradio
|
| 35 |
Pillow
|
|
|
|
| 1 |
+
# π£οΈ Street Descriptions using MuniVis Model
|
| 2 |
|
| 3 |
+
This Space provides a simple Gradio interface for generating image captions using a fine-tuned BLIP model hosted at [`saja003/MuniVis`](https://huggingface.co/saja003/MuniVis). It also includes the option to translate the generated English captions into Arabic using a MarianMT translation model.
|
| 4 |
|
| 5 |
+
---
|
| 6 |
|
| 7 |
+
## π Features
|
|
|
|
|
|
|
| 8 |
|
| 9 |
+
- π§ Image captioning with a fine-tuned BLIP model.
|
| 10 |
+
- π Language selection: English or Arabic.
|
| 11 |
+
- πΈ Upload any street or urban image to generate a descriptive caption.
|
| 12 |
+
- π€ Translation powered by [Helsinki-NLP/opus-mt-en-ar](https://huggingface.co/Helsinki-NLP/opus-mt-en-ar).
|
| 13 |
|
| 14 |
+
---
|
| 15 |
|
| 16 |
+
## π How it works
|
| 17 |
|
| 18 |
1. Upload an image.
|
| 19 |
+
2. Select a language (English or Arabic).
|
| 20 |
+
3. Receive a descriptive caption of the scene.
|
| 21 |
+
- If Arabic is selected, the caption is translated automatically.
|
| 22 |
|
| 23 |
+
---
|
| 24 |
|
| 25 |
+
## π§ Models Used
|
|
|
|
|
|
|
| 26 |
|
| 27 |
+
- **BLIP (Bootstrapping Language Image Pretraining):**
|
| 28 |
+
- Fine-tuned on street and infrastructure images.
|
| 29 |
+
- Model repo: [`saja003/MuniVis`](https://huggingface.co/saja003/MuniVis)
|
| 30 |
+
- **MarianMT Translation Model:**
|
| 31 |
+
- [`Helsinki-NLP/opus-mt-en-ar`](https://huggingface.co/Helsinki-NLP/opus-mt-en-ar) for English to Arabic translation.
|
| 32 |
|
| 33 |
+
---
|
| 34 |
|
| 35 |
+
## π οΈ Requirements
|
| 36 |
+
|
| 37 |
+
This Space uses the following libraries:
|
| 38 |
+
|
| 39 |
+
```bash
|
| 40 |
transformers
|
| 41 |
+
torch
|
| 42 |
gradio
|
| 43 |
Pillow
|