saja003 commited on
Commit
e4bf2b1
Β·
verified Β·
1 Parent(s): 54f807f

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +27 -19
README.md CHANGED
@@ -1,35 +1,43 @@
1
- # πŸ–ΌοΈ MuniVis - Multilingual Image Captioning
2
 
3
- **MuniVis** is a powerful image captioning application built using the BLIP (Bootstrapped Language-Image Pretraining) model fine-tuned on custom data. It provides image descriptions in both **English** and **Arabic**, making it suitable for multilingual applications, accessibility tools, and urban scene understanding.
4
 
5
- ## πŸ” What It Does
6
 
7
- - Generates English image captions using a fine-tuned BLIP model.
8
- - Automatically translates captions into Arabic using MarianMT (English β†’ Arabic).
9
- - Provides a simple web interface powered by [Gradio](https://gradio.app/).
10
 
11
- ## πŸš€ Demo
 
 
 
12
 
13
- Try it on [Hugging Face Spaces](https://huggingface.co/spaces/saja003/MuniVis)!
14
 
15
- ## πŸ“· How to Use
16
 
17
  1. Upload an image.
18
- 2. Choose your preferred language (English or Arabic).
19
- 3. The model will analyze the image and generate a meaningful description.
 
20
 
21
- ## 🧠 Model Information
22
 
23
- - **Image Captioning Backbone**: `BLIP (Salesforce/blip-image-captioning-base)`
24
- - **Translation Model**: `Helsinki-NLP/opus-mt-en-ar`
25
- - **Custom Fine-Tuned Model**: [`saja003/MuniVis`](https://huggingface.co/saja003/MuniVis)
26
 
27
- ## πŸ“¦ Requirements
 
 
 
 
28
 
29
- This app runs on the following Python packages:
30
 
31
- ```txt
32
- torch
 
 
 
33
  transformers
 
34
  gradio
35
  Pillow
 
1
+ # πŸ›£οΈ Street Descriptions using MuniVis Model
2
 
3
+ This Space provides a simple Gradio interface for generating image captions using a fine-tuned BLIP model hosted at [`saja003/MuniVis`](https://huggingface.co/saja003/MuniVis). It also includes the option to translate the generated English captions into Arabic using a MarianMT translation model.
4
 
5
+ ---
6
 
7
+ ## πŸ” Features
 
 
8
 
9
+ - 🧠 Image captioning with a fine-tuned BLIP model.
10
+ - 🌐 Language selection: English or Arabic.
11
+ - πŸ“Έ Upload any street or urban image to generate a descriptive caption.
12
+ - πŸ€– Translation powered by [Helsinki-NLP/opus-mt-en-ar](https://huggingface.co/Helsinki-NLP/opus-mt-en-ar).
13
 
14
+ ---
15
 
16
+ ## πŸš€ How it works
17
 
18
  1. Upload an image.
19
+ 2. Select a language (English or Arabic).
20
+ 3. Receive a descriptive caption of the scene.
21
+ - If Arabic is selected, the caption is translated automatically.
22
 
23
+ ---
24
 
25
+ ## 🧠 Models Used
 
 
26
 
27
+ - **BLIP (Bootstrapping Language Image Pretraining):**
28
+ - Fine-tuned on street and infrastructure images.
29
+ - Model repo: [`saja003/MuniVis`](https://huggingface.co/saja003/MuniVis)
30
+ - **MarianMT Translation Model:**
31
+ - [`Helsinki-NLP/opus-mt-en-ar`](https://huggingface.co/Helsinki-NLP/opus-mt-en-ar) for English to Arabic translation.
32
 
33
+ ---
34
 
35
+ ## πŸ› οΈ Requirements
36
+
37
+ This Space uses the following libraries:
38
+
39
+ ```bash
40
  transformers
41
+ torch
42
  gradio
43
  Pillow