Spaces:
Runtime error
Runtime error
File size: 1,408 Bytes
7d48082 b9e2109 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 | ---
title: Oculus UI Element Detector
emoji: 🔍
colorFrom: blue
colorTo: purple
sdk: gradio
sdk_version: 4.21.0
app_file: app.py
pinned: false
license: mit
---
# Oculus UI Element Detector
This application detects UI elements in screenshots and annotates them with bounding boxes and text labels.
## Features
- Text detection using OCR
- UI element detection using YOLOv8
- Element code assignment
- Image annotation with bounding boxes
- Arrow annotations for clarity
## Usage
1. **Upload Screenshot**
- Upload a screenshot to detect UI elements
- The app will process the image and return an annotated version with detected elements
2. **Use Data URI**
- Alternatively, paste an image data URI
- Useful for integration with other applications
## API Access
This app also exposes an API for programmatic access:
```python
import gradio as gr
# Connect to the Space
client = gr.Client("https://shanurrahman-oculus-ui-detector.hf.space")
# Process an image
result = client.predict(
"data:image/png;base64,...", # your image data URI
api_name="/process_image_data_uri"
)
```
## Output Format
The app returns:
1. An annotated image with bounding boxes
2. A text representation of detected elements with their positions and content
## Technologies Used
- EasyOCR for text detection
- YOLOv8 for object detection
- Gradio for the user interface
- FastAPI for the backend API |