dAIso / README.md
happyquokka's picture
Fix: use Gradio 4.36.1 with pinned huggingface_hub
c566aa4
---
title: dAIso - Semiconductor Defect Detection
emoji: πŸ”¬
colorFrom: blue
colorTo: green
sdk: gradio
sdk_version: 4.36.1
python_version: "3.10"
app_file: app.py
pinned: false
license: mit
---
# dAIso - Semiconductor Defect Detection Demo
**Agent V10: YOLO + Two-Stage GPT-4o Pipeline**
This is an interactive demo showcasing the semiconductor defect detection system developed for the Hyundai NGV AI Agent Hackathon 2026.
## Features
### 1. Dashboard
- Overall analysis statistics
- Classification distribution (Normal vs Abnormal)
- Defect type breakdown
- Performance metrics
### 2. Inspection Results
- Individual image analysis details
- YOLO detection results (holes, leads, body)
- Stage 1: GPT-4o visual observations
- Stage 2: Decision making and defect scoring
- Recheck information
### 3. Visualizations
- Classification pie charts
- Defect type bar charts
- Confidence score distributions
- Processing time analysis
- YOLO detection performance
### 4. AI Assistant (Chatbot)
Ask questions about the analysis results in Korean or English:
- "전체 뢄석 μš”μ•½ν•΄μ€˜"
- "μ–΄λ–€ 결함이 κ°€μž₯ λ§Žμ•„?"
- "DEV_005 κ²°κ³Ό μ•Œλ €μ€˜"
- "YOLO 탐지 μ„±λŠ₯은?"
## Pipeline Architecture
```
Image Input
β”‚
β–Ό
β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
β”‚ Stage 0: YOLO β”‚ β†’ Component Detection
β”‚ (Roboflow API) β”‚ β†’ Bounding boxes
β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜
β”‚
β–Ό
β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
β”‚ Stage 1: GPT-4o β”‚ β†’ Visual Observation
β”‚ (Observation) β”‚ β†’ Body/Lead analysis
β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜
β”‚
β–Ό
β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
β”‚ Stage 2: GPT-4o β”‚ β†’ Defect scoring
β”‚ (Decision) β”‚ β†’ Classification
β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜
β”‚
β–Ό
β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
β”‚ Conditional β”‚ β†’ Confidence check
β”‚ Recheck β”‚ β†’ Weighted voting
β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜
```
## Tech Stack
- **LLM**: GPT-4o (via Luxia Cloud Bridge API)
- **Object Detection**: Roboflow Workflow API
- **UI**: Gradio
- **Visualization**: Matplotlib
## Team
- Dong-Hyeon Lim
- Munkyeong Suh
---
Hyundai NGV AI Agent Hackathon 2026