dAIso / README.md
happyquokka's picture
Fix: use Gradio 4.36.1 with pinned huggingface_hub
c566aa4

A newer version of the Gradio SDK is available: 6.5.1

Upgrade
metadata
title: dAIso - Semiconductor Defect Detection
emoji: πŸ”¬
colorFrom: blue
colorTo: green
sdk: gradio
sdk_version: 4.36.1
python_version: '3.10'
app_file: app.py
pinned: false
license: mit

dAIso - Semiconductor Defect Detection Demo

Agent V10: YOLO + Two-Stage GPT-4o Pipeline

This is an interactive demo showcasing the semiconductor defect detection system developed for the Hyundai NGV AI Agent Hackathon 2026.

Features

1. Dashboard

  • Overall analysis statistics
  • Classification distribution (Normal vs Abnormal)
  • Defect type breakdown
  • Performance metrics

2. Inspection Results

  • Individual image analysis details
  • YOLO detection results (holes, leads, body)
  • Stage 1: GPT-4o visual observations
  • Stage 2: Decision making and defect scoring
  • Recheck information

3. Visualizations

  • Classification pie charts
  • Defect type bar charts
  • Confidence score distributions
  • Processing time analysis
  • YOLO detection performance

4. AI Assistant (Chatbot)

Ask questions about the analysis results in Korean or English:

  • "전체 뢄석 μš”μ•½ν•΄μ€˜"
  • "μ–΄λ–€ 결함이 κ°€μž₯ λ§Žμ•„?"
  • "DEV_005 κ²°κ³Ό μ•Œλ €μ€˜"
  • "YOLO 탐지 μ„±λŠ₯은?"

Pipeline Architecture

Image Input
    β”‚
    β–Ό
β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
β”‚  Stage 0: YOLO      β”‚  β†’ Component Detection
β”‚  (Roboflow API)     β”‚  β†’ Bounding boxes
β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜
    β”‚
    β–Ό
β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
β”‚  Stage 1: GPT-4o    β”‚  β†’ Visual Observation
β”‚  (Observation)      β”‚  β†’ Body/Lead analysis
β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜
    β”‚
    β–Ό
β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
β”‚  Stage 2: GPT-4o    β”‚  β†’ Defect scoring
β”‚  (Decision)         β”‚  β†’ Classification
β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜
    β”‚
    β–Ό
β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
β”‚  Conditional        β”‚  β†’ Confidence check
β”‚  Recheck            β”‚  β†’ Weighted voting
β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜

Tech Stack

  • LLM: GPT-4o (via Luxia Cloud Bridge API)
  • Object Detection: Roboflow Workflow API
  • UI: Gradio
  • Visualization: Matplotlib

Team

  • Dong-Hyeon Lim
  • Munkyeong Suh

Hyundai NGV AI Agent Hackathon 2026