--- title: dAIso - Semiconductor Defect Detection emoji: πŸ”¬ colorFrom: blue colorTo: green sdk: gradio sdk_version: 4.36.1 python_version: "3.10" app_file: app.py pinned: false license: mit --- # dAIso - Semiconductor Defect Detection Demo **Agent V10: YOLO + Two-Stage GPT-4o Pipeline** This is an interactive demo showcasing the semiconductor defect detection system developed for the Hyundai NGV AI Agent Hackathon 2026. ## Features ### 1. Dashboard - Overall analysis statistics - Classification distribution (Normal vs Abnormal) - Defect type breakdown - Performance metrics ### 2. Inspection Results - Individual image analysis details - YOLO detection results (holes, leads, body) - Stage 1: GPT-4o visual observations - Stage 2: Decision making and defect scoring - Recheck information ### 3. Visualizations - Classification pie charts - Defect type bar charts - Confidence score distributions - Processing time analysis - YOLO detection performance ### 4. AI Assistant (Chatbot) Ask questions about the analysis results in Korean or English: - "전체 뢄석 μš”μ•½ν•΄μ€˜" - "μ–΄λ–€ 결함이 κ°€μž₯ λ§Žμ•„?" - "DEV_005 κ²°κ³Ό μ•Œλ €μ€˜" - "YOLO 탐지 μ„±λŠ₯은?" ## Pipeline Architecture ``` Image Input β”‚ β–Ό β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β” β”‚ Stage 0: YOLO β”‚ β†’ Component Detection β”‚ (Roboflow API) β”‚ β†’ Bounding boxes β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜ β”‚ β–Ό β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β” β”‚ Stage 1: GPT-4o β”‚ β†’ Visual Observation β”‚ (Observation) β”‚ β†’ Body/Lead analysis β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜ β”‚ β–Ό β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β” β”‚ Stage 2: GPT-4o β”‚ β†’ Defect scoring β”‚ (Decision) β”‚ β†’ Classification β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜ β”‚ β–Ό β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β” β”‚ Conditional β”‚ β†’ Confidence check β”‚ Recheck β”‚ β†’ Weighted voting β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜ ``` ## Tech Stack - **LLM**: GPT-4o (via Luxia Cloud Bridge API) - **Object Detection**: Roboflow Workflow API - **UI**: Gradio - **Visualization**: Matplotlib ## Team - Dong-Hyeon Lim - Munkyeong Suh --- Hyundai NGV AI Agent Hackathon 2026