π Update README to reflect Civil Engineering QC focus
Browse files
README.md
CHANGED
|
@@ -1,6 +1,6 @@
|
|
| 1 |
---
|
| 2 |
title: ForgeSight
|
| 3 |
-
emoji:
|
| 4 |
colorFrom: red
|
| 5 |
colorTo: gray
|
| 6 |
sdk: gradio
|
|
@@ -8,28 +8,29 @@ sdk_version: 5.29.1
|
|
| 8 |
app_file: app.py
|
| 9 |
pinned: true
|
| 10 |
license: mit
|
| 11 |
-
short_description: "Multimodal QC Copilot on AMD MI300X + ROCm"
|
| 12 |
tags:
|
| 13 |
- amd
|
| 14 |
- rocm
|
| 15 |
- mi300x
|
| 16 |
- qwen
|
| 17 |
- vllm
|
|
|
|
| 18 |
- quality-control
|
| 19 |
- agents
|
| 20 |
---
|
| 21 |
|
| 22 |
-
#
|
| 23 |
|
| 24 |
-
ForgeSight is a production-ready **Agentic Quality Control (QC) Pipeline** designed for
|
| 25 |
|
| 26 |
## π Key Features
|
| 27 |
|
| 28 |
-
* **Multimodal Reasoning**: Uses **Qwen2-VL-7B** to "see" and understand complex
|
| 29 |
* **4-Agent Pipeline**: Chained reasoning workflow:
|
| 30 |
-
1. **Inspector** β Identifies
|
| 31 |
2. **Diagnostician** β Performs industry-literate root-cause analysis.
|
| 32 |
-
3. **Action** β Generates prioritized work orders and tool checklists.
|
| 33 |
4. **Reporter** β Summarizes findings into human-readable executive reports.
|
| 34 |
* **MI300X Optimized**: Served via **vLLM on ROCm**, utilizing continuous batching and paged attention for near-instant inference.
|
| 35 |
* **Audit-Ready**: Generates downloadable **PDF QC Audit Reports** for every inspection.
|
|
@@ -57,13 +58,13 @@ graph TD
|
|
| 57 |
|
| 58 |
## π οΈ Installation & Setup
|
| 59 |
|
| 60 |
-
1. **Clone the Repo**: `git clone https://
|
| 61 |
2. **Install Deps**: `pip install -r requirements.txt`
|
| 62 |
3. **Configure Environment**: Set `AMD_INFERENCE_URL` and `AMD_INFERENCE_TOKEN` in your `.env`.
|
| 63 |
-
4. **Launch**: `python
|
| 64 |
|
| 65 |
## π Performance on AMD
|
| 66 |
-
The MI300X's 5.3 TB/s bandwidth allows ForgeSight to maintain **>2500 tokens/sec** throughput, enabling real-time visual inspection of
|
| 67 |
|
| 68 |
---
|
| 69 |
Built by **Hans** for the **AMD Developer Hackathon**.
|
|
|
|
| 1 |
---
|
| 2 |
title: ForgeSight
|
| 3 |
+
emoji: ποΈ
|
| 4 |
colorFrom: red
|
| 5 |
colorTo: gray
|
| 6 |
sdk: gradio
|
|
|
|
| 8 |
app_file: app.py
|
| 9 |
pinned: true
|
| 10 |
license: mit
|
| 11 |
+
short_description: "Multimodal Civil QC Copilot on AMD MI300X + ROCm"
|
| 12 |
tags:
|
| 13 |
- amd
|
| 14 |
- rocm
|
| 15 |
- mi300x
|
| 16 |
- qwen
|
| 17 |
- vllm
|
| 18 |
+
- civil-engineering
|
| 19 |
- quality-control
|
| 20 |
- agents
|
| 21 |
---
|
| 22 |
|
| 23 |
+
# ποΈ ForgeSight β Multimodal QC Copilot on AMD Instinctβ’ MI300X
|
| 24 |
|
| 25 |
+
ForgeSight is a production-ready **Agentic Quality Control (QC) Pipeline** designed for civil engineering, construction, and infrastructure projects. Built exclusively for the **AMD + lablab.ai Developer Hackathon**, it leverages the massive 192GB VRAM of the **AMD Instinct MI300X** to run a state-of-the-art multimodal multi-agent workflow.
|
| 26 |
|
| 27 |
## π Key Features
|
| 28 |
|
| 29 |
+
* **Multimodal Reasoning**: Uses **Qwen2-VL-7B** to "see" and understand complex structural defects, safety hazards, and code violations across construction sites, roads, and housing in a single forward pass.
|
| 30 |
* **4-Agent Pipeline**: Chained reasoning workflow:
|
| 31 |
+
1. **Inspector** β Identifies structural anomalies and safety violations.
|
| 32 |
2. **Diagnostician** β Performs industry-literate root-cause analysis.
|
| 33 |
+
3. **Action** β Generates prioritized work orders and tool checklists for site engineers.
|
| 34 |
4. **Reporter** β Summarizes findings into human-readable executive reports.
|
| 35 |
* **MI300X Optimized**: Served via **vLLM on ROCm**, utilizing continuous batching and paged attention for near-instant inference.
|
| 36 |
* **Audit-Ready**: Generates downloadable **PDF QC Audit Reports** for every inspection.
|
|
|
|
| 58 |
|
| 59 |
## π οΈ Installation & Setup
|
| 60 |
|
| 61 |
+
1. **Clone the Repo**: `git clone https://huggingface.co/spaces/lablab-ai-amd-developer-hackathon/ForgeSight`
|
| 62 |
2. **Install Deps**: `pip install -r requirements.txt`
|
| 63 |
3. **Configure Environment**: Set `AMD_INFERENCE_URL` and `AMD_INFERENCE_TOKEN` in your `.env`.
|
| 64 |
+
4. **Launch**: `python app.py`
|
| 65 |
|
| 66 |
## π Performance on AMD
|
| 67 |
+
The MI300X's 5.3 TB/s bandwidth allows ForgeSight to maintain **>2500 tokens/sec** throughput, enabling real-time visual inspection of massive infrastructure projects without the latency typical of cloud-based VLM APIs.
|
| 68 |
|
| 69 |
---
|
| 70 |
Built by **Hans** for the **AMD Developer Hackathon**.
|