rasAli02 commited on
Commit
d5d627a
Β·
1 Parent(s): acb3a4f

πŸ“ Update README to reflect Civil Engineering QC focus

Browse files
Files changed (1) hide show
  1. README.md +11 -10
README.md CHANGED
@@ -1,6 +1,6 @@
1
  ---
2
  title: ForgeSight
3
- emoji: πŸ”
4
  colorFrom: red
5
  colorTo: gray
6
  sdk: gradio
@@ -8,28 +8,29 @@ sdk_version: 5.29.1
8
  app_file: app.py
9
  pinned: true
10
  license: mit
11
- short_description: "Multimodal QC Copilot on AMD MI300X + ROCm"
12
  tags:
13
  - amd
14
  - rocm
15
  - mi300x
16
  - qwen
17
  - vllm
 
18
  - quality-control
19
  - agents
20
  ---
21
 
22
- # πŸ” ForgeSight β€” Multimodal QC Copilot on AMD Instinctβ„’ MI300X
23
 
24
- ForgeSight is a production-ready **Agentic Quality Control (QC) Pipeline** designed for high-throughput manufacturing environments. Built exclusively for the **AMD + lablab.ai Developer Hackathon**, it leverages the massive 192GB VRAM of the **AMD Instinct MI300X** to run a state-of-the-art multimodal multi-agent workflow.
25
 
26
  ## πŸš€ Key Features
27
 
28
- * **Multimodal Reasoning**: Uses **Qwen2-VL-7B** to "see" and understand complex assembly line defects in a single forward pass.
29
  * **4-Agent Pipeline**: Chained reasoning workflow:
30
- 1. **Inspector** β€” Identifies surface defects, anomalies, and violations.
31
  2. **Diagnostician** β€” Performs industry-literate root-cause analysis.
32
- 3. **Action** β€” Generates prioritized work orders and tool checklists.
33
  4. **Reporter** β€” Summarizes findings into human-readable executive reports.
34
  * **MI300X Optimized**: Served via **vLLM on ROCm**, utilizing continuous batching and paged attention for near-instant inference.
35
  * **Audit-Ready**: Generates downloadable **PDF QC Audit Reports** for every inspection.
@@ -57,13 +58,13 @@ graph TD
57
 
58
  ## πŸ› οΈ Installation & Setup
59
 
60
- 1. **Clone the Repo**: `git clone https://github.com/rasali535/hans.git`
61
  2. **Install Deps**: `pip install -r requirements.txt`
62
  3. **Configure Environment**: Set `AMD_INFERENCE_URL` and `AMD_INFERENCE_TOKEN` in your `.env`.
63
- 4. **Launch**: `python hf_space/app.py`
64
 
65
  ## πŸ“Š Performance on AMD
66
- The MI300X's 5.3 TB/s bandwidth allows ForgeSight to maintain **>2500 tokens/sec** throughput, enabling real-time visual inspection of high-speed manufacturing lines without the latency typical of cloud-based VLM APIs.
67
 
68
  ---
69
  Built by **Hans** for the **AMD Developer Hackathon**.
 
1
  ---
2
  title: ForgeSight
3
+ emoji: πŸ—οΈ
4
  colorFrom: red
5
  colorTo: gray
6
  sdk: gradio
 
8
  app_file: app.py
9
  pinned: true
10
  license: mit
11
+ short_description: "Multimodal Civil QC Copilot on AMD MI300X + ROCm"
12
  tags:
13
  - amd
14
  - rocm
15
  - mi300x
16
  - qwen
17
  - vllm
18
+ - civil-engineering
19
  - quality-control
20
  - agents
21
  ---
22
 
23
+ # πŸ—οΈ ForgeSight β€” Multimodal QC Copilot on AMD Instinctβ„’ MI300X
24
 
25
+ ForgeSight is a production-ready **Agentic Quality Control (QC) Pipeline** designed for civil engineering, construction, and infrastructure projects. Built exclusively for the **AMD + lablab.ai Developer Hackathon**, it leverages the massive 192GB VRAM of the **AMD Instinct MI300X** to run a state-of-the-art multimodal multi-agent workflow.
26
 
27
  ## πŸš€ Key Features
28
 
29
+ * **Multimodal Reasoning**: Uses **Qwen2-VL-7B** to "see" and understand complex structural defects, safety hazards, and code violations across construction sites, roads, and housing in a single forward pass.
30
  * **4-Agent Pipeline**: Chained reasoning workflow:
31
+ 1. **Inspector** β€” Identifies structural anomalies and safety violations.
32
  2. **Diagnostician** β€” Performs industry-literate root-cause analysis.
33
+ 3. **Action** β€” Generates prioritized work orders and tool checklists for site engineers.
34
  4. **Reporter** β€” Summarizes findings into human-readable executive reports.
35
  * **MI300X Optimized**: Served via **vLLM on ROCm**, utilizing continuous batching and paged attention for near-instant inference.
36
  * **Audit-Ready**: Generates downloadable **PDF QC Audit Reports** for every inspection.
 
58
 
59
  ## πŸ› οΈ Installation & Setup
60
 
61
+ 1. **Clone the Repo**: `git clone https://huggingface.co/spaces/lablab-ai-amd-developer-hackathon/ForgeSight`
62
  2. **Install Deps**: `pip install -r requirements.txt`
63
  3. **Configure Environment**: Set `AMD_INFERENCE_URL` and `AMD_INFERENCE_TOKEN` in your `.env`.
64
+ 4. **Launch**: `python app.py`
65
 
66
  ## πŸ“Š Performance on AMD
67
+ The MI300X's 5.3 TB/s bandwidth allows ForgeSight to maintain **>2500 tokens/sec** throughput, enabling real-time visual inspection of massive infrastructure projects without the latency typical of cloud-based VLM APIs.
68
 
69
  ---
70
  Built by **Hans** for the **AMD Developer Hackathon**.