Spaces:
Runtime error
Runtime error
Commit ·
bbb543e
1
Parent(s): 16f7cf4
add reports
Browse files
IBM_Hackathon_Report/ibm_ai_tools_usage.md
ADDED
|
@@ -0,0 +1,79 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
# IBM watsonx Usage Report
|
| 2 |
+
|
| 3 |
+
## Overview
|
| 4 |
+
ClaimCheck AI leverages IBM watsonx as the backbone for claim verification.
|
| 5 |
+
The system uses IBM watsonx.ai’s large language models and embedding capabilities to handle:
|
| 6 |
+
1. **Text Retrieval (RAG)**
|
| 7 |
+
2. **Claim Verification**
|
| 8 |
+
3. **Evidence Reranking**
|
| 9 |
+
4. *(Optionally)* IBM Speech-to-Text for transcription.
|
| 10 |
+
|
| 11 |
+
---
|
| 12 |
+
|
| 13 |
+
## Agents & IBM Integration
|
| 14 |
+
|
| 15 |
+
### 1. **Transcriber Agent**
|
| 16 |
+
- **Goal**: Convert audio from Zoom/phone calls to text.
|
| 17 |
+
- **IBM Usage**: Can integrate IBM Speech-to-Text (STT) to provide enterprise-grade transcription accuracy.
|
| 18 |
+
- **Inputs**: WAV/MP3/OGG audio file.
|
| 19 |
+
- **Outputs**: JSON array of `{ speaker, start, end, text }`.
|
| 20 |
+
|
| 21 |
+
---
|
| 22 |
+
|
| 23 |
+
### 2. **Claim Extractor Agent**
|
| 24 |
+
- **Goal**: Identify factual statements in the transcript.
|
| 25 |
+
- **IBM Usage**: Powered by IBM watsonx.ai LLM (Prompt Lab) to output JSON with `{ claim_text, speaker, start, end }`.
|
| 26 |
+
|
| 27 |
+
---
|
| 28 |
+
|
| 29 |
+
### 3. **Retriever Agent**
|
| 30 |
+
- **Goal**: Retrieve relevant knowledge base snippets to support or refute claims.
|
| 31 |
+
- **IBM Usage**:
|
| 32 |
+
- **IBM Text Embeddings**: Generates semantic vector representations of KB snippets and claims.
|
| 33 |
+
- **FAISS Vector Search**: Finds top-K relevant evidence from local index.
|
| 34 |
+
- **IBM Rerank API**: Orders results by relevance.
|
| 35 |
+
- **Benefit**: Reduces false positives in evidence retrieval.
|
| 36 |
+
|
| 37 |
+
---
|
| 38 |
+
|
| 39 |
+
### 4. **Verifier Agent**
|
| 40 |
+
- **Goal**: Cross-check each claim against retrieved evidence.
|
| 41 |
+
- **IBM Usage**: LLM prompt to classify as "Supported", "Contradicted", or "Unverifiable".
|
| 42 |
+
- **Output**: Verdicts with reasoning.
|
| 43 |
+
|
| 44 |
+
---
|
| 45 |
+
|
| 46 |
+
### 5. **Summarizer Agent**
|
| 47 |
+
- **Goal**: Produce final human-readable report.
|
| 48 |
+
- **IBM Usage**: LLM summarization model to combine claims, evidence, and verdicts into structured output.
|
| 49 |
+
|
| 50 |
+
---
|
| 51 |
+
|
| 52 |
+
## Deployment & Scalability
|
| 53 |
+
While deployment is not in the scope of this hackathon, in a production setting:
|
| 54 |
+
- **IBM watsonx.ai models** can run in a secure IBM Cloud environment.
|
| 55 |
+
- **IBM Orchestrate** could be used to automate claim verification workflows (triggered after each meeting).
|
| 56 |
+
- **IBM Code Assistant** could accelerate code integration for enterprise clients.
|
| 57 |
+
- **Scalable Vector Store**: IBM Cloud Object Storage could hold large KB datasets for retrieval.
|
| 58 |
+
|
| 59 |
+
---
|
| 60 |
+
|
| 61 |
+
## Required Capabilities & Datasets
|
| 62 |
+
- **KB Sources**: SLA documents, compliance policies, contractual clauses, product documentation.
|
| 63 |
+
- **Integrations**: Zoom/Teams API for call recordings.
|
| 64 |
+
- **Agents**: 5 specialized agents as described.
|
| 65 |
+
- **IBM Services**:
|
| 66 |
+
- Text Embeddings API
|
| 67 |
+
- Text Rerank API
|
| 68 |
+
- LLM Prompting via Prompt Lab
|
| 69 |
+
- (Optional) Speech-to-Text
|
| 70 |
+
|
| 71 |
+
---
|
| 72 |
+
|
| 73 |
+
## Why IBM watsonx is Critical
|
| 74 |
+
- **Enterprise readiness** — Secure, compliant AI processing.
|
| 75 |
+
- **High accuracy retrieval** — Embeddings + Rerank reduce noise.
|
| 76 |
+
- **Custom KB adaptability** — Works across industries.
|
| 77 |
+
- **Unified ecosystem** — AI models, APIs, and orchestration tools in one platform.
|
| 78 |
+
|
| 79 |
+
By combining these capabilities, ClaimCheck AI transforms unstructured meeting dialogue into **evidence-backed, compliance-ready reports** in near real-time.
|
IBM_Hackathon_Report/problem_statement.md
ADDED
|
@@ -0,0 +1,76 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
# Problem & Solution Statement
|
| 2 |
+
|
| 3 |
+
## Problem
|
| 4 |
+
In industries where critical decisions depend on the accuracy of verbal communication—such as finance, healthcare, legal compliance, and customer support—important claims made during meetings or calls often go unverified.
|
| 5 |
+
For example:
|
| 6 |
+
- A customer service rep claims a service has "99.99% uptime."
|
| 7 |
+
- A vendor promises "P95 latency under 200 ms globally."
|
| 8 |
+
- A team assures compliance with "30-day data retention policies."
|
| 9 |
+
|
| 10 |
+
These statements, if untrue or unsupported, can result in:
|
| 11 |
+
- Legal liabilities
|
| 12 |
+
- Financial loss
|
| 13 |
+
- Reputation damage
|
| 14 |
+
- Regulatory penalties
|
| 15 |
+
|
| 16 |
+
Existing meeting transcription and summarization tools do not go far enough — they focus on creating readable notes, but do not actively **validate** or **cross-check claims** against authoritative knowledge bases.
|
| 17 |
+
|
| 18 |
+
---
|
| 19 |
+
|
| 20 |
+
## Solution
|
| 21 |
+
We have built **ClaimCheck AI**, an *agentic AI* system that automatically:
|
| 22 |
+
1. **Transcribes** conversations (speech-to-text).
|
| 23 |
+
2. **Extracts** claims made in the dialogue.
|
| 24 |
+
3. **Retrieves** relevant evidence from a curated Knowledge Base (KB) using IBM watsonx embeddings and reranking.
|
| 25 |
+
4. **Verifies** whether each claim is supported, contradicted, or unverifiable.
|
| 26 |
+
5. **Summarizes** the findings in a structured, auditable report.
|
| 27 |
+
|
| 28 |
+
---
|
| 29 |
+
|
| 30 |
+
## Target Users
|
| 31 |
+
- **Compliance Officers** – Automatically flag unsupported statements in regulated industries.
|
| 32 |
+
- **Enterprise Managers** – Validate vendor promises and internal KPIs.
|
| 33 |
+
- **Customer Success & Support Teams** – Ensure commitments to customers are accurate.
|
| 34 |
+
- **Legal Teams** – Use as supporting evidence for contractual disputes.
|
| 35 |
+
|
| 36 |
+
---
|
| 37 |
+
|
| 38 |
+
## User Interaction Flow
|
| 39 |
+
1. **Upload a call recording or connect via Zoom/phone integration**.
|
| 40 |
+
2. The platform transcribes the audio.
|
| 41 |
+
3. An AI claim extractor detects possible factual statements.
|
| 42 |
+
4. IBM watsonx-powered retrieval finds the top-matching KB evidence.
|
| 43 |
+
5. A verifier agent cross-checks claims against evidence.
|
| 44 |
+
6. A final report is generated with:
|
| 45 |
+
- List of claims
|
| 46 |
+
- Associated evidence
|
| 47 |
+
- Verdict: Supported / Contradicted / Unverifiable
|
| 48 |
+
|
| 49 |
+
---
|
| 50 |
+
|
| 51 |
+
## Creativity & Uniqueness
|
| 52 |
+
Unlike traditional meeting summarizers:
|
| 53 |
+
- **Evidence-backed summaries** — not just "what was said," but "whether it’s true."
|
| 54 |
+
- **Multi-agent pipeline** — dedicated agents for transcription, claim extraction, retrieval, verification, and summarization.
|
| 55 |
+
- **Scalable KB integration** — supports industry-specific compliance rules, SLAs, and historical records.
|
| 56 |
+
- **Audit trail** — every verdict links back to the evidence snippet.
|
| 57 |
+
|
| 58 |
+
This approach moves beyond passive transcription to **active truth verification in real time**.
|
| 59 |
+
|
| 60 |
+
---
|
| 61 |
+
|
| 62 |
+
## Agentic AI in Action
|
| 63 |
+
ClaimCheck AI works as a *multi-agent system*:
|
| 64 |
+
1. **Transcriber Agent** – Converts speech to text (IBM Speech-to-Text possible).
|
| 65 |
+
2. **Claim Extractor Agent** – Uses LLM prompting to detect factual statements.
|
| 66 |
+
3. **Retriever Agent** – Uses IBM watsonx text embeddings + FAISS + IBM reranker.
|
| 67 |
+
4. **Verifier Agent** – Cross-references claims with evidence and generates verdicts.
|
| 68 |
+
5. **Summarizer Agent** – Produces structured human-readable reports.
|
| 69 |
+
|
| 70 |
+
---
|
| 71 |
+
|
| 72 |
+
## High Impact
|
| 73 |
+
ClaimCheck AI could:
|
| 74 |
+
- Prevent false compliance reporting in regulated industries.
|
| 75 |
+
- Detect SLA breaches before they become customer escalations.
|
| 76 |
+
- Save legal teams countless hours in discovery and evidence-gathering.
|
README.md
CHANGED
|
@@ -1,6 +1,6 @@
|
|
| 1 |
# ClaimCheck.AI — Agentic Fact Verification for Calls
|
| 2 |
|
| 3 |
-
**ClaimCheck.AI** is an
|
| 4 |
1) **ASR Agent** → transcript + timestamps
|
| 5 |
2) **Claim Extraction (watsonx.ai LLM)** → JSON claims
|
| 6 |
3) **Evidence Retrieval (watsonx.ai Embeddings + FAISS + optional Rerank)** → KB hits
|
|
|
|
| 1 |
# ClaimCheck.AI — Agentic Fact Verification for Calls
|
| 2 |
|
| 3 |
+
**ClaimCheck.AI** is an multi-agent AI platform that turns meeting audio (Zoom/phone) into an evidence-backed report:
|
| 4 |
1) **ASR Agent** → transcript + timestamps
|
| 5 |
2) **Claim Extraction (watsonx.ai LLM)** → JSON claims
|
| 6 |
3) **Evidence Retrieval (watsonx.ai Embeddings + FAISS + optional Rerank)** → KB hits
|