stutiagrawal commited on
Commit
bbb543e
·
1 Parent(s): 16f7cf4

add reports

Browse files
IBM_Hackathon_Report/ibm_ai_tools_usage.md ADDED
@@ -0,0 +1,79 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # IBM watsonx Usage Report
2
+
3
+ ## Overview
4
+ ClaimCheck AI leverages IBM watsonx as the backbone for claim verification.
5
+ The system uses IBM watsonx.ai’s large language models and embedding capabilities to handle:
6
+ 1. **Text Retrieval (RAG)**
7
+ 2. **Claim Verification**
8
+ 3. **Evidence Reranking**
9
+ 4. *(Optionally)* IBM Speech-to-Text for transcription.
10
+
11
+ ---
12
+
13
+ ## Agents & IBM Integration
14
+
15
+ ### 1. **Transcriber Agent**
16
+ - **Goal**: Convert audio from Zoom/phone calls to text.
17
+ - **IBM Usage**: Can integrate IBM Speech-to-Text (STT) to provide enterprise-grade transcription accuracy.
18
+ - **Inputs**: WAV/MP3/OGG audio file.
19
+ - **Outputs**: JSON array of `{ speaker, start, end, text }`.
20
+
21
+ ---
22
+
23
+ ### 2. **Claim Extractor Agent**
24
+ - **Goal**: Identify factual statements in the transcript.
25
+ - **IBM Usage**: Powered by IBM watsonx.ai LLM (Prompt Lab) to output JSON with `{ claim_text, speaker, start, end }`.
26
+
27
+ ---
28
+
29
+ ### 3. **Retriever Agent**
30
+ - **Goal**: Retrieve relevant knowledge base snippets to support or refute claims.
31
+ - **IBM Usage**:
32
+ - **IBM Text Embeddings**: Generates semantic vector representations of KB snippets and claims.
33
+ - **FAISS Vector Search**: Finds top-K relevant evidence from local index.
34
+ - **IBM Rerank API**: Orders results by relevance.
35
+ - **Benefit**: Reduces false positives in evidence retrieval.
36
+
37
+ ---
38
+
39
+ ### 4. **Verifier Agent**
40
+ - **Goal**: Cross-check each claim against retrieved evidence.
41
+ - **IBM Usage**: LLM prompt to classify as "Supported", "Contradicted", or "Unverifiable".
42
+ - **Output**: Verdicts with reasoning.
43
+
44
+ ---
45
+
46
+ ### 5. **Summarizer Agent**
47
+ - **Goal**: Produce final human-readable report.
48
+ - **IBM Usage**: LLM summarization model to combine claims, evidence, and verdicts into structured output.
49
+
50
+ ---
51
+
52
+ ## Deployment & Scalability
53
+ While deployment is not in the scope of this hackathon, in a production setting:
54
+ - **IBM watsonx.ai models** can run in a secure IBM Cloud environment.
55
+ - **IBM Orchestrate** could be used to automate claim verification workflows (triggered after each meeting).
56
+ - **IBM Code Assistant** could accelerate code integration for enterprise clients.
57
+ - **Scalable Vector Store**: IBM Cloud Object Storage could hold large KB datasets for retrieval.
58
+
59
+ ---
60
+
61
+ ## Required Capabilities & Datasets
62
+ - **KB Sources**: SLA documents, compliance policies, contractual clauses, product documentation.
63
+ - **Integrations**: Zoom/Teams API for call recordings.
64
+ - **Agents**: 5 specialized agents as described.
65
+ - **IBM Services**:
66
+ - Text Embeddings API
67
+ - Text Rerank API
68
+ - LLM Prompting via Prompt Lab
69
+ - (Optional) Speech-to-Text
70
+
71
+ ---
72
+
73
+ ## Why IBM watsonx is Critical
74
+ - **Enterprise readiness** — Secure, compliant AI processing.
75
+ - **High accuracy retrieval** — Embeddings + Rerank reduce noise.
76
+ - **Custom KB adaptability** — Works across industries.
77
+ - **Unified ecosystem** — AI models, APIs, and orchestration tools in one platform.
78
+
79
+ By combining these capabilities, ClaimCheck AI transforms unstructured meeting dialogue into **evidence-backed, compliance-ready reports** in near real-time.
IBM_Hackathon_Report/problem_statement.md ADDED
@@ -0,0 +1,76 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # Problem & Solution Statement
2
+
3
+ ## Problem
4
+ In industries where critical decisions depend on the accuracy of verbal communication—such as finance, healthcare, legal compliance, and customer support—important claims made during meetings or calls often go unverified.
5
+ For example:
6
+ - A customer service rep claims a service has "99.99% uptime."
7
+ - A vendor promises "P95 latency under 200 ms globally."
8
+ - A team assures compliance with "30-day data retention policies."
9
+
10
+ These statements, if untrue or unsupported, can result in:
11
+ - Legal liabilities
12
+ - Financial loss
13
+ - Reputation damage
14
+ - Regulatory penalties
15
+
16
+ Existing meeting transcription and summarization tools do not go far enough — they focus on creating readable notes, but do not actively **validate** or **cross-check claims** against authoritative knowledge bases.
17
+
18
+ ---
19
+
20
+ ## Solution
21
+ We have built **ClaimCheck AI**, an *agentic AI* system that automatically:
22
+ 1. **Transcribes** conversations (speech-to-text).
23
+ 2. **Extracts** claims made in the dialogue.
24
+ 3. **Retrieves** relevant evidence from a curated Knowledge Base (KB) using IBM watsonx embeddings and reranking.
25
+ 4. **Verifies** whether each claim is supported, contradicted, or unverifiable.
26
+ 5. **Summarizes** the findings in a structured, auditable report.
27
+
28
+ ---
29
+
30
+ ## Target Users
31
+ - **Compliance Officers** – Automatically flag unsupported statements in regulated industries.
32
+ - **Enterprise Managers** – Validate vendor promises and internal KPIs.
33
+ - **Customer Success & Support Teams** – Ensure commitments to customers are accurate.
34
+ - **Legal Teams** – Use as supporting evidence for contractual disputes.
35
+
36
+ ---
37
+
38
+ ## User Interaction Flow
39
+ 1. **Upload a call recording or connect via Zoom/phone integration**.
40
+ 2. The platform transcribes the audio.
41
+ 3. An AI claim extractor detects possible factual statements.
42
+ 4. IBM watsonx-powered retrieval finds the top-matching KB evidence.
43
+ 5. A verifier agent cross-checks claims against evidence.
44
+ 6. A final report is generated with:
45
+ - List of claims
46
+ - Associated evidence
47
+ - Verdict: Supported / Contradicted / Unverifiable
48
+
49
+ ---
50
+
51
+ ## Creativity & Uniqueness
52
+ Unlike traditional meeting summarizers:
53
+ - **Evidence-backed summaries** — not just "what was said," but "whether it’s true."
54
+ - **Multi-agent pipeline** — dedicated agents for transcription, claim extraction, retrieval, verification, and summarization.
55
+ - **Scalable KB integration** — supports industry-specific compliance rules, SLAs, and historical records.
56
+ - **Audit trail** — every verdict links back to the evidence snippet.
57
+
58
+ This approach moves beyond passive transcription to **active truth verification in real time**.
59
+
60
+ ---
61
+
62
+ ## Agentic AI in Action
63
+ ClaimCheck AI works as a *multi-agent system*:
64
+ 1. **Transcriber Agent** – Converts speech to text (IBM Speech-to-Text possible).
65
+ 2. **Claim Extractor Agent** – Uses LLM prompting to detect factual statements.
66
+ 3. **Retriever Agent** – Uses IBM watsonx text embeddings + FAISS + IBM reranker.
67
+ 4. **Verifier Agent** – Cross-references claims with evidence and generates verdicts.
68
+ 5. **Summarizer Agent** – Produces structured human-readable reports.
69
+
70
+ ---
71
+
72
+ ## High Impact
73
+ ClaimCheck AI could:
74
+ - Prevent false compliance reporting in regulated industries.
75
+ - Detect SLA breaches before they become customer escalations.
76
+ - Save legal teams countless hours in discovery and evidence-gathering.
README.md CHANGED
@@ -1,6 +1,6 @@
1
  # ClaimCheck.AI — Agentic Fact Verification for Calls
2
 
3
- **ClaimCheck.AI** is an agentic AI pipeline that turns meeting audio (Zoom/phone) into an evidence-backed report:
4
  1) **ASR Agent** → transcript + timestamps
5
  2) **Claim Extraction (watsonx.ai LLM)** → JSON claims
6
  3) **Evidence Retrieval (watsonx.ai Embeddings + FAISS + optional Rerank)** → KB hits
 
1
  # ClaimCheck.AI — Agentic Fact Verification for Calls
2
 
3
+ **ClaimCheck.AI** is an multi-agent AI platform that turns meeting audio (Zoom/phone) into an evidence-backed report:
4
  1) **ASR Agent** → transcript + timestamps
5
  2) **Claim Extraction (watsonx.ai LLM)** → JSON claims
6
  3) **Evidence Retrieval (watsonx.ai Embeddings + FAISS + optional Rerank)** → KB hits