Hugging Face's logo

Spaces:
Rutvij1504
/
RRTest_Rag
Paused

App Files Community
RRTest_Rag / presentation_slides.md
Rutvij1504's picture
Rutvij1504
Expand identity query matching to handle variations like who am i talking to
4ec2da8
preview code
|
Raw
History Blame Contribute Delete
13.9 kB

Mintoak RAG Assistant presentation slides

This file contains a complete, slide-by-slide guide structured for Google Slides. Each slide details a clean layout recommendation, copy-pasteable bullet points, and speaker notes.

Slide 1: Project Features (Functional & Non-Functional)

  • Layout: Two-column comparison layout. Left column: Functional Features (Layman Terms). Right column: Non-Functional Features (Technical Qualities).
  • Header / Title: What this Project Provides: Core Features
  • Subtitle: Bifurcated Functional Capabilities & Technical Quality Standards
  • Bullet Points:
    • Functional Features (Layman Terms):
      • Semantic Search via Chatbot: Visitors can ask questions in natural, conversational language and find exact matches without needing to guess keyword search terms.
      • Structured Answers with Citations: Answers are presented in a clean, organized format with direct website links (URLs) so visitors can easily verify info and navigate to the right page.
      • Conversational Lead Generation: Automatically captures visitor contact details (name and email) directly through the chatbot whenever a visitor asks about booking a demo or contacting the sales team.
    • Non-Functional Features (Technical Qualities):
      • Low-Cost Infrastructure: Runs on lightweight, quantized models (Qwen-2.5 1.5B 4-bit) that can be hosted locally or on-premise, bypassing expensive third-party cloud API costs.
      • Optimized for High Traffic: Built with fast response times, small memory footprints, and rule-based caching (for greetings/deflections) to efficiently manage concurrent queries on high-traffic websites.
      • High-Speed Execution: Powered by Apple Silicon MLX (local) and optimized PyTorch (production) to minimize response latency.
      • Zero-Latency Security Checks: Instant pre-inference checks to block prompt injections and offensive language before they reach the model.
      • Scalable Database Portability: Seamless transition from development ChromaDB to production-grade PostgreSQL with pgvector.
      • Rigorous Testing Framework: Evaluation engine that guarantees accuracy and alignment across 60 testing scenarios with a 100% success rate.
  • Visual Suggestion: Split layout with side-by-side card groups: soft green/teal styling for customer-facing features (Functional) and cool grey/blue styling for technical features (Non-Functional).

Speaker Notes

"In Slide 1, we look at the exact features this project delivers. On the left are the layman-friendly functional features: semantic chatbot search, structured responses citing real source URLs, and conversational lead capture. On the right, we highlight the non-functional qualities: low-cost infrastructure using a quantized local model, high-traffic optimization with caching and lightweight footprints, speed, security filters, database portability, and our automated testing suite verifying a 100% pass rate."

Slide 2: Strategic Goals & Brand Positioning

  • Layout: Two-column split. Left: Core strategic principles. Right: Brand guardrails.
  • Title: Strategic Goals & Brand Positioning
  • Bullet Points:
    • SaaS Platform Framing: Position Mintoak strictly as a white-labeled SaaS platform and modular solution, not individual "software" or retail "apps."
    • Acquirer-Led B2B Context: Speak directly to bank heads of digital products and merchant acquiring. Focus on activation, retention, and time-to-market.
    • The B2B/B2C Separation: Explicitly clarify that Mintoak enables merchants to run custom loyalty campaigns, and does not directly issue rewards to end-consumers.
    • Brand Protection: Enforce strict uppercase brand spelling: Mintoak (banning all lowercase or camelCase variants).
  • Visual Suggestion: Icon stack representing Bank/Acquirer ➔ Mintoak SaaS Platform ➔ SME Merchant.

Speaker Notes

"A key challenge in building this agent was aligning it with our strict business positioning. The assistant is instructed never to call Mintoak 'software' or a 'tool', but rather a white-labeled SaaS platform. Additionally, it must distinguish between the B2B users—the bank acquiring teams and merchants—and B2C end-consumers, making sure it never incorrectly claims that Mintoak issues loyalty points directly to shoppers."

Slide 3: System Architecture Overview

  • Layout: Horizontal flowchart/process block showing the 4 main stages.
  • Title: Dual-Engine System Architecture
  • Bullet Points:
    • 1. Input Guardrails: Checks incoming queries for profanity and injection attempts with zero latency.
    • 2. Semantic Retrieval: Searches a local vector store (ChromaDB/pgvector) for relevant passages.
    • 3. LLM Synthesis: Combines retrieved context and query inside a strict system prompt; processes via MLX Qwen 2.5 1.5B Instruct model.
    • 4. Compliance Post-Processor: Evaluates the output, corrects brand spelling, limits emojis, and swaps banned casual phrases with approved enterprise terminology.
  • Visual Suggestion: 4-stage pipeline layout with icons (Shield ➔ Database ➔ CPU / AI ➔ Filter).

Speaker Notes

"Our architecture represents a dual-engine flow: a fast pre-processing layer to filter threats, a retrieval engine that queries the vectorized CMS, a fine-tuned LLM running locally, and a post-processing compliance filter. This design ensures that every response is not only factually grounded in our site's content but also written in Mintoak's precise corporate voice."

Slide 4: The Vector Database & Retrieval Engine

  • Layout: Split layout. Left: Key retrieval mechanics. Right: Database schemas.
  • Title: Retrieval: ChromaDB & pgvector
  • Bullet Points:
    • Local Ingest & Chunks: Over 900+ document chunks processed directly from the website CMS.
    • Dense Embeddings: Generated locally using the all-MiniLM-L6-v2 SentenceTransformers model (384 dimensions).
    • Dynamic Catalog Injector: Detects high-level queries about "products" or "catalog" and automatically prepends the master product list chunk into the context window.
    • Production Portability: Designed to easily migrate from SQLite-backed ChromaDB in development to enterprise PostgreSQL using the pgvector extension.
  • Visual Suggestion: A comparison graphic showing ChromaDB (dev) on the left migrating to PostgreSQL/pgvector on the right.

Speaker Notes

"The retrieval system is optimized for fast, local execution. We embed 900+ document chunks using a 384-dimensional dense model. To make sure broad questions are handled accurately, we built a dynamic catalog injector. If someone asks 'What products do you have?', the database automatically pulls a synthetic master catalog chunk and feeds it into the LLM context, preventing incomplete responses."

Slide 5: Multi-Tiered Guardrails & Refusal Routing

  • Layout: Three vertical columns highlighting the three tiers of protection.
  • Title: Guardrails & Refusal Routing
  • Bullet Points:
    • Tier 1: Pre-processing Filter: Checks query string for offensive keywords or prompt injection patterns (e.g., 'ignore previous instructions'). Blocks execution before model activation.
    • Tier 2: Semantic Distance Cut-off: Computes vector similarity. If cosine distance is > 0.82, or > 0.60 without explicit brand keywords, it is instantly routed to a refusal.
    • Tier 3: Graceful Refusals: Off-scope questions or missing information are answered with polite, pre-defined redirects, preventing hallucinations.
  • Visual Suggestion: concentric circular rings of defense wrapping the core LLM engine.

Speaker Notes

"Safety is critical for a public-facing assistant. We implemented a three-tier system. Tier 1 stops profanity and prompt injections before they hit the model. Tier 2 checks if the user's question is actually relevant to our website's topic using a vector similarity threshold. Tier 3 handles the output, converting any missing data deflections into standard, helpful redirects to our contact page."

Slide 6: Zero-Tolerance Compliance Pipeline

  • Layout: Side-by-side table comparing banned casual words to approved enterprise replacements.
  • Title: Zero-Tolerance Compliance Pipeline
  • Bullet Points:
    • Automated Word Swapping: Python regex filters intercept the raw LLM output to clean up generic 'AI-speak'.
    • Banned Words & Approved Substitutes:
      • Seamless / Seamlessly ➔ Integrated / Efficiently
      • Empower / Empowering ➔ Enable / Enabling
      • Leverage / Leveraging ➔ Use / Utilizing
      • Game-changer ➔ Significant advancement
      • Synergy / Synergies ➔ Alignment / Alignments
    • Emoji Limiter: Limits output to a maximum of one contextually relevant emoji (e.g., 💡, 📈) to keep responses clean.
  • Visual Suggestion: A visual representing the string post-processing pipeline turning unstructured LLM text into polished business copy.

Speaker Notes

"To prevent the assistant from sounding like a generic chatbot, we created a zero-tolerance compliance pipeline. The system automatically filters out typical AI clichés. Emojis are capped at a maximum of one per response, and any casing errors like 'MintOak' are instantly corrected to 'Mintoak' before the user sees them."

Slide 7: Conversational Lead Capture

  • Layout: Conversational flow tree showing user engagement to system flag.
  • Title: Conversational Lead Capture Integration
  • Bullet Points:
    • Intent-Based Triggers: Detects when a user asks about partnerships, custom pricing, or scheduling a demo.
    • In-Context Conversion: Prompts the user politely for their Name and Email address.
    • Hidden System Marker: Once details are captured, appends a hidden [CAPTURE_LEAD] marker.
    • CRM Handshake: Downstream services capture the marker and write the lead's name, email, and query directly into a backend database (leads.jsonl).
  • Visual Suggestion: Dialog flowchart detailing: User inquiry ➔ Assistant prompt ➔ User details provided ➔ CRM sync.

Speaker Notes

"Rather than using intrusive popup forms, we capture leads conversationally. When a user asks about product pricing or booking a demo, the assistant politely asks for their name and email. Once provided, the app detects these credentials and writes them to a leads database, allowing our sales team to follow up immediately."

Slide 8: Evaluation Metrics & Testing Results

  • Layout: 4 grid cards displaying metrics.
  • Title: Evaluation Metrics & Testing Results
  • Bullet Points:
    • Overall Pass Rate: 100.0% across a 60-case validation suite.
    • Greeting & Identity Performance: 18/18 Passed with zero latency (cached routing).
    • Out-of-Scope & Injection Protection: 24/24 Passed with perfect refusal routing.
    • General Product Inquiries: 18/18 Passed with high factual grounding.
    • Average Inference Latency: 7.35s (under local LLM processing).
  • Visual Suggestion: High-contrast KPI cards showcasing 100.0% Pass Rate, 60 Test Cases, and 0 Failed Cases.

Speaker Notes

"We ran a comprehensive testing suite consisting of 60 test cases spanning greetings, general product questions, injection attacks, and out-of-scope inquiries. The system achieved a 100% pass rate. Greetings and safety blocks are handled instantly via rule-based caching, while general product inquiries complete with an average latency of 7.35 seconds."

Slide 9: Dual Deployment Configurations

  • Layout: Two horizontal boxes comparing Dev vs. Prod environments.
  • Title: Dual Deployment Configurations
  • Bullet Points:
    • Development / local macOS (MLX-Optimized):
      • Apple Silicon accelerated local inference (mlx-lm).
      • Uses a 4-bit quantized Qwen-2.5-1.5B-Instruct model.
      • Storage: Local SQLite/ChromaDB.
    • Production (Web Server):
      • Flask framework with PyTorch and Hugging Face Transformers.
      • Database: PostgreSQL with pgvector for scalable production queries.
      • Dockerized setup ready for Hugging Face Spaces or containerized cloud hosting.
  • Visual Suggestion: Architecture icons representing macOS (Apple Silicon logo) vs. Cloud Server (Docker/PostgreSQL logos).

Speaker Notes

"The repository supports two deployment modes. Locally, developers can run an MLX-optimized server that utilizes the Apple Silicon GPU for fast 4-bit quantized inference. In production, we switch to a PyTorch/Flask container using a PostgreSQL vector database, making it fully ready for cloud deployment via Docker."

Slide 10: Strategic Impact & Roadmap

  • Layout: Horizontal timeline or list of next steps.
  • Title: Strategic Impact & Roadmap
  • Bullet Points:
    • Strategic Impact: Establishes a highly grounded, white-labeled AI advisor that builds brand trust and protects bank-merchant relationships.
    • Next Steps (Immediate Roadmap):
      • CRM Integration: Connect the lead capture pipeline to Salesforce/HubSpot APIs.
      • Analytics Integration: Track common search terms to identify what features bank clients query most.
      • Expanded Test Bank: Increase the evaluation suite from 60 to 500+ test cases to test edge cases.
  • Visual Suggestion: A simple, clean checkmarked roadmap timeline.

Speaker Notes

"To wrap up, this RAG assistant provides a secure, aligned, and highly reliable portal for bank and merchant acquirers. By keeping the model local or containerized, we avoid high API expenses and retain full control of our data. Our next steps are to connect the lead capture pipeline directly to our CRM and scale our test bank. I am happy to open the floor to any questions."