personal-website-backend / knowledge.md
ceaustin117's picture
Initial commit: RAG chatbot backend
16b6c1d
|
Raw
History Blame Contribute Delete
4.72 kB
# Chris Austin - Senior AI Engineer
## Overview
Chris Austin is a Senior AI Engineer with 7+ years of experience building scalable data systems and AI solutions, from ML pipelines to multi-agent GenAI apps. Experienced in Python, Spark, SQL, and deploying across Azure, AWS, and hybrid environments.
## Current Role
Senior AI Engineer at Cognizant.
## Location
Los Angeles / Remote
## Education
B.S. in Mathematics and Computer Science from Temple University.
## Contact
- Email: ceaustin117@gmail.com
- LinkedIn: linkedin.com/in/christopher-austin
- GitHub: github.com/ceaustin117
## Featured Projects
### Multi-Agent GenAI Tax Automation
Designed a multi-agent GenAI architecture on Azure that automated tax document workflows, cutting review time from 14 days to 1 day, and enabling real-time AI approval through a React web app.
Technologies: Azure, GenAI, Multi-Agent Systems, React, Python
### LLM vs Rule-Based Classification
Built a classification pipeline that compares LLM vs rule-based outputs to cut manual review time by 40% and reached over 95% accuracy.
Technologies: LLM, Python, ML Pipelines, Azure
### Microsoft Fabric Analytics Solution
Delivered a Microsoft Fabric analytics solution with semantic search and AI insights, improving decision-making speed and accuracy across operational sources.
Technologies: Microsoft Fabric, Azure, Semantic Search, AI
### Databricks MLOps Pipeline
Rebuilt legacy ML pipelines within a modern Databricks MLOps lifecycle framework (MLflow, CI/CD), adding LLM-based monitoring and improving deployment speed.
Technologies: Databricks, MLflow, CI/CD, Python
### Cloud ML Demand Forecasting
Built a cloud ML pipeline for demand forecasting, cutting modeling time from hours to minutes and delivering forecasts via a React dashboard.
Technologies: AWS, ML Pipelines, React, CI/CD
### Predictive Vehicle Mapping Pipeline
Engineered a predictive mapping pipeline using Azure Data Factory and Python, integrating ML models that improved processing speed by 500% across millions of vehicles.
Technologies: Azure Data Factory, Python, ML, Spark
## Key Achievements
- Reduced tax document review time from 14 days to 1 day
- Achieved 500% processing speed improvement on vehicle mapping pipeline
- Reached 95%+ classification accuracy on LLM pipeline
- 7+ years of professional experience in data and AI
## Skills
- GenAI & LLMs: LangChain, Multi-Agent Systems, RAG, Prompt Engineering
- ML Engineering: ML Pipelines, MLflow, Forecasting, Classification
- Cloud: Azure (Data Factory, ML, Functions, Fabric), AWS, Databricks, Snowflake
- Programming: Python, SQL, Spark/PySpark, TypeScript, JavaScript
## Certifications
- Microsoft Azure AI Engineer
- Microsoft Azure Fabric Data Engineer
- AWS Certified Cloud Practitioner
- Databricks Generative AI Engineer
## This Website's RAG Chatbot Architecture
This chatbot you're talking to is a RAG (Retrieval-Augmented Generation) system built by Chris Austin to demonstrate AI engineering skills.
### Architecture Overview
The system consists of two main components:
1. **Frontend**: React TypeScript app hosted on GitHub Pages
2. **Backend**: Python FastAPI server hosted on HuggingFace Spaces
### How It Works
1. User types a question in the chat interface
2. Frontend sends the question to the backend API
3. Backend embeds the question using sentence-transformers (all-MiniLM-L6-v2)
4. Cosine similarity search finds the most relevant chunks from the knowledge base
5. Top 3 relevant chunks are sent as context to the LLM
6. Groq API (llama-3.1-8b-instant) generates a response based on the context
7. Response is returned to the frontend and displayed
### Tech Stack
- **Frontend**: React 19, TypeScript, CSS, GitHub Pages
- **Backend**: Python, FastAPI, uvicorn
- **Embeddings**: sentence-transformers (all-MiniLM-L6-v2 model)
- **Vector Store**: In-memory with pre-computed embeddings stored in JSON
- **LLM**: Groq API with Llama 3.1 8B Instant model
- **Hosting**: HuggingFace Spaces (backend), GitHub Pages (frontend)
### Why This Architecture
- **Cost**: $0 - uses free tiers of Groq and HuggingFace
- **Simplicity**: No complex vector database needed for small knowledge base
- **Speed**: Groq provides fast inference, sentence-transformers are lightweight
- **Customizable**: All code is custom Python, easy to modify and extend
### Key Design Decisions
- Pre-computed embeddings: Knowledge base is small (~6 chunks), so embeddings are computed once and stored in JSON
- In-memory search: Simple numpy cosine similarity, no need for Pinecone/Chroma
- Groq over OpenAI: Faster and has generous free tier
- Separate frontend/backend: Clean separation, backend can be reused for other interfaces