Spaces:
Paused
Paused
| title: ChatCal Voice-Enabled AI Assistant | |
| emoji: 🎤📅 | |
| colorFrom: blue | |
| colorTo: purple | |
| sdk: gradio | |
| sdk_version: 4.44.1 | |
| app_file: app.py | |
| pinned: true | |
| license: mit | |
| suggested_hardware: cpu-basic | |
| # 🎤📅 ChatCal Voice-Enabled AI Assistant | |
| An intelligent AI scheduling assistant with **voice interaction capabilities** powered by WebRTC, Whisper STT, and Bark TTS. Book Google Calendar appointments through natural conversation - now with voice input and audio responses! | |
| ## 🎯 Features | |
| ### 🗣️ Voice Interaction | |
| - 🎤 **Real-time Speech-to-Text**: WebRTC audio capture with Whisper transcription | |
| - 🔊 **Text-to-Speech Responses**: AI responses with natural voice synthesis | |
| - 🎭 **Multiple Voice Options**: Choose from different voice personalities | |
| - ⚡ **Real-time Processing**: Live transcription as you speak | |
| ### 📅 Smart Calendar Integration | |
| - 🤖 **AI-Powered Booking**: Natural language appointment scheduling | |
| - 📅 **Google Calendar Sync**: Seamless integration with your calendar | |
| - 🔍 **Conflict Detection**: Smart availability checking | |
| - 🎥 **Google Meet Integration**: Automatic video conference setup | |
| - 📧 **Email Notifications**: Booking confirmations and cancellations | |
| ### 🧠 Intelligent Conversation | |
| - 💭 **Conversation Memory**: Persistent context across interactions | |
| - 🎯 **Smart Extraction**: Automatically extract names, emails, times | |
| - 🌍 **Timezone Awareness**: Global scheduling support | |
| - ⏰ **Flexible Time Parsing**: "tomorrow at 2pm", "next Tuesday", etc. | |
| ## 🏗️ Architecture | |
| - **Frontend**: Gradio with WebRTC audio capture | |
| - **AI**: Groq Llama-3.1 with Anthropic Claude fallback | |
| - **STT**: Whisper via external service integration | |
| - **TTS**: Bark text-to-speech synthesis | |
| - **Calendar**: Google Calendar API with OAuth2 | |
| - **Storage**: Google Cloud Secret Manager for persistent auth | |
| ## 🚀 Usage | |
| ### Voice Interaction | |
| 1. Click the microphone button to start recording | |
| 2. Speak naturally: "Hi, I'm John. Book a 30-minute meeting tomorrow at 2pm" | |
| 3. Watch real-time transcription appear in the text box | |
| 4. AI responds with voice confirmation of your booking | |
| ### Text Interaction | |
| - Type messages as normal - voice and text work together | |
| - Edit voice transcriptions before sending | |
| - Use quick action buttons for common requests | |
| ### Example Conversations | |
| **Voice**: "Book a Google Meet with Peter next Tuesday at 10 AM for 45 minutes" | |
| **AI Audio Response**: "Perfect! I've scheduled your 45-minute Google Meet with Peter for next Tuesday at 10:00 AM..." | |
| ## 🛠️ Development | |
| This space integrates: | |
| - **ChatCal Core**: Calendar booking logic and Google integration | |
| - **STT Service**: External Whisper service for speech recognition | |
| - **TTS Service**: External Bark service for voice synthesis | |
| - **WebRTC**: Browser-based audio capture and streaming | |
| ## 🔐 Privacy & Security | |
| - Secure OAuth2 authentication with Google | |
| - Audio processed in real-time, not stored | |
| - Persistent token storage via Google Secret Manager | |
| - All calendar operations respect your existing permissions | |
| ## 📞 Contact | |
| For business scheduling needs or technical support: pgits.job@gmail.com |