Spaces:
Running
Running
| title: Gu Wiki | |
| emoji: 📉 | |
| colorFrom: blue | |
| colorTo: indigo | |
| sdk: static | |
| pinned: false | |
| license: mit | |
| short_description: 'Gujarati Language Model and Speech Recognition (ASR) System ' | |
| thumbnail: >- | |
| https://cdn-uploads.huggingface.co/production/uploads/686277c878145a796a2d08f5/a0syUAMIRVb2SCUceB2mK.png | |
| tags: | |
| - track:backyard | |
| - sponsor:nvidia | |
| - achievement:offgrid | |
| - achievement:sharing | |
| - achievement:fieldnotes | |
| # GuWiki 🇮🇳 | |
| **Gujarati Language Model & Automatic Speech Recognition (ASR) System Built from Scratch** | |
| GuWiki is an open-source initiative focused on building AI systems specifically for the Gujarati language. The project combines a custom-trained Gujarati Language Model with a Gujarati Speech Recognition system to make Gujarati knowledge and voice interactions more accessible. | |
| The goal is simple: | |
| > Bring Gujarati knowledge, speech, and AI together in one place. | |
| --- | |
| ### 🧠 Gujarati Language Model | |
| * Trained from scratch on large-scale Gujarati text data | |
| * Character-level tokenization and encoding | |
| * Knowledge collected from: | |
| * Gujarati Wikipedia | |
| * Public Gujarati text sources | |
| * Curated raw Gujarati documents | |
| * Designed specifically for Gujarati understanding and generation | |
| ### 🎙️ Gujarati Automatic Speech Recognition (ASR) | |
| * Wav2Vec2-based speech recognition model | |
| * Trained from scratch on Gujarati audio datasets | |
| * Supports Gujarati voice-to-text conversion | |
| * Optimized for real-world Gujarati speech | |
| ### 🌐 Full Stack Application | |
| * **Frontend:** Next Web Application (`src/`) | |
| * **Backend:** FastAPI (`app/`, `models/`) | |
| * Supports: | |
| * Text-based conversations | |
| * Voice-based conversations | |
| * AI-powered Gujarati knowledge retrieval | |
| --- | |
| ## 📂 Project Structure | |
| ```bash | |
| GuWiki/ | |
| │ | |
| ├── src/ # Frontend Application | |
| ├── app/ # FastAPI Backend | |
| ├── models/ # LLM and ASR Models | |
| ├── requirements.txt | |
| ├── Dockerfile | |
| └── README.md | |
| ``` | |
| --- | |
| ## 🛠️ Tech Stack | |
| ### Frontend | |
| * Next | |
| * TypeScript | |
| ### Backend | |
| * FastAPI | |
| * Python | |
| ### AI & ML | |
| * PyTorch | |
| * Hugging Face Transformers | |
| * Custom Gujarati ASR Model | |
| * Custom Gujarati Character-Level Language Model | |
| --- | |
| ## 🏃 Running Locally | |
| ### Clone Repository | |
| ```bash | |
| git clone https://github.com/aijadugar/GuWiki.git | |
| cd GuWiki | |
| ``` | |
| ### Backend Setup | |
| ```bash | |
| python -m venv venv | |
| source venv/bin/activate | |
| ``` | |
| Install dependencies: | |
| ```bash | |
| pip install -r requirements.txt | |
| ``` | |
| Run FastAPI server: | |
| ```bash | |
| uvicorn app.main:app --reload | |
| ``` | |
| ### Frontend Setup | |
| ```bash | |
| cd src | |
| npm install | |
| npm run dev | |
| ``` | |
| --- | |
| ## 🐳 Docker | |
| Build image: | |
| ```bash | |
| docker build -t guwiki . | |
| ``` | |
| Run container: | |
| ```bash | |
| docker run -p 8000:8000 guwiki | |
| ``` | |
| --- | |
| ## 🎯 Vision | |
| Gujarati is one of the most widely spoken languages in India, with over 60 million native speakers worldwide, yet it remains significantly underrepresented in modern AI systems. | |
| GuWiki aims to build: | |
| * High-quality Gujarati language models | |
| * Robust Gujarati speech recognition | |
| * Open-source datasets and benchmarks | |
| * AI tools designed specifically for Gujarati users | |
| --- | |
| ## 🔮 Roadmap | |
| The next generation of GuWiki will include: | |
| ### Language Model Improvements | |
| * SentencePiece Tokenization | |
| * Byte Pair Encoding (BPE) | |
| * Larger Gujarati corpora | |
| * Better context understanding | |
| * Improved benchmark performance | |
| ### Speech Recognition Improvements | |
| * Larger Gujarati voice datasets | |
| * Noise-robust training | |
| * Better pronunciation handling | |
| * Reduced Word Error Rate (WER) | |
| ### Platform Improvements | |
| * Real-time voice conversations | |
| * Knowledge-grounded responses | |
| * Mobile applications | |
| * Community-driven dataset expansion | |
| --- | |
| ## 🤝 Contributing | |
| Contributions are welcome! | |
| You can help by: | |
| * Improving model architectures | |
| * Adding Gujarati datasets | |
| * Enhancing ASR performance | |
| * Fixing bugs | |
| * Improving documentation | |
| * Creating benchmarks | |
| Fork the repository, create a feature branch, and submit a pull request. | |
| --- | |
| ## 📜 License | |
| This project is open-source and available under the MIT License. | |
| --- |