# 🌾 Agricultural AI System - Complete Setup Guide ## ✅ **Model Training Status Verification** All models have been trained and are ready: ### **Trained Models Location: `trained_models/`** - ✅ **Whisper Multilingual**: `whisper_multilingual/` (9 Indian languages) - ✅ **TinyLlama Agricultural**: `tinyllama_agricultural/` (Q&A chatbot) - ✅ **EfficientNet Crop Classification**: `efficientnet_crop_classification/` - ✅ **Disease Detection**: `disease_detection/` (EfficientNet-V2 — train and place checkpoint here) - ✅ **Market Prediction Models**: `market_prediction/` (3 ML models) ### **Pre-trained Models Location: `models/`** - ✅ **NLLB Translation**: `models/translation/nllb_600m/` (Multi-language translation) --- ## 🚀 **Complete System Setup** ### **1. Backend API Setup** #### **Install Backend Dependencies** ```bash cd backend pip install -r requirements.txt ``` #### **Start Backend Server** ```bash python api_complete.py ``` **Backend will run on**: `http://localhost:8000` **API Endpoints Available**: - `/health` - Health check - `/chat` - Agricultural Q&A - `/speech-to-text` - Voice recognition - `/text-to-speech` - Audio response generation - `/image-diagnosis` - Disease detection - `/crop-classification` - Crop identification - `/market-prediction` - Price prediction - `/translate` - Multi-language translation --- ### **2. Frontend Setup** #### **Install Frontend Dependencies** ```bash cd Frontend npm install # or pnpm install ``` #### **Start Frontend Development Server** ```bash npm run dev # or pnpm dev ``` **Frontend will run on**: `http://localhost:3000` --- ## 🔧 **System Architecture** ### **Backend (FastAPI)** - **File**: `backend/api_complete.py` - **Port**: 8000 - **Features**: - All trained models loaded on startup - CORS enabled for frontend connection - GPU acceleration for inference - Error handling and logging ### **Frontend (Next.js + React)** - **File**: `Frontend/` - **Port**: 3000 - **Features**: - Modern UI with Tailwind CSS - Real-time chat interface - Image upload and diagnosis - Voice input support - Multi-language support ### **API Client** - **File**: `Frontend/lib/api.ts` - **Features**: - TypeScript interfaces - Error handling - File upload support - All endpoints connected --- ## 🎯 **How to Use the System** ### **1. Start Both Servers** ```bash # Terminal 1 - Backend cd backend python api_complete.py # Terminal 2 - Frontend cd Frontend npm run dev ``` ### **2. Access the Application** Open browser: `http://localhost:3000` ### **3. Available Features** #### **🤖 AI Assistant** - Ask questions in Hindi/English - Get agricultural advice - Real-time chat interface #### **📸 Image Diagnosis** - Upload plant images - Get disease detection - Treatment recommendations #### **🎤 Voice Input & Output** - **Speech-to-Text**: Speak in 9 Indian languages - **Text-to-Speech**: AI responses as audio - **Voice Interaction**: Complete voice-based conversation #### **📊 Market Prediction** - Enter crop details - Get price predictions - Market recommendations #### **🌐 Translation** - Translate between languages - Support for Indian languages - NLLB model integration --- ## 🔍 **Model Details** ### **1. Whisper Multilingual Speech Recognition** - **Languages**: Bengali, Gujarati, Hindi, Kannada, Malayalam, Marathi, Odia, Tamil, Telugu - **Training Data**: 67,072 samples - **Use**: Voice input processing ### **2. TinyLlama Agricultural Q&A** - **Training Data**: 50,231 agricultural Q&A pairs - **Languages**: Hindi + English responses - **Use**: Chat assistant ### **3. EfficientNet Vision Models** - **Crop Classification**: Identifies crop types - **Disease Detection**: Detects plant diseases - **Use**: Image analysis ### **4. Market Prediction** - **Models**: Random Forest, Gradient Boosting, Linear Regression - **Use**: Price forecasting ### **5. NLLB Translation** - **Model**: 600M parameters - **Languages**: 200+ languages - **Use**: Multi-language support --- ## 🛠️ **Troubleshooting** ### **Backend Issues** ```bash # Check if models are loaded curl http://localhost:8000/health # Check GPU availability python -c "import torch; print(torch.cuda.is_available())" ``` ### **Frontend Issues** #### **Dependency Resolution Error** If you get `ERESOLVE unable to resolve dependency tree`: ```bash # Clear cache and reinstall with legacy peer deps rm -rf node_modules package-lock.json npm install --legacy-peer-deps ``` #### **Alternative Installation** ```bash # Use pnpm instead of npm npm install -g pnpm pnpm install ``` #### **Force Clean Install** ```bash # Clear all caches npm cache clean --force rm -rf node_modules package-lock.json npm install --legacy-peer-deps ``` ### **Model Loading Issues** - Ensure all trained models exist in `trained_models/` - Check GPU memory (8GB RTX 4060 recommended) - Verify Python dependencies are installed --- ## 📱 **System Requirements** ### **Hardware** - **GPU**: NVIDIA RTX 4060 (8GB VRAM) or better - **RAM**: 16GB+ recommended - **Storage**: 10GB+ for models ### **Software** - **Python**: 3.8+ - **Node.js**: 18+ - **CUDA**: 11.8+ (for GPU acceleration) --- ## 🎉 **Success Indicators** ### **Backend Ready** ``` INFO: Uvicorn running on http://0.0.0.0:8000 ✅ All models loaded successfully! ``` ### **Frontend Ready** ``` ready - started server on 0.0.0.0:3000 ``` ### **System Working** - Chat responds to agricultural questions - Image upload shows disease detection - Voice input transcribes correctly - All pages load without errors --- ## 🔗 **API Testing** Test individual endpoints: ```bash # Health check curl http://localhost:8000/health # Chat test curl -X POST http://localhost:8000/chat -F "message=मेरे टमाटर में रोग है" # Text-to-speech test curl -X POST http://localhost:8000/text-to-speech -F "text=आपके पौधे में रोग है" -F "language=hi" --output speech.wav # Image diagnosis test curl -X POST http://localhost:8000/image-diagnosis -F "image_file=@plant_image.jpg" ``` --- ## 📞 **Support** If you encounter issues: 1. Check both backend and frontend logs 2. Verify all models are in correct directories 3. Ensure GPU drivers are updated 4. Check network connectivity between frontend/backend **Your complete Agricultural AI System is now ready! 🌾🤖**