| | --- |
| | title: LLM Chat Interface |
| | emoji: 🤖 |
| | colorFrom: blue |
| | colorTo: purple |
| | sdk: gradio |
| | sdk_version: 4.44.1 |
| | app_file: app.py |
| | pinned: false |
| | --- |
| | |
| | # LLM Chat Interface |
| |
|
| | A beautiful web-based chat interface for local LLM models built with Gradio. |
| |
|
| | ## Features |
| |
|
| | - 🤖 Chat with local LLM models |
| | - 🎨 Beautiful, modern UI with dark theme |
| | - ⚙️ Adjustable model parameters (temperature, top-p, max tokens) |
| | - 💬 System message support |
| | - 📱 Responsive design |
| | - 🔄 Real-time chat history |
| |
|
| | ## Deployment on Hugging Face Spaces |
| |
|
| | This project is configured for easy deployment on Hugging Face Spaces. |
| |
|
| | ### Quick Deploy |
| |
|
| | 1. **Fork this repository** to your GitHub account |
| | 2. **Create a new Space** on Hugging Face: |
| |
|
| | - Go to [huggingface.co/spaces](https://huggingface.co/spaces) |
| | - Click "Create new Space" |
| | - Choose "Gradio" as the SDK |
| | - Select your forked repository |
| | - Choose hardware (CPU is sufficient for basic usage) |
| |
|
| | 3. **Configure the Space**: |
| | - The Space will automatically use `app.py` as the entry point |
| | - Model files should be placed in the `models/` directory |
| | - Environment variables can be set in the Space settings |
| |
|
| | ### Model Setup |
| |
|
| | To use your own model: |
| |
|
| | 1. **Add model files** to the `models/` directory |
| | 2. **Update the model path** in `app/llm_manager.py` |
| | 3. **Push changes** to your repository |
| |
|
| | ### Environment Variables |
| |
|
| | Set these in your HF Space settings if needed: |
| |
|
| | - `MODEL_PATH`: Path to your model file |
| | - `MODEL_TYPE`: Type of model (llama, phi, etc.) |
| |
|
| | ## Local Development |
| |
|
| | ```bash |
| | # Install dependencies |
| | pip install -r requirements.txt |
| | |
| | # Run the interface |
| | python app.py |
| | ``` |
| |
|
| | ## Project Structure |
| |
|
| | ``` |
| | ├── app/ |
| | │ ├── __init__.py |
| | │ ├── gradio_interface.py # Main Gradio interface |
| | │ ├── llm_manager.py # LLM model management |
| | │ └── api_models.py # API data models |
| | ├── models/ # Model files directory |
| | ├── tests/ # Test files |
| | ├── app.py # HF Spaces entry point |
| | ├── requirements.txt # Python dependencies |
| | └── README.md # This file |
| | ``` |
| |
|
| | ## Contributing |
| |
|
| | 1. Fork the repository |
| | 2. Create a feature branch |
| | 3. Make your changes |
| | 4. Add tests if applicable |
| | 5. Submit a pull request |
| |
|
| | ## License |
| |
|
| | MIT License - see LICENSE file for details. |
| |
|
