GodeusAI - Conversations with the infinite, locally hosted.

GodeusAI is a spiritual assistant chatbot powered by a fine-tuned Mistral-7B language model with LoRA adapters. It provides answers to spiritual and philosophical questions, and can be run locally for private, offline use.

Features

Chatbot interface for spiritual Q&A
Fine-tuned on custom spiritual/philosophical data
LoRA adapter for efficient model adaptation
Utilities for context-based question answering
Example notebook for data preparation and training

Quickstart

1. Install Dependencies

pip install -r requirements.txt

2. Run the Chatbot

python inference.py

You’ll see a prompt:
💉 Welcome to GodeusAI — your spiritual assistant. Type 'exit' to quit.

Project Structure

File/Folder	Purpose
`inference.py`	Main script to chat with the model
`rag_utils.py`	Utilities for loading model and context-based QA
`few_shots_qa.jsonl`	Example Q&A pairs for few-shot prompting
`adapter_model.safetensors`	LoRA adapter weights (required for inference)
`adapter_config.json`	Configuration for the LoRA adapter
`GodeusAI.ipynb`	Notebook for data prep, training, and experimentation
`requirements.txt`	Python dependencies

Data & Training

few_shots_qa.jsonl: Example format for few-shot Q&A pairs.
GodeusAI.ipynb:
- Prepares data from PDFs
- Chunks and formats into JSONL
- Trains LoRA adapters on Mistral-7B

Model

Base model: mistralai/Mistral-7B-v0.1
Adapter: LoRA (config in adapter_config.json, weights in adapter_model.safetensors)

License

This project is for research and educational purposes.
Refer to the base model and dataset licenses for usage restrictions.