qwen2
ExocoreV1 / replit.md
ChoruYt's picture
ExocoreV1: multi-thinking, web search, auto-load, loss chart, architecture tree, no system prompt
5e7ce6a verified
|
Raw
History Blame Contribute Delete
3.65 kB
# ExocoreV1
A from-scratch AI system built around **ExocoreV1** β€” a powerful 751M-parameter language model, fully rebranded and independent of any third-party naming.
**HuggingFace:** https://huggingface.co/Exocore/ExocoreV1
## Project Overview
ExocoreV1 is a full-stack AI chat and training platform:
- **Chat interface** β€” Talk to ExocoreV1 with Fast, Thinking, and Deep Think modes
- **Research tools** β€” Web search (DuckDuckGo) + multi-URL reader integrated into the chat pipeline
- **Training page** β€” Train new models from text, with live Chart.js loss curve and architecture tree visualization
- **Auto-train** β€” Gemini-powered automatic data generation + training
- **Auto-load** β€” Exocore.pt loads automatically on startup (no button click needed)
## Architecture
- **Backend**: Python + Flask (`main.py`)
- **Model engine**: `exocore_model.py` β€” ExocoreLM (28-layer transformer, 751M params, GQA, RoPE, SwiGLU)
- **Training**: `trainer.py` β€” MiniGPT character-level trainer + ExocoreV1 inference
- **Gemini client**: `gemini_client.py`
- **Templates**: `templates/index.html`, `templates/train.html`
## Key Files
| File | Purpose |
|------|---------|
| `main.py` | Flask server, all API routes |
| `exocore_model.py` | ExocoreLM architecture (Qwen3-compatible, ExocoreV1 branded) |
| `trainer.py` | Training loop + MiniGPT + ExocoreV1 inference |
| `gemini_client.py` | Gemini API integration |
| `models/trained/Exocore.pt` | ExocoreV1 model weights (751M params, PROTECTED) |
## ExocoreV1 Model Architecture
| Component | Value |
|-----------|-------|
| Parameters | 751.6M |
| Layers | 28 |
| Hidden size | 1024 |
| Attention heads | 16Q / 8 KV |
| Head dim | 128 |
| FFN intermediate | 3072 (SwiGLU) |
| Vocab size | 151,936 |
| Max context | 40,960 tokens |
| RoPE theta | 1,000,000 |
| Precision | bfloat16 |
## API Endpoints
| Endpoint | Method | Description |
|----------|--------|-------------|
| `/api/models` | GET | List all available models |
| `/api/load` | POST | Load a model |
| `/api/chat` | POST | Stream chat (SSE) |
| `/api/clear` | POST | Clear chat history |
| `/api/status` | GET | Server/model status |
| `/api/autoload-status` | GET | Auto-load progress |
| `/api/model-details` | GET | Current model architecture info |
| `/api/search` | POST | DuckDuckGo web search |
| `/api/read-link` | POST | Fetch and parse URL content (multi-link) |
| `/api/train/start` | POST | Start training |
| `/api/train/status` | GET | Training status + loss history |
| `/api/train/stop` | POST | Stop training |
| `/api/train/models` | GET | List trained models |
| `/api/train/model-info/<name>` | GET | Model architecture info |
| `/api/gemini/*` | POST/GET | Gemini integration |
## Chat Modes
| Mode | Description |
|------|-------------|
| Fast | Direct answer, no thinking |
| Thinking | Single-pass reasoning before answering |
| Deep Think | Two-pass multi-step reasoning (Pass 1 + Pass 2 think blocks) |
## Research Features
- **Web search**: DuckDuckGo HTML scraping, returns title + snippet + URL
- **Read Page**: Fetches any URL, strips nav/scripts, returns clean text (up to 4000 chars)
- **Multi-link reading**: Read up to 4 URLs simultaneously and merge into research context
- **Context injection**: Research context is automatically injected into the model prompt
## User Preferences
- No system prompt exposed in UI β€” ExocoreV1 identity is baked into the model prompt automatically
- Exocore.pt is permanently protected from deletion
- No "qwen" branding anywhere in the UI or code
- Model auto-loads on startup
- No system prompt field in UI β€” identity lives inside the model