Create README.md
Browse files
README.md
ADDED
|
@@ -0,0 +1,104 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: mit
|
| 3 |
+
language:
|
| 4 |
+
- en
|
| 5 |
+
base_model:
|
| 6 |
+
- google/gemma-2-2b-it
|
| 7 |
+
pipeline_tag: text-generation
|
| 8 |
+
---
|
| 9 |
+
|
| 10 |
+
# RemiAI Open Source Framework
|
| 11 |
+
|
| 12 |
+
[](https://opensource.org/licenses/MIT)
|
| 13 |
+
[](https://www.electronjs.org/)
|
| 14 |
+
[](https://huggingface.co/)
|
| 15 |
+
|
| 16 |
+
**A "No-Setup" Local AI Framework for Students**
|
| 17 |
+
|
| 18 |
+
This project is an open-source, offline AI chat application designed for students and colleges. It allows you to run powerful LLMs (like Llama 3, Mistral, etc.) on your laptop without needing GPU, internet, Python, or complicated installations.
|
| 19 |
+
|
| 20 |
+
**Note** - No need any GPU in your laptop to run, it will use the CPU in your laptop for the response generation(inference) and if you want to modify the project code and use another model make sure that your are using the `.gguf` formated weights only, normal weights like `.safetensors` will not supported in this application.
|
| 21 |
+
---
|
| 22 |
+
|
| 23 |
+
## 🚀 Quick Start (One-Line Command)
|
| 24 |
+
|
| 25 |
+
If you have Git and Node.js installed, open your terminal (Command Prompt or PowerShell) and run:
|
| 26 |
+
|
| 27 |
+
`for powershell`
|
| 28 |
+
```bash
|
| 29 |
+
git clone https://huggingface.co/remiai3/RemiAI_Framework
|
| 30 |
+
cd RemiAI_Framework
|
| 31 |
+
git lfs install
|
| 32 |
+
git lfs pull
|
| 33 |
+
npm install
|
| 34 |
+
npm start
|
| 35 |
+
```
|
| 36 |
+
|
| 37 |
+
### ⚠️ IMPORTANT: Git LFS Required
|
| 38 |
+
This repository uses **Git Large File Storage (LFS)** for the AI engine binaries.
|
| 39 |
+
**If you download the ZIP or clone without LFS, the app will not work (Error: "RemiAI engine missing").**
|
| 40 |
+
|
| 41 |
+
---
|
| 42 |
+
|
| 43 |
+
## 💻 Manual Installation
|
| 44 |
+
|
| 45 |
+
### 1. Requirements
|
| 46 |
+
* **Node.js**: [Download Here](https://nodejs.org/) (Install the LTS version).
|
| 47 |
+
* **Git & Git LFS**: [Download Git](https://git-scm.com/) | [Download Git LFS](https://git-lfs.com/)
|
| 48 |
+
* **Windows Laptop**: (Code includes optimized `.exe` binaries for Windows).
|
| 49 |
+
|
| 50 |
+
### 2. Download & Setup
|
| 51 |
+
1. **Download** the project zip (or clone the repo).
|
| 52 |
+
2. **Extract** the folder.
|
| 53 |
+
3. **Open Terminal** inside the folder path.
|
| 54 |
+
4. **Pull Engine Files** (Critical Step):
|
| 55 |
+
```bash
|
| 56 |
+
git lfs install
|
| 57 |
+
git lfs pull
|
| 58 |
+
```
|
| 59 |
+
5. Run the installer for libraries:
|
| 60 |
+
```bash
|
| 61 |
+
npm install
|
| 62 |
+
```
|
| 63 |
+
|
| 64 |
+
### 3. Run the App
|
| 65 |
+
Simply type:
|
| 66 |
+
```bash
|
| 67 |
+
npm start
|
| 68 |
+
```
|
| 69 |
+
The application will launch, the AI engine will start in the background, and you can begin chatting immediately!
|
| 70 |
+
|
| 71 |
+
---
|
| 72 |
+
|
| 73 |
+
## 📦 Features
|
| 74 |
+
|
| 75 |
+
* **Zero Python Dependency**: We use compiled binaries (`.dll` and `.exe` included) so you don't need to install Python, PyTorch, or set up virtual environments.
|
| 76 |
+
* **Plug & Play Models**: Supports `.gguf` format.
|
| 77 |
+
* Want a different model? Download any `.gguf` file, rename it to `model.gguf`, and place it in the project root.
|
| 78 |
+
* **Auto-Optimization**: Automatically detects your CPU features (AVX vs AVX2) to give you the best speed possible.
|
| 79 |
+
* **Privacy First**: Runs 100% offline. No data leaves your device.
|
| 80 |
+
|
| 81 |
+
* **Privacy First**: Runs 100% offline. No data leaves your device.
|
| 82 |
+
|
| 83 |
+
---
|
| 84 |
+
|
| 85 |
+
## ❓ Troubleshooting
|
| 86 |
+
|
| 87 |
+
**Error: "RemiAI Engine Missing"**
|
| 88 |
+
This means you downloaded the "pointer" files (130 bytes) instead of the real engine.
|
| 89 |
+
**Fix**:
|
| 90 |
+
1. Open terminal in project folder.
|
| 91 |
+
2. Run `git lfs install`
|
| 92 |
+
3. Run `git lfs pull`
|
| 93 |
+
4. Restart the app.
|
| 94 |
+
|
| 95 |
+
---
|
| 96 |
+
|
| 97 |
+
## 🛠️ Credits & License
|
| 98 |
+
|
| 99 |
+
* **Created By**: RemiAI Team
|
| 100 |
+
* **License**: MIT License.
|
| 101 |
+
* *You are free to rename, modify, and distribute this application as your own project!*
|
| 102 |
+
|
| 103 |
+
**Note on Models**: The application will only uses the `.gguf` formated weights only to make it as the CPU friendly run the application without any GPU
|
| 104 |
+
---
|