Krishkanth commited on
Commit
56da54b
Β·
verified Β·
1 Parent(s): d3ebca4

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +179 -0
README.md CHANGED
@@ -1,3 +1,182 @@
1
  ---
2
  license: apache-2.0
 
 
 
 
 
 
 
 
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: apache-2.0
3
+ tags:
4
+ - GGUF
5
+ - conversational
6
+ - krish-mind
7
+ - ai-assistant
8
+ language:
9
+ - en
10
+ pipeline_tag: text-generation
11
  ---
12
+
13
+ # 🧠 Krish Mind
14
+
15
+ **Krish Mind** is an independent AI assistant created by **Krish CS**. It is designed to be helpful, intelligent, and friendly.
16
+
17
+ This repository contains the model in **GGUF format**, which is optimized for running on regular computers (CPUs) without needing expensive GPUs.
18
+
19
+ ---
20
+
21
+ ## πŸ“¦ Available Model Files
22
+
23
+ | File Name | Size | Best For | RAM Required |
24
+ |-----------|------|----------|--------------|
25
+ | `krish-mind-standalone-Q4.gguf` | **~5 GB** | πŸ–₯️ Most computers, Free cloud services | **8-16 GB** |
26
+ | `krish-mind-standalone.gguf` | **~16 GB** | πŸ’ͺ Powerful computers, Best quality | **32+ GB** |
27
+
28
+ ### Which one should I download?
29
+
30
+ - **If you have a normal computer (8-16 GB RAM):** Download the **Q4** version.
31
+ - **If you have a powerful computer (32+ GB RAM):** Download the **Full** version for best quality.
32
+
33
+ ---
34
+
35
+ ## πŸš€ How to Use (Step-by-Step for Beginners)
36
+
37
+ You have **3 easy options** to run Krish Mind on your computer:
38
+
39
+ ---
40
+
41
+ ### Option 1: Use with Ollama (Easiest! Recommended for Beginners)
42
+
43
+ [Ollama](https://ollama.ai) is a free app that lets you run AI models with just one click.
44
+
45
+ **Steps:**
46
+
47
+ 1. **Download and Install Ollama:**
48
+ - Go to [https://ollama.ai/download](https://ollama.ai/download)
49
+ - Download the installer for your system (Windows/Mac/Linux)
50
+ - Install it like any other app
51
+
52
+ 2. **Download the Model File:**
53
+ - Click on `krish-mind-standalone-Q4.gguf` above
54
+ - Click the **Download** button
55
+ - Save it somewhere you can find (e.g., your Downloads folder)
56
+
57
+ 3. **Create a Modelfile:**
58
+ - Open Notepad (or any text editor)
59
+ - Type this:
60
+ ```
61
+ FROM ./krish-mind-standalone-Q4.gguf
62
+ ```
63
+ - Save it as `Modelfile` (no extension) in the same folder as the .gguf file
64
+
65
+ 4. **Open Terminal/Command Prompt:**
66
+ - Navigate to the folder with your files
67
+ - Run this command:
68
+ ```
69
+ ollama create krish-mind -f Modelfile
70
+ ```
71
+
72
+ 5. **Chat with Krish Mind:**
73
+ ```
74
+ ollama run krish-mind
75
+ ```
76
+
77
+ Now you can type messages and chat! πŸŽ‰
78
+
79
+ ---
80
+
81
+ ### Option 2: Use with LM Studio (Visual App, No Coding!)
82
+
83
+ [LM Studio](https://lmstudio.ai) is a beautiful desktop app for running AI models.
84
+
85
+ **Steps:**
86
+
87
+ 1. **Download LM Studio:**
88
+ - Go to [https://lmstudio.ai](https://lmstudio.ai)
89
+ - Download for your operating system
90
+ - Install and open it
91
+
92
+ 2. **Load the Model:**
93
+ - In LM Studio, click **"My Models"** (left sidebar)
94
+ - Click **"Import from file"**
95
+ - Select the `krish-mind-standalone-Q4.gguf` file you downloaded
96
+
97
+ 3. **Start Chatting:**
98
+ - Click on the model to load it
99
+ - Use the chat interface to talk with Krish Mind!
100
+
101
+ ---
102
+
103
+ ### Option 3: Use with Python (For Developers)
104
+
105
+ If you know Python, you can use the `gguf` compatible libraries to load and run the model.
106
+
107
+ **Requirements:**
108
+ - Python 3.8 or newer
109
+ - 8+ GB RAM (for Q4) or 32+ GB RAM (for Full)
110
+
111
+ **Installation:**
112
+ ```bash
113
+ pip install ctransformers
114
+ ```
115
+
116
+ **Code Example:**
117
+ ```python
118
+ from ctransformers import AutoModelForCausalLM
119
+
120
+ # Load the model (use the Q4 version for most computers)
121
+ model = AutoModelForCausalLM.from_pretrained(
122
+ "Krishkanth/krish-mind",
123
+ model_file="krish-mind-standalone-Q4.gguf",
124
+ model_type="llama"
125
+ )
126
+
127
+ # Chat with the model
128
+ response = model("Hello! Who are you?")
129
+ print(response)
130
+ ```
131
+
132
+ ---
133
+
134
+ ## πŸ’» System Requirements
135
+
136
+ ### Minimum (for Q4 version):
137
+ - **RAM:** 8 GB (16 GB recommended)
138
+ - **Storage:** 6 GB free space
139
+ - **CPU:** Any modern processor (Intel i5/AMD Ryzen 5 or better)
140
+ - **GPU:** Not required! Works on CPU only.
141
+
142
+ ### Recommended (for Full version):
143
+ - **RAM:** 32 GB or more
144
+ - **Storage:** 20 GB free space
145
+ - **CPU:** Intel i7/AMD Ryzen 7 or better
146
+ - **GPU:** Optional but helpful
147
+
148
+ ---
149
+
150
+ ## ❓ Frequently Asked Questions
151
+
152
+ ### Q: What is GGUF?
153
+ **A:** GGUF is a file format that makes AI models smaller and faster. It allows you to run AI on your own computer without needing expensive cloud services or GPUs.
154
+
155
+ ### Q: What's the difference between Q4 and Full version?
156
+ **A:**
157
+ - **Q4** = Compressed version, smaller file, uses less RAM, slightly lower quality
158
+ - **Full** = Original quality, bigger file, needs more RAM, best responses
159
+
160
+ ### Q: Can I run this on my phone?
161
+ **A:** Not directly, but there are some Android apps that support GGUF models. Check out "Maid" or "LLM Farm" on the app stores.
162
+
163
+ ### Q: Is this free to use?
164
+ **A:** Yes! This model is released under the Apache 2.0 license. You can use it for personal or commercial projects.
165
+
166
+ ---
167
+
168
+ ## πŸ™ Credits
169
+
170
+ - **Created by:** Krish CS
171
+ - **Model:** Krish Mind - An independent AI assistant
172
+
173
+ ---
174
+
175
+ ## πŸ“ž Need Help?
176
+
177
+ If you have questions or run into problems:
178
+ 1. Check the FAQ above
179
+ 2. Open an issue in the "Community" tab above
180
+ 3. Make sure you have enough RAM for the model you chose
181
+
182
+ Happy chatting with Krish Mind! 🧠✨