Update README.md

README.md

@@ -109,7 +109,7 @@ for chat in prompts:
     print(f"Response:\n{response}\n{'-'*80}\n")
 ```
 
-### Key Adjustments:
+# **Key Adjustments**
 1. **System Prompts:** Each prompt defines a different role or persona for the AI to adopt.
 2. **User Prompts:** These specify the context or task for the assistant, ranging from teaching to storytelling or career advice.
 3. **Looping Through Prompts:** Each prompt is processed in a loop to showcase the model's versatility.
@@ -125,3 +125,93 @@ You can expand the list of prompts to explore a variety of scenarios and respons
 # **Technical Details**
 
 Triangulum 10B employs a state-of-the-art autoregressive architecture inspired by LLaMA. The optimized transformer framework ensures both efficiency and scalability, making it suitable for a variety of use cases.
+
+# **How to Run Triangulum 10B on Ollama Locally**
+
+```markdown
+# How to Run Ollama Locally
+
+This guide demonstrates the power of using open-source LLMs locally, showcasing examples with different open-source models for various use cases. By the end, you'll be equipped to run any future open-source LLM models with ease.
+
+---
+
+## Example 1: How to Run the Triangulum-10B Model
+
+The **Triangulum-10B** model is an open-source LLM known for its capabilities across text-based tasks. We'll interact with it similarly to ChatGPT, but run it locally with support for quants.
+
+### Step 1: Download the Model
+
+First, download the **Triangulum-10B-F16.gguf** model using the following command:
+
+```bash
+ollama run triangulum-10b-f16.gguf
+```
+
+### Step 2: Model Initialization and Download
+
+Upon running the command, Ollama will initialize and download the model files. You should see output similar to the following:
+
+```plaintext
+pulling manifest
+pulling 8934d96d3f08... 100% ▕██████████████████████████████████████████████████████████████████████████████████████████▏ 3.8 GB
+pulling 8c17c2ebb0ea... 100% ▕██████████████████████████████████████████████████████████████████████████████████████████▏ 7.0 KB
+pulling 7c23fb36d801... 100% ▕██████████████████████████████████████████████████████████████████████████████████████████▏ 4.8 KB
+pulling 2e0493f67d0c... 100% ▕██████████████████████████████████████████████████████████████████████████████████████████▏   59 B
+pulling fa304d675061... 100% ▕██████████████████████████████████████████████████████████████████████████████████████████▏   91 B
+pulling 42ba7f8a01dd... 100% ▕██████████████████████████████████████████████████████████████████████████████████████████▏  557 B
+verifying sha256 digest
+writing manifest
+removing any unused layers
+success
+>>> Send a message (/? for help)
+```
+
+### Step 3: Interact with the Model
+
+Once the model is ready, you can send a prompt. For example, let's ask:
+
+```plaintext
+>>> What can you do for me?
+```
+
+If you asked the same question, you should receive a response like this:
+
+```plaintext
+As a responsible AI language model, I am here to assist you with any questions or tasks you may have. Here are some examples of things I can help with:
+
+1. Answering questions: I can provide information on a wide range of topics, from science and technology to history and culture.
+2. Generating ideas: I can help you brainstorm ideas for creative projects, or provide suggestions for solving problems.
+3. Writing assistance: I can help you with writing tasks such as proofreading, editing, and suggesting alternative words or phrases.
+4. Translation: I can translate text from one language to another.
+5. Summarizing content: I can summarize long pieces of text, such as articles or documents, into shorter, more digestible versions.
+6. Creativity: I can help you generate creative ideas for stories, poems, or other forms of writing.
+7. Language learning: I can assist you in learning a new language by providing grammar explanations, vocabulary lists, and practice exercises.
+8. Chatting: I'm here to chat with you and provide a response to any question or topic you'd like to discuss.
+
+Please let me know if there is anything specific you would like me to help you with.
+```
+
+### Step 4: Exit the Program
+
+To exit the program, simply type:
+
+```plaintext
+/exit
+```
+## Example 2: Running Multi-Modal Models (Future Use)
+
+Ollama supports running multi-modal models where you can send images and ask questions based on them. This section will be updated as more models become available.
+
+## Notes on Using Quantized Models
+
+Quantized models like **triangulum-10b-f16.gguf** are optimized for performance on resource-constrained hardware, making it accessible for local inference.
+
+1. Ensure your system has sufficient VRAM or CPU resources.
+2. Use the `.gguf` model format for compatibility with Ollama.
+
+## Conclusion
+
+Running the **Triangulum-10B** model with Ollama provides a robust way to leverage open-source LLMs locally for diverse use cases. By following these steps, you can explore the capabilities of other open-source models in the future.
+
+Happy experimenting!
+```