Update README.md
Browse files
README.md
CHANGED
|
@@ -13,12 +13,12 @@ base_model:
|
|
| 13 |
|
| 14 |
# Nakshatra: Human-like Conversational AI Prototype
|
| 15 |
|
| 16 |
-
**, Nakshatra leverages advanced conversational techniques to deliver highly coherent, empathetic, and contextually aware interactions, making it a major leap forward in AI-human interaction.
|
| 20 |
|
| 21 |
-
- Delivers near-human conversational quality and responsiveness.
|
| 22 |
- Exhibits deep contextual understanding and emotional intelligence in interactions.
|
| 23 |
- Aimed at providing more natural, emotionally intuitive dialogue experiences.- Aimed at providing more natural, emotionally intuitive dialogue experiences.
|
| 24 |
|
|
@@ -34,9 +34,9 @@ import torch
|
|
| 34 |
from transformers import AutoModelForCausalLM, AutoTokenizer
|
| 35 |
|
| 36 |
# Load the Nakshatra model
|
| 37 |
-
model = AutoModelForCausalLM.from_pretrained("
|
| 38 |
# Load the tokenizer
|
| 39 |
-
tokenizer = AutoTokenizer.from_pretrained("
|
| 40 |
|
| 41 |
# Define the chat input
|
| 42 |
chat = [
|
|
@@ -75,9 +75,9 @@ from webscout.Local import formats
|
|
| 75 |
from webscout.Local.samplers import SamplerSettings
|
| 76 |
|
| 77 |
# Download the model
|
| 78 |
-
repo_id = "
|
| 79 |
-
filename = "nakshatra-
|
| 80 |
-
model_path = download_model(repo_id, filename, token=
|
| 81 |
|
| 82 |
# Load the model
|
| 83 |
model = Model(model_path, n_gpu_layers=40)
|
|
|
|
| 13 |
|
| 14 |
# Nakshatra: Human-like Conversational AI Prototype
|
| 15 |
|
| 16 |
+

|
| 17 |
|
| 18 |
## Overview
|
| 19 |
Nakshatra is a groundbreaking prototype AI model, boasting **10x** better human-like responses compared to the previous HelpingAI models. Designed by **Abhay Koul (OEvortex)**, Nakshatra leverages advanced conversational techniques to deliver highly coherent, empathetic, and contextually aware interactions, making it a major leap forward in AI-human interaction.
|
| 20 |
|
| 21 |
+
- Delivers near-human conversational quality and responsiveness.- Delivers near-human conversational quality and responsiveness.
|
| 22 |
- Exhibits deep contextual understanding and emotional intelligence in interactions.
|
| 23 |
- Aimed at providing more natural, emotionally intuitive dialogue experiences.- Aimed at providing more natural, emotionally intuitive dialogue experiences.
|
| 24 |
|
|
|
|
| 34 |
from transformers import AutoModelForCausalLM, AutoTokenizer
|
| 35 |
|
| 36 |
# Load the Nakshatra model
|
| 37 |
+
model = AutoModelForCausalLM.from_pretrained("OEvortex/Nakshatra", trust_remote_code=True)
|
| 38 |
# Load the tokenizer
|
| 39 |
+
tokenizer = AutoTokenizer.from_pretrained("OEvortex/Nakshatra", trust_remote_code=True)
|
| 40 |
|
| 41 |
# Define the chat input
|
| 42 |
chat = [
|
|
|
|
| 75 |
from webscout.Local.samplers import SamplerSettings
|
| 76 |
|
| 77 |
# Download the model
|
| 78 |
+
repo_id = "OEvortex/Nakshatra"
|
| 79 |
+
filename = "nakshatra-q4_k_m.gguf"
|
| 80 |
+
model_path = download_model(repo_id, filename, token=None)
|
| 81 |
|
| 82 |
# Load the model
|
| 83 |
model = Model(model_path, n_gpu_layers=40)
|