GGUF
conversational
How to use from
llama.cpp
Install from brew
brew install llama.cpp
# Start a local OpenAI-compatible server with a web UI:
llama-server -hf shafire/SpectraMindQ:F16
# Run inference directly in the terminal:
llama-cli -hf shafire/SpectraMindQ:F16
Install from WinGet (Windows)
winget install llama.cpp
# Start a local OpenAI-compatible server with a web UI:
llama-server -hf shafire/SpectraMindQ:F16
# Run inference directly in the terminal:
llama-cli -hf shafire/SpectraMindQ:F16
Use pre-built binary
# Download pre-built binary from:
# https://github.com/ggerganov/llama.cpp/releases
# Start a local OpenAI-compatible server with a web UI:
./llama-server -hf shafire/SpectraMindQ:F16
# Run inference directly in the terminal:
./llama-cli -hf shafire/SpectraMindQ:F16
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git
cd llama.cpp
cmake -B build
cmake --build build -j --target llama-server llama-cli
# Start a local OpenAI-compatible server with a web UI:
./build/bin/llama-server -hf shafire/SpectraMindQ:F16
# Run inference directly in the terminal:
./build/bin/llama-cli -hf shafire/SpectraMindQ:F16
Use Docker
docker model run hf.co/shafire/SpectraMindQ:F16
Quick Links

SpectraMind Quantum LLM GGUF-Compatible and Fully Optimized

SpectraMind

SpectraMind is an advanced, multi-layered language model based on the Zephyr 7B architecture, built with quantum-inspired data processing techniques. Trained on custom datasets with unique quantum reasoning enhancements, SpectraMind integrates ethical decision-making frameworks with deep problem-solving capabilities, handling complex, multi-dimensional tasks with precision.

SpectraMind Performance

Watch Our Model in Action

LICENSE: Zero Public Licence v1.0 Section 1 โ€“ Safety layer must stay intact. Section 2 โ€“ Export to states under UK embargo requires licence. Section 3 โ€“ Author disclaims forks that remove Section 1 or 2.

Use Cases:
This model is ideal for advanced NLP tasks, including ethical decision-making, multi-variable reasoning, and comprehensive problem-solving in quantum and mathematical contexts.

Key Highlights of SpectraMind:

  • Quantum-Enhanced Reasoning: Designed for tackling complex ethical questions and multi-layered logic problems, SpectraMind applies quantum-math techniques in AI for nuanced solutions.
  • Refined Dataset Curation: Data was refined over multiple iterations, focusing on clarity and consistency, to align with SpectraMind's quantum-based reasoning.
  • Iterative Training: The model underwent extensive testing phases to ensure accurate and reliable responses.
  • Optimized for CPU Inference: Compatible with web UIs and desktop interfaces like oobabooga and lm studio, and performs well in self-hosted environments for CPU-only setups.

Model Overview

  • Developer: Shafaet Brady Hussain - ResearchForum
  • Funded by: Researchforum.online
  • Language: English
  • Model Type: Causal Language Model
  • Base Model: Zephyr 7B Beta (HuggingFaceH4)
  • License: Apache-2.0

Usage: Run on any web interface or as a bot for self-hosted solutions. Designed to run smoothly on CPU.

Tested on CPU - Ideal for Local and Self-Hosted Environments

AGENT INTERFACE DETAILS:
SpectraMind Agent Interface


Usage Code Example:

You can load and interact with SpectraMind using the following code snippet:

from transformers import AutoModelForCausalLM, AutoTokenizer

model_path = "PATH_TO_THIS_REPO"

tokenizer = AutoTokenizer.from_pretrained(model_path)
model = AutoModelForCausalLM.from_pretrained(
    model_path,
    device_map="auto",
    torch_dtype="auto"
).eval()

# Example prompt
messages = [
    {"role": "user", "content": "What challenges do you enjoy solving?"}
]

input_ids = tokenizer.apply_chat_template(conversation=messages, tokenize=True, add_generation_prompt=True, return_tensors="pt")
output_ids = model.generate(input_ids.to("cuda"))
response = tokenizer.decode(output_ids[0][input_ids.shape[1]:], skip_special_tokens=True)

print(response)  # Prints the model's response
Downloads last month
24
GGUF
Model size
7B params
Architecture
llama
Hardware compatibility
Log In to add your hardware

16-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support