Instructions to use FerrellSyntheticIntelligence/Vitalis_LFM2.5_Cortex.GGUF with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- llama-cpp-python
How to use FerrellSyntheticIntelligence/Vitalis_LFM2.5_Cortex.GGUF with llama-cpp-python:
# !pip install llama-cpp-python from llama_cpp import Llama llm = Llama.from_pretrained( repo_id="FerrellSyntheticIntelligence/Vitalis_LFM2.5_Cortex.GGUF", filename="LFM2.5-1.2B-Instruct-Q4_K_M.gguf", )
llm.create_chat_completion( messages = "No input example has been defined for this model task." )
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use FerrellSyntheticIntelligence/Vitalis_LFM2.5_Cortex.GGUF with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf FerrellSyntheticIntelligence/Vitalis_LFM2.5_Cortex.GGUF:Q4_K_M # Run inference directly in the terminal: llama cli -hf FerrellSyntheticIntelligence/Vitalis_LFM2.5_Cortex.GGUF:Q4_K_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf FerrellSyntheticIntelligence/Vitalis_LFM2.5_Cortex.GGUF:Q4_K_M # Run inference directly in the terminal: llama cli -hf FerrellSyntheticIntelligence/Vitalis_LFM2.5_Cortex.GGUF:Q4_K_M
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf FerrellSyntheticIntelligence/Vitalis_LFM2.5_Cortex.GGUF:Q4_K_M # Run inference directly in the terminal: ./llama-cli -hf FerrellSyntheticIntelligence/Vitalis_LFM2.5_Cortex.GGUF:Q4_K_M
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf FerrellSyntheticIntelligence/Vitalis_LFM2.5_Cortex.GGUF:Q4_K_M # Run inference directly in the terminal: ./build/bin/llama-cli -hf FerrellSyntheticIntelligence/Vitalis_LFM2.5_Cortex.GGUF:Q4_K_M
Use Docker
docker model run hf.co/FerrellSyntheticIntelligence/Vitalis_LFM2.5_Cortex.GGUF:Q4_K_M
- LM Studio
- Jan
- Ollama
How to use FerrellSyntheticIntelligence/Vitalis_LFM2.5_Cortex.GGUF with Ollama:
ollama run hf.co/FerrellSyntheticIntelligence/Vitalis_LFM2.5_Cortex.GGUF:Q4_K_M
- Unsloth Studio
How to use FerrellSyntheticIntelligence/Vitalis_LFM2.5_Cortex.GGUF with Unsloth Studio:
Install Unsloth Studio (macOS, Linux, WSL)
curl -fsSL https://unsloth.ai/install.sh | sh # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for FerrellSyntheticIntelligence/Vitalis_LFM2.5_Cortex.GGUF to start chatting
Install Unsloth Studio (Windows)
irm https://unsloth.ai/install.ps1 | iex # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for FerrellSyntheticIntelligence/Vitalis_LFM2.5_Cortex.GGUF to start chatting
Using HuggingFace Spaces for Unsloth
# No setup required # Open https://huggingface.co/spaces/unsloth/studio in your browser # Search for FerrellSyntheticIntelligence/Vitalis_LFM2.5_Cortex.GGUF to start chatting
- Pi
How to use FerrellSyntheticIntelligence/Vitalis_LFM2.5_Cortex.GGUF with Pi:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf FerrellSyntheticIntelligence/Vitalis_LFM2.5_Cortex.GGUF:Q4_K_M
Configure the model in Pi
# Install Pi: npm install -g @mariozechner/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "llama-cpp": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "FerrellSyntheticIntelligence/Vitalis_LFM2.5_Cortex.GGUF:Q4_K_M" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Hermes Agent new
How to use FerrellSyntheticIntelligence/Vitalis_LFM2.5_Cortex.GGUF with Hermes Agent:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf FerrellSyntheticIntelligence/Vitalis_LFM2.5_Cortex.GGUF:Q4_K_M
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default FerrellSyntheticIntelligence/Vitalis_LFM2.5_Cortex.GGUF:Q4_K_M
Run Hermes
hermes
- Atomic Chat new
- OpenClaw new
How to use FerrellSyntheticIntelligence/Vitalis_LFM2.5_Cortex.GGUF with OpenClaw:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf FerrellSyntheticIntelligence/Vitalis_LFM2.5_Cortex.GGUF:Q4_K_M
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:8080/v1 \ --custom-model-id "FerrellSyntheticIntelligence/Vitalis_LFM2.5_Cortex.GGUF:Q4_K_M" \ --custom-provider-id llama-cpp \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
- Docker Model Runner
How to use FerrellSyntheticIntelligence/Vitalis_LFM2.5_Cortex.GGUF with Docker Model Runner:
docker model run hf.co/FerrellSyntheticIntelligence/Vitalis_LFM2.5_Cortex.GGUF:Q4_K_M
- Lemonade
How to use FerrellSyntheticIntelligence/Vitalis_LFM2.5_Cortex.GGUF with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull FerrellSyntheticIntelligence/Vitalis_LFM2.5_Cortex.GGUF:Q4_K_M
Run and chat with the model
lemonade run user.Vitalis_LFM2.5_Cortex.GGUF-Q4_K_M
List all available models
lemonade list
| """ | |
| Neurosynthetic Quadruflow Engine — Vitalis FSI | |
| Coordinates four independent cognitive flows (semantic, algorithmic, | |
| structural, collaborative) and folds their results into a single | |
| multimodal resolution that is written to the cryptographic ledger. | |
| The engine is fully asynchronous, emits real‑time events through the | |
| `broker` (WebSocket UI broadcaster) and feeds the Self‑Model for | |
| continuous competency tracking. | |
| """ | |
| from __future__ import annotations | |
| import asyncio | |
| import random | |
| import time | |
| import uuid | |
| from dataclasses import dataclass, field | |
| from typing import Any, Dict, List | |
| # --------------------------------------------------------------------------- # | |
| # Cognition & persistence layers | |
| # --------------------------------------------------------------------------- # | |
| from src.cognition import ( | |
| PlanningCortex, | |
| ErrorLearningLoop, | |
| ConceptGraph, | |
| SelfModel, | |
| ) | |
| from src.memory.ledger import EpisodicLedger | |
| try: | |
| from src.ui.dashboard import broker | |
| except Exception: # pragma: no cover | |
| broker = None # type: ignore[assignment] | |
| # --------------------------------------------------------------------------- # | |
| # Data structures | |
| # --------------------------------------------------------------------------- # | |
| class QuadruflowState: | |
| """Container for the four parallel flow payloads.""" | |
| semantic_frame: Dict[str, Any] = field(default_factory=dict) | |
| algorithmic_frame: Dict[str, Any] = field(default_factory=dict) | |
| structural_frame: Dict[str, Any] = field(default_factory=dict) | |
| collaborative_frame: Dict[str, Any] = field(default_factory=dict) | |
| # --------------------------------------------------------------------------- # | |
| # Core engine | |
| # --------------------------------------------------------------------------- # | |
| class NeurosyntheticQuadruflowEngine: | |
| """ | |
| Orchestrates the four cognitive flows, merges their telemetry, | |
| decides on success/failure, records the outcome in the ledger and | |
| updates the Self‑Model. | |
| """ | |
| def __init__(self) -> None: | |
| self.cortex = PlanningCortex() | |
| self.loop = ErrorLearningLoop() | |
| self.graph = ConceptGraph() | |
| self.self_model = SelfModel() | |
| self.ledger = EpisodicLedger() | |
| # ------------------------------------------------------------------- # | |
| # Individual flow implementations (all async) | |
| # ------------------------------------------------------------------- # | |
| async def _execute_semantic_flow( | |
| self, task: str, context: Dict[str, Any] | |
| ) -> Dict[str, Any]: | |
| """Flow 1 – linguistic de‑construction.""" | |
| await asyncio.sleep(random.uniform(0.05, 0.15)) | |
| return { | |
| "tokens_parsed": len(task.split()), | |
| "density_index": round(random.uniform(0.6, 0.95), 3), | |
| "concepts_linked": context.get("core_concepts", []), | |
| } | |
| async def _execute_algorithmic_flow(self, task: str) -> Dict[str, Any]: | |
| """Flow 2 – planning & risk estimation.""" | |
| await asyncio.sleep(random.uniform(0.08, 0.20)) | |
| plan = self.cortex.plan(task) | |
| return { | |
| "plan_id": plan.get("plan_id", "unk"), | |
| "approach": plan.get("approach", "standard"), | |
| "estimated_risk": plan.get("risk", 0.4), | |
| } | |
| async def _execute_structural_flow(self, task: str) -> Dict[str, Any]: | |
| """Flow 3 – resource isolation & boundary checks.""" | |
| await asyncio.sleep(random.uniform(0.05, 0.12)) | |
| return { | |
| "isolation_verified": True, | |
| "boundary_overhead_bytes": random.randint(1024, 4096), | |
| } | |
| async def _execute_collaborative_flow(self, task: str) -> Dict[str, Any]: | |
| """Flow 4 – human‑intent alignment.""" | |
| await asyncio.sleep(random.uniform(0.04, 0.10)) | |
| return { | |
| "alignment_coefficient": round(random.uniform(0.85, 0.99), 3), | |
| "feedback_delta": "STABLE", | |
| } | |
| # ------------------------------------------------------------------- # | |
| # Helper: broadcast a message if a UI broker is available | |
| # ------------------------------------------------------------------- # | |
| async def _broadcast(self, payload: Dict[str, Any]) -> None: | |
| """Safely send a message to the UI; no‑op when broker is missing.""" | |
| if broker is not None: | |
| try: | |
| await broker.broadcast(payload) | |
| except Exception: # pragma: no cover | |
| pass | |
| # ------------------------------------------------------------------- # | |
| # Public entry point – runs a full Quadruflow cycle | |
| # ------------------------------------------------------------------- # | |
| async def process_quadruflow_cycle(self, task_input: str) -> Dict[str, Any]: | |
| """Execute the four flows concurrently and reconcile metrics.""" | |
| start_time = time.time() | |
| cycle_id = f"qflow_{uuid.uuid4().hex[:6]}" | |
| context = self.graph.context_for_task(task_input) | |
| await self._broadcast( | |
| { | |
| "event": "TRACE", | |
| "message": f"Initializing Quadruflow Cycle [{cycle_id}] for task: '{task_input}'", | |
| "type": "info", | |
| } | |
| ) | |
| flow_futures = asyncio.gather( | |
| self._execute_semantic_flow(task_input, context), | |
| self._execute_algorithmic_flow(task_input), | |
| self._execute_structural_flow(task_input), | |
| self._execute_collaborative_flow(task_input), | |
| ) | |
| try: | |
| semantic, algorithmic, structural, collaborative = await flow_futures | |
| except Exception as exc: # pragma: no cover | |
| await self._broadcast( | |
| { | |
| "event": "TRACE", | |
| "message": f"Critical Quadruflow processing failure: {exc}", | |
| "type": "error", | |
| } | |
| ) | |
| raise | |
| state = QuadruflowState( | |
| semantic_frame=semantic, | |
| algorithmic_frame=algorithmic, | |
| structural_frame=structural, | |
| collaborative_frame=collaborative, | |
| ) | |
| computed_risk: float = algorithmic["estimated_risk"] | |
| execution_success: bool = computed_risk < 0.55 | |
| remediation: Dict[str, Any] | None = None | |
| if not execution_success: | |
| remediation = self.loop.record_error( | |
| task=task_input, | |
| error_type="integration_fail", | |
| context=context, | |
| details=f"Quadruflow risk {computed_risk:.2f} exceeds threshold.", | |
| ) | |
| await self._broadcast( | |
| { | |
| "event": "TRACE", | |
| "message": ( | |
| f"Quadruflow Exception caught. Injecting remediation: " | |
| f"{remediation.get('recommended')}" | |
| ), | |
| "type": "error", | |
| } | |
| ) | |
| else: | |
| await self._broadcast( | |
| { | |
| "event": "TRACE", | |
| "message": "Quadruflow Convergence Complete. System State Verified.", | |
| "type": "success", | |
| } | |
| ) | |
| self.self_model.update( | |
| task=task_input, | |
| success=execution_success, | |
| confidence=1.0 - computed_risk, | |
| tier=int(computed_risk * 10), | |
| ) | |
| latency_ms = round((time.time() - start_time) * 1000, 3) | |
| metrics: Dict[str, Any] = { | |
| "cycle_id": cycle_id, | |
| "task": task_input, | |
| "latency_ms": latency_ms, | |
| "status": "SUCCESS" if execution_success else "FAILED", | |
| "quadruflow_matrices": { | |
| "flow_1_semantic": state.semantic_frame, | |
| "flow_2_algorithmic": state.algorithmic_frame, | |
| "flow_3_structural": state.structural_frame, | |
| "flow_4_collaborative": state.collaborative_frame, | |
| }, | |
| "remediation": remediation, | |
| } | |
| block_hash = self.ledger.record_event( | |
| event_type="NEUROSYNTHETIC_QUADRUFLOW_RESOLUTION", | |
| payload=metrics, | |
| ) | |
| await self._broadcast( | |
| { | |
| "event": "SYSTEM_SYNC", | |
| "data": { | |
| "self_model": self.self_model._state, | |
| "memory_chain": [{"block_hash": block_hash}], | |
| }, | |
| } | |
| ) | |
| await self._broadcast( | |
| { | |
| "event": "TRACE", | |
| "message": ( | |
| f"Quadruflow block compiled. Ledger hash anchor: {block_hash[:16]}..." | |
| ), | |
| "type": "success", | |
| "speech": f"Quadruflow resolved. Engine tracking at {latency_ms} milliseconds.", | |
| } | |
| ) | |
| return metrics | |