Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Buckets new
  • Docs
  • Enterprise
  • Pricing
    • Website
      • Tasks
      • HuggingChat
      • Collections
      • Languages
      • Organizations
    • Community
      • Blog
      • Posts
      • Daily Papers
      • Learn
      • Discord
      • Forum
      • GitHub
    • Solutions
      • Team & Enterprise
      • Hugging Face PRO
      • Enterprise Support
      • Inference Providers
      • Inference Endpoints
      • Storage Buckets

  • Log In
  • Sign Up

cyberviser
/
0AI-CyberViserAI-PeachTreeAI-HancockAuditorAI

Safetensors
GGUF
mistral
conversational
Model card Files Files and versions
xet
Community

Instructions to use cyberviser/0AI-CyberViserAI-PeachTreeAI-HancockAuditorAI with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

  • Libraries
  • llama-cpp-python

    How to use cyberviser/0AI-CyberViserAI-PeachTreeAI-HancockAuditorAI with llama-cpp-python:

    # !pip install llama-cpp-python
    
    from llama_cpp import Llama
    
    llm = Llama.from_pretrained(
    	repo_id="cyberviser/0AI-CyberViserAI-PeachTreeAI-HancockAuditorAI",
    	filename="hancock-model.q4_k_m.gguf",
    )
    
    llm.create_chat_completion(
    	messages = "No input example has been defined for this model task."
    )
  • Notebooks
  • Google Colab
  • Kaggle
  • Local Apps Settings
  • llama.cpp

    How to use cyberviser/0AI-CyberViserAI-PeachTreeAI-HancockAuditorAI with llama.cpp:

    Install (macOS, Linux)
    curl -LsSf https://llama.app/install.sh | sh
    # Start a local OpenAI-compatible server with a web UI:
    llama serve -hf cyberviser/0AI-CyberViserAI-PeachTreeAI-HancockAuditorAI:Q4_K_M
    # Run inference directly in the terminal:
    llama cli -hf cyberviser/0AI-CyberViserAI-PeachTreeAI-HancockAuditorAI:Q4_K_M
    Install from WinGet (Windows)
    winget install llama.cpp
    # Start a local OpenAI-compatible server with a web UI:
    llama serve -hf cyberviser/0AI-CyberViserAI-PeachTreeAI-HancockAuditorAI:Q4_K_M
    # Run inference directly in the terminal:
    llama cli -hf cyberviser/0AI-CyberViserAI-PeachTreeAI-HancockAuditorAI:Q4_K_M
    Use pre-built binary
    # Download pre-built binary from:
    # https://github.com/ggerganov/llama.cpp/releases
    # Start a local OpenAI-compatible server with a web UI:
    ./llama-server -hf cyberviser/0AI-CyberViserAI-PeachTreeAI-HancockAuditorAI:Q4_K_M
    # Run inference directly in the terminal:
    ./llama-cli -hf cyberviser/0AI-CyberViserAI-PeachTreeAI-HancockAuditorAI:Q4_K_M
    Build from source code
    git clone https://github.com/ggerganov/llama.cpp.git
    cd llama.cpp
    cmake -B build
    cmake --build build -j --target llama-server llama-cli
    # Start a local OpenAI-compatible server with a web UI:
    ./build/bin/llama-server -hf cyberviser/0AI-CyberViserAI-PeachTreeAI-HancockAuditorAI:Q4_K_M
    # Run inference directly in the terminal:
    ./build/bin/llama-cli -hf cyberviser/0AI-CyberViserAI-PeachTreeAI-HancockAuditorAI:Q4_K_M
    Use Docker
    docker model run hf.co/cyberviser/0AI-CyberViserAI-PeachTreeAI-HancockAuditorAI:Q4_K_M
  • LM Studio
  • Jan
  • Ollama

    How to use cyberviser/0AI-CyberViserAI-PeachTreeAI-HancockAuditorAI with Ollama:

    ollama run hf.co/cyberviser/0AI-CyberViserAI-PeachTreeAI-HancockAuditorAI:Q4_K_M
  • Unsloth Studio

    How to use cyberviser/0AI-CyberViserAI-PeachTreeAI-HancockAuditorAI with Unsloth Studio:

    Install Unsloth Studio (macOS, Linux, WSL)
    curl -fsSL https://unsloth.ai/install.sh | sh
    # Run unsloth studio
    unsloth studio -H 0.0.0.0 -p 8888
    # Then open http://localhost:8888 in your browser
    # Search for cyberviser/0AI-CyberViserAI-PeachTreeAI-HancockAuditorAI to start chatting
    Install Unsloth Studio (Windows)
    irm https://unsloth.ai/install.ps1 | iex
    # Run unsloth studio
    unsloth studio -H 0.0.0.0 -p 8888
    # Then open http://localhost:8888 in your browser
    # Search for cyberviser/0AI-CyberViserAI-PeachTreeAI-HancockAuditorAI to start chatting
    Using HuggingFace Spaces for Unsloth
    # No setup required
    # Open https://huggingface.co/spaces/unsloth/studio in your browser
    # Search for cyberviser/0AI-CyberViserAI-PeachTreeAI-HancockAuditorAI to start chatting
  • Pi

    How to use cyberviser/0AI-CyberViserAI-PeachTreeAI-HancockAuditorAI with Pi:

    Start the llama.cpp server
    # Install llama.cpp:
    brew install llama.cpp
    # Start a local OpenAI-compatible server:
    llama serve -hf cyberviser/0AI-CyberViserAI-PeachTreeAI-HancockAuditorAI:Q4_K_M
    Configure the model in Pi
    # Install Pi:
    npm install -g @mariozechner/pi-coding-agent
    # Add to ~/.pi/agent/models.json:
    {
      "providers": {
        "llama-cpp": {
          "baseUrl": "http://localhost:8080/v1",
          "api": "openai-completions",
          "apiKey": "none",
          "models": [
            {
              "id": "cyberviser/0AI-CyberViserAI-PeachTreeAI-HancockAuditorAI:Q4_K_M"
            }
          ]
        }
      }
    }
    Run Pi
    # Start Pi in your project directory:
    pi
  • Hermes Agent new

    How to use cyberviser/0AI-CyberViserAI-PeachTreeAI-HancockAuditorAI with Hermes Agent:

    Start the llama.cpp server
    # Install llama.cpp:
    brew install llama.cpp
    # Start a local OpenAI-compatible server:
    llama serve -hf cyberviser/0AI-CyberViserAI-PeachTreeAI-HancockAuditorAI:Q4_K_M
    Configure Hermes
    # Install Hermes:
    curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash
    hermes setup
    # Point Hermes at the local server:
    hermes config set model.provider custom
    hermes config set model.base_url http://127.0.0.1:8080/v1
    hermes config set model.default cyberviser/0AI-CyberViserAI-PeachTreeAI-HancockAuditorAI:Q4_K_M
    Run Hermes
    hermes
  • Atomic Chat new
  • OpenClaw new

    How to use cyberviser/0AI-CyberViserAI-PeachTreeAI-HancockAuditorAI with OpenClaw:

    Start the llama.cpp server
    # Install llama.cpp:
    brew install llama.cpp
    # Start a local OpenAI-compatible server:
    llama serve -hf cyberviser/0AI-CyberViserAI-PeachTreeAI-HancockAuditorAI:Q4_K_M
    Configure OpenClaw
    # Install OpenClaw:
    npm install -g openclaw@latest
    # Register the local server and set it as the default model:
    openclaw onboard --non-interactive --mode local \
      --auth-choice custom-api-key \
      --custom-base-url http://127.0.0.1:8080/v1 \
      --custom-model-id "cyberviser/0AI-CyberViserAI-PeachTreeAI-HancockAuditorAI:Q4_K_M" \
      --custom-provider-id llama-cpp \
      --custom-compatibility openai \
      --custom-text-input \
      --accept-risk \
      --skip-health
    Run OpenClaw
    openclaw agent --local --agent main --message "Hello from Hugging Face"
  • Docker Model Runner

    How to use cyberviser/0AI-CyberViserAI-PeachTreeAI-HancockAuditorAI with Docker Model Runner:

    docker model run hf.co/cyberviser/0AI-CyberViserAI-PeachTreeAI-HancockAuditorAI:Q4_K_M
  • Lemonade

    How to use cyberviser/0AI-CyberViserAI-PeachTreeAI-HancockAuditorAI with Lemonade:

    Pull the model
    # Download Lemonade from https://lemonade-server.ai/
    lemonade pull cyberviser/0AI-CyberViserAI-PeachTreeAI-HancockAuditorAI:Q4_K_M
    Run and chat with the model
    lemonade run user.0AI-CyberViserAI-PeachTreeAI-HancockAuditorAI-Q4_K_M
    List all available models
    lemonade list

You need to agree to share your contact information to access this model

This repository is publicly accessible, but you have to accept the conditions to access its files and content.

Log in or Sign Up to review the conditions and access this model content.

Gated model
You can list files but not access them

Preview of files found in this repository
  • .gitattributes
    1.58 kB
    Upload hancock-model.q4_k_m.gguf with huggingface_hub 2 months ago
  • chat_template.jinja
    3.96 kB
    Upload folder using huggingface_hub 2 months ago
  • config.json
    753 Bytes
    Upload folder using huggingface_hub 2 months ago
  • hancock-model.q4_k_m.gguf
    4.37 GB
    xet
    Update metadata (tokenizer.ggml.add_sep_token) about 1 month ago
  • model-00001-of-00003.safetensors
    4.95 GB
    xet
    Upload folder using huggingface_hub 2 months ago
  • model-00002-of-00003.safetensors
    5 GB
    xet
    Upload folder using huggingface_hub 2 months ago
  • model-00003-of-00003.safetensors
    4.55 GB
    xet
    Upload folder using huggingface_hub 2 months ago
  • model.safetensors.index.json
    24 kB
    Upload folder using huggingface_hub 2 months ago
  • tokenizer.json
    3.67 MB
    Upload folder using huggingface_hub 2 months ago
  • tokenizer.model
    587 kB
    xet
    Upload folder using huggingface_hub 2 months ago
  • tokenizer_config.json
    141 kB
    Upload folder using huggingface_hub 2 months ago