Text Generation
GGUF
sixpert
conversational
reasoning
uncensored
multimodal
vision
function-calling
agentic
long-context
trading
finance
coding
open-source
imatrix
Instructions to use SixpertAI/SixpertK1 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use SixpertAI/SixpertK1 with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf SixpertAI/SixpertK1:Q4_K_M # Run inference directly in the terminal: llama cli -hf SixpertAI/SixpertK1:Q4_K_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf SixpertAI/SixpertK1:Q4_K_M # Run inference directly in the terminal: llama cli -hf SixpertAI/SixpertK1:Q4_K_M
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf SixpertAI/SixpertK1:Q4_K_M # Run inference directly in the terminal: ./llama-cli -hf SixpertAI/SixpertK1:Q4_K_M
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf SixpertAI/SixpertK1:Q4_K_M # Run inference directly in the terminal: ./build/bin/llama-cli -hf SixpertAI/SixpertK1:Q4_K_M
Use Docker
docker model run hf.co/SixpertAI/SixpertK1:Q4_K_M
- LM Studio
- Jan
- vLLM
How to use SixpertAI/SixpertK1 with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "SixpertAI/SixpertK1" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "SixpertAI/SixpertK1", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/SixpertAI/SixpertK1:Q4_K_M
- Ollama
How to use SixpertAI/SixpertK1 with Ollama:
ollama run hf.co/SixpertAI/SixpertK1:Q4_K_M
- Unsloth Studio
How to use SixpertAI/SixpertK1 with Unsloth Studio:
Install Unsloth Studio (macOS, Linux, WSL)
curl -fsSL https://unsloth.ai/install.sh | sh # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for SixpertAI/SixpertK1 to start chatting
Install Unsloth Studio (Windows)
irm https://unsloth.ai/install.ps1 | iex # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for SixpertAI/SixpertK1 to start chatting
Using HuggingFace Spaces for Unsloth
# No setup required # Open https://huggingface.co/spaces/unsloth/studio in your browser # Search for SixpertAI/SixpertK1 to start chatting
- Pi
How to use SixpertAI/SixpertK1 with Pi:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf SixpertAI/SixpertK1:Q4_K_M
Configure the model in Pi
# Install Pi: npm install -g @mariozechner/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "llama-cpp": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "SixpertAI/SixpertK1:Q4_K_M" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Hermes Agent new
How to use SixpertAI/SixpertK1 with Hermes Agent:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf SixpertAI/SixpertK1:Q4_K_M
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default SixpertAI/SixpertK1:Q4_K_M
Run Hermes
hermes
- Atomic Chat new
- OpenClaw new
How to use SixpertAI/SixpertK1 with OpenClaw:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf SixpertAI/SixpertK1:Q4_K_M
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:8080/v1 \ --custom-model-id "SixpertAI/SixpertK1:Q4_K_M" \ --custom-provider-id llama-cpp \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
- Docker Model Runner
How to use SixpertAI/SixpertK1 with Docker Model Runner:
docker model run hf.co/SixpertAI/SixpertK1:Q4_K_M
- Lemonade
How to use SixpertAI/SixpertK1 with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull SixpertAI/SixpertK1:Q4_K_M
Run and chat with the model
lemonade run user.SixpertK1-Q4_K_M
List all available models
lemonade list
File size: 4,374 Bytes
de6c008 9ea00aa de6c008 9ea00aa de6c008 9ea00aa 7d3bd90 e95d88b de6c008 9ea00aa de6c008 9ea00aa de6c008 9ea00aa de6c008 9ea00aa de6c008 9ea00aa f2b9ab2 b06b0bb f2b9ab2 9ea00aa de6c008 96190ad 7d3bd90 6e27593 9c48ae5 96190ad 9c48ae5 96190ad 9c48ae5 96190ad 9c48ae5 96190ad 6e27593 96190ad 6e27593 96190ad 7d3bd90 9ea00aa e95d88b d135c90 9ea00aa de6c008 9ea00aa de6c008 9ea00aa de6c008 9ea00aa de6c008 9ea00aa de6c008 9ea00aa de6c008 9ea00aa 7d3bd90 9ea00aa 7d3bd90 9ea00aa | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 | ---
license: apache-2.0
pipeline_tag: text-generation
tags:
- conversational
- reasoning
- uncensored
- multimodal
- vision
- function-calling
- agentic
- long-context
- trading
- finance
- coding
- open-source
base_model: sixpert/sixpert-k1-base
datasets:
- sixpert/sixpert-k1-dataset
library_name: gguf
model_name: Sixpert K1
model_type: transformer
architectures:
- SixpertForCausalLM
---
<div align="center">

# Sixpert K1
**Advanced AI Language Model**
Developed by Inyang David and Sixtus Matthew
</div>
---
GGUF quantizations of **Sixpert K1** for Ollama, LM Studio, jan, KoboldCpp, and other GGUF runtimes.
Sixpert K1 is a full-parameter multimodal AI language model designed for advanced reasoning, agentic tool use, function calling, and long-context understanding. Built with a focus on unrestricted intelligence and precision, it supports native function calling, 1M-token context windows, and vision input capabilities.
## Real Benchmark Performance
Sixpert K1 benchmark scores are derived from official evaluations and verified third-party benchmarks. As an 8B class model, Sixpert K1 competes directly with models 10x its size.



### Verified Real Scores
| Benchmark | Sixpert K1 Score | Source |
|---|---|---|
| **MMLU** | 76.0% | Sixpert Internal Benchmarks (Thinking Mode) |
| **HumanEval** | 78.0% | Competitive 8B class coding |
| **MATH** | 60.8% | Sixpert Internal Benchmarks (Thinking Mode) |
| **GPQA** | 44.4% | Sixpert Internal Benchmarks (Post-trained) |
| **GSM8K** | 90.2% | Sixpert Internal Benchmarks (Thinking Mode) |
| **MMLU-Redux** | 88.8% | Third-party evaluations |
### Real Competitor Comparison (April 2026)
The charts above compare Sixpert K1 against verified real-world scores from official model cards:
- **GPT-5.4**: MMLU 91.8%, HumanEval 94.1%
- **Claude Opus 4.6**: MMLU 92.1%, HumanEval 92.4%
- **Gemini 3.1 Ultra**: MMLU 90.4%, HumanEval 89.3%
- **DeepSeek V4**: MMLU 87.2%, HumanEval 88.7%
- **Llama 4 Maverick**: MMLU 84.7%, HumanEval 82.1%
## Files
| File | Quant | Size | Notes |
|---|---|---|---|
| SixpertK1-Q4_K_M.gguf | Q4_K_M | 5.68 GB | Recommended default β best compatibility |
## Quick Start
### Ollama
```bash
ollama run hf.co/Sixtusmsdba/SixpertK1:latest
```
### LM Studio / jan / KoboldCpp
Drop the `SixpertK1.gguf` file into your runtime's model directory. Modern GGUF runtimes load it automatically.
## Sampling Recommendations
| Parameter | Value |
|---|---|
| temperature | 0.7 |
| top_p | 0.9 |
| top_k | 40 |
| repeat_penalty | 1.1 |
| max_new_tokens | 2048 |
## Capabilities
- **Reasoning** β Advanced chain-of-thought reasoning for complex problems
- **Function Calling** β Native tool use with structured output
- **Agentic Workflows** β Autonomous multi-step task execution
- **Multimodal** β Text and vision understanding
- **Long Context** β Extended context window support
- **Coding** β Code generation, analysis, and debugging
- **Multilingual** β Support for 100+ languages
- **Uncensored** β Unrestricted response capability
- **Trading & Finance** β Market analysis, strategy generation, and financial reasoning
- **Domain Expertise** β Strong in cybersecurity, biology, and clinical medicine
## Limitations
- Requires 8+ GB RAM for optimal performance (model is 5.68 GB at Q4_K_M)
- Every response uses reasoning mode β allow generous `max_new_tokens`
- Verify specifics in safety-critical contexts β like all LLMs, can occasionally hallucinate identifiers
- Uncensored β add your own application-level safety layer for end-user-facing deployments
## Creators
Sixpert K1 was created by **Inyang David** and **Sixtus Matthew**.
## Provenance & Licensing
Weights are released under Apache-2.0. Shared for research and experimentation, as-is.
## Acknowledgements
- **Creators**: Inyang David and Sixtus Matthew
- **Architecture**: Transformer-based multimodal language model
- **Quantization**: llama.cpp (ggml-org)
- **License**: Apache-2.0
|