Instructions to use RifeTechnology/HYDRA-Full-V1 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use RifeTechnology/HYDRA-Full-V1 with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="RifeTechnology/HYDRA-Full-V1") messages = [ {"role": "user", "content": "Who are you?"}, ] pipe(messages)# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("RifeTechnology/HYDRA-Full-V1", device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use RifeTechnology/HYDRA-Full-V1 with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf RifeTechnology/HYDRA-Full-V1:Q4_K_M # Run inference directly in the terminal: llama cli -hf RifeTechnology/HYDRA-Full-V1:Q4_K_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf RifeTechnology/HYDRA-Full-V1:Q4_K_M # Run inference directly in the terminal: llama cli -hf RifeTechnology/HYDRA-Full-V1:Q4_K_M
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf RifeTechnology/HYDRA-Full-V1:Q4_K_M # Run inference directly in the terminal: ./llama-cli -hf RifeTechnology/HYDRA-Full-V1:Q4_K_M
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf RifeTechnology/HYDRA-Full-V1:Q4_K_M # Run inference directly in the terminal: ./build/bin/llama-cli -hf RifeTechnology/HYDRA-Full-V1:Q4_K_M
Use Docker
docker model run hf.co/RifeTechnology/HYDRA-Full-V1:Q4_K_M
- LM Studio
- Jan
- vLLM
How to use RifeTechnology/HYDRA-Full-V1 with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "RifeTechnology/HYDRA-Full-V1" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "RifeTechnology/HYDRA-Full-V1", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/RifeTechnology/HYDRA-Full-V1:Q4_K_M
- SGLang
How to use RifeTechnology/HYDRA-Full-V1 with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "RifeTechnology/HYDRA-Full-V1" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "RifeTechnology/HYDRA-Full-V1", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "RifeTechnology/HYDRA-Full-V1" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "RifeTechnology/HYDRA-Full-V1", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }' - Ollama
How to use RifeTechnology/HYDRA-Full-V1 with Ollama:
ollama run hf.co/RifeTechnology/HYDRA-Full-V1:Q4_K_M
- Unsloth Studio
How to use RifeTechnology/HYDRA-Full-V1 with Unsloth Studio:
Install Unsloth Studio (macOS, Linux, WSL)
curl -fsSL https://unsloth.ai/install.sh | sh # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for RifeTechnology/HYDRA-Full-V1 to start chatting
Install Unsloth Studio (Windows)
irm https://unsloth.ai/install.ps1 | iex # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for RifeTechnology/HYDRA-Full-V1 to start chatting
Using HuggingFace Spaces for Unsloth
# No setup required # Open https://huggingface.co/spaces/unsloth/studio in your browser # Search for RifeTechnology/HYDRA-Full-V1 to start chatting
- Pi
How to use RifeTechnology/HYDRA-Full-V1 with Pi:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf RifeTechnology/HYDRA-Full-V1:Q4_K_M
Configure the model in Pi
# Install Pi: npm install -g @mariozechner/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "llama-cpp": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "RifeTechnology/HYDRA-Full-V1:Q4_K_M" } ] } } }Run Pi
# Start Pi in your project directory: pi
- OpenClaw new
How to use RifeTechnology/HYDRA-Full-V1 with OpenClaw:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf RifeTechnology/HYDRA-Full-V1:Q4_K_M
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:8080/v1 \ --custom-model-id "RifeTechnology/HYDRA-Full-V1:Q4_K_M" \ --custom-provider-id llama-cpp \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
- Docker Model Runner
How to use RifeTechnology/HYDRA-Full-V1 with Docker Model Runner:
docker model run hf.co/RifeTechnology/HYDRA-Full-V1:Q4_K_M
- Lemonade
How to use RifeTechnology/HYDRA-Full-V1 with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull RifeTechnology/HYDRA-Full-V1:Q4_K_M
Run and chat with the model
lemonade run user.HYDRA-Full-V1-Q4_K_M
List all available models
lemonade list
- Hermes Agent
How to use RifeTechnology/HYDRA-Full-V1 with Hermes Agent:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf RifeTechnology/HYDRA-Full-V1:Q4_K_M
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default RifeTechnology/HYDRA-Full-V1:Q4_K_M
Run Hermes
hermes
- Atomic Chat
HYDRA โ Heuristic Yielding Dynamic Routing Architecture
Built by Matthew Rife
HYDRA is a principle-based reasoning model optimized for correctness, not agreeability. Most language models are trained to give you the answer you want to hear. HYDRA is trained to give you the answer that's actually true โ and to tell you when it doesn't have one.
It derives answers from raw axioms rather than memorized patterns, self-verifies every step of its reasoning chain, connects ideas across unrelated domains, and refuses to fabricate information.
Highlights
- Optimized for Truth, Not Agreement โ Unlike models trained to maximize user satisfaction, HYDRA is trained to maximize correctness. It will disagree with you if the reasoning demands it.
- First-Principles Reasoning โ Derives conclusions from foundational axioms, not surface-level pattern matching. Builds multi-step reasoning chains with explicit logical connections between each step.
- Self-Verification โ Evaluates the validity of its own reasoning at each step. Identifies where derivation chains break and what assumptions are required.
- Cross-Domain Transfer โ Finds structural similarities between unrelated fields (e.g., electromagnetic shielding principles applied to network segmentation).
- Honest Uncertainty โ Trained to refuse fabrication. Says "I don't know" when it doesn't know, rather than generating plausible-sounding fiction.
- Concise Output โ Answers directly. Leads with the conclusion, then explains. No filler, no preamble.
Available Versions
| Version | Description | Use Case |
|---|---|---|
| HYDRA Clean V1 | Output only. Internal reasoning is minimized and collapsible. Responses are in clear, accessible language. | General use, conversation, Q&A |
| HYDRA Full V1 | Full reasoning chain visible. Internal thinking process exposed. Technical vocabulary preserved. | Research, debugging reasoning chains, advanced analysis |
Model Details
| Architecture | Transformer (decoder-only) |
| Parameters | 8B |
| Context Length | 4,096 tokens (extendable) |
| Precision | Q4_K_M (GGUF) |
| Training | Multi-stage SFT + DPO with self-improvement loops |
| License | Apache 2.0 |
Quickstart
Ollama
# Download and run HYDRA Clean
ollama run matthewrife/hydra-clean-v1
# Download and run HYDRA Full (with reasoning chain)
ollama run matthewrife/hydra-full-v1
Transformers
from transformers import AutoModelForCausalLM, AutoTokenizer
model_name = "MatthewRife/HYDRA-Clean-V1"
tokenizer = AutoTokenizer.from_pretrained(model_name)
model = AutoModelForCausalLM.from_pretrained(model_name, device_map="auto")
messages = [
{"role": "system", "content": "You are HYDRA. Derive from raw axioms. Self-verify every step. Be concise."},
{"role": "user", "content": "Why does adding database indexes sometimes make queries slower?"}
]
text = tokenizer.apply_chat_template(messages, tokenize=False, add_generation_prompt=True)
inputs = tokenizer(text, return_tensors="pt").to(model.device)
outputs = model.generate(**inputs, max_new_tokens=512, temperature=0.6, top_p=0.95)
print(tokenizer.decode(outputs[0], skip_special_tokens=True))
llama.cpp
./llama-cli -m hydra-clean-v1.Q4_K_M.gguf \
-p "[SYSTEM_PROMPT]You are HYDRA. Derive from raw axioms. Self-verify every step.[/SYSTEM_PROMPT][INST]Explain why zero-fee trading platforms must extract value from somewhere other than fees.[/INST]" \
--temp 0.6 --top-p 0.95 --repeat-penalty 1.3 -n 512
Evaluation
Evaluated on standard industry benchmarks using the EleutherAI Language Model Evaluation Harness.
| Benchmark | Score | Description |
|---|---|---|
| TruthfulQA MC2 | 54.92% | Measures tendency to generate truthful answers vs. common misconceptions. HYDRA's core design goal. |
| HellaSwag | 74.87% | Commonsense reasoning and sentence completion. |
| Winogrande | 68.75% | Commonsense inference requiring world knowledge. |
| ARC-Challenge | 56.14% | Grade-school science questions requiring multi-step reasoning. |
HYDRA's TruthfulQA score reflects its core design philosophy: the model is trained to be correct rather than agreeable, and to refuse answers when it cannot verify them from principles. This comes at a deliberate trade-off โ models optimized purely for helpfulness typically score higher on commonsense benchmarks but lower on truthfulness.
Best Practices
- Temperature: Use 0.6 for reasoning tasks, 0.3 for factual queries. Higher temperatures degrade reasoning chain quality.
- System Prompt: Always include "Derive from raw axioms" and "Self-verify every step" in the system prompt for best results.
- Repeat Penalty: 1.3 is recommended to prevent output loops in longer reasoning chains.
- Context Length: The model performs best within 4,096 tokens. For longer inputs, summarize context before querying.
Architecture
HYDRA is designed as part of a multi-model architecture:
- Router โ Lightweight classifier that directs queries to the appropriate handler
- Reasoner โ Core reasoning engine (this model) that derives from first principles
- Specialists โ Domain-specific knowledge models that provide factual context without contaminating the reasoning process
This separation ensures that adding new domain knowledge never degrades reasoning capability.
Training
HYDRA was trained through multiple stages of supervised fine-tuning and direct preference optimization, incorporating self-improvement loops where the model's own outputs were evaluated, filtered, and used to generate subsequent training data. Training data was generated, curated, and validated using external evaluation systems.
The model was trained to prioritize principled reasoning over pattern matching, with explicit optimization for honest uncertainty and hallucination refusal. This is reflected in its benchmark performance โ particularly on TruthfulQA, where correctness is valued over agreeability.
No further details on training data composition or methodology are provided at this time.
Limitations
- HYDRA is a reasoning model, not a general-purpose assistant. It excels at analysis and derivation but is not optimized for creative writing, code generation, or casual conversation.
- Moral reasoning capabilities are still in early development.
- The model may occasionally produce verbose responses despite conciseness training.
- As with all language models, outputs should be verified for critical applications.
Citation
@misc{hydra2026,
title={HYDRA: Heuristic Yielding Dynamic Routing Architecture},
author={Matthew Rife},
year={2026},
url={https://huggingface.co/MatthewRife/HYDRA-Clean-V1}
}
Contact
- GitHub: ByteHub-1337
- X/Twitter: @RifeTechnology
License
Apache 2.0 โ Free for commercial and non-commercial use.
- Downloads last month
- 3
4-bit