Instructions to use FINAL-Bench/Darwin-28B-Coder-GGUF with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- llama-cpp-python
How to use FINAL-Bench/Darwin-28B-Coder-GGUF with llama-cpp-python:
# !pip install llama-cpp-python from llama_cpp import Llama llm = Llama.from_pretrained( repo_id="FINAL-Bench/Darwin-28B-Coder-GGUF", filename="Darwin-28B-Coder-F16.gguf", )
llm.create_chat_completion( messages = [ { "role": "user", "content": "What is the capital of France?" } ] ) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use FINAL-Bench/Darwin-28B-Coder-GGUF with llama.cpp:
Install from brew
brew install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama-server -hf FINAL-Bench/Darwin-28B-Coder-GGUF:Q4_K_M # Run inference directly in the terminal: llama-cli -hf FINAL-Bench/Darwin-28B-Coder-GGUF:Q4_K_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama-server -hf FINAL-Bench/Darwin-28B-Coder-GGUF:Q4_K_M # Run inference directly in the terminal: llama-cli -hf FINAL-Bench/Darwin-28B-Coder-GGUF:Q4_K_M
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf FINAL-Bench/Darwin-28B-Coder-GGUF:Q4_K_M # Run inference directly in the terminal: ./llama-cli -hf FINAL-Bench/Darwin-28B-Coder-GGUF:Q4_K_M
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf FINAL-Bench/Darwin-28B-Coder-GGUF:Q4_K_M # Run inference directly in the terminal: ./build/bin/llama-cli -hf FINAL-Bench/Darwin-28B-Coder-GGUF:Q4_K_M
Use Docker
docker model run hf.co/FINAL-Bench/Darwin-28B-Coder-GGUF:Q4_K_M
- LM Studio
- Jan
- vLLM
How to use FINAL-Bench/Darwin-28B-Coder-GGUF with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "FINAL-Bench/Darwin-28B-Coder-GGUF" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "FINAL-Bench/Darwin-28B-Coder-GGUF", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/FINAL-Bench/Darwin-28B-Coder-GGUF:Q4_K_M
- Ollama
How to use FINAL-Bench/Darwin-28B-Coder-GGUF with Ollama:
ollama run hf.co/FINAL-Bench/Darwin-28B-Coder-GGUF:Q4_K_M
- Unsloth Studio
How to use FINAL-Bench/Darwin-28B-Coder-GGUF with Unsloth Studio:
Install Unsloth Studio (macOS, Linux, WSL)
curl -fsSL https://unsloth.ai/install.sh | sh # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for FINAL-Bench/Darwin-28B-Coder-GGUF to start chatting
Install Unsloth Studio (Windows)
irm https://unsloth.ai/install.ps1 | iex # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for FINAL-Bench/Darwin-28B-Coder-GGUF to start chatting
Using HuggingFace Spaces for Unsloth
# No setup required # Open https://huggingface.co/spaces/unsloth/studio in your browser # Search for FINAL-Bench/Darwin-28B-Coder-GGUF to start chatting
- Pi
How to use FINAL-Bench/Darwin-28B-Coder-GGUF with Pi:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama-server -hf FINAL-Bench/Darwin-28B-Coder-GGUF:Q4_K_M
Configure the model in Pi
# Install Pi: npm install -g @mariozechner/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "llama-cpp": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "FINAL-Bench/Darwin-28B-Coder-GGUF:Q4_K_M" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Hermes Agent new
How to use FINAL-Bench/Darwin-28B-Coder-GGUF with Hermes Agent:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama-server -hf FINAL-Bench/Darwin-28B-Coder-GGUF:Q4_K_M
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default FINAL-Bench/Darwin-28B-Coder-GGUF:Q4_K_M
Run Hermes
hermes
- Atomic Chat new
- Docker Model Runner
How to use FINAL-Bench/Darwin-28B-Coder-GGUF with Docker Model Runner:
docker model run hf.co/FINAL-Bench/Darwin-28B-Coder-GGUF:Q4_K_M
- Lemonade
How to use FINAL-Bench/Darwin-28B-Coder-GGUF with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull FINAL-Bench/Darwin-28B-Coder-GGUF:Q4_K_M
Run and chat with the model
lemonade run user.Darwin-28B-Coder-GGUF-Q4_K_M
List all available models
lemonade list
WOW
Darwin V9 β GPQA Diamond 90.9%, #1 on the leaderboard, with pure greedy decoding
Darwin-398B-JGOS reaches 90.9% (180/198) on GPQA Diamond, the PhD-level scientific reasoning benchmark, ranking #1 on the Hugging Face GPQA Diamond leaderboard. No self-consistency, no test-time compute scaling β this was achieved with a single greedy decode (temperature 0, single sample, max 16,384 tokens). The full eval config is published in the model card, so anyone can reproduce it. Raw reasoning, no score inflation.
The result comes from Darwin V9, a patented evolutionary model-development platform. Its core idea: it never trains a model from scratch.
Why Darwin V9 beats training from scratch
Cost & speed: no trillion-token pretraining run, no months of compute β a purpose-built, high-performance model is produced in a fraction of the time.
Reuse of proven intelligence: instead of re-learning every capability from a blank slate, it selects and combines only the strengths of already-trained, already-validated models, so results are stable and predictable.
Surgical transplantation: it identifies which neural region of which model holds which capability β at the FFN (Feed Forward Network) layer level β and grafts in only the segments that contribute to the target skill.
How it works: a large model (Qwen 3.5 397B) serves as the mother model (the substrate); several father models specialized in reasoning, coding, and language are analyzed layer-by-layer across their FFN regions; the segments that contribute to the target performance are extracted and transplanted into the mother model to produce a new child model. The result is a ~400B MoE that activates only ~17B parameters per token at inference β large-model capacity with efficient inference.
If training from scratch means rebuilding everything from a blank page, Darwin V9 means precisely recombining intelligence that has already been proven. GPQA Diamond #1 is the proof.
Model: https://huggingface.co/FINAL-Bench/Darwin-398B-JGOS
Leaderboard: https://huggingface.co/datasets/Idavidrein/gpqa