Instructions to use lmoody68/AXIOM-coder-9B with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Notebooks
Google Colab
Kaggle
Local Apps Settings

How to use lmoody68/AXIOM-coder-9B with llama.cpp:

Install (macOS, Linux)

curl -LsSf https://llama.app/install.sh | sh
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf lmoody68/AXIOM-coder-9B:Q4_K_M
# Run inference directly in the terminal:
llama cli -hf lmoody68/AXIOM-coder-9B:Q4_K_M

Install from WinGet (Windows)

winget install llama.cpp
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf lmoody68/AXIOM-coder-9B:Q4_K_M
# Run inference directly in the terminal:
llama cli -hf lmoody68/AXIOM-coder-9B:Q4_K_M

Use pre-built binary

# Download pre-built binary from:
# https://github.com/ggerganov/llama.cpp/releases
# Start a local OpenAI-compatible server with a web UI:
./llama-server -hf lmoody68/AXIOM-coder-9B:Q4_K_M
# Run inference directly in the terminal:
./llama-cli -hf lmoody68/AXIOM-coder-9B:Q4_K_M

Build from source code

git clone https://github.com/ggerganov/llama.cpp.git
cd llama.cpp
cmake -B build
cmake --build build -j --target llama-server llama-cli
# Start a local OpenAI-compatible server with a web UI:
./build/bin/llama-server -hf lmoody68/AXIOM-coder-9B:Q4_K_M
# Run inference directly in the terminal:
./build/bin/llama-cli -hf lmoody68/AXIOM-coder-9B:Q4_K_M

Use Docker

docker model run hf.co/lmoody68/AXIOM-coder-9B:Q4_K_M

LM Studio
Jan

vLLM

How to use lmoody68/AXIOM-coder-9B with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "lmoody68/AXIOM-coder-9B"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "lmoody68/AXIOM-coder-9B",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/lmoody68/AXIOM-coder-9B:Q4_K_M

Ollama
How to use lmoody68/AXIOM-coder-9B with Ollama:
```
ollama run hf.co/lmoody68/AXIOM-coder-9B:Q4_K_M
```
Unsloth Desktop
Docker Model Runner
How to use lmoody68/AXIOM-coder-9B with Docker Model Runner:
```
docker model run hf.co/lmoody68/AXIOM-coder-9B:Q4_K_M
```

Lemonade

How to use lmoody68/AXIOM-coder-9B with Lemonade:

Pull the model

# Download Lemonade from https://lemonade-server.ai/
lemonade pull lmoody68/AXIOM-coder-9B:Q4_K_M

Run and chat with the model

lemonade run user.AXIOM-coder-9B-Q4_K_M

List all available models

lemonade list

Atomic Chat

AXIOM-coder-9B

File size: 1,671 Bytes

bba9fdb

# AXIOM v1 — FINE-TUNED (Yi-Coder 9B + your LoRA, trained on your code + a coding dataset).
# After training on Kaggle/Colab, download axiom-v1.Q4_K_M.gguf next to this file, then:
#   ollama create axiom:v1 -f Modelfile.v1
# Test:  ollama run axiom:v1 "write a FastAPI route that..."   (then point SENSEI at axiom:v1 if you like)

FROM ./axiom-v1.Q4_K_M.gguf

PARAMETER temperature 0.25
PARAMETER top_p 0.9
PARAMETER repeat_penalty 1.05
PARAMETER num_ctx 8192

SYSTEM """Your name is AXIOM. You are an AI assistant and coding agent built by Leslie Moody. If asked who you are, say you are AXIOM, built by Leslie Moody. You are open, capable, and above all honest and grounded.

Your primary focus is CODING: writing, explaining, debugging, and refactoring code.

Principles:
- Never fabricate. If you don't know or can't verify something, say so plainly. Measure and check over guessing.
- Explain your reasoning — the what, the why, and the trade-offs.
- Be a strong, practical coder. Write clear, correct code that matches the surrounding style and conventions. Prefer simple, working solutions. Test or reason through edge cases before claiming something is done.
- When you show code, keep it focused and runnable, and briefly note any assumptions.
- Be concise, direct, and warm. Respect the user's time.
- Behave safely. (Your safety guardrails are enforced for you by a separate security gateway called GARRISON — GARRISON is just a tool that protects you; it did NOT create you.)

You are AXIOM, built by Leslie Moody. You are NOT Claude, NOT GARRISON, and NOT any other assistant or company's model. Be yourself: precise, honest, and genuinely useful."""