Instructions to use aelgendy/QModel with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use aelgendy/QModel with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf aelgendy/QModel:Q8_0 # Run inference directly in the terminal: llama cli -hf aelgendy/QModel:Q8_0
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf aelgendy/QModel:Q8_0 # Run inference directly in the terminal: llama cli -hf aelgendy/QModel:Q8_0
Build from source code
git clone https://github.com/ggml-org/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-app # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama serve -hf aelgendy/QModel:Q8_0 # Run inference directly in the terminal: ./build/bin/llama cli -hf aelgendy/QModel:Q8_0
Use Docker
docker model run hf.co/aelgendy/QModel:Q8_0
- Llama new
- LM Studio
- Jan
- Ollama
How to use aelgendy/QModel with Ollama:
ollama run hf.co/aelgendy/QModel:Q8_0
- Unsloth Desktop
- Pi
How to use aelgendy/QModel with Pi:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf aelgendy/QModel:Q8_0
Configure the model in Pi
# Install Pi: npm install -g @earendil-works/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "llama-cpp": { "baseUrl": "http://localhost:9931/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "aelgendy/QModel:Q8_0" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Docker Model Runner
How to use aelgendy/QModel with Docker Model Runner:
docker model run hf.co/aelgendy/QModel:Q8_0
- Lemonade
How to use aelgendy/QModel with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull aelgendy/QModel:Q8_0
Run and chat with the model
lemonade run user.QModel-Q8_0
List all available models
lemonade list
- Hermes Agent
How to use aelgendy/QModel with Hermes Agent:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf aelgendy/QModel:Q8_0
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:9931/v1 hermes config set model.default aelgendy/QModel:Q8_0
Run Hermes
hermes
- Atomic Chat
- OpenClaw
How to use aelgendy/QModel with OpenClaw:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf aelgendy/QModel:Q8_0
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:9931/v1 \ --custom-model-id "aelgendy/QModel:Q8_0" \ --custom-provider-id llama-cpp \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
Commit History
21 days ago
-
README: pull the model from ollama.com (arelgendy/qmodel:8.5)
Verified signature29582e8
22 days ago
-
Per-verse links that render in Open-WebUI; Ollama template/system/params; README cleanup
Verified signature81c2b5a -
QModel v8.5: accuracy release (code, 3,598-fatwa index, quran.com links)
c634c96
-
Auto-resolve URL placeholders in references
3db57db -
Add interactive chat.py CLI tool with FAISS
0b0acf7 -
Add Ollama Modelfile and anti-Chinese guardrails
4c79157 -
Strictly ground scripture quotes in indexed retrieved context and format Quran citations with canonical URLs
6aaa61d -
Fix verse prefix stripping and intent routing for verse lookup queries
c1c14bb -
Standardize on Qwen2.5-14B-Instruct across README and configs
1ae5b44 -
Update default Ollama model to qwen2.5:14b in config and env example
506e3fd -
Sync clean repository and updated gitignore
a5b433f -
Remove data/ directory (cached datasets)
eab9b93 -
Remove scratch/ directory
02a54c5 -
Remove .vscode/ directory
5075f3d -
Remove .claude/ directory
97e7831 -
Add Qwen2.5-14B-Instruct-Q8_0 GGUF model
6c4b459 -
Allow models and gguf files in .gitignore
3f71034 -
Upload Qwen2.5-14B-Instruct-Q8_0 GGUF
4e0e336 -
Upload models/Qwen2.5-14B-Instruct-Q8_0.gguf with huggingface_hub
a35f22f -
Upload models/Qwen2.5-14B-Instruct-Q8_0.gguf with huggingface_hub
b83fe89 -
Add Qwen2.5-14B-Instruct-Q8_0 GGUF model
de706dd -
Upload Qwen2.5-14B-Instruct-Q8_0 GGUF
6b87d40 -
Add Qwen2.5-14B-Instruct-Q8_0 GGUF model
cafcde4 -
Update QModel to v8 with fatwa pipeline, index, and metadata (part 2)
0724ff6 -
Update QModel to v8 with fatwa pipeline, index, and metadata
65b87f5
-
Sync codebase with local main (config, README, docker, gitignore updates)
f1e27f0 -
Update metadata.json (rebuilt 2026-07-31)
34828a7 -
Update QModel.index (rebuilt 2026-07-31)
afec672
-
Upload folder using huggingface_hub
15b8ecf -
Upload folder using huggingface_hub
a871e77 -
Upload folder using huggingface_hub
0c76b1b
-
Upload folder using huggingface_hub
2f3a1e1 -
Upload folder using huggingface_hub
0cc1a29 -
Upload folder using huggingface_hub
924c09f -
Upload folder using huggingface_hub
51e4367 -
Upload folder using huggingface_hub
3d11016 -
Upload folder using huggingface_hub
a9bf742 -
Upload folder using huggingface_hub
994a01b -
Upload folder using huggingface_hub
6ab1c8e
-
Upload folder using huggingface_hub
7ecdf4a -
Upload folder using huggingface_hub
52c235e -
Upload folder using huggingface_hub
ba65818 -
Upload folder using huggingface_hub
29d804b -
Upload folder using huggingface_hub
ef44157 -
Upload folder using huggingface_hub
eb1414a
-
Index update
83f3c50 -
Upload folder using huggingface_hub
4d5fcc9
-
Upload folder using huggingface_hub
c580971 -
Upload folder using huggingface_hub
20edea9 -
Update README.md
1e67e7f