Text Generation
GGUF
English
llama.cpp
mesh-llm
Qwen3
NousResearch
NousCoder
split
distributed
imatrix
conversational
Instructions to use exdysa/NousCoder-14B-Q4_K_M-layers with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- llama-cpp-python
How to use exdysa/NousCoder-14B-Q4_K_M-layers with llama-cpp-python:
# !pip install llama-cpp-python from llama_cpp import Llama llm = Llama.from_pretrained( repo_id="exdysa/NousCoder-14B-Q4_K_M-layers", filename="layers/layer-000.gguf", )
llm.create_chat_completion( messages = [ { "role": "user", "content": "What is the capital of France?" } ] ) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use exdysa/NousCoder-14B-Q4_K_M-layers with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf exdysa/NousCoder-14B-Q4_K_M-layers # Run inference directly in the terminal: llama cli -hf exdysa/NousCoder-14B-Q4_K_M-layers
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf exdysa/NousCoder-14B-Q4_K_M-layers # Run inference directly in the terminal: llama cli -hf exdysa/NousCoder-14B-Q4_K_M-layers
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf exdysa/NousCoder-14B-Q4_K_M-layers # Run inference directly in the terminal: ./llama-cli -hf exdysa/NousCoder-14B-Q4_K_M-layers
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf exdysa/NousCoder-14B-Q4_K_M-layers # Run inference directly in the terminal: ./build/bin/llama-cli -hf exdysa/NousCoder-14B-Q4_K_M-layers
Use Docker
docker model run hf.co/exdysa/NousCoder-14B-Q4_K_M-layers
- LM Studio
- Jan
- vLLM
How to use exdysa/NousCoder-14B-Q4_K_M-layers with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "exdysa/NousCoder-14B-Q4_K_M-layers" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "exdysa/NousCoder-14B-Q4_K_M-layers", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/exdysa/NousCoder-14B-Q4_K_M-layers
- Ollama
How to use exdysa/NousCoder-14B-Q4_K_M-layers with Ollama:
ollama run hf.co/exdysa/NousCoder-14B-Q4_K_M-layers
- Unsloth Studio
How to use exdysa/NousCoder-14B-Q4_K_M-layers with Unsloth Studio:
Install Unsloth Studio (macOS, Linux, WSL)
curl -fsSL https://unsloth.ai/install.sh | sh # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for exdysa/NousCoder-14B-Q4_K_M-layers to start chatting
Install Unsloth Studio (Windows)
irm https://unsloth.ai/install.ps1 | iex # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for exdysa/NousCoder-14B-Q4_K_M-layers to start chatting
Using HuggingFace Spaces for Unsloth
# No setup required # Open https://huggingface.co/spaces/unsloth/studio in your browser # Search for exdysa/NousCoder-14B-Q4_K_M-layers to start chatting
- Pi
How to use exdysa/NousCoder-14B-Q4_K_M-layers with Pi:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf exdysa/NousCoder-14B-Q4_K_M-layers
Configure the model in Pi
# Install Pi: npm install -g @mariozechner/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "llama-cpp": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "exdysa/NousCoder-14B-Q4_K_M-layers" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Hermes Agent new
How to use exdysa/NousCoder-14B-Q4_K_M-layers with Hermes Agent:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf exdysa/NousCoder-14B-Q4_K_M-layers
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default exdysa/NousCoder-14B-Q4_K_M-layers
Run Hermes
hermes
- Atomic Chat new
- OpenClaw new
How to use exdysa/NousCoder-14B-Q4_K_M-layers with OpenClaw:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf exdysa/NousCoder-14B-Q4_K_M-layers
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:8080/v1 \ --custom-model-id "exdysa/NousCoder-14B-Q4_K_M-layers" \ --custom-provider-id llama-cpp \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
- Docker Model Runner
How to use exdysa/NousCoder-14B-Q4_K_M-layers with Docker Model Runner:
docker model run hf.co/exdysa/NousCoder-14B-Q4_K_M-layers
- Lemonade
How to use exdysa/NousCoder-14B-Q4_K_M-layers with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull exdysa/NousCoder-14B-Q4_K_M-layers
Run and chat with the model
lemonade run user.NousCoder-14B-Q4_K_M-layers-{{QUANT_TAG}}List all available models
lemonade list
| { | |
| "schema_version": 1, | |
| "model_id": "bartowski/NousResearch_NousCoder-14B-GGUF:Q4_K_M", | |
| "source_model": { | |
| "path": "/Users/f784e/.cache/huggingface/hub/models--bartowski--NousResearch_NousCoder-14B-GGUF/snapshots/d65069f866af4df2b81ad979c846b409c72ebb2a/NousResearch_NousCoder-14B-Q4_K_M.gguf", | |
| "sha256": "9cc51afc755319db42a6324baf3395436cce5954dc87df95d3b9e7d625610624", | |
| "repo": "bartowski/NousResearch_NousCoder-14B-GGUF", | |
| "revision": "main", | |
| "primary_file": "NousResearch_NousCoder-14B-Q4_K_M.gguf", | |
| "canonical_ref": "bartowski/NousResearch_NousCoder-14B-GGUF@main/NousResearch_NousCoder-14B-Q4_K_M.gguf", | |
| "distribution_id": "NousResearch_NousCoder-14B-Q4_K_M", | |
| "files": [ | |
| { | |
| "path": "NousResearch_NousCoder-14B-Q4_K_M.gguf", | |
| "size_bytes": null, | |
| "sha256": null | |
| } | |
| ] | |
| }, | |
| "format": "layer-package", | |
| "layer_count": 40, | |
| "shared": { | |
| "metadata": { | |
| "path": "shared/metadata.gguf", | |
| "tensor_count": 0, | |
| "tensor_bytes": 0, | |
| "artifact_bytes": 5934944, | |
| "sha256": "a51aadea7b8505890ff4c09897804e613600b4ac9e1137d1bf4e7397b784e874" | |
| }, | |
| "embeddings": { | |
| "path": "shared/embeddings.gguf", | |
| "tensor_count": 1, | |
| "tensor_bytes": 437575680, | |
| "artifact_bytes": 443510688, | |
| "sha256": "fb98fe118efbbd8b0c03390c4c2aba6af208f67d776cc06d8e30ff8941b1c8e3" | |
| }, | |
| "output": { | |
| "path": "shared/output.gguf", | |
| "tensor_count": 2, | |
| "tensor_bytes": 638151680, | |
| "artifact_bytes": 644086720, | |
| "sha256": "99f1c010c997ed163f8b193dc5dc227a84814275a2037e0fa2b2706c7cd2bf3c" | |
| } | |
| }, | |
| "layers": [ | |
| { | |
| "layer_index": 0, | |
| "path": "layers/layer-000.gguf", | |
| "tensor_count": 11, | |
| "tensor_bytes": 210166784, | |
| "artifact_bytes": 216102368, | |
| "sha256": "d2a4a183a4eb3a626a83ec85969b149e694025c629b6d66dfa686de1948e3e43" | |
| }, | |
| { | |
| "layer_index": 1, | |
| "path": "layers/layer-001.gguf", | |
| "tensor_count": 11, | |
| "tensor_bytes": 210166784, | |
| "artifact_bytes": 216102368, | |
| "sha256": "5f9484a277de25dcac9ce0b892168dff0d8d0cf9baa48dc6d005d0570ab48bc6" | |
| }, | |
| { | |
| "layer_index": 2, | |
| "path": "layers/layer-002.gguf", | |
| "tensor_count": 11, | |
| "tensor_bytes": 210166784, | |
| "artifact_bytes": 216102368, | |
| "sha256": "5978e293d9b4b6ce34c02d962426a5e3aa1aba34b55bcd98f04704a9621b266c" | |
| }, | |
| { | |
| "layer_index": 3, | |
| "path": "layers/layer-003.gguf", | |
| "tensor_count": 11, | |
| "tensor_bytes": 210166784, | |
| "artifact_bytes": 216102368, | |
| "sha256": "642a8bf3cb5b72abc5ea282a82c66a955898dc526401b8abe26805c5ed770e5a" | |
| }, | |
| { | |
| "layer_index": 4, | |
| "path": "layers/layer-004.gguf", | |
| "tensor_count": 11, | |
| "tensor_bytes": 210166784, | |
| "artifact_bytes": 216102368, | |
| "sha256": "be92a6643273e5e0c21d3cd0ec4a151422dd026eb80d7f7be7dac5e1d252bf4c" | |
| }, | |
| { | |
| "layer_index": 5, | |
| "path": "layers/layer-005.gguf", | |
| "tensor_count": 11, | |
| "tensor_bytes": 185836544, | |
| "artifact_bytes": 191772128, | |
| "sha256": "62f10959c6768b66c2382c714315c73cfd3b625d7d4b66e7657094214e3c85d2" | |
| }, | |
| { | |
| "layer_index": 6, | |
| "path": "layers/layer-006.gguf", | |
| "tensor_count": 11, | |
| "tensor_bytes": 185836544, | |
| "artifact_bytes": 191772128, | |
| "sha256": "207b130b2d97024de5d6b1ef3e7eab67f2f3129d397c04508b2d68e34b62ebd4" | |
| }, | |
| { | |
| "layer_index": 7, | |
| "path": "layers/layer-007.gguf", | |
| "tensor_count": 11, | |
| "tensor_bytes": 210166784, | |
| "artifact_bytes": 216102368, | |
| "sha256": "f930da0f1ea8f9777ce0e1431c30add20b93058cbb336f4a088ae053e4a2ab93" | |
| }, | |
| { | |
| "layer_index": 8, | |
| "path": "layers/layer-008.gguf", | |
| "tensor_count": 11, | |
| "tensor_bytes": 185836544, | |
| "artifact_bytes": 191772128, | |
| "sha256": "a25d4d1c25c5d423c850fa360defcc00c557dc38c307139bf52f1c16fdadd60b" | |
| }, | |
| { | |
| "layer_index": 9, | |
| "path": "layers/layer-009.gguf", | |
| "tensor_count": 11, | |
| "tensor_bytes": 185836544, | |
| "artifact_bytes": 191772128, | |
| "sha256": "4cc093187400835334885fe7fe62b44a3acca3057a423667619bc576b00516ee" | |
| }, | |
| { | |
| "layer_index": 10, | |
| "path": "layers/layer-010.gguf", | |
| "tensor_count": 11, | |
| "tensor_bytes": 210166784, | |
| "artifact_bytes": 216102368, | |
| "sha256": "d616015ae2b2244f0570bf7071d827dd7053d265db06cc0dad186874ac922021" | |
| }, | |
| { | |
| "layer_index": 11, | |
| "path": "layers/layer-011.gguf", | |
| "tensor_count": 11, | |
| "tensor_bytes": 185836544, | |
| "artifact_bytes": 191772128, | |
| "sha256": "b0c60f4d1d0bfbce177c595a697ad89934c89fc747ffcccf3b0164beec905c53" | |
| }, | |
| { | |
| "layer_index": 12, | |
| "path": "layers/layer-012.gguf", | |
| "tensor_count": 11, | |
| "tensor_bytes": 185836544, | |
| "artifact_bytes": 191772128, | |
| "sha256": "38474218321a9ba7851b0df840b1b658884210874078c483771f5db036cfa0a1" | |
| }, | |
| { | |
| "layer_index": 13, | |
| "path": "layers/layer-013.gguf", | |
| "tensor_count": 11, | |
| "tensor_bytes": 210166784, | |
| "artifact_bytes": 216102368, | |
| "sha256": "c82235aea0eca28211f83cfb50fee748e6069d2996d106eee9a8590c4435cff4" | |
| }, | |
| { | |
| "layer_index": 14, | |
| "path": "layers/layer-014.gguf", | |
| "tensor_count": 11, | |
| "tensor_bytes": 185836544, | |
| "artifact_bytes": 191772128, | |
| "sha256": "5e740604e3fb40e15ed8f36c9212ba4329b1284b1ce9b70eeb6d707f2ef54ddf" | |
| }, | |
| { | |
| "layer_index": 15, | |
| "path": "layers/layer-015.gguf", | |
| "tensor_count": 11, | |
| "tensor_bytes": 185836544, | |
| "artifact_bytes": 191772128, | |
| "sha256": "2ab8957aa8b0a99b00c182e2b6c91a1ede18677d2f06a23248f5505c6d62aac3" | |
| }, | |
| { | |
| "layer_index": 16, | |
| "path": "layers/layer-016.gguf", | |
| "tensor_count": 11, | |
| "tensor_bytes": 210166784, | |
| "artifact_bytes": 216102368, | |
| "sha256": "97c45c806118983c6a5cf133a890bb4e86c5d180fcebcd22ea391be474a2e54e" | |
| }, | |
| { | |
| "layer_index": 17, | |
| "path": "layers/layer-017.gguf", | |
| "tensor_count": 11, | |
| "tensor_bytes": 185836544, | |
| "artifact_bytes": 191772128, | |
| "sha256": "5839f4e275c64b6adae73974124d497415bb5a2844adfd7e295beb37a845fad5" | |
| }, | |
| { | |
| "layer_index": 18, | |
| "path": "layers/layer-018.gguf", | |
| "tensor_count": 11, | |
| "tensor_bytes": 185836544, | |
| "artifact_bytes": 191772128, | |
| "sha256": "f65426d9d2b20007b49ff528ea70ed6595e3eeffffe1d80a47b490661758f7de" | |
| }, | |
| { | |
| "layer_index": 19, | |
| "path": "layers/layer-019.gguf", | |
| "tensor_count": 11, | |
| "tensor_bytes": 210166784, | |
| "artifact_bytes": 216102368, | |
| "sha256": "7f341781699c053edef31263edccddf3fb8c6c4c8bc2ac8d2efc7b5253fbc749" | |
| }, | |
| { | |
| "layer_index": 20, | |
| "path": "layers/layer-020.gguf", | |
| "tensor_count": 11, | |
| "tensor_bytes": 185836544, | |
| "artifact_bytes": 191772128, | |
| "sha256": "70b8b608189fbef134612366d588b19ef44ed3a5d55bc6a2efe97ec2a33c58a9" | |
| }, | |
| { | |
| "layer_index": 21, | |
| "path": "layers/layer-021.gguf", | |
| "tensor_count": 11, | |
| "tensor_bytes": 185836544, | |
| "artifact_bytes": 191772128, | |
| "sha256": "25510d8ef0abf29f76411241bd37445416d5dd5a588617017db2a47eb8f2b0bc" | |
| }, | |
| { | |
| "layer_index": 22, | |
| "path": "layers/layer-022.gguf", | |
| "tensor_count": 11, | |
| "tensor_bytes": 210166784, | |
| "artifact_bytes": 216102368, | |
| "sha256": "3781a32d7f0a39e618d8b31b0959f45fd323e8851de0fbcfd0a58fc5c8fda419" | |
| }, | |
| { | |
| "layer_index": 23, | |
| "path": "layers/layer-023.gguf", | |
| "tensor_count": 11, | |
| "tensor_bytes": 185836544, | |
| "artifact_bytes": 191772128, | |
| "sha256": "1befcade72fcfbc28a3ff1ce82df3f99ea6fa6d719821bbfe1412be7dc48011f" | |
| }, | |
| { | |
| "layer_index": 24, | |
| "path": "layers/layer-024.gguf", | |
| "tensor_count": 11, | |
| "tensor_bytes": 185836544, | |
| "artifact_bytes": 191772128, | |
| "sha256": "da71f1e65adfb34b75cf9f6853655319fc081f755870fef74e1b1d10c55c18a6" | |
| }, | |
| { | |
| "layer_index": 25, | |
| "path": "layers/layer-025.gguf", | |
| "tensor_count": 11, | |
| "tensor_bytes": 210166784, | |
| "artifact_bytes": 216102368, | |
| "sha256": "bb37f4e6c98a2455f35033d47f751e8eb4fbb7535a1b0fd5a8bfe6d6b35992a5" | |
| }, | |
| { | |
| "layer_index": 26, | |
| "path": "layers/layer-026.gguf", | |
| "tensor_count": 11, | |
| "tensor_bytes": 185836544, | |
| "artifact_bytes": 191772128, | |
| "sha256": "b58410edc5009a2fe962a92764deb200ebb576cec0d0f68672d62353d6ac5cd8" | |
| }, | |
| { | |
| "layer_index": 27, | |
| "path": "layers/layer-027.gguf", | |
| "tensor_count": 11, | |
| "tensor_bytes": 185836544, | |
| "artifact_bytes": 191772128, | |
| "sha256": "6ec6e31a0c1aab078441bc66f33927f988eaef69d5f389656a4e1e5fed100594" | |
| }, | |
| { | |
| "layer_index": 28, | |
| "path": "layers/layer-028.gguf", | |
| "tensor_count": 11, | |
| "tensor_bytes": 210166784, | |
| "artifact_bytes": 216102368, | |
| "sha256": "9e9691978de5dd4b21a151243cdbc2711a5dcebe347f13989fad8bf3eb02da7a" | |
| }, | |
| { | |
| "layer_index": 29, | |
| "path": "layers/layer-029.gguf", | |
| "tensor_count": 11, | |
| "tensor_bytes": 185836544, | |
| "artifact_bytes": 191772128, | |
| "sha256": "c08c3a3bd91e101ecf44e4093d9d85da2071a34e2cf17fffe5cbbd6e95f49a6a" | |
| }, | |
| { | |
| "layer_index": 30, | |
| "path": "layers/layer-030.gguf", | |
| "tensor_count": 11, | |
| "tensor_bytes": 185836544, | |
| "artifact_bytes": 191772128, | |
| "sha256": "39980048c4ad2ec06ef1455febe1e347c7bc21ea27231e0ff02ab0f619005ea5" | |
| }, | |
| { | |
| "layer_index": 31, | |
| "path": "layers/layer-031.gguf", | |
| "tensor_count": 11, | |
| "tensor_bytes": 210166784, | |
| "artifact_bytes": 216102368, | |
| "sha256": "8b35eb36293c12bf6e2ec7552f0da0a631b7343f5568178c9647acc81d9b6c0b" | |
| }, | |
| { | |
| "layer_index": 32, | |
| "path": "layers/layer-032.gguf", | |
| "tensor_count": 11, | |
| "tensor_bytes": 185836544, | |
| "artifact_bytes": 191772128, | |
| "sha256": "dd22fbaa4391efdf926469260bb13678f5af410e74a51d0589e93c8fb4cde6e9" | |
| }, | |
| { | |
| "layer_index": 33, | |
| "path": "layers/layer-033.gguf", | |
| "tensor_count": 11, | |
| "tensor_bytes": 185836544, | |
| "artifact_bytes": 191772128, | |
| "sha256": "5bb5d92d6dc44d5351d96eb6b0fa06457ea29dcc0ab84e0f801da6b806dbeb29" | |
| }, | |
| { | |
| "layer_index": 34, | |
| "path": "layers/layer-034.gguf", | |
| "tensor_count": 11, | |
| "tensor_bytes": 210166784, | |
| "artifact_bytes": 216102368, | |
| "sha256": "b4800dfa6c5475431771c60d609648e82860087a768bf45753c5a208588c3e75" | |
| }, | |
| { | |
| "layer_index": 35, | |
| "path": "layers/layer-035.gguf", | |
| "tensor_count": 11, | |
| "tensor_bytes": 210166784, | |
| "artifact_bytes": 216102368, | |
| "sha256": "ab8285d476fb307583c97e336056b57b2002ba5079466eafdc9985d39968d9e0" | |
| }, | |
| { | |
| "layer_index": 36, | |
| "path": "layers/layer-036.gguf", | |
| "tensor_count": 11, | |
| "tensor_bytes": 210166784, | |
| "artifact_bytes": 216102368, | |
| "sha256": "22f2f9c32bff3166b9806a1bf5c9c0b8962f94bae11698780ac960d3ac830421" | |
| }, | |
| { | |
| "layer_index": 37, | |
| "path": "layers/layer-037.gguf", | |
| "tensor_count": 11, | |
| "tensor_bytes": 210166784, | |
| "artifact_bytes": 216102368, | |
| "sha256": "1021afb2898775c1c18d9b4b6f4a4a780b53c9bcf48d16e6f88638b7385c3651" | |
| }, | |
| { | |
| "layer_index": 38, | |
| "path": "layers/layer-038.gguf", | |
| "tensor_count": 11, | |
| "tensor_bytes": 210166784, | |
| "artifact_bytes": 216102368, | |
| "sha256": "6851a1f2670d2e453041636c5428a4a079b44d1ca5d0d189d61195e3f1b5128d" | |
| }, | |
| { | |
| "layer_index": 39, | |
| "path": "layers/layer-039.gguf", | |
| "tensor_count": 11, | |
| "tensor_bytes": 210166784, | |
| "artifact_bytes": 216102368, | |
| "sha256": "4aef7d779441d4df33922f2304d65d8fb4c81c0f3240148a7efcf07bcaf6d690" | |
| } | |
| ], | |
| "skippy_abi_version": "0.1.11", | |
| "created_at_unix_secs": 1780272237 | |
| } | |