GGUF
Spanish
English
deepseek_v2
moderno-tech
nova
nova-coder
quantized
code-generation
local-ai
custom_code
conversational
Instructions to use ModernoTech/Nova-Coder with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use ModernoTech/Nova-Coder with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf ModernoTech/Nova-Coder:Q4_K_M # Run inference directly in the terminal: llama cli -hf ModernoTech/Nova-Coder:Q4_K_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf ModernoTech/Nova-Coder:Q4_K_M # Run inference directly in the terminal: llama cli -hf ModernoTech/Nova-Coder:Q4_K_M
Build from source code
git clone https://github.com/ggml-org/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-app # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama serve -hf ModernoTech/Nova-Coder:Q4_K_M # Run inference directly in the terminal: ./build/bin/llama cli -hf ModernoTech/Nova-Coder:Q4_K_M
Use Docker
docker model run hf.co/ModernoTech/Nova-Coder:Q4_K_M
- Llama new
- LM Studio
- Jan
- Ollama
How to use ModernoTech/Nova-Coder with Ollama:
ollama run hf.co/ModernoTech/Nova-Coder:Q4_K_M
- Unsloth Desktop
- Docker Model Runner
How to use ModernoTech/Nova-Coder with Docker Model Runner:
docker model run hf.co/ModernoTech/Nova-Coder:Q4_K_M
- Lemonade
How to use ModernoTech/Nova-Coder with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull ModernoTech/Nova-Coder:Q4_K_M
Run and chat with the model
lemonade run user.Nova-Coder-Q4_K_M
List all available models
lemonade list
- Atomic Chat
Commit History
4 days ago
-
Update README.md
Verified signatureea4d300 -
Update README.md
Verified signature61bdcee -
Remove visible manufacturer reference from public Model Card; hidden compatibility identifiers remain external
Verified signature017523f -
Remove temporary test artifact
Verified signature4133ffb -
Normalize legal-reference wording while preserving third-party attribution
Verified signature532a1a5 -
Remove visible external-manufacturer references from public GGUF commercial presentation
Verified signature69cc89d -
Nova GGUF: add legal section and remove unnecessary palette instructions
Verified signaturefa5678c -
Legal documentation: THIRD_PARTY_NOTICES/DEEPSEEK-MODEL-LICENSE.txt
Verified signature5a4423f -
Legal documentation: THIRD_PARTY_NOTICES/MIT-LICENSE.txt
Verified signaturec7eb350 -
Legal documentation: THIRD_PARTY_NOTICES/README.md
Verified signatureaeb19dd -
Legal documentation: MODERNO-TECH-DISCLAIMER.md
Verified signature0e40476 -
Legal documentation: MODERNO-TECH-TERMS.md
Verified signature0163238 -
Legal documentation: MODERNO-TECH-LICENSE.md
Verified signatureb724bbe -
test legal doc
Verified signature19efcc4 -
Preserve legal notices without modifying DeepSeek terms
Verified signature8dc8694 -
Preserve legal notices without modifying DeepSeek terms
Verified signature00978f6 -
Add remote metadata validation report
Verified signature8afe331 -
Add server-side remote Xet SHA-256 identifiers for Nova-Coder-2.0 GGUF variants
Verified signaturedfa8394 -
Nova/GGUF: clarify tokenizer and chat-template origin
Verified signature4621fd1 -
Nova Coder GGUF: rebrand complete README, all 13 quantizations and Nova identifiers
Verified signature6d95033 -
Server-side rename all remaining DeepSeek weight filenames to Nova-Coder identifiers (batch B)
Verified signature5cd3a9d -
Preserve DeepSeek Model License notice
Verified signature38bde89 -
Preserve MIT License
Verified signatureaea5d87 -
Nova/GGUF model card identifying Nova Coder variant, quantization table, legal attribution, and no unverified metrics
Verified signature5dc541c -
Add official branding asset nova-coder-inference-process.gif
Verified signatureb541c77 -
Add official branding asset moderno-tech-logo.png
Verified signature2338942 -
Add official branding asset nova-coder-banner.jpg
Verified signature1d2dea4 -
Remove generic Q4 source path after Nova-named alias
Verified signature263d32f -
Server-side copy priority Q4_K_M quantization to Nova naming
Verified signature355f6fa -
Duplicate from second-state/DeepSeek-Coder-V2-Lite-Instruct-GGUF
Co-authored-by: Sam Liu <apepkuss79@users.noreply.huggingface.co>22c1157