GGUF
English
small
cpu
edge
edge-devices
safety
general
text
wolkyen
neptune
pluto
neptun3
conversational
Instructions to use Wolkyen/Neptun3-One with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use Wolkyen/Neptun3-One with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf Wolkyen/Neptun3-One:Q4_K_M # Run inference directly in the terminal: llama cli -hf Wolkyen/Neptun3-One:Q4_K_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf Wolkyen/Neptun3-One:Q4_K_M # Run inference directly in the terminal: llama cli -hf Wolkyen/Neptun3-One:Q4_K_M
Build from source code
git clone https://github.com/ggml-org/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-app # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama serve -hf Wolkyen/Neptun3-One:Q4_K_M # Run inference directly in the terminal: ./build/bin/llama cli -hf Wolkyen/Neptun3-One:Q4_K_M
Use Docker
docker model run hf.co/Wolkyen/Neptun3-One:Q4_K_M
- Llama new
- LM Studio
- Jan
- Ollama
How to use Wolkyen/Neptun3-One with Ollama:
ollama run hf.co/Wolkyen/Neptun3-One:Q4_K_M
- Unsloth Desktop
- Pi
How to use Wolkyen/Neptun3-One with Pi:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf Wolkyen/Neptun3-One:Q4_K_M
Configure the model in Pi
# Install Pi: npm install -g @earendil-works/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "llama-cpp": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "Wolkyen/Neptun3-One:Q4_K_M" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Docker Model Runner
How to use Wolkyen/Neptun3-One with Docker Model Runner:
docker model run hf.co/Wolkyen/Neptun3-One:Q4_K_M
- Lemonade
How to use Wolkyen/Neptun3-One with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull Wolkyen/Neptun3-One:Q4_K_M
Run and chat with the model
lemonade run user.Neptun3-One-Q4_K_M
List all available models
lemonade list
- Hermes Agent
How to use Wolkyen/Neptun3-One with Hermes Agent:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf Wolkyen/Neptun3-One:Q4_K_M
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default Wolkyen/Neptun3-One:Q4_K_M
Run Hermes
hermes
- Atomic Chat
- OpenClaw
How to use Wolkyen/Neptun3-One with OpenClaw:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf Wolkyen/Neptun3-One:Q4_K_M
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:8080/v1 \ --custom-model-id "Wolkyen/Neptun3-One:Q4_K_M" \ --custom-provider-id llama-cpp \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
Commit History
Yesterday
-
Update README.md
Verified signature70666c0 -
Update README.md
Verified signature--- license: apache-2.0 language: - en tags: - small - cpu - edge - edge-devices - safety - general - text - wolkyen - neptune - pluto - neptun3 --- # Neptun3 One **Neptun3 One** is a lightweight, 350-million-parameter language model developed by **Wolkyen**, designed to deliver strong general-purpose performance in an exceptionally compact architecture. Built using a **hybrid architecture**, Neptun3 One focuses on balancing intelligence, efficiency, and practical usability. It is designed to compete with and outperform similarly sized language models across everyday tasks while maintaining a small computational footprint. Despite its compact size, Neptun3 One supports **native tool use**, enabling applications to integrate external tools and build lightweight AI-powered workflows. ## Key Features - **350M Parameters:** An exceptionally compact model designed for efficient inference. - **Hybrid Architecture:** Combines architectural techniques to balance performance and computatio…7bf1a8e -
Upload 4 files
Verified signature# Neptun3 One **Neptun3 One** is a lightweight, 350-million-parameter language model developed by **Wolkyen**, designed to deliver strong general-purpose performance in an exceptionally compact architecture. Built using a **hybrid architecture**, Neptun3 One focuses on balancing intelligence, efficiency, and practical usability. It is designed to compete with and outperform similarly sized language models across everyday tasks while maintaining a small computational footprint. Despite its compact size, Neptun3 One supports **native tool use**, enabling applications to integrate external tools and build lightweight AI-powered workflows. ## Key Features - **350M Parameters:** An exceptionally compact model designed for efficient inference. - **Hybrid Architecture:** Combines architectural techniques to balance performance and computational efficiency. - **General-Purpose Intelligence:** Designed for conversations, instruction following, text generation, and everyday assistance. - **…89dac7d -
Update README.md
Verified signatureNeptun3 One The first model of the open-weight Neptun3 series a 350M text model for math and general use supports native tool calling beats models of similar size great for CPU and edge-devices 5969038 -
initial commit
Verified signaturedada044