How to use from
Hermes Agent
Start the llama.cpp server
# Install llama.cpp:
brew install llama.cpp
# Start a local OpenAI-compatible server:
llama serve -hf droplychee-core/droplychee-1.0-code-gguf:BF16
Configure Hermes
# Install Hermes:
curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash
hermes setup
# Point Hermes at the local server:
hermes config set model.provider custom
hermes config set model.base_url http://127.0.0.1:8080/v1
hermes config set model.default droplychee-core/droplychee-1.0-code-gguf:BF16
Run Hermes
hermes
Quick Links

droplychee-1.0-code-gguf : GGUF

This model was finetuned and converted to GGUF format using Unsloth.

Example usage:

  • For text only LLMs: llama-cli -hf droplychee-core/droplychee-1.0-code-gguf --jinja
  • For multimodal models: llama-mtmd-cli -hf droplychee-core/droplychee-1.0-code-gguf --jinja

Available Model files:

  • deepreinforce-ai_Ornith-1.0-9B_1784282608.F16.gguf
  • deepreinforce-ai_Ornith-1.0-9B_1784282608.BF16-mmproj.gguf This was trained 2x faster with Unsloth
Downloads last month
621
GGUF
Model size
9B params
Architecture
qwen35
Hardware compatibility
Log In to add your hardware

16-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support