neano-GGUF / README.md
Xenobd's picture
Upload README.md with huggingface_hub
f3a295f verified
metadata
base_model: Xenobd/neano
tags:
  - text-generation-inference
  - transformers
  - unsloth
  - llama
  - llama-cpp
  - gguf-my-repo
license: apache-2.0
language:
  - en

neano

Model creator: Xenobd
Original model: Xenobd/neano
GGUF quantization: provided by Xenobd using llama.cpp

Special thanks

🙏 Special thanks to Georgi Gerganov and the whole team working on llama.cpp for making all of this possible.

Use with Ollama

ollama run "hf.co/Xenobd/neano-GGUF:Q8_0"

Use with LM Studio

lms load "Xenobd/neano-GGUF"

Use with llama.cpp CLI

llama-cli --hf "Xenobd/neano-GGUF:Q8_0" -p "The meaning to life and the universe is"

Use with llama.cpp Server:

llama-server --hf "Xenobd/neano-GGUF:Q8_0" -c 4096