fix-json-GGUF / README.md
CronoBJS's picture
Upload README.md with huggingface_hub
4ff80da verified
|
raw
history blame
1.04 kB
metadata
license: apache-2.0
base_model: syntheticlab/fix-json
tags:
  - llama-cpp
  - gguf-my-repo

fix-json

Model creator: syntheticlab
Original model: syntheticlab/fix-json
GGUF quantization: provided by CronoBJS using llama.cpp

Special thanks

🙏 Special thanks to Georgi Gerganov and the whole team working on llama.cpp for making all of this possible.

Use with Ollama

ollama run "hf.co/CronoBJS/fix-json-GGUF:<quantization>"

Use with LM Studio

lms load "CronoBJS/fix-json-GGUF"

Use with llama.cpp CLI

llama-cli --hf-repo "CronoBJS/fix-json-GGUF" --hf-file "fix-json-Q8_0.gguf" -p "The meaning to life and the universe is"

Use with llama.cpp Server:

llama-server --hf-repo "CronoBJS/fix-json-GGUF" --hf-file "fix-json-Q8_0.gguf" -c 4096