CronoBJS commited on
Commit
4ff80da
·
verified ·
1 Parent(s): 9af543c

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +41 -0
README.md ADDED
@@ -0,0 +1,41 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ base_model: syntheticlab/fix-json
4
+ tags:
5
+ - llama-cpp
6
+ - gguf-my-repo
7
+ ---
8
+
9
+ # fix-json
10
+
11
+ **Model creator:** [syntheticlab](https://huggingface.co/syntheticlab)<br/>
12
+ **Original model**: [syntheticlab/fix-json](https://huggingface.co/syntheticlab/fix-json)<br/>
13
+ **GGUF quantization:** provided by [CronoBJS](https:/huggingface.co/CronoBJS) using `llama.cpp`<br/>
14
+
15
+ ## Special thanks
16
+
17
+ 🙏 Special thanks to [Georgi Gerganov](https://github.com/ggerganov) and the whole team working on [llama.cpp](https://github.com/ggerganov/llama.cpp/) for making all of this possible.
18
+
19
+ ## Use with Ollama
20
+
21
+ ```bash
22
+ ollama run "hf.co/CronoBJS/fix-json-GGUF:<quantization>"
23
+ ```
24
+
25
+ ## Use with LM Studio
26
+
27
+ ```bash
28
+ lms load "CronoBJS/fix-json-GGUF"
29
+ ```
30
+
31
+ ## Use with llama.cpp CLI
32
+
33
+ ```bash
34
+ llama-cli --hf-repo "CronoBJS/fix-json-GGUF" --hf-file "fix-json-Q8_0.gguf" -p "The meaning to life and the universe is"
35
+ ```
36
+
37
+ ## Use with llama.cpp Server:
38
+
39
+ ```bash
40
+ llama-server --hf-repo "CronoBJS/fix-json-GGUF" --hf-file "fix-json-Q8_0.gguf" -c 4096
41
+ ```