appvoid commited on
Commit
5523822
·
verified ·
1 Parent(s): 9a5e503

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +32 -0
README.md ADDED
@@ -0,0 +1,32 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: appvoid/arco-chat-merged-3
3
+ library_name: transformers
4
+ tags:
5
+ - mergekit
6
+ - merge
7
+ - llama-cpp
8
+ - gguf-my-repo
9
+ ---
10
+
11
+ # arco-chat-merged-3
12
+ **Model creator:** [appvoid](https://huggingface.co/appvoid)<br/>
13
+ **Original model**: [appvoid/arco-chat-merged-3](https://huggingface.co/appvoid/arco-chat-merged-3)<br/>
14
+ **GGUF quantization:** provided by [appvoid](https:/huggingface.co/appvoid) using `llama.cpp`<br/>
15
+ ## Special thanks
16
+ 🙏 Special thanks to [Georgi Gerganov](https://github.com/ggerganov) and the whole team working on [llama.cpp](https://github.com/ggerganov/llama.cpp/) for making all of this possible.
17
+ ## Use with Ollama
18
+ ```bash
19
+ ollama run "hf.co/appvoid/arco-chat:<quantization>"
20
+ ```
21
+ ## Use with LM Studio
22
+ ```bash
23
+ lms load "appvoid/arco-chat"
24
+ ```
25
+ ## Use with llama.cpp CLI
26
+ ```bash
27
+ llama-cli --hf-repo "appvoid/arco-chat" --hf-file "arco-chat-F16.gguf" -p "The meaning to life and the universe is"
28
+ ```
29
+ ## Use with llama.cpp Server:
30
+ ```bash
31
+ llama-server --hf-repo "appvoid/arco-chat" --hf-file "arco-chat-F16.gguf" -c 4096
32
+ ```