Dips-1991 commited on
Commit
19d6a1c
·
verified ·
1 Parent(s): 8460d4f

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +29 -0
README.md ADDED
@@ -0,0 +1,29 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: mrm8488/tinyllama-ft-codeAlpaca-adapter
3
+ datasets:
4
+ - generator
5
+ license: apache-2.0
6
+ tags:
7
+ - generated_from_trainer
8
+ - llama-cpp
9
+ - gguf-my-lora
10
+ model-index:
11
+ - name: tinyllama-bnb-4bit-ft-codeAlpaca
12
+ results: []
13
+ ---
14
+
15
+ # Dips-1991/tinyllama-ft-codeAlpaca-adapter-F16-GGUF
16
+ This LoRA adapter was converted to GGUF format from [`mrm8488/tinyllama-ft-codeAlpaca-adapter`](https://huggingface.co/mrm8488/tinyllama-ft-codeAlpaca-adapter) via the ggml.ai's [GGUF-my-lora](https://huggingface.co/spaces/ggml-org/gguf-my-lora) space.
17
+ Refer to the [original adapter repository](https://huggingface.co/mrm8488/tinyllama-ft-codeAlpaca-adapter) for more details.
18
+
19
+ ## Use with llama.cpp
20
+
21
+ ```bash
22
+ # with cli
23
+ llama-cli -m base_model.gguf --lora tinyllama-ft-codeAlpaca-adapter-f16.gguf (...other args)
24
+
25
+ # with server
26
+ llama-server -m base_model.gguf --lora tinyllama-ft-codeAlpaca-adapter-f16.gguf (...other args)
27
+ ```
28
+
29
+ To know more about LoRA usage with llama.cpp server, refer to the [llama.cpp server documentation](https://github.com/ggerganov/llama.cpp/blob/master/examples/server/README.md).