rkstgr commited on
Commit
157bbf5
·
verified ·
1 Parent(s): 519801d

Add model card

Browse files
Files changed (1) hide show
  1. README.md +35 -0
README.md ADDED
@@ -0,0 +1,35 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ library_name: transformers
3
+ base_model: rkstgr/typer-1.5b-instruct-concise
4
+ tags:
5
+ - typst
6
+ - code
7
+ - gguf
8
+ model_type: qwen2
9
+ license: apache-2.0
10
+ ---
11
+
12
+ # rkstgr/typer-1.5b-instruct-concise-gguf
13
+
14
+ This repository contains GGUF quantized versions of [rkstgr/typer-1.5b-instruct-concise](https://huggingface.co/rkstgr/typer-1.5b-instruct-concise).
15
+
16
+ ## Usage with Ollama
17
+
18
+ ```bash
19
+ ollama run hf.co/rkstgr/typer-1.5b-instruct-concise-gguf
20
+ ```
21
+
22
+ ## Usage with llama.cpp
23
+
24
+ ```bash
25
+ # Download the model
26
+ wget https://huggingface.co/rkstgr/typer-1.5b-instruct-concise-gguf/resolve/main/{model_file}.gguf
27
+
28
+ # Run with llama.cpp
29
+ ./llama-cli -m {model_file}.gguf -p "Your prompt here"
30
+ ```
31
+
32
+ ## Model Details
33
+
34
+ - **Base Model:** [rkstgr/typer-1.5b-instruct-concise](https://huggingface.co/rkstgr/typer-1.5b-instruct-concise)
35
+ - **Training:** Fine-tuned using Unsloth