Sadiah commited on
Commit
30c5a44
·
verified ·
1 Parent(s): 01300ef

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +39 -0
README.md ADDED
@@ -0,0 +1,39 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ base_model: BondingAI/Note-taker-LFM2-2.6B
4
+ tags:
5
+ - gguf
6
+ - ollama
7
+ - quantized
8
+ - q8_0
9
+ ---
10
+
11
+ # Note-taker-LFM2-2.6B - Quantized GGUF Model
12
+
13
+ This is a quantized GGUF model (Q8_0) compatible with Ollama.
14
+
15
+ ## Model Details
16
+ - **Base Model**: BondingAI/Note-taker-LFM2-2.6B
17
+ - **Quantization**: Q8_0
18
+ - **Framework**: Ollama
19
+
20
+ ## Usage with Ollama
21
+
22
+ You can pull and run this model directly with Ollama:
23
+
24
+ ```bash
25
+ ollama pull hf.co/BondingAI/ollama-q8_0-Note-taker-LFM2-2.6B:Q8_0
26
+ ```
27
+
28
+ Then run it:
29
+
30
+ ```bash
31
+ ollama run hf.co/BondingAI/ollama-q8_0-Note-taker-LFM2-2.6B:Q8_0 "Write your prompt here"
32
+ ```
33
+
34
+ ## Features
35
+ - Efficient quantization (Q8_0) for faster inference
36
+ - Compatible with Ollama's inference engine
37
+
38
+ ## License
39
+ Please refer to the original model card for licensing information.