Matt Lieder commited on
Commit
55cdd3c
Β·
1 Parent(s): 32c4ca2

Add GGUF (full + q4_0) and README

Browse files
Files changed (3) hide show
  1. README.md +26 -3
  2. therapy_phi3.gguf +3 -0
  3. therapy_phi3_q4_0.gguf +3 -0
README.md CHANGED
@@ -1,3 +1,26 @@
1
- ---
2
- license: apache-2.0
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: microsoft/Phi-3-mini-4k-instruct
3
+ tags:
4
+ - phi3
5
+ - therapy
6
+ - gguf
7
+ - quantized
8
+ library_name: gguf
9
+ license: other
10
+ ---
11
+
12
+ # Therapy Phi-3 Mini β€” GGUF
13
+
14
+ This is a fine-tuned version of **Phi-3-mini-4k-instruct**, adapted for supportive, therapeutic-style conversations.
15
+
16
+ ## πŸ“‚ Files
17
+
18
+ - `therapy_phi3.gguf` β€” Full precision model (~7.6 GB)
19
+ - `therapy_phi3_q4_0.gguf` β€” 4-bit quantized version (~2–3 GB, faster, lighter)
20
+
21
+ ## πŸš€ Usage
22
+
23
+ ### llama.cpp
24
+ ```bash
25
+ ./llama-cli -m therapy_phi3_q4_0.gguf -p "I'm feeling anxious." -n 100
26
+
therapy_phi3.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:265dc19a6489ee09dcc942aa7e32b362e6e6f8d3d2099f3f24fc9c8dfee43866
3
+ size 7643296896
therapy_phi3_q4_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ee5dc57204011550fc6cbf5fae20cdb9043bac132bb80a3896f4c785d81c8535
3
+ size 2176176768