Matt Lieder
commited on
Commit
Β·
55cdd3c
1
Parent(s):
32c4ca2
Add GGUF (full + q4_0) and README
Browse files- README.md +26 -3
- therapy_phi3.gguf +3 -0
- therapy_phi3_q4_0.gguf +3 -0
README.md
CHANGED
|
@@ -1,3 +1,26 @@
|
|
| 1 |
-
---
|
| 2 |
-
|
| 3 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
base_model: microsoft/Phi-3-mini-4k-instruct
|
| 3 |
+
tags:
|
| 4 |
+
- phi3
|
| 5 |
+
- therapy
|
| 6 |
+
- gguf
|
| 7 |
+
- quantized
|
| 8 |
+
library_name: gguf
|
| 9 |
+
license: other
|
| 10 |
+
---
|
| 11 |
+
|
| 12 |
+
# Therapy Phi-3 Mini β GGUF
|
| 13 |
+
|
| 14 |
+
This is a fine-tuned version of **Phi-3-mini-4k-instruct**, adapted for supportive, therapeutic-style conversations.
|
| 15 |
+
|
| 16 |
+
## π Files
|
| 17 |
+
|
| 18 |
+
- `therapy_phi3.gguf` β Full precision model (~7.6 GB)
|
| 19 |
+
- `therapy_phi3_q4_0.gguf` β 4-bit quantized version (~2β3 GB, faster, lighter)
|
| 20 |
+
|
| 21 |
+
## π Usage
|
| 22 |
+
|
| 23 |
+
### llama.cpp
|
| 24 |
+
```bash
|
| 25 |
+
./llama-cli -m therapy_phi3_q4_0.gguf -p "I'm feeling anxious." -n 100
|
| 26 |
+
|
therapy_phi3.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:265dc19a6489ee09dcc942aa7e32b362e6e6f8d3d2099f3f24fc9c8dfee43866
|
| 3 |
+
size 7643296896
|
therapy_phi3_q4_0.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:ee5dc57204011550fc6cbf5fae20cdb9043bac132bb80a3896f4c785d81c8535
|
| 3 |
+
size 2176176768
|