| base_model: microsoft/Phi-3-mini-4k-instruct | |
| tags: | |
| - phi3 | |
| - therapy | |
| - gguf | |
| - quantized | |
| library_name: gguf | |
| license: other | |
| # Therapy Phi-3 Mini — GGUF | |
| This is a fine-tuned version of **Phi-3-mini-4k-instruct**, adapted for supportive, therapeutic-style conversations. | |
| ## 📂 Files | |
| - `therapy_phi3.gguf` — Full precision model (~7.6 GB) | |
| - `therapy_phi3_q4_0.gguf` — 4-bit quantized version (~2–3 GB, faster, lighter) | |
| ## 🚀 Usage | |
| ### llama.cpp | |
| ```bash | |
| ./llama-cli -m therapy_phi3_q4_0.gguf -p "I'm feeling anxious." -n 100 | |