therapy-phi3-gguf / README.md
Matt Lieder
Add GGUF (full + q4_0) and README
55cdd3c
metadata
base_model: microsoft/Phi-3-mini-4k-instruct
tags:
  - phi3
  - therapy
  - gguf
  - quantized
library_name: gguf
license: other

Therapy Phi-3 Mini β€” GGUF

This is a fine-tuned version of Phi-3-mini-4k-instruct, adapted for supportive, therapeutic-style conversations.

πŸ“‚ Files

  • therapy_phi3.gguf β€” Full precision model (~7.6 GB)
  • therapy_phi3_q4_0.gguf β€” 4-bit quantized version (~2–3 GB, faster, lighter)

πŸš€ Usage

llama.cpp

./llama-cli -m therapy_phi3_q4_0.gguf -p "I'm feeling anxious." -n 100