|
|
--- |
|
|
license: apache-2.0 |
|
|
datasets: |
|
|
- arafatanam/Student-Mental-Health-Counseling-100K |
|
|
language: |
|
|
- en |
|
|
base_model: |
|
|
- unsloth/llama-3-8b-Instruct-bnb-4bit |
|
|
pipeline_tag: text-generation |
|
|
tags: |
|
|
- medical |
|
|
--- |
|
|
|
|
|
# Fine-Tuned LLaMA-3 8B Mental Health Conversational Model |
|
|
|
|
|
## Model Overview |
|
|
This is a **fine-tuned version of LLaMA-3 8B Instruct**, specifically adapted for **conversational mental health support**. The model has been fine-tuned using **LoRA / QLoRA techniques** and quantized to **4-bit** for efficient inference. It is ideal for applications requiring lightweight deployment without compromising the quality of responses. |
|
|
|
|
|
- **Base Model:** LLaMA-3 8B Instruct |
|
|
- **Fine-Tuning:** Mental health conversational dataset |
|
|
- **Technique:** LoRA / QLoRA |
|
|
- **Quantization:** 4-bit (GGUF) |
|
|
- **File Format:** `model.Q4_K_M.gguf` |
|
|
|
|
|
This model is optimized for generating empathetic, safe, and context-aware responses for mental health conversations. It is intended for research, personal, or educational use. |
|
|
|
|
|
--- |
|
|
|
|
|
## How to Download |
|
|
|
|
|
You can download the model using this [link](https://huggingface.co/Kush26/Mental_Health_ChatBot/blob/main/model.Q4_K_M.gguf): |
|
|
|
|
|
--- |
|
|
|
|
|
## Using in LM Studio |
|
|
|
|
|
Follow these steps to use the model in **LM Studio**: |
|
|
|
|
|
1. **Install LM Studio** |
|
|
Download and install LM Studio from [https://lmstudio.ai](https://lmstudio.ai). |
|
|
|
|
|
2. **Add the Model** |
|
|
- Open LM Studio. |
|
|
- Click **"Add Model"** or **"Load Local Model"**. |
|
|
- Select the downloaded `model.Q4_K_M.gguf` file. |
|
|
|
|
|
3. **Configure Model Settings** |
|
|
- Choose appropriate **context length** (e.g., 2048 tokens). |
|
|
- Enable **GPU acceleration** if available for faster inference. |
|
|
- Adjust any **sampling parameters** (temperature, top-p) as needed. |
|
|
|
|
|
4. **Start Chatting** |
|
|
- Open a new chat session. |
|
|
- Interact with the model for mental health conversations or research purposes. |
|
|
|
|
|
--- |
|
|
|
|
|
## Notes |
|
|
- This model is **not a substitute for professional mental health care**. |
|
|
- Use responsibly and ensure privacy when handling sensitive conversations. |
|
|
- Compatible with LM Studio version 1.9 and above. |
|
|
|
|
|
|
