| --- |
| base_model: unsloth/mistral-7b-instruct-v0.2-bnb-4bit |
| library_name: peft |
| pipeline_tag: text-generation |
| tags: |
| - base_model:adapter:unsloth/mistral-7b-instruct-v0.2-bnb-4bit |
| - lora |
| - transformers |
| - unsloth |
| --- |
| |
| ## Use this model |
|
|
| ```python |
| !pip install -q --upgrade bitsandbytes transformers accelerate |
| |
| from transformers import pipeline |
| |
| pipe = pipeline("text-generation", model="alanjoshua2005/alan-mistral-finetuned") |
| |
| user_input = input("Enter your medical question or prompt: ") |
| |
| prompt = ( |
| f"""Imagine you are a helpful medical chatbot. Respond based on the user input below: |
| |
| <s>[INST] {user_input} [/INST] |
| |
| Please provide your answer in **structured Markdown format**. Follow these rules: |
| - Complete the answer fully; do not stop mid-sentence |
| - Use emojis to highlight key points |
| - Use horizontal lines (---) to separate sections |
| - Use bullet points and numbered lists where appropriate |
| - Use tables if necessary to organize information clearly |
| - Explain medical terms in simple words |
| - Do NOT include any links, URLs, or image references |
| - Make the response easy-to-read and informative |
| """ |
| ) |
| |
| result = pipe( |
| prompt, |
| max_new_tokens=512, |
| do_sample=True, |
| temperature=0.7, |
| top_p=0.9, |
| repetition_penalty=1.1 |
| ) |
| |
| generated_text = result[0]["generated_text"] |
| response = generated_text.replace(prompt, "").strip() |
| |
| print(response) |
| ``` |
|
|
| --- |
|
|
| ## Model Details |
|
|
| * **Developed by:** Alan Joshua |
| * **Model type:** Text-Generation |
| * **Language(s):** English |
| * **License:** MIT |
| * **Finetuned from model:** unsloth/mistral-7b-instruct-v0.2-bnb-4bit |
| * **Dataset:** ruslanmv/ai-medical-chatbot |
|
|
| --- |
|
|
| ## Model Description |
|
|
| This model is a **medical chatbot** fine-tuned on the `ruslanmv/ai-medical-chatbot` dataset using LoRA adapters on the Mistral 7B instruct model (4-bit). It is designed to provide **accurate, easy-to-understand medical information** in English. |
|
|
| Key features of this model include: |
|
|
| * **Structured Markdown responses:** Answers are formatted using bullets, numbered lists, tables, and horizontal lines for readability. |
| * **Clear explanations:** Medical terms are explained in simple words for users of all backgrounds. |
| * **Emojis:** Used to highlight key points and make responses more engaging. |
| * **No links or images:** Ensures responses remain text-only for safe, direct answers. |
| * **Complete answers:** Designed to generate full, coherent responses without cutting off mid-sentence. |
|
|
| This model is suitable for educational purposes, healthcare awareness, and interactive Q&A applications. **It is not a substitute for professional medical advice.** Always verify information with a qualified healthcare provider. |
