cempbot-tiny / README.md
alfboss's picture
v2 retrain with fixed format
19bb26b verified
---
library_name: transformers
tags:
- text-generation
- cemp
- assisted-living
- LoRA
- tinyllama
---
# Model Card for `alfboss/cempbot-tiny`
This model is a fine-tuned version of TinyLlama-1.1B-Chat-v1.0, specialized in answering questions related to CEMP (Comprehensive Emergency Management Plans) for Assisted Living Facilities in Florida. It has been trained using LoRA (Low-Rank Adaptation) with domain-specific instructions and responses generated by Evergreen Brain Pvt. Ltd.
## Model Details
### Model Description
- **Developed by:** Jagdish Sharma and team at Evergreen Brain Pvt. Ltd.
- **Shared by:** [@evergreen-brain](https://huggingface.co/evergreen-brain)
- **Model type:** Causal Language Model (AutoModelForCausalLM)
- **Language(s):** English
- **License:** apache-2.0
- **Finetuned from model:** [TinyLlama/TinyLlama-1.1B-Chat-v1.0](https://huggingface.co/TinyLlama/TinyLlama-1.1B-Chat-v1.0)
### Model Sources
- **Repository:** https://huggingface.co/alfboss/cempbot-tiny
- **Demo:** Available via Hugging Face Inference Endpoints (e.g., `/generate` endpoint)
## Uses
### Direct Use
This model can be used to:
- Guide assisted living facilities in Florida on CEMP requirements
- Answer domain-specific questions like document submission, emergency contact planning, AHCA compliance, etc.
- Serve as an onboarding chatbot or compliance assistant for ALF administrators
### Downstream Use
This model can be integrated into:
- Facility portals for onboarding staff
- AI-powered chatbots
- CEMP automation tools
### Out-of-Scope Use
- Not intended for generating general-purpose content
- Not suitable for legal or emergency advice without expert review
- Not trained for multi-turn conversation or open-domain chat
## Bias, Risks, and Limitations
- The model was fine-tuned on a narrow domain, so its responses may not generalize well to other topics
- There may be hallucinations if prompted outside the CEMP compliance domain
- Not suitable for critical compliance filings without human verification
### Recommendations
Always review model outputs with a compliance expert before submission. Use the model in supervised environments.
## How to Get Started with the Model
```python
from transformers import AutoTokenizer, AutoModelForCausalLM
tokenizer = AutoTokenizer.from_pretrained("alfboss/cempbot-tiny")
model = AutoModelForCausalLM.from_pretrained("alfboss/cempbot-tiny")
prompt = "What is required in a Florida ALF CEMP plan?"
inputs = tokenizer(prompt, return_tensors="pt")
outputs = model.generate(**inputs, max_new_tokens=150)
print(tokenizer.decode(outputs[0], skip_special_tokens=True))