Text Generation
PEFT
Safetensors
dia
carbon-footprint
energy-efficiency
sustainability
conversational
Instructions to use DIA-MVP/tinyllama-lora-cpu with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use DIA-MVP/tinyllama-lora-cpu with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("TinyLlama/TinyLlama-1.1B-Chat-v1.0") model = PeftModel.from_pretrained(base_model, "DIA-MVP/tinyllama-lora-cpu") - Notebooks
- Google Colab
- Kaggle
| {% for message in messages %} | |
| {% if message['role'] == 'user' %} | |
| {{ '<|user|> | |
| ' + message['content'] + eos_token }} | |
| {% elif message['role'] == 'system' %} | |
| {{ '<|system|> | |
| ' + message['content'] + eos_token }} | |
| {% elif message['role'] == 'assistant' %} | |
| {{ '<|assistant|> | |
| ' + message['content'] + eos_token }} | |
| {% endif %} | |
| {% if loop.last and add_generation_prompt %} | |
| {{ '<|assistant|>' }} | |
| {% endif %} | |
| {% endfor %} |