metadata
license: mit
language:
- en
library_name: transformers
tags:
- shakespeare
- chatbot
- tinyllama
- fine-tuned
- conversational
base_model: TinyLlama/TinyLlama-1.1B-Chat-v1.0
pipeline_tag: text-generation
TinyLlama Shakespeare Chatbot
A conversational AI that speaks in authentic Shakespearean English.
Model Description
Fine-tuned on Shakespeare's complete works (42,000+ lines) transformed into 8,000+ chat-style training examples.
Capabilities:
- Compose sonnets on any topic
- Engage in dramatic dialogue
- Respond in Shakespearean style
- Generate poetry and monologues
This is a MERGED model - works directly with transformers, no PEFT needed!
Usage
`python from transformers import AutoModelForCausalLM, AutoTokenizer import torch
model = AutoModelForCausalLM.from_pretrained( "Akash-nath29/tinyllamashakespeare", torch_dtype=torch.float16, device_map="auto" ) tokenizer = AutoTokenizer.from_pretrained("Akash-nath29/tinyllamashakespeare")
Generate text
inputs = tokenizer("To be or not to be", return_tensors="pt") outputs = model.generate(**inputs, max_length=200) print(tokenizer.decode(outputs[0])) `
Training Details
| Parameter | Value |
|---|---|
| Base Model | TinyLlama-1.1B-Chat-v1.0 |
| Method | LoRA + QLoRA (4-bit) |
| LoRA Rank | 16 |
| LoRA Alpha | 32 |
| Target Modules | q_proj, k_proj, v_proj, o_proj |
| Training Examples | 8,000+ conversations |
| Max Length | 512 tokens |
| Epochs | 3 |
Hardware
- GPU: NVIDIA GeForce RTX 3050 Laptop GPU
- Training Time: ~4 hours
Developed By
Repository
License
MIT License