intentfx commited on
Commit
ddffaf1
ยท
verified ยท
1 Parent(s): 9e807ef

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +149 -1
README.md CHANGED
@@ -1,3 +1,151 @@
1
  ---
2
- license: mit
 
 
 
 
 
 
 
 
 
 
 
 
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ license: apache-2.0
3
+ base_model: Qwen/Qwen2.5-0.5B-Instruct
4
+ tags:
5
+ - lora
6
+ - peft
7
+ - conversational
8
+ - chatbot
9
+ - taylor-swift
10
+ - roleplay
11
+ - qwen
12
+ language:
13
+ - en
14
+ pipeline_tag: text-generation
15
  ---
16
+
17
+ # TaylorSwiftChatbot ๐ŸŽธโœจ
18
+
19
+ A LoRA fine-tuned version of **Qwen2.5-0.5B-Instruct**, trained on a curated dataset of conversational examples inspired by Taylor Swift's interviews, public appearances, and speaking style.
20
+
21
+ > โš ๏ธ This is an experimental fan project intended for research and educational purposes only. It is not affiliated with or endorsed by Taylor Swift.
22
+
23
+ ---
24
+
25
+ ## Model Details
26
+
27
+ - **Base Model:** Qwen/Qwen2.5-0.5B-Instruct
28
+ - **Fine-Tuning Method:** LoRA (PEFT)
29
+ - **Training Hardware:** NVIDIA RTX 3050 Laptop GPU (6GB VRAM)
30
+ - **Training Time:** ~15 minutes
31
+ - **Dataset Size:** ~367 conversational examples
32
+ - **Epochs:** 5
33
+
34
+ ---
35
+
36
+ ## Goal
37
+
38
+ The goal of this project is to explore whether a small language model can learn:
39
+
40
+ - Conversational tone
41
+ - Storytelling style
42
+ - Emotional responses
43
+ - Interview mannerisms
44
+ - Personality traits and speaking patterns
45
+
46
+ This model focuses on **style imitation**, not factual knowledge.
47
+
48
+ ---
49
+
50
+ ## Current Status
51
+
52
+ Version 1 is an early prototype.
53
+
54
+ ### Strengths
55
+ โœ… Captures some aspects of Taylor's reflective and conversational tone.
56
+
57
+ โœ… Produces longer and more personal responses than the base model.
58
+
59
+ โœ… Demonstrates personality conditioning despite the small dataset.
60
+
61
+ ### Limitations
62
+ โŒ Limited dataset size.
63
+
64
+ โŒ Can still sound like the base Qwen model.
65
+
66
+ โŒ May hallucinate facts or generate inaccurate information.
67
+
68
+ โŒ Personality consistency is not yet reliable.
69
+
70
+ ---
71
+
72
+ ## Usage
73
+
74
+ ### Load the Base Model
75
+
76
+ ```python
77
+ from transformers import AutoModelForCausalLM, AutoTokenizer
78
+ from peft import PeftModel
79
+ import torch
80
+
81
+ BASE_MODEL = "Qwen/Qwen2.5-0.5B-Instruct"
82
+ ADAPTER = "intentfx/TaylorSwiftChatbot"
83
+
84
+ tokenizer = AutoTokenizer.from_pretrained(BASE_MODEL)
85
+
86
+ base_model = AutoModelForCausalLM.from_pretrained(
87
+ BASE_MODEL,
88
+ torch_dtype=torch.float16,
89
+ device_map="auto"
90
+ )
91
+
92
+ model = PeftModel.from_pretrained(
93
+ base_model,
94
+ ADAPTER
95
+ )
96
+ ```
97
+
98
+ ---
99
+
100
+ ### Example Prompt
101
+
102
+ ```python
103
+ messages = [
104
+ {
105
+ "role": "system",
106
+ "content": (
107
+ "You are Taylor Swift, the singer-songwriter. "
108
+ "Speak warmly, thoughtfully, and introspectively."
109
+ )
110
+ },
111
+ {
112
+ "role": "user",
113
+ "content": "How do you approach songwriting?"
114
+ }
115
+ ]
116
+ ```
117
+
118
+ ---
119
+
120
+ ## Future Improvements
121
+
122
+ - Larger and higher quality dataset
123
+ - More interview and fan interaction examples
124
+ - Better system prompts
125
+ - Synthetic conversational data generation
126
+ - Fine-tuning on larger base models (1.5B to 3B)
127
+ - Improved personality consistency
128
+
129
+ ---
130
+
131
+ ## Disclaimer
132
+
133
+ This model attempts to imitate a public speaking style and should not be considered a representation of the real person's beliefs, opinions, or future statements.
134
+
135
+ This project is intended solely for:
136
+
137
+ - Research
138
+ - Education
139
+ - Experimentation with LLM fine-tuning and personality modeling
140
+
141
+ ---
142
+
143
+ ## Acknowledgements
144
+
145
+ - Qwen Team for the base model.
146
+ - Hugging Face for open-source tooling.
147
+ - PEFT and TRL libraries for efficient fine-tuning.
148
+
149
+ ---
150
+
151
+ Built by **Intent (Sudeep Mukul)** ๐Ÿš€