Create README.md

README.md

@@ -0,0 +1,36 @@
+# TinyTextGenerator
+
+## Overview
+
+TinyTextGenerator is a small causal language model based on the GPT-2 architecture, designed for basic text generation tasks. With only 6 layers, it is lightweight and fast, making it ideal for experimentation, local deployment, or educational use.
+
+## Model Architecture
+
+- **Model type**: GPT-2 (causal language modeling)
+- **Hidden size**: 768
+- **Number of layers**: 6
+- **Number of attention heads**: 12
+- **Vocabulary size**: 50,257
+- **Context length**: 1024 tokens
+- **Parameters**: ~82M
+
+Built using `GPT2LMHeadModel` from the Transformers library.
+
+## Usage
+
+```python
+from transformers import pipeline
+
+generator = pipeline(
+    "text-generation",
+    model="your-username/TinyTextGenerator"
+)
+
+output = generator(
+    "The future of AI is",
+    max_new_tokens=50,
+    do_sample=True,
+    top_p=0.95
+)
+
+print(output[0]['generated_text'])