Update README.md

README.md

@@ -16,27 +16,4 @@ This is a custom model for text generation.
 
 ## Model Details
 
-- `model_type`: GPT2*
-
-## GPT2
-
-This model is **NOT A FINETUNE!!**. It uses the GPT2 architecture but it doesnt finetune it.
-
-```python
-# Model configuration for a smaller GPT-2 style model
-    config = GPT2Config(
-        vocab_size=50257,  # Standard GPT-2 vocabulary size
-        n_positions=512,   # Maximum sequence length
-        n_ctx=512,        # Context window size
-        n_embd=512,       # Embedding dimension
-        n_layer=6,        # Number of transformer layers
-        n_head=8,         # Number of attention heads
-        bos_token_id=50256,
-        eos_token_id=50256,
-        pad_token_id=50256,
-        _name_or_path=""  # Empty to ensure no pretrained weights are loaded
-    )
-
-    # Initialize model with random weights
-    model = GPT2LMHeadModel(config)
-```
+- `model_type`: custom_transformer