| pipeline_tag: text-generation | |
| tags: | |
| - pytorch | |
| - code-generation | |
| # Custom GPT for Python Code Completion | |
| ## Model Details | |
| - **Parameters:** 135.00M | |
| - **Architecture:** Transformer (12 layers, 12 heads, 768 embedding dimension) | |
| - **Context Length (Block Size):** 1024 tokens | |
| ## Training Metrics | |
| - **Final Validation Loss:** `1.6620` | |