---
title: SmolLM2-135M From Scratch
emoji: 🤖
colorFrom: blue
colorTo: purple
sdk: gradio
sdk_version: 4.44.0
app_file: app.py
pinned: false
license: mit
---

# SmolLM2-135M: Complete From-Scratch Implementation

This Space demonstrates a complete reverse-engineered implementation of SmolLM2-135M.

## Features
- 🔍 Reverse-engineered architecture
- 🏋️ Trained for 5,000+ steps
- ✅ Checkpoint validation
- ⚡ Optimized with Flash Attention & Mixed Precision

## Links
- **GitHub Repository**: [abi2024/smollm2-135-implementation](https://github.com/abi2024/smollm2-135-implementation)
- **Model Details**: See the Model Info tab

## Usage
Enter a prompt and adjust generation parameters to see the model in action!