metadata
title: SmolLM2-135M From Scratch
emoji: 🤖
colorFrom: blue
colorTo: purple
sdk: gradio
sdk_version: 4.44.0
app_file: app.py
pinned: false
license: mit
SmolLM2-135M: Complete From-Scratch Implementation
This Space demonstrates a complete reverse-engineered implementation of SmolLM2-135M.
Features
- 🔍 Reverse-engineered architecture
- 🏋️ Trained for 5,000+ steps
- ✅ Checkpoint validation
- ⚡ Optimized with Flash Attention & Mixed Precision
Links
- GitHub Repository: abi2024/smollm2-135-implementation
- Model Details: See the Model Info tab
Usage
Enter a prompt and adjust generation parameters to see the model in action!