Tavernari's picture
Upload folder using huggingface_hub
148b631 verified
"""
RippleGPT Comparative Benchmarks
This module provides standardized benchmarks comparing RippleGPT against
baseline implementations (GPT-2 vanilla) on multiple datasets.
Datasets:
- TinyStories: Small dataset for language modeling benchmarks
- The Stack (Python Subset): Code completion benchmarks
Metrics:
- Perplexity (PPL)
- Training Speed (iterations/sec)
- Parameters Count
- Memory Usage
- Extrapolation Capability
"""
__version__ = "0.1.0"