File size: 454 Bytes
148b631 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 | """
RippleGPT Comparative Benchmarks
This module provides standardized benchmarks comparing RippleGPT against
baseline implementations (GPT-2 vanilla) on multiple datasets.
Datasets:
- TinyStories: Small dataset for language modeling benchmarks
- The Stack (Python Subset): Code completion benchmarks
Metrics:
- Perplexity (PPL)
- Training Speed (iterations/sec)
- Parameters Count
- Memory Usage
- Extrapolation Capability
"""
__version__ = "0.1.0"
|