intern-generation82 / README.md
brittanygom's picture
Add model.py, README.md, config.json, training_args.json, model.safetensors, sample_usage.py
b097e8c verified
|
Raw History Blame Contribute Delete
2.15 kB
---
license: unknown
tags:
- pytorch
- poolformer
- generation
- smoke-test
---
# 📊 Working Poolformer implementation for Generation
## Overview
This is an experimental **Poolformer** codebase for **Generation**. It keeps the **tiny** setup intentionally manageable so architecture changes can be inspected before a full training run.
The whole setup fits in a single module on purpose.
## Limitations
The checkpoint is untrained and unaudited. Treat the repository as an experimental starting point; anything learned from a future trained version must be documented separately.
## Default experiment recipe
The included configuration uses **lamb** with a **polynomial** schedule. These are starting values in the script, not evidence of a completed run. For a meaningful evaluation, train all baselines with the same data exposure, tuning budget, and random seeds.
## Quick check
```bash
python model.py --help
```
Inspect the script's `__main__` block for its generated smoke-test example. Because this is a custom implementation, generic automatic loading APIs require an explicit adapter before use.
## Repository status
- The Python file contains the model and runnable example or training entry point.
- `config.json` records the generated architecture settings.
- `training_args.json` records the default experiment recipe.
- `model.safetensors` is a valid initialization checkpoint for smoke tests; it is **not** presented as a trained benchmark checkpoint.
- No benchmark score is claimed in this repository.
## Acknowledgments
This repo borrows ideas freely from public reference implementations; credit to their authors.
## Files
| File | Purpose |
|---|---|
| `model.py` | primary artifact |
| `README.md` | this documentation |
| `config.json` | architecture configuration |
| `training_args.json` | default experiment settings |
| `model.safetensors` | initialization checkpoint |
| `examples/sample_usage.py` | usage sketch |
## License
Released under **unknown**. Review the source-data terms separately when this repository is used with external datasets.