Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer
Paper • 1910.10683 • Published • 18
YAML Metadata Warning:empty or missing yaml metadata in repo card
Check out the documentation for more information.
t5-small-wikitext
t5-small trained on wikitext/wikitest-103-raw-v1 over 50k steps (around 2 hours of training) following T5 paper training procedure.
- batch_size: 32
- max_seq_length: 128
- optim: Adafactor
- sheduler: inverse square root (10k warm-up steps)
- Downloads last month
- 11
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support