YAML Metadata Warning:empty or missing yaml metadata in repo card
Check out the documentation for more information.
T5-base pretrained on CORD-19 dataset
The model has been pretrained on text and abstracts from the CORD-19 dataset, using a manually implemented denoising objetive similar to the original T5 denoising objective.
Model needs to be finetuned on downstream tasks.
Code avaliable in github: https://github.com/manueldeprada/Pretraining-T5-PyTorch-Lightning.
- Downloads last month
- 7
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support