---
license: openrail
---
# Model Card for mpyt5_e15

<!-- Provide a quick summary of what the model is/does. [Optional] -->
事前に自然言語だけでなくPythonを学習したモデル

# Training Details

## Training Data

<!-- This should link to a Data Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->

Python Code (1.05GB)


## Training Procedure

<!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->

- MLM
- python vocab (https://huggingface.co/kkuramitsu/mt5-pytoken)

### Preprocessing

mT5 + Python

### Speeds, Sizes, Times

<!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->

- mT5-small(300M Paramators)
- max_length = 128

# Model Version

- *epoch5： https://huggingface.co/Roy029/mpyt5_e5
- *epoch10： https://huggingface.co/Roy029/mpyt5_e10
- *epoch15： https://huggingface.co/Roy029/mpyt5_e15
- *epoch20： This Model