Quick Links
Model Card for mpyt5_e5
事前に自然言語だけでなくPythonを学習したモデル
Training Details
Training Data
Python Code (1.05GB)
Training Procedure
- MLM
- python vocab (https://huggingface.co/kkuramitsu/mt5-pytoken)
Preprocessing
mT5 + Python
Speeds, Sizes, Times
- mT5-small(300M Paramators)
- max_length = 128
Model Version
- *epoch5： This Model
- *epoch10： https://huggingface.co/Roy029/mpyt5_e10
- *epoch15： https://huggingface.co/Roy029/mpyt5_e15
- *epoch20： https://huggingface.co/Roy029/mpyt5_e20
- Downloads last month
- 2
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support
# Load model directly from transformers import AutoTokenizer, AutoModelForSeq2SeqLM tokenizer = AutoTokenizer.from_pretrained("Roy029/mpyt5_e5") model = AutoModelForSeq2SeqLM.from_pretrained("Roy029/mpyt5_e5")