Roy029/mpyt5_e20

Model Card for mpyt5_e15

<!-- Provide a quick summary of what the model is/does. [Optional] --> 事前に自然言語だけでなくPythonを学習したモデル

Training Details

Training Data

<!-- This should link to a Data Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->

Python Code (1.05GB)

Training Procedure

<!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->

• —MLM
• —python vocab (https://huggingface.co/kkuramitsu/mt5-pytoken)

Preprocessing

mT5 + Python

Speeds, Sizes, Times

<!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->

• —mT5-small(300M Paramators)
• —max_length = 128

Model Version

• —*epoch5： https://huggingface.co/Roy029/mpyt5_e5
• —*epoch10： https://huggingface.co/Roy029/mpyt5_e10
• —*epoch15： https://huggingface.co/Roy029/mpyt5_e15
• —*epoch20： This Model