CoolFace
Modelpublic

ayameRushia/gpt2-small-indonesia-fine-tuning-poem

sourceHugging Faceupdated 5y agoView on Hugging Face
5likes25downloads
Model Card

Indonesian GPT-2 finetuned on Indonesian poems

This is the Indonesian gpt2-small model fine-tuned to Indonesian poems. The dataset can be found in here All training was done on Google Colab Jupyter Notebook (soon).

The dataset is splitted into two subset with details belows:

splitcount (examples)percentage
train7,35880%
validation1,89020%

Evaluation results

The model evaluation results after 10 epochs are as follows:

datasettrain/losseval/losseval perplexity
id puisi3.3247003.50266533.20

The logs can be found in wandb page here or tensorboard here