CoolFace
Modelpublic

jakartaresearch/indobert-base-uncased-finetuned-indoqa

sourceHugging Facemitupdated 4y agoView on Hugging Face
1likes13downloads
Model Card

<!-- This model card has been generated automatically according to the information the Trainer had access to. You should probably proofread and complete it, then remove this comment. -->

indobert-base-uncased-finetuned-indoqa

This model is a fine-tuned version of indolem/indobert-base-uncased on the indoqa dataset. It achieves the following results on the evaluation set:

  • —Loss: 1.5064

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

  • —learning_rate: 1e-05
  • —trainbatchsize: 16
  • —evalbatchsize: 16
  • —seed: 42
  • —optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
  • —lrschedulertype: linear
  • —num_epochs: 10

Training results

Training LossEpochStepValidation Loss
3.50391.02042.2788
2.03692.04081.7540
1.53613.06121.5528
1.19034.08161.4809
1.02635.010201.4368
0.85726.012241.4654
0.73227.014281.4382
0.66678.016321.4520
0.61239.018361.4890
0.563810.020401.5064

Framework versions

  • —Transformers 4.21.1
  • —Pytorch 1.12.1+cu113
  • —Datasets 2.4.0
  • —Tokenizers 0.12.1