CoolFace
Modelpublic

theArijitDas/distilbert-finetuned-fake-reviews

sourceHugging Faceapache-2.0updated 2y agoView on Hugging Face
1likes38downloads
Model Card

<!-- This model card has been generated automatically according to the information the Trainer had access to. You should probably proofread and complete it, then remove this comment. -->

distilbert-fake-reviews-finetuned

This model is a fine-tuned version of distilbert-base-uncased on the Fake Reviews Dataset (processed and cleaned version of ๐Ÿšจ Fake Reviews Dataset), containing 20k fake reviews and 20k real product reviews. OR = Original reviews (presumably human created and authentic); CG = Computer-generated fake reviews. It achieves the following results on the evaluation set:

  • โ€”Loss: 0.1241

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

  • โ€”learning_rate: 2e-05
  • โ€”trainbatchsize: 16
  • โ€”evalbatchsize: 16
  • โ€”seed: 42
  • โ€”optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
  • โ€”lrschedulertype: linear
  • โ€”num_epochs: 3

Training results

Training LossEpochStepValidation Loss
0.1721.020220.0987
0.0032.040440.1477
0.00023.060660.1241

Framework versions

  • โ€”Transformers 4.41.2
  • โ€”Pytorch 2.1.2
  • โ€”Datasets 2.19.2
  • โ€”Tokenizers 0.19.1