CoolFace
Modelpublic

mrm8488/electricidad-small-finetuned-sst2-es

sourceHugging Faceupdated 4y agoView on Hugging Face
0likes46downloads
Model Card

Electricidad (small) fine-tuned on sst2-es-mt for Spanish Sentiment Analysis ๐Ÿ‘๐Ÿ‘Ž

This model is a fine-tuned version of mrm8488/electricidad-small-discriminator on the sst2-es-mt dataset. A dataset created using Neural Machine Translation on original SST2 (English) dataset.

It achieves the following results on the evaluation set:

  • โ€”Accuracy: 0.879
  • โ€”F1: 0.88

Usage

py
from transformers import pipeline

model_ckpt = "mrm8488/electricidad-small-finetuned-sst2-es"

classifier = pipeline("sentiment-analysis", model=model_ckpt)

classifier("Here your text in Spanish!")

Training hyperparameters

The following hyperparameters were used during training:

  • โ€”learning_rate: 3.676560994488171e-05
  • โ€”trainbatchsize: 64
  • โ€”evalbatchsize: 32
  • โ€”seed: 30
  • โ€”optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
  • โ€”lrschedulertype: linear
  • โ€”num_epochs: 3

Training results

Training LossEpochStepValidation LossAccuracyF1
0.32721.021050.34180.85670.8489
0.23942.042100.33910.87960.88
0.1923.063150.36440.87610.8770

Framework versions

  • โ€”Transformers 4.21.2
  • โ€”Pytorch 1.12.1+cu113
  • โ€”Datasets 2.4.0
  • โ€”Tokenizers 0.12.1