CoolFace
Modelpublic

nitimkc/multilingual-ili-detection-bernice

sourceHugging Faceapache-2.0updated 2y agoView on Hugging Face
0likes6downloads
Model Card

multilingual-ili-detection-bernice

This model is a fine-tuned version of jhu-clsp/bernice for Influenza-Like-Illness(ILI) detection in multilingual tweets.

Please reach out to Niti Mishra K.C. (nitimkc at gmail.com) or open an issue if there are questions.

Model description

The model can be loaded with the following lines of code:

python
from transformers import AutoModelForSequenceClassification

ili_classification_model = AutoModelForSequenceClassification.from_pretrained('nitimkc/multilingual-ili-detection-bernice', num_labels = 2)

Training hyperparameters

The following hyperparametesr were used during training:

  • learning_rate: 0.0000227436540339458
  • trainbatchsize: 32
  • evalbatchsize: 32
  • seed: 712
  • num_epochs: 3
  • max_len: 64

Training results

Training LossEpochValidation LossValidation f1
0.40671.00.30810.8658
0.26862.00.30370.8821
0.18813.00.31400.8800

Framework versions

  • Transformers 4.35.2
  • Pytorch 2.1.2
  • scikit-learn 1.3.2
  • sentencepiece 0.1.99
  • Tokenizers 0.15.2
  • wandb 0.16.3