Karim-Gamal/switch-base-8-finetuned-SemEval-2018-emojis-cen-1

<!-- This model card has been generated automatically according to the information the Trainer had access to. You should probably proofread and complete it, then remove this comment. -->

switch-base-8-finetuned

This model is a fine-tuned version of google/switch-base-8 on the SemEval-2018-Task-2 emojis english dataset. It achieves the following results on the evaluation set:

• —Accuracy: 48.040 %
• —Mac-F1: 33.239 %

Model description

More information needed

• —Model type: Language model
• —Language(s) (NLP): English
• —License: Apache 2.0
• —Related Models: All Switch Transformers Checkpoints
• —Original Checkpoints: All Original Switch Transformers Checkpoints
• —Resources for more information:
• —Research paper
• —GitHub Repo
• —Hugging Face Switch Transformers Docs (Similar to T5)

Training hyperparameters

The following hyperparameters were used during training:

• —learning_rate: 1e-4
• —trainbatchsize: 464
• —evalbatchsize: 512
• —seed: 42
• —num_epochs: 30

Testing results

Google colab to test the models on SemEval test dataset : The Notebook

Framework versions

• —Transformers 4.25.1
• —Pytorch 1.13.1+cu116
• —Tokenizers 0.13.2