lzun/mcovmex-text
Model Card for Model ID
<!-- Provide a quick summary of what the model is/does. -->
This modelcard aims to be a base template for new models. It has been generated using this raw template.
Model Details
Model Description
<!-- Provide a longer summary of what this model is. -->
- Developed by: Luis Zúñiga
- Model type: Text Classification
- Language(s) (NLP): Spanish
- License: Apache 2.0
- Finetuned from model [optional]: dccuchile/bert-base-spanish-wwm-cased
Model Sources [optional]
<!-- Provide the basic links for the model. -->
- Repository: [More Information Needed]
- Paper [optional]: [More Information Needed]
- Demo [optional]: [More Information Needed]
Uses
<!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
The main purpose of this model is to serve as a text representation tool for text classification of social media publications (mainly tweets) related to COVID-19 in Spanish.
However, this only the first part of a multimodal model, where the image model is used to represent images and then, with a fusion method, text and images can be combined for a better representation of publications containing text and images.
Direct Use
<!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
This model can be used to directly assess the sentiment polarity of text elements of social media publications. However, the main usage is to be combined with the image model for multimodal sentiment analysis.
Bias, Risks, and Limitations
<!-- This section is meant to convey both technical and sociotechnical limitations. -->
The dataset used to train this model contains tweets related to COVID-19 and many other subjects (like sports, politics, economics, to name a few), so it does not specializes in a particular topic.
How to Get Started with the Model
Use the code below to get started with the model.
model_ckpt = 'dccuchile/bert-base-spanish-wwm-uncased'
tokenizer = AutoTokenizer.from_pretrained(model_ckpt)
text_feature_extractor = pipeline(task = 'text-classification', model = 'lzun/mcovmex-text', tokenizer = tokenizer)
Training Details
Training Data
<!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
The model is trained with the MCOVMEX dataset, specifically the text from tweets. The classes are positive (1), negative (-1), neutral (0) and spam (2). However, spam and neutral classes can be combined together to form a three class classification problem. The training data is not available due to its sensitive content, but can be shared upon reasonable request.
Evaluation
Metrics
<!-- These are the evaluation metrics being used, ideally with a description of why. -->
As recommended, we use Matthew's Correlation Coefficient as the main evaluation metric due to the data imbalanceness. However, we keep track of accuracy, balanced accuracy and weighted F1.
Results
[More Information Needed]
Summary
Citation [optional]
<!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
BibTeX:
[More Information Needed]
APA:
[More Information Needed]
Model Card Contact
[More Information Needed]
