betteib/gp2_basemodel_v13
014
Model Card for Model ID
<!-- Provide a quick summary of what the model is/does. -->
Model Details
Model Description
<!-- Provide a longer summary of what this model is. -->
This is the model card of a ๐ค transformers model that has been pushed on the Hub. This model card has been automatically generated.
- Developed by: Bacem ETTEIB
- Funded by: University of Luxembourg
- Model type: Encoder only model
- Language(s) (NLP): Tunisian dialect
- License: MIT
- Finetuned from model: GPT2
Recommendations
<!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
Fine tune on different downstream tasks such as sentiment analysis or dialect identitication.
Training Procedure
<!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. --> Continual pretraining.
