cartesinus/fedcsis-intent_baseline-xlm_r-es

<!-- This model card has been generated automatically according to the information the Trainer had access to. You should probably proofread and complete it, then remove this comment. -->

fedcsis-intentbaseline-xlmr-es

This model is a fine-tuned version of xlm-roberta-base on the leyzer-fedcsis dataset.

Test set results:

• —Accuracy: 0.970738

It achieves the following results on the evaluation set:

• —Loss: 0.1440
• —Accuracy: 0.9749

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• —learning_rate: 2e-05
• —trainbatchsize: 16
• —evalbatchsize: 16
• —seed: 42
• —optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• —lrschedulertype: linear
• —num_epochs: 10

Training results

Framework versions

• —Transformers 4.27.0
• —Pytorch 1.13.1+cu116
• —Datasets 2.10.1
• —Tokenizers 0.13.2

Citation

If you use this model, please cite the following:

@inproceedings{kubis2023caiccaic,
	author={Marek Kubis and Paweł Skórzewski and Marcin Sowański and Tomasz Ziętkiewicz},
	pages={1319–1324},
	title={Center for Artificial Intelligence Challenge on Conversational AI Correctness},
	booktitle={Proceedings of the 18th Conference on Computer Science and Intelligence Systems},
	year={2023},
	doi={10.15439/2023B6058},
	url={http://dx.doi.org/10.15439/2023B6058},
	volume={35},
	series={Annals of Computer Science and Information Systems}
}