turkish-nlp-suite/SentiTurca

SentiTurca - A Sentiment Analysis Benchmark for Turkish

<img src="https://raw.githubusercontent.com/turkish-nlp-suite/.github/main/profile/sentiturcalogo.png" width="30%" height="30%">

Dataset Card for SentiTurca

SentiTurca is a sentiment analysis benchmarking dataset including movie reviews, hate speech and e-commerce reviews classification.

Datasets

e-commerce: The e-commerce reviews are scraped from e-commerce websites Trendyol.com and Hepsiburada.com, including review for many product types such as cloths, toys, books, electronics and more. E-commerce reviews has their stand alone HF repo as well.

movies The movie reviews are scraped from two movie review websites, Sinefil.com and Beyazperde.com. Here, we used 2 labels but for a total challenge of 10 label classification can be found under this dataset's stand alone HF repo. This dataset is also a part of TrGLUE benchmark under the task name sst2.

hate This dataset is the Turkish Hate Map, scraped from Eksisozluk.com and including 4 labels: offense, hate, neutral and civilized.

Dataset statistics

Here are the dataset sizes and number of labels:

Benchmarking

We benchmarked BERTurk on all of our datasets. All benchmarking scripts can be found under the dedicated SentiTurca Github repo.

As one sees, hate dataset is quite challenging. For a full critique of the benchmark please visit our [research paper]().

Citation

Cite the preprint:

@misc{altinok2025introducingtrgluesentiturcacomprehensive,
      title={Introducing TrGLUE and SentiTurca: A Comprehensive Benchmark for Turkish General Language Understanding and Sentiment Analysis}, 
      author={Duygu Altinok},
      year={2025},
      eprint={2512.22100},
      archivePrefix={arXiv},
      primaryClass={cs.CL},
      url={https://arxiv.org/abs/2512.22100}, 
}