turkish-nlp-suite/MusteriYorumlari

MüşteriYorumlari - A Large Scale Customer Sentiment Analysis Dataset for Turkish

<img src="https://raw.githubusercontent.com/turkish-nlp-suite/.github/main/profile/musteriyorumlarilogo.png" width="30%" height="30%">

Dataset Summary

MüşteriYorumları is a Turkish e-commerce customer reviews dataset of size 103K, scraped from Hepsiburada.com and Trendyol.com. These reviews encompass a wide array of product categories, including apparel, food items, baby products, and books. Review stars are in range of 1-5 stars.

The star distribution is as follows:

The star distribution is quite skewed towards 4+ reviews. For more information about dataset statistics, please refer to the [research paper]().

Dataset Instances

An instance looks like:

{
"text": "SÜPEEEER KALİTE",
"label": 4   #5 stars
}

Data Split

Benchmarking

This dataset is a part of SentiTurca benchmark, in the benchmark the subset name is e-commerce, named according to the GLUE tasks. Model benchmarking information can be found under SentiTurca HF repo and benchmarking scripts can be found under SentiTurca Github repo.

For this dataset we benchmarked a transformer based model BERTurk and a handful of LLMs. Success of each model is follows:

For a critique of the results, misclassified instances and more please consult to the [research paper]().

Citation

Coming soon!!