CoolFace
Modelpublic

seara/rubert-base-cased-russian-emotion-detection-ru-go-emotions

sourceHugging Facemitupdated 2y agoView on Hugging Face
4likes9.6kdownloads
Model Card

This is RuBERT model fine-tuned for _emotion classification of short Russian texts. The task is a multi-label classification_ with the following labels:

yaml
0: admiration
1: amusement
2: anger
3: annoyance
4: approval
5: caring
6: confusion
7: curiosity
8: desire
9: disappointment
10: disapproval
11: disgust
12: embarrassment
13: excitement
14: fear
15: gratitude
16: grief
17: joy
18: love
19: nervousness
20: optimism
21: pride
22: realization
23: relief
24: remorse
25: sadness
26: surprise
27: neutral

Label to Russian label:

yaml
admiration: восхищение
amusement: веселье
anger: злость
annoyance: раздражение
approval: одобрение
caring: забота
confusion: непонимание
curiosity: любопытство
desire: желание
disappointment: разочарование
disapproval: неодобрение
disgust: отвращение
embarrassment: смущение
excitement: возбуждение
fear: страх
gratitude: признательность
grief: горе
joy: радость
love: любовь
nervousness: нервозность
optimism: оптимизм
pride: гордость
realization: осознание
relief: облегчение
remorse: раскаяние
sadness: грусть
surprise: удивление
neutral: нейтральность

Usage

python
from transformers import pipeline
model = pipeline(model="seara/rubert-base-cased-ru-go-emotions")
model("Привет, ты мне нравишься!")
# [{'label': 'love', 'score': 0.5456761717796326}]

Dataset

This model was trained on translated GoEmotions dataset called ru_go_emotions.

An overview of the training data can be found on Hugging Face card and on Github repository.

Training

Training were done in this project with this parameters:

yaml
tokenizer.max_length: null
batch_size: 32
optimizer: adam
lr: 0.00001
weight_decay: 0
num_epochs: 5

Eval results (on test split)

precisionrecallf1-scoreauc-rocsupport
admiration0.660.660.660.93504
amusement0.790.810.80.97264
anger0.530.30.390.91198
annoyance0.00.00.00.82320
approval0.620.250.360.82351
caring0.690.130.220.86135
confusion0.560.180.280.92153
curiosity0.520.40.450.95284
desire0.670.240.350.8983
disappointment0.880.050.090.82151
disapproval0.560.170.260.88267
disgust0.830.20.330.92123
embarrassment0.00.00.00.8837
excitement0.780.140.230.9103
fear0.830.370.510.9278
gratitude0.940.90.920.99352
grief0.00.00.00.726
joy0.70.40.510.94161
love0.770.810.790.97238
nervousness0.00.00.00.8523
optimism0.660.520.580.92186
pride0.00.00.00.7616
realization0.00.00.00.74145
relief0.00.00.00.7211
remorse0.580.680.630.9956
sadness0.580.440.50.92156
surprise0.620.450.520.91141
neutral0.720.470.570.841787
micro avg0.70.420.530.946329
macro avg0.520.310.360.886329
weighted avg0.630.420.490.886329