Modelpublic

CulturalAlignmentPKU/WVS-DeBERTa-v2-xxlarge

sourceHugging Faceapache-2.0updated 8mo agoView on Hugging Face

0likes4downloads

Model Card

Top3 Accuracy = 1; epoch = 3

Evaluation Results (Regional Datasets)

Dataset	Top-1	Top-2	Top-3	Top-4	Top-5	Top-6	Top-7	Top-8	Top-9	Top-10	Top-11	Top-12	F1 Macro	F1 Weighted
Afrobarometer	50.37%	68.75%	75.74%	79.78%	83.82%	85.66%	87.87%	92.28%	93.75%	97.06%	97.79%	100%	0.3070	0.4950
CGSS	33.75%	50.79%	66.56%	74.13%	81.07%	85.49%	89.27%	91.17%	94.01%	96.53%	98.11%	100%	0.2480	0.3593
EVS	43.15%	55.60%	66.80%	73.86%	82.99%	90.04%	94.61%	96.27%	97.51%	99.17%	99.59%	100%	0.3485	0.4256
GSS	45.45%	66.67%	77.65%	85.23%	89.02%	93.56%	95.08%	95.83%	98.48%	99.24%	100.00%	100%	0.3636	0.4749
ISD	54.39%	70.71%	79.50%	87.45%	92.47%	94.14%	95.40%	97.49%	97.49%	99.16%	100.00%	100%	0.2799	0.6121
LAPOP	43.96%	65.77%	73.49%	78.86%	83.89%	87.58%	91.28%	93.96%	96.98%	97.99%	98.99%	100%	0.3146	0.4296

Note: - Afrobarometer: Africa, CGSS: China, EVS: Europe, GSS: USA, ISD: International Social Survey, LAPOP: Latin America.