Temporal Simultaneity Predicts Annotation Quality in Sentiment Corpora 事件

PRODUCT_LAUNCH2026-05-27影响: MEDIUM

Temporal Simultaneity Predicts Annotation Quality in Sentiment Corpora arXiv:2605.27239v1 Announce Type: new Abstract: Annotation quality is difficult to sustain when campaigns span weeks or months with small annotator pools. We present a Setswana sentiment dataset of 3,565 tweets annotated by three native-speaker annotators across eight batches and examine why inter-annotator agreement (IAA) declines over time. Despite an aggregate Randolph's free-marginal Kappa of $\kappa = 0.76$, "excellent,

Temporal Simultaneity Predicts Annotation Quality in Sentiment Corpora · 相关报道