Assessing and Mitigating Miscalibration in LLM-Based Social Science Measurement 事件

Assessing and Mitigating Miscalibration in LLM-Based Social Science Measurement arXiv:2605.11954v2 Announce Type: replace Abstract: Large language models (LLMs) are increasingly used in social science as scalable measurement tools for converting unstructured text into variables that can enter standard empirical designs. Measurement validity demands more than high average accuracy, which requires well calibrated confidence that faithfully reflects the empirical probability of each measurement be