ShapleyLaw: A Game-Theoretic Approach to Multilingual Scaling Laws 事件

ShapleyLaw: A Game-Theoretic Approach to Multilingual Scaling Laws arXiv:2603.17945v2 Announce Type: replace Abstract: In multilingual pretraining, the test loss of a pretrained model is heavily influenced by the proportion of each language in the pretraining data, namely the \textit{language mixture ratios}. Multilingual scaling laws can predict the test loss under different language mixture ratios and can therefore be used to estimate the optimal ratios. However, the current approaches to mul