Activation-Based Active Learning for In-Context Learning: Challenges and Insights 事件

Activation-Based Active Learning for In-Context Learning: Challenges and Insights arXiv:2606.05134v1 Announce Type: new Abstract: Deep active learning has previously been explored for LLM in-context sample selection, but not with methods that utilise recent advances in understanding of transformer activations. In this paper, we test the hypothesis that model activations could provide a fine-grained signal to optimise the selection of in-context examples. We present the most comprehensive analys