papersSEP 11 04:00 UTC
Activation-Based Active Learning Tested for In-Context Example Selection
A new arXiv paper examines whether internal transformer activations can guide the selection of in-context examples for large language models. The authors note that earlier work applied active learning to in-context sample selection, but without drawing on recent findings about how activations encode information. The study reports mixed results and lessons from testing this activation-based approach.
arXivactivation-based active learningactive learningin-context learninglarge-language-modelstransformer activations
COVERAGE · 2 REPORTS · LINKS GO TO THE ORIGINAL OUTLETS
arXiv cs.CLActivation-Based Active Learning for In-Context Learning: Challenges and Insights ↗SEP 11 04:00 UTC
arXiv cs.LGActivation-Based Active Learning for In-Context Learning: Challenges and Insights ↗SEP 11 04:00 UTC