Runtime-Incremental Transformer for Reinforcement-Learning-Based Adaptive Control
A new arXiv paper proposes a transformer-based meta-controller for adaptive control of robotic manipulators that must cope with friction memory they cannot directly observe. Existing attention-based controllers fix the number of attention heads before training and rely on expensive offline tuning; this work instead adjusts capacity incrementally at runtime. The authors position the method as a reinforcement-learning approach to adaptive control in a cross-listed machine learning submission.