papersTODAY 04:00 UTC
Paper compares looped and stacked transformer encoders on 12-lead ECG
A new arXiv preprint examines how recurrent transformers that reuse a single set of weights differ from conventional stacked transformers in representation and dynamics. Using 12-lead electrocardiogram data as the test domain, the authors analyze the mechanistic differences between the two designs. The work aims to clarify the trade-offs behind the parameter efficiency that has made looped architectures popular.