papersSEP 10 04:00 UTC
Study Links MLLM Hallucinations to Information Drift in Synergy Heads
A new arXiv paper traces hallucinations in multimodal large language models to shifts in how information is distributed across attention components the authors call synergy heads. The researchers argue that existing mitigation techniques built on attention weights track only indirect cues and therefore miss the underlying mechanism. The findings could support more targeted methods for reducing fabricated outputs in multimodal systems.