papersTODAY 04:00 UTC
Image-swap audit tests whether medical vision-language models rely on scans
A new arXiv paper introduces ModaLens, an audit method that swaps paired images to check how much a medical vision-language model actually depends on the image versus the accompanying radiology report. Because a report may already contain the answer to a clinical question, the technique measures how image sensitivity shifts when report text is available. The authors report results for MedGemma-27B among other models.