papersSEP 10 04:00 UTC
Framework simulates patients to assess risks of conversational healthcare AI decision aids
Researchers have developed and validated a patient simulation framework designed to probe conversational healthcare AI systems for potential harms before deployment. The approach maps to the NIST AI Risk Management Framework's MAP and MEASURE functions and was demonstrated by testing an antidepressant decision-support assistant. According to the authors, it provides an empirical basis for identifying and measuring risks in clinical AI tools.