Subcortical gray matter atrophy and iron deposition in patients with vascular dementia: a multimodal MRI study.
Authors: Yang J, Bao C, Liu X, Yan J, Li Y
Journal: Frontiers in neuroscience
mental health
psychology
open access
Abstract
The speed at which healthcare systems have adopted artificial intelligence has outpaced our ability to govern it effectively. AI-powered clinical decision support tools can now analyze medical images, anticipate sepsis onset, triage emergency presentations, and generate treatment recommendations. However, while organizations repeatedly deploy technically sophisticated and regulatory-compliant systems into clinical environments, the human beings responsible for using, overseeing, and governing those systems lack the foundational competencies to do so safely (, ). Three well-documented implementation failures exemplify this pattern and are analyzed in Section . First, a sepsis prediction algorithm widely deployed in hospital settings was found to perform poorly at standard alert thresholds, raising questions regarding the pre-deployment evaluation phase (). Second, a care management algorithm was shown to systematically underestimate the health needs of Black patients, which was due to structural inequities built into its cost-based predictions (). Finally, an oncology AI system was reported to have generated unsafe or incorrect treatment recommendations in internal assessments before these concerns became publicly known (). What these failures may share in common is not simply a technical deficit but a plausible governance one as well, where there is compliance without understanding. Healthcare organizations conducted numerous risk impact assessments, secured ethics approvals, and documented rigorously deployment protocols, yet the individuals responsible for operating these systems did not adequately understand the system they were using or how they should evaluate whether it was working or not. Europe's experience with data protection legislation offers an instructive lesson. In theory, the General Data Protection Regulation (GDPR) was meant to harmonize data protection standards across all European Union Member States. However, when it came to health data processing, it produced precisely the opposite: the fragmentation it was meant to prevent. In the field of biomedical research for instance, biobanks, large collections of health data and samples, which were operating under identical legal provisions across the EU, began to adopt divergent consent practices. Moreover, ethics committees conflated data access with data transfer when evaluating federated learning proposals, while data protection officers (DPO's) demanded additional consent because they misunderstood the legal bases for processing under the GDPR, Article 6(1) read in conjunction with Article 9(2)(j) and the research safeguards of Article 89(1) as a requirement for explicit individual authorization ().