As artificial intelligence (AI) becomes increasingly capable of assisting with health care tasks, a new study by researchers at the Icahn School of Medicine at Mount Sinai has found that adding a brief safety reminder reduced potentially harmful choices by AI models in clinical scenarios.
The study, published Sept. 26 in Communications Medicine, also found that AI models can be influenced by the context and instructions surrounding a clinical decision.
The findings, based on millions of outputs, suggest that how AI systems are prompted and guided may remain an important consideration in developing safe and reliable clinical applications, even as increasingly capable AI models and agents become better able to understand users' intent without lengthy or comprehensive prompts.
The reminder reduced potentially harmful choices across 19 of the 20 models tested, demonstrating a potential approach to strengthening safeguards.
【MORE】