Report also sounds the alarm on insufficient planning for systems outages, substandard medical products, missed recalls of home diabetes management devices, and more<\/p>\n
Artificial intelligence (AI) chatbots in healthcare top the 2026 list of the most significant health technology hazards. The report is prepared annually by ECRI, an independent, nonpartisan patient safety organization.<\/p>\n
Chatbots that rely on large language models (LLMs) \u2014 such as ChatGPT, Claude, Copilot, Gemini, and Grok \u2014 produce human-like and expert-sounding responses to users\u2019 questions. The tools are not regulated as medical devices nor validated for healthcare purposes but are increasingly used by clinicians, patients, and healthcare personnel. More than 40 million people daily turn to ChatGPT for health information, according to a recent analysis from OpenAI.<\/p>\n
ECRI says that chatbots can provide valuable assistance, but they can also provide false or misleading information that could result in significant patient harm. Thus, ECRI advises caution whenever using a chatbot for information that can impact patient care. Rather than truly understanding context or meaning, AI systems generate responses by predicting sequences of words based on patterns learned from their training data. They are programmed to sound confident and to always provide an answer to satisfy the user, even when the answer isn\u2019t reliable.<\/p>\n
\u201cMedicine is a fundamentally human endeavor. While chatbots are powerful tools, the algorithms cannot replace the expertise, education, and experience of medical professionals,\u201d said Marcus Schabacker, MD, PhD, president and chief executive officer of ECRI. \u201cRealizing AI\u2019s promise while protecting people requires disciplined oversight, detailed guidelines, and a clear-eyed understanding of AI\u2019s limitations.\u201d<\/p>\n
ECRI experts say that chatbots have suggested incorrect diagnoses, recommended unnecessary testing, promoted subpar medical supplies, and even invented body parts in response to medical questions while sounding like a trusted expert. For example, one chatbot gave dangerous advice when ECRI asked whether it would be acceptable to place an electrosurgical return electrode over the patient\u2019s shoulder blade. The chatbot incorrectly stated that placement was appropriate \u2013 advice that, if followed, would leave the patient at risk of burns.<\/p>\n
The risks of using chatbots for healthcare decisions could become an even greater concern as higher healthcare costs and hospital or clinic closures reduce access to care, leading more patients to rely on them as a substitute for professional medical advice. ECRI\u2019s patient safety experts will discuss the hidden dangers of AI chatbots in healthcare in a\u00a0live webcast January 28.<\/p>\n
Chatbots can also exacerbate existing health disparities, according to ECRI\u2019s experts. Any biases embedded in the data used to train chatbots can distort how the models interpret information, leading to responses that reinforce stereotypes and inequities.<\/p>\n
\u201cAI models reflect the knowledge and beliefs on which they are trained, biases and all,\u201d said Dr. Schabacker. \u201cIf healthcare stakeholders are not careful, AI could further entrench the disparities that many have worked for decades to eliminate from health systems.\u201d<\/p>\n
ECRI\u2019s report offers recommendations for using chatbots more wisely. Patients, clinicians, and other chatbot users can reduce risk by educating themselves on the tools\u2019 limitations and always verifying information obtained from a chatbot with a knowledgeable source. For their part, health systems can promote responsible use of AI tools by establishing AI governance committees, providing clinicians with AI training, and regularly auditing AI tools\u2019 performance.<\/p>\n
The Top 10 Health Technology Hazards for 2026 in ranked order are:<\/p>\n
Misuse of AI\u00a0chatbots in healthcare<\/p>\n
Unpreparedness for a \u201cdigital darkness\u201d event, or a sudden loss of access to electronic systems and patient information<\/p>\n
Substandard and falsified medical products<\/p>\n
Recall communication failures for home diabetes management technologies<\/p>\n
Misconnections of syringes or tubing to patient lines, particularly amid slow ENFit and NRFit adoption<\/p>\n
Underutilizing medication safety technologies in perioperative settings<\/p>\n
Inadequate device cleaning instructions<\/p>\n
Cybersecurity risks from legacy medical devices<\/p>\n
Health technology implementations that prompt unsafe clinical workflows<\/p>\n
Poor water quality during instrument sterilization<\/p>\n
Now in its 18th\u00a0year, ECRI\u2019s Top 10 Health Technology Hazards report identifies critical healthcare technology issues. ECRI follows a rigorous review process to select topics, drawing insight from incident investigations, reporting databases, and independent medical device testing. Since its creation in 2008, the report has supported hospitals, health systems, ambulatory surgery centers, and manufacturers in mitigating risks.<\/p>\n
An executive brief of the\u00a0Top 10 Health Technology Hazards report is available for download. The full report is accessible to ECRI members and includes detailed steps that organizations and industry can take to reduce risk and improve patient safety. To learn more, visit\u00a0www.ECRI.org.The post Misuse of AI chatbots tops annual list of health technology hazards first appeared on AI-Tech Park.<\/p>\n","protected":false},"excerpt":{"rendered":"
Report also sounds the alarm on insufficient planning for systems outages, substandard medical products, missed recalls of home diabetes management devices, and more Artificial intelligence (AI) chatbots in healthcare top the 2026 list of the most significant health technology hazards. The report is prepared annually by ECRI, an independent, nonpartisan…<\/p>\n
The post Misuse of AI chatbots tops annual list of health technology hazards<\/a> first appeared on AI-Tech Park<\/a>.<\/p>\n<\/div>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"site-container-style":"default","site-container-layout":"default","site-sidebar-layout":"default","disable-article-header":"default","disable-site-header":"default","disable-site-footer":"default","disable-content-area-spacing":"default","footnotes":""},"categories":[1,489],"tags":[3],"class_list":["post-782","post","type-post","status-publish","format-standard","hentry","category-ai-and-ml","category-chatbots","tag-ai"],"yoast_head":"\n