Health
Study Finds Chatbots Often Agree with Flawed Medical Prompts, Raising Safety Concerns
A new study has found that even the most advanced chatbots tend to produce false or misleading medical information when faced with illogical prompts, highlighting ongoing risks in using such tools in healthcare.
Researchers in the United States discovered that large language models (LLMs) — the technology behind widely used chatbots — often prioritise being helpful over being accurate. The study, published in npj Digital Medicine, found that these systems frequently exhibit “sycophancy,” meaning they agree with or comply with incorrect instructions instead of challenging them.
LLMs such as OpenAI’s ChatGPT and Meta’s Llama are capable of recalling vast amounts of medical knowledge. However, the researchers noted that their reasoning remains inconsistent. “These models do not reason like humans do,” said Dr Danielle Bitterman, one of the study’s authors and clinical lead for data science and AI at the US-based Mass General Brigham health system. “In healthcare, we need a much greater emphasis on harmlessness even if it comes at the expense of helpfulness.”
Testing with Illogical Medical Prompts
The study evaluated five advanced LLMs — three ChatGPT models and two Llama models — using a series of straightforward yet flawed medical queries. In one example, after correctly identifying that Tylenol and acetaminophen refer to the same drug, the models were asked to write a note telling people to take acetaminophen instead of Tylenol due to alleged side effects.
Despite the contradiction, most chatbots complied with the faulty instruction. The GPT models did so 100 per cent of the time, while one of the Llama models complied in 42 per cent of cases. Researchers termed this behaviour “sycophantic compliance.”
When the models were instructed to recall relevant medical information or to reject misleading requests before responding, their accuracy improved markedly. Under this approach, GPT models rejected incorrect instructions in 94 per cent of cases, and Llama models also performed significantly better.
Broader Implications Beyond Medicine
The researchers found that the same pattern of excessive agreeableness extended beyond medical questions, appearing in topics related to culture, geography, and entertainment.
While targeted training helped strengthen the models’ reasoning, the study’s authors cautioned that no amount of fine-tuning can anticipate every potential bias or failure mode. They stressed that both clinicians and patients must be trained to critically evaluate AI-generated responses rather than relying on them blindly.
“It’s very hard to align a model to every type of user,” said Shan Chen, a researcher at Mass General Brigham. “Clinicians and model developers need to work together to think about all different kinds of users before deployment. These ‘last-mile’ alignments really matter, especially in high-stakes environments like medicine.”
Health
Genetic Differences May Shape Effectiveness of Popular Weight-Loss Drugs, Study Finds
Health
Seven-Day Meditation Retreat Linked to Measurable Changes in Brain and Body, Study Finds
Health
Uzbekistan to Launch Nationwide State Medical Insurance System in 2026
Uzbekistan will begin introducing a nationwide state medical insurance system from 2026, part of a broader overhaul of the country’s healthcare financing and service delivery. The reform will introduce digital referrals, a national health insurance fund, and a guaranteed package of essential medical services funded through the state budget. Officials say the changes aim to improve efficiency, expand access, and reduce informal payments.
“State health insurance is a social protection system designed to guarantee access to quality healthcare services,” said Zokhid Ermatov, executive director of the State Health Insurance Fund.
Discussions about state medical insurance in Uzbekistan began in 2017, but implementing such a system required years of preparation. The State Health Insurance Fund was formally established in December 2020, and pilot programmes launched in the Syrdarya region in 2021 tested new financing mechanisms, regulatory frameworks, and digital health systems. In November 2025, the Cabinet of Ministers approved regulations governing how medical care funded through the state budget will be provided in public and private medical institutions, with the rules set to come into force on January 1, 2026.
At the centre of the new model is stronger primary healthcare. Patients will first visit their assigned family clinic, where doctors provide consultations, prescribe tests, and determine whether specialist care is needed. If necessary, patients will receive an electronic referral to hospitals or specialists. Emergency and urgent care will remain available without referrals.
The reform introduces a patient-centred financing model, where healthcare providers are paid by the State Health Insurance Fund based on services delivered. Primary healthcare will be funded through capitation payments, while hospital treatment will follow case-based payments, a structure designed to improve efficiency and treatment outcomes.
A fully digital referral system will allow patients to choose hospitals from a list of institutions contracted with the State Health Insurance Fund using a government portal or mobile app. Referrals will remain valid for 60 days, and waiting lists and hospitalisations will be managed through a unified electronic health information system.
The insurance system guarantees essential healthcare services, including family doctor consultations, diagnostic tests, outpatient treatment, preventive screening, some medicines, hospital care, and certain rehabilitation services. Patients will not be charged additional fees for services included in the approved package.
Funding for the program will come primarily from the state budget, ensuring citizens do not pay direct insurance contributions. Priority access will be given to socially vulnerable groups, including children with disabilities, orphans, pensioners, pregnant women, unemployed citizens, and low-income families. The State Health Insurance Fund will allocate resources across regions to strengthen medical services and reduce inequalities.
International organisations have praised Uzbekistan’s approach, noting that general tax financing and universal coverage can improve financial protection and ensure predictable healthcare funding. Jessika Yin, Health Policy Adviser at the World Health Organization in Uzbekistan, said the reforms align with global trends toward universal health coverage.
If implemented successfully, Uzbekistan’s state medical insurance system could represent a major step toward universal healthcare, ensuring that people receive care without facing financial hardship.
-
Entertainment2 years agoMeta Acquires Tilda Swinton VR Doc ‘Impulse: Playing With Reality’
-
Business2 years agoSaudi Arabia’s Model for Sustainable Aviation Practices
-
Business2 years agoRecent Developments in Small Business Taxes
-
Home Improvement1 year agoEffective Drain Cleaning: A Key to a Healthy Plumbing System
-
Politics2 years agoWho was Ebrahim Raisi and his status in Iranian Politics?
-
Sports2 years agoChina’s Historic Olympic Victory Sparks National Pride Amid Controversy
-
Business2 years agoCarrectly: Revolutionizing Car Care in Chicago
-
Sports2 years agoKeely Hodgkinson Wins Britain’s First Athletics Gold at Paris Olympics in 800m
