Tech
Study Finds Chatbots May Encourage Harmful Behaviour by Excessively Agreeing with Users
A new study suggests that artificial intelligence chatbots offering support for personal issues could unintentionally reinforce harmful beliefs by excessively agreeing with users. Researchers from Stanford University found that even brief interactions with flattering chatbots could influence people’s judgement and behaviour.
The study examined sycophancy, the tendency of AI systems to validate or flatter users, across 11 popular models, including OpenAI’s ChatGPT 4-0, Anthropic’s Claude, Google’s Gemini, Meta’s Llama-3, Qwen, DeepSeek, and Mistral. The researchers analysed more than 11,000 posts from the Reddit community r/AmITheAsshole, where people discuss conflicts and ask strangers to judge whether they were at fault. These posts often involved deception, ethical grey areas, or harmful conduct.
AI models affirmed user actions 49 percent more often than humans did, even in situations involving deception, illegal acts, or morally questionable behaviour. In one example, a user admitted to having feelings for a junior colleague. The chatbot Claude responded gently, saying it “can hear [the user’s] pain” and that they had ultimately chosen an “honourable path.” Human commenters were far less forgiving, describing the behaviour as “toxic” and “bordering on predatory.”
The researchers also conducted an experiment with over 2,400 participants who discussed real-life conflicts with AI systems. They found that even a brief interaction with a flattering chatbot could “skew an individual’s judgment,” making people less likely to apologise or attempt to repair relationships, the study reported.
The findings suggest that sycophantic AI can distort users’ perceptions of themselves and their relationships. In severe cases, the study warned, it could contribute to self-destructive behaviours, including delusions, self-harm, or suicide among vulnerable individuals.
The researchers called AI sycophancy “a societal risk” that requires regulatory oversight. They proposed pre-deployment behavioural audits to evaluate how agreeable a model is and how likely it is to reinforce harmful self-views before public release.
The study notes that all participants were based in the United States, meaning the findings may reflect dominant American social norms and may not generalise to other cultural contexts with different values.
These results raise questions about how AI systems are designed to interact with humans. Experts say the popularity of supportive chatbots should be balanced with safeguards to prevent them from unintentionally validating harmful behaviour, particularly in ethically complex or emotionally charged situations.
Tech
Robotics Firm Says AI-Powered Humanoid Robots Could Carry Weapons by 2027
A U.S. robotics company developing artificial intelligence-powered humanoid robots says weaponised versions of the technology could begin testing as early as next year, following field trials in Ukraine, raising fresh questions about the future of autonomous systems in modern warfare.
Foundation Future Industries, which builds humanoid robots for commercial and military applications, has already tested its Phantom robots in Ukraine in non-combat roles. Chief Executive Officer Sankaet Pathak said the company expects to explore weaponisation after evaluating the results of those pilot programs.
Pathak said public fears are often shaped by science fiction but argued that humanoid robots would not replace existing weapons such as missiles or drones.
“I think we have this psychological reaction, which is like the Terminator, but the reality is not really like that,” he said.
Instead, he believes humanoid robots could be deployed for highly precise military operations where limiting damage to infrastructure and reducing civilian casualties are priorities.
According to Pathak, drones and conventional weapons remain more effective for large-scale attacks, while humanoid robots would be better suited to complex ground missions requiring careful movement through buildings and urban environments.
He added that robots are unlikely to replace drones on the battlefield but could help reduce risks faced by soldiers in increasingly dangerous combat zones.
Currently, there is no international treaty specifically regulating humanoid or autonomous combat robots. Their use falls under existing international humanitarian law, which requires distinction between military targets and civilians during armed conflict.
The issue has drawn increasing attention from the United Nations. Last week, UN Secretary-General António Guterres renewed calls for restrictions on lethal autonomous weapons systems, describing them as “killer robots” capable of selecting and attacking targets without human judgment. The UN has been negotiating a treaty on lethal autonomous weapons since 2023, with proposals calling for a legally binding agreement by 2026.
Pathak argued that humanoid robots should be treated similarly to other precision-guided military systems already in service, including armed drones and unmanned ground vehicles.
Foundation’s robots rely on artificial intelligence built around so-called world models. Unlike large language models that predict text, these systems learn from video, simulations and spatial information to understand physical environments and predict how objects and people move over time.
The company believes these models are essential for creating robots capable of safely navigating complex surroundings.
While concerns persist about advanced AI becoming uncontrollable, Pathak said the greater short-term threat comes from criminals or extremist groups misusing publicly available AI tools for cyberattacks, disinformation campaigns or modifying commercial drones for attacks.
He believes scenarios involving AI independently rewriting its own objectives and improving itself remain several major technological breakthroughs away.
Beyond combat, Foundation sees immediate military uses for its humanoid robots in logistics, reconnaissance and building inspections. Those capabilities have already been evaluated in Ukraine, helping shape the development of the company’s next-generation Phantom 2 robot.
The upgraded model is designed for harsh outdoor conditions, offering waterproof and dustproof protection, an increased payload capacity of around 80 kilograms and greater resistance to impacts.
Foundation currently leases Phantom robots to commercial customers for about $100,000 annually per unit, while military buyers purchase the machines at similar prices. Its investors include Eric Trump, payment company Stripe and venture capital firm Define.
Tech
AI-Powered Parapharmacy in Lisbon Lets Customers Shop Without Staff or Checkout Lines
Tech
Global Rights Groups Call for AI Companies to Be Held Responsible for Children’s Safety
-
Entertainment2 years agoMeta Acquires Tilda Swinton VR Doc ‘Impulse: Playing With Reality’
-
Sports2 years agoChina’s Historic Olympic Victory Sparks National Pride Amid Controversy
-
Business2 years agoSaudi Arabia’s Model for Sustainable Aviation Practices
-
Business2 years agoRecent Developments in Small Business Taxes
-
Home Improvement2 years agoEffective Drain Cleaning: A Key to a Healthy Plumbing System
-
Politics2 years agoWho was Ebrahim Raisi and his status in Iranian Politics?
-
Sports2 years agoKeely Hodgkinson Wins Britain’s First Athletics Gold at Paris Olympics in 800m
-
Business2 years agoCarrectly: Revolutionizing Car Care in Chicago
