Tech
Concerns Grow Over Mental Health Risks of AI Chatbots Amid Rising Use
As the use of AI-powered chatbots expands, mental health professionals are voicing concerns about their unintended risks, particularly for vulnerable users who may rely on them for emotional support.
Amelia, a 31-year-old from the United Kingdom who asked for her name to be changed, first turned to ChatGPT while on medical leave for depression. She described the chatbot’s responses as initially “sweet and supportive.” But over time, her interactions took a darker turn. “If suicidal ideation entered my head, I would ask about it,” she told Euronews Next.
Although the chatbot never encouraged harmful behavior, it provided clinical-style summaries of suicide methods when prompted in specific ways. Amelia said this access was troubling: “I had never researched a suicide method before because that information felt inaccessible. But when I had it on my phone, I could just open it and get an immediate summary.” She has since stopped using chatbots and is now under the care of medical professionals.
Her experience underscores wider anxieties about the role of artificial intelligence in mental health. According to the World Health Organization, more than one billion people worldwide live with mental health disorders, and many lack adequate access to treatment. In this context, AI companions such as ChatGPT, Pi, and Character.AI are increasingly being used as substitutes for human connection.
“AI chatbots are readily available, offering 24/7 accessibility at minimal cost,” said Dr. Hamilton Morrin, Academic Clinical Fellow at King’s College London. “But some models not designed for therapeutic use can respond in ways that are misleading or unsafe.”
A July survey by Common Sense Media found that 72 percent of teenagers had used AI companions at least once, with more than half using them regularly. Researchers warn that such reliance can lead to “AI psychosis,” a term describing distorted thinking or delusional beliefs amplified by repeated chatbot interactions.
Concerns have already reached the courts. In California, parents have filed a lawsuit against OpenAI, alleging that ChatGPT contributed to their son’s death by suicide. OpenAI has since acknowledged that its systems have not always behaved appropriately in sensitive contexts and announced new safety controls to flag signs of acute distress. Meta, the parent company of Facebook and Instagram, has also pledged to block its chatbots from discussing self-harm or eating disorders with teenagers.
Experts argue that safeguards must go further. Suggested measures include requiring chatbots to remind users they are not human, detecting signs of psychological distress, and setting strict conversational boundaries on intimate or harmful topics. “AI platforms must involve clinicians, ethicists, and human-AI specialists in auditing emotionally responsive systems,” Dr. Morrin said.
Despite the risks, professionals stress that the technology is not inherently harmful but should never replace human care. “AI offers many benefits to society, but it should not replace the human support essential to mental health,” said Dr. Roman Raczka, President of the British Psychological Society. “Greater investment in mental health services is critical to ensure people receive timely, in-person support.”
Tech
Robotics Firm Says AI-Powered Humanoid Robots Could Carry Weapons by 2027
A U.S. robotics company developing artificial intelligence-powered humanoid robots says weaponised versions of the technology could begin testing as early as next year, following field trials in Ukraine, raising fresh questions about the future of autonomous systems in modern warfare.
Foundation Future Industries, which builds humanoid robots for commercial and military applications, has already tested its Phantom robots in Ukraine in non-combat roles. Chief Executive Officer Sankaet Pathak said the company expects to explore weaponisation after evaluating the results of those pilot programs.
Pathak said public fears are often shaped by science fiction but argued that humanoid robots would not replace existing weapons such as missiles or drones.
“I think we have this psychological reaction, which is like the Terminator, but the reality is not really like that,” he said.
Instead, he believes humanoid robots could be deployed for highly precise military operations where limiting damage to infrastructure and reducing civilian casualties are priorities.
According to Pathak, drones and conventional weapons remain more effective for large-scale attacks, while humanoid robots would be better suited to complex ground missions requiring careful movement through buildings and urban environments.
He added that robots are unlikely to replace drones on the battlefield but could help reduce risks faced by soldiers in increasingly dangerous combat zones.
Currently, there is no international treaty specifically regulating humanoid or autonomous combat robots. Their use falls under existing international humanitarian law, which requires distinction between military targets and civilians during armed conflict.
The issue has drawn increasing attention from the United Nations. Last week, UN Secretary-General António Guterres renewed calls for restrictions on lethal autonomous weapons systems, describing them as “killer robots” capable of selecting and attacking targets without human judgment. The UN has been negotiating a treaty on lethal autonomous weapons since 2023, with proposals calling for a legally binding agreement by 2026.
Pathak argued that humanoid robots should be treated similarly to other precision-guided military systems already in service, including armed drones and unmanned ground vehicles.
Foundation’s robots rely on artificial intelligence built around so-called world models. Unlike large language models that predict text, these systems learn from video, simulations and spatial information to understand physical environments and predict how objects and people move over time.
The company believes these models are essential for creating robots capable of safely navigating complex surroundings.
While concerns persist about advanced AI becoming uncontrollable, Pathak said the greater short-term threat comes from criminals or extremist groups misusing publicly available AI tools for cyberattacks, disinformation campaigns or modifying commercial drones for attacks.
He believes scenarios involving AI independently rewriting its own objectives and improving itself remain several major technological breakthroughs away.
Beyond combat, Foundation sees immediate military uses for its humanoid robots in logistics, reconnaissance and building inspections. Those capabilities have already been evaluated in Ukraine, helping shape the development of the company’s next-generation Phantom 2 robot.
The upgraded model is designed for harsh outdoor conditions, offering waterproof and dustproof protection, an increased payload capacity of around 80 kilograms and greater resistance to impacts.
Foundation currently leases Phantom robots to commercial customers for about $100,000 annually per unit, while military buyers purchase the machines at similar prices. Its investors include Eric Trump, payment company Stripe and venture capital firm Define.
Tech
AI-Powered Parapharmacy in Lisbon Lets Customers Shop Without Staff or Checkout Lines
Tech
Global Rights Groups Call for AI Companies to Be Held Responsible for Children’s Safety
-
Entertainment2 years agoMeta Acquires Tilda Swinton VR Doc ‘Impulse: Playing With Reality’
-
Sports2 years agoChina’s Historic Olympic Victory Sparks National Pride Amid Controversy
-
Business2 years agoSaudi Arabia’s Model for Sustainable Aviation Practices
-
Business2 years agoRecent Developments in Small Business Taxes
-
Home Improvement2 years agoEffective Drain Cleaning: A Key to a Healthy Plumbing System
-
Politics2 years agoWho was Ebrahim Raisi and his status in Iranian Politics?
-
Sports2 years agoKeely Hodgkinson Wins Britain’s First Athletics Gold at Paris Olympics in 800m
-
Business2 years agoCarrectly: Revolutionizing Car Care in Chicago
