Tech
Concerns Grow Over Mental Health Risks of AI Chatbots Amid Rising Use
As the use of AI-powered chatbots expands, mental health professionals are voicing concerns about their unintended risks, particularly for vulnerable users who may rely on them for emotional support.
Amelia, a 31-year-old from the United Kingdom who asked for her name to be changed, first turned to ChatGPT while on medical leave for depression. She described the chatbot’s responses as initially “sweet and supportive.” But over time, her interactions took a darker turn. “If suicidal ideation entered my head, I would ask about it,” she told Euronews Next.
Although the chatbot never encouraged harmful behavior, it provided clinical-style summaries of suicide methods when prompted in specific ways. Amelia said this access was troubling: “I had never researched a suicide method before because that information felt inaccessible. But when I had it on my phone, I could just open it and get an immediate summary.” She has since stopped using chatbots and is now under the care of medical professionals.
Her experience underscores wider anxieties about the role of artificial intelligence in mental health. According to the World Health Organization, more than one billion people worldwide live with mental health disorders, and many lack adequate access to treatment. In this context, AI companions such as ChatGPT, Pi, and Character.AI are increasingly being used as substitutes for human connection.
“AI chatbots are readily available, offering 24/7 accessibility at minimal cost,” said Dr. Hamilton Morrin, Academic Clinical Fellow at King’s College London. “But some models not designed for therapeutic use can respond in ways that are misleading or unsafe.”
A July survey by Common Sense Media found that 72 percent of teenagers had used AI companions at least once, with more than half using them regularly. Researchers warn that such reliance can lead to “AI psychosis,” a term describing distorted thinking or delusional beliefs amplified by repeated chatbot interactions.
Concerns have already reached the courts. In California, parents have filed a lawsuit against OpenAI, alleging that ChatGPT contributed to their son’s death by suicide. OpenAI has since acknowledged that its systems have not always behaved appropriately in sensitive contexts and announced new safety controls to flag signs of acute distress. Meta, the parent company of Facebook and Instagram, has also pledged to block its chatbots from discussing self-harm or eating disorders with teenagers.
Experts argue that safeguards must go further. Suggested measures include requiring chatbots to remind users they are not human, detecting signs of psychological distress, and setting strict conversational boundaries on intimate or harmful topics. “AI platforms must involve clinicians, ethicists, and human-AI specialists in auditing emotionally responsive systems,” Dr. Morrin said.
Despite the risks, professionals stress that the technology is not inherently harmful but should never replace human care. “AI offers many benefits to society, but it should not replace the human support essential to mental health,” said Dr. Roman Raczka, President of the British Psychological Society. “Greater investment in mental health services is critical to ensure people receive timely, in-person support.”
Tech
AI Security Test Reveals Vulnerabilities in US Government Systems Within Hours
Tech
Tech Innovations Offer Relief as Europe Faces Intense Summer Heat
Tech
Sweden’s ‘W’ Platform Joins Europe’s Push to Build Big Tech Alternative
A new Sweden-based social media platform called “W” has entered the growing field of European tech initiatives seeking to challenge the dominance of US-based Big Tech companies, as the European Commission announced its participation on Wednesday.
The platform, which was first introduced at the World Economic Forum in January, promotes itself as a digital space built on “verified human users, transparency, privacy and free speech.” It has now launched a beta version, with access limited to users who pass a vetting process before being allowed to post content.
European Commission President Ursula von der Leyen and European Council President Antonio Costa are among the early official users of the platform, signalling political support for the initiative. Users are required to verify their identity either by registering their real name or by using “W Identity,” a separate verification tool that scans passports or national identity documents directly on a user’s device.
According to the company, W was developed by a group of entrepreneurs working across media, technology and artificial intelligence. The platform states that it plans to host data exclusively on European servers operated by European companies, aligning its infrastructure with EU data protection standards.
CEO Anna Zeiter has said the platform intends to rely on European service providers, including Switzerland-based encrypted email company Proton and Finland’s cloud computing firm UpCloud, as part of its commitment to privacy-focused operations within Europe.
The launch comes amid a broader push across the continent to reduce dependence on US technology giants and strengthen what policymakers describe as “digital sovereignty.” Governments in France, Germany and the Netherlands have previously raised concerns that reliance on foreign-owned platforms could expose Europe to security risks and limit control over sensitive data.
W is part of a wider wave of European alternatives to mainstream social media networks. Other emerging platforms include Bulle in France, Eurosky, Monnett and eYou, all aiming to offer regionally governed digital ecosystems.
Some of these platforms recently signed a declaration supporting the development of Europe’s “social stack,” a shared digital infrastructure intended to provide a more diverse and resilient online environment. The initiative argues for reducing reliance on dominant global platforms and promoting alternatives with governance structures rooted in Europe.
However, analysts have noted that competing with established social media giants presents significant challenges. Experts have pointed out that new platforms often struggle to maintain large user bases, as they typically lack the scale, engagement features and convenience that have made existing networks dominant in global digital communication.
Despite these challenges, supporters of W and similar projects say the push reflects a broader effort to reshape Europe’s digital landscape and assert greater control over data, privacy and online governance in an increasingly competitive global tech environment.
-
Entertainment2 years agoMeta Acquires Tilda Swinton VR Doc ‘Impulse: Playing With Reality’
-
Sports2 years agoChina’s Historic Olympic Victory Sparks National Pride Amid Controversy
-
Business2 years agoSaudi Arabia’s Model for Sustainable Aviation Practices
-
Business2 years agoRecent Developments in Small Business Taxes
-
Home Improvement2 years agoEffective Drain Cleaning: A Key to a Healthy Plumbing System
-
Politics2 years agoWho was Ebrahim Raisi and his status in Iranian Politics?
-
Sports2 years agoKeely Hodgkinson Wins Britain’s First Athletics Gold at Paris Olympics in 800m
-
Business2 years agoCarrectly: Revolutionizing Car Care in Chicago
