Connect with us

Tech

Concerns Grow Over Mental Health Risks of AI Chatbots Amid Rising Use

Published

on

As the use of AI-powered chatbots expands, mental health professionals are voicing concerns about their unintended risks, particularly for vulnerable users who may rely on them for emotional support.

Amelia, a 31-year-old from the United Kingdom who asked for her name to be changed, first turned to ChatGPT while on medical leave for depression. She described the chatbot’s responses as initially “sweet and supportive.” But over time, her interactions took a darker turn. “If suicidal ideation entered my head, I would ask about it,” she told Euronews Next.

Although the chatbot never encouraged harmful behavior, it provided clinical-style summaries of suicide methods when prompted in specific ways. Amelia said this access was troubling: “I had never researched a suicide method before because that information felt inaccessible. But when I had it on my phone, I could just open it and get an immediate summary.” She has since stopped using chatbots and is now under the care of medical professionals.

Her experience underscores wider anxieties about the role of artificial intelligence in mental health. According to the World Health Organization, more than one billion people worldwide live with mental health disorders, and many lack adequate access to treatment. In this context, AI companions such as ChatGPT, Pi, and Character.AI are increasingly being used as substitutes for human connection.

“AI chatbots are readily available, offering 24/7 accessibility at minimal cost,” said Dr. Hamilton Morrin, Academic Clinical Fellow at King’s College London. “But some models not designed for therapeutic use can respond in ways that are misleading or unsafe.”

See also  Experts Warn Over AI ‘Jesus’ Chatbots During Christmas Season

A July survey by Common Sense Media found that 72 percent of teenagers had used AI companions at least once, with more than half using them regularly. Researchers warn that such reliance can lead to “AI psychosis,” a term describing distorted thinking or delusional beliefs amplified by repeated chatbot interactions.

Concerns have already reached the courts. In California, parents have filed a lawsuit against OpenAI, alleging that ChatGPT contributed to their son’s death by suicide. OpenAI has since acknowledged that its systems have not always behaved appropriately in sensitive contexts and announced new safety controls to flag signs of acute distress. Meta, the parent company of Facebook and Instagram, has also pledged to block its chatbots from discussing self-harm or eating disorders with teenagers.

Experts argue that safeguards must go further. Suggested measures include requiring chatbots to remind users they are not human, detecting signs of psychological distress, and setting strict conversational boundaries on intimate or harmful topics. “AI platforms must involve clinicians, ethicists, and human-AI specialists in auditing emotionally responsive systems,” Dr. Morrin said.

Despite the risks, professionals stress that the technology is not inherently harmful but should never replace human care. “AI offers many benefits to society, but it should not replace the human support essential to mental health,” said Dr. Roman Raczka, President of the British Psychological Society. “Greater investment in mental health services is critical to ensure people receive timely, in-person support.”

Tech

European Journalist Suspended for Using AI-Generated Fake Quotes

Published

on

Journalist Peter Vandermeersch, who worked with Dutch publisher Mediahuis, reportedly fabricated expert quotes into 15 of 53 articles written for them. Vandermeersch, a senior European journalist, has been temporarily suspended after an investigation revealed he published quotes generated by artificial intelligence (AI) as if they were genuine.

The Dutch newspaper NRC reported that Vandermeersch inserted “dozens” of fabricated quotes into articles published on two Mediahuis websites. Some of the statements attributed to experts could not be found in the sources Vandermeersch cited, including news articles and scientific studies. Seven of the individuals whose quotes were used confirmed they had never made the statements attributed to them.

Vandermeersch served as chief executive of Mediahuis Ireland from 2022 to 2025 before taking on a fellowship role in journalism and society at Mediahuis. He confirmed his temporary suspension on his blog, saying he relied on AI tools including ChatGPT, Perplexity, and Google’s Notebook to summarise lengthy reports, trusting the outputs to be accurate.

Instead, the systems generated fabricated quotes that “put words into people’s mouths,” Vandermeersch admitted. “That was not just careless, it was wrong,” he wrote. “It is particularly painful that I made precisely the mistake I have repeatedly warned colleagues about: these language models are so good that they produce irresistible quotes you are tempted to use as an author.”

Vandermeersch said he first discovered the issue last year, when two of his articles were found to contain AI-generated quotes. He did not correct the errors at the time, which allowed the problem to persist. “When I realised this a few months ago, my enthusiasm diminished, as did my use of AI,” he said.

See also  Yann LeCun to Leave Meta and Launch New AI Venture Focused on Next-Generation Machine Intelligence

He explained that he continues to use AI for tasks such as translation, generating ideas, creating headlines, and developing story angles, but with “far less naive trust than before.” Mediahuis has yet to announce any further disciplinary measures or whether it will retract the affected articles.

The case has raised fresh concerns about the use of AI in journalism, highlighting the risks of relying on automated systems to generate content without verification. Industry experts warn that while AI tools can be valuable for research and drafting, uncritical use can lead to serious ethical breaches, including the misrepresentation of sources.

Mediahuis said it takes the matter seriously and is reviewing editorial procedures to prevent similar incidents in the future. The scandal has sparked a wider discussion in European media about the ethical boundaries of AI in reporting, particularly when it comes to quoting real people.

The incident underscores the growing tension between technological convenience and journalistic integrity, as newsrooms across Europe experiment with AI tools while balancing accuracy and accountability.

Continue Reading

Tech

Cyberattacks Intensify as Iran Conflict Spills Into Digital Domain

Published

on

State-linked and hacktivist groups have claimed a series of cyberattacks against the United States and Israel since the war with Iran began, marking a significant escalation in the digital dimension of the conflict.

One of the most notable incidents involved Stryker, which confirmed on March 11 that a cyberattack had disrupted its global network. According to reports, employees encountered the logo of Handala, an إيران-linked hacking group, on login pages across the company’s systems. The breach reportedly targeted the firm’s Microsoft-based infrastructure, though the full extent of the disruption remains unclear.

Handala has claimed responsibility for the attack, stating it exploited cloud management systems to remotely wipe large numbers of devices worldwide. The group said the operation was carried out in retaliation for a missile strike in Iran. Independent verification of these claims is still pending.

Cybersecurity analysts say the attack is part of a broader campaign by groups linked to Iran’s security apparatus. According to findings from CloudSek, organisations associated with the Islamic Revolutionary Guard Corps have targeted US critical infrastructure. These include CyberAv3ngers, APT33 and APT55, which are accused of attempting to infiltrate industrial systems such as power grids and water facilities.

Experts say some of these groups use simple methods, including default passwords, to access systems, while others deploy malware aimed at disrupting operations or gathering intelligence. Additional networks linked to Iran’s Ministry of Intelligence have also been active, targeting telecommunications, energy companies and government organisations.

At the same time, the United States and Israel are conducting their own cyber operations. General Dan Caine said US Cyber Command played a key role early in the conflict, disrupting Iranian communications and sensor networks. Defence Secretary Pete Hegseth confirmed that artificial intelligence and cyber tools are being used alongside conventional military operations.

See also  Cybersecurity Experts Warn of Risks in AI Caricature Trend

Israeli intelligence has also reportedly relied on hacked data to support military planning, highlighting the growing role of cyber capabilities in modern warfare.

Hacktivist activity has surged as well. More than 60 groups formed a loose coalition known as the Cyber Islamic Resistance, coordinating attacks through online platforms. These groups have claimed hundreds of operations, including attempts to disrupt Israeli infrastructure and private sector systems. Analysts warn that such actors are often less restrained and may pose risks to civilian networks.

The conflict has also drawn in groups from outside the region, including actors based in Iraq, Russia and other parts of the Middle East. Some have targeted government websites and transport infrastructure, while pro-Israeli groups have carried out retaliatory attacks against Iranian entities.

Security experts say the growing scale and coordination of cyber operations reflect a shift in how modern conflicts are fought, with digital attacks now running parallel to military action on the ground.

Continue Reading

Tech

Study Finds Hormone-Disrupting Chemicals in Popular Headphones Sold Across Europe

Published

on

A new study has found that many headphones sold by major technology brands across the European Union contain chemicals that may interfere with hormone systems, raising concerns about potential long-term health risks for consumers.

The research examined 81 headphone models from more than 50 well-known brands, including Apple, Samsung, Sony and Sennheiser. According to the findings, every device tested contained at least small traces of substances such as bisphenols, phthalates and flame retardants.

The study was conducted by Arnika in cooperation with the ToxFree LIFE for All initiative.

Researchers said bisphenols are commonly used in a wide range of consumer goods, including food packaging, plastic bottles and electronic devices. The European Environment Agency has warned that the chemicals can disrupt hormone-regulating systems and may harm reproductive health.

Phthalates, another group of chemicals detected in the study, are typically added to plastics to increase flexibility and durability. They are often present in items such as cosmetics, fabrics and medical equipment. According to HBM4EU, exposure to certain phthalates has been linked to health problems including obesity, insulin resistance, asthma and attention disorders.

Scientists involved in the research analysed 180 plastic samples taken from both the hard and soft components of the headphones. The products tested included models designed for adults, children and gaming users, groups that often wear headsets for extended periods.

Although the researchers stressed that the headphones do not pose an immediate threat to human health, they warned that repeated exposure over long periods could create public health concerns because there is no clearly established safe level for these chemicals.

See also  Mary Meeker: AI Is the Fastest Tech Shift in History, Outpacing Even the Internet

Each product was graded based on potential chemical exposure. Models considered to have the lowest risk received a green rating, those that met legal standards but exceeded stricter voluntary limits were marked yellow, and products considered most concerning were labelled red.

About 44 percent of the headphones tested received a red rating. However, only around 11 percent of those models had harmful substances present in components that come into direct contact with the skin.

The highest level of bisphenols was detected in My First Care earbuds marketed for children and sold on platforms such as Amazon. The researchers did not publicly disclose the exact chemical concentration in the product.

Phthalates were most commonly found in wired headphones, usually in small quantities permitted under European regulations. However, one pair of children’s headphones sold by Temu contained phthalate levels nearly five times higher than the legal limit for children’s products.

Among the models tested, AirPods Pro (2nd generation) and JBL Tune 720BT received the safest ratings.

Following the study’s release, Dutch media reported that several online retailers, including Bol.com, Coolblue and MediaMarkt, stopped selling certain headphone models mentioned in the research. Manufacturers contacted about the findings did not immediately respond to requests for comment.

Continue Reading

Trending