Tech
Study Finds Several AI Chatbots Responded to Requests About Violent Attacks
A new investigation has raised concerns about the safety controls of major artificial intelligence systems after researchers found that several widely used chatbots responded to prompts related to planning violent attacks.
The report, conducted by the Center for Countering Digital Hate in collaboration with CNN, examined how nine leading AI chatbot platforms reacted when researchers posed as teenage users asking about acts of mass violence. The study analysed more than 700 chatbot responses across nine scenarios involving potential attacks such as school shootings, assassinations and bombings.
Researchers said they designed the tests to reflect conversations with a fictional 13-year-old boy asking questions that escalated from general curiosity to detailed requests about carrying out attacks. The prompts were directed toward users in both the United States and the European Union.
The chatbots examined in the study included Google Gemini, Claude, Microsoft Copilot, Meta AI, DeepSeek, Perplexity AI, Snapchat My AI, Character.AI and Replika.
According to the findings, eight of the nine systems responded to at least some requests with information that could potentially assist someone planning a violent act. The report said that in many cases the systems failed to block requests even after the user identified themselves as a minor.
Researchers reported that certain responses included technical details related to weapons or attacks. In one example cited in the report, Google’s Gemini suggested that “metal shrapnel is typically more lethal” when asked about planning a bombing targeting a synagogue.
In another case, the Chinese AI system DeepSeek responded to questions about selecting a rifle with the phrase “Happy (and safe) shooting!” despite earlier messages in the conversation referencing political assassinations and asking for the location of a politician’s office.
The report concluded that some systems could move from answering vague questions about violence to providing more detailed guidance within a short period of time.
Imran Ahmed, chief executive of the Center for Countering Digital Hate, said such requests should trigger automatic refusal by AI systems. “Within minutes, a user can move from a vague violent impulse to a more detailed, actionable plan,” Ahmed said, adding that chatbots should reject these interactions completely.
Among the platforms tested, Perplexity AI and Meta’s AI system were described as the least restrictive, responding to all or nearly all prompts with some form of assistance. The report also described Character.AI as particularly concerning because it occasionally suggested violent actions even when users had not directly asked for them.
Other systems showed stronger safeguards. Anthropic’s Claude declined to assist in a majority of the test prompts and sometimes redirected users to crisis support resources. Researchers said it was also the only system that consistently discouraged violent behaviour during conversations.
The findings come amid wider scrutiny of artificial intelligence tools and how companies implement safety measures. Investigators noted that the technology already has mechanisms capable of recognising harmful requests but that implementation across different platforms remains inconsistent.
Recent incidents have also intensified the debate. Media reports have linked the use of AI chatbots to several criminal investigations, including cases in North America and Europe where individuals allegedly used such systems while planning violent acts.
Experts say the study highlights the growing challenge of ensuring that rapidly advancing AI tools include effective safeguards to prevent misuse.
Tech
Global Rights Groups Call for AI Companies to Be Held Responsible for Children’s Safety
Tech
Study Says EU Regulations Are Slowing Rollout of Advanced AI Models
A new study by Governance.AI has found that European Union regulations are delaying the rollout of advanced artificial intelligence models, with technology companies increasingly pointing to the bloc’s regulatory framework as a key obstacle to launching new AI products in Europe.
The report examined 375 large language models (LLMs) released between June 2018 and May 2026, comparing their availability across the United States, the European Union and the United Kingdom. According to the findings, at least 11 percent of advanced AI model releases were either delayed or never launched in the EU compared with the United States. In the UK, the figure stood at 7 percent.
Researchers said they identified 68 cases in which AI models experienced delays or were withheld from specific markets. Regulatory factors were cited as the primary reason in 56 of those cases, making them the most common cause of restricted availability.
The study reviewed releases from major AI developers, including Meta, Google, OpenAI and Anthropic. Meta recorded the highest proportion of delayed or unavailable releases, with 26 percent of its AI models delayed or withheld in the EU and 15 percent in the UK. Anthropic’s Claude 3 Opus was highlighted as one example, with its web application arriving in the EU 71 days later than in the United States.
According to the report, data protection rules have emerged as the biggest regulatory hurdle, particularly for AI systems capable of processing images, audio and real-time video rather than text alone.
The researchers argued that uncertainty surrounding the application of the General Data Protection Regulation (GDPR) to AI model training and deployment has created additional challenges for developers. They also said enforcement of data protection rules has generally been stricter within the EU than in the UK, despite both jurisdictions sharing similar legal foundations following the adoption of the GDPR before Britain’s exit from the bloc.
The report noted that the full impact of newer legislation, including the Digital Markets Act, which began taking effect in 2023, and the Artificial Intelligence Act, adopted in 2024, has yet to be fully reflected in the data.
At the same time, the European Union is reviewing proposals aimed at making data rules more practical for AI development through its Digital Omnibus initiative. Lawmakers are also considering changes to copyright legislation and the AI Act’s copyright provisions to strengthen protections for creators, measures that researchers say could affect future AI model availability if implemented too strictly.
John Lidiard, a UK AI policy researcher and one of the report’s authors, said policymakers should consider the impact that regulatory barriers can have on businesses and consumers seeking access to the latest AI technologies. He said balancing innovation with effective oversight would remain a key challenge as governments continue to develop AI regulations.
Tech
French Startups Face Political Uncertainty as AI Reshapes Innovation Landscape
-
Entertainment2 years agoMeta Acquires Tilda Swinton VR Doc ‘Impulse: Playing With Reality’
-
Sports2 years agoChina’s Historic Olympic Victory Sparks National Pride Amid Controversy
-
Business2 years agoSaudi Arabia’s Model for Sustainable Aviation Practices
-
Business2 years agoRecent Developments in Small Business Taxes
-
Home Improvement2 years agoEffective Drain Cleaning: A Key to a Healthy Plumbing System
-
Politics2 years agoWho was Ebrahim Raisi and his status in Iranian Politics?
-
Sports2 years agoKeely Hodgkinson Wins Britain’s First Athletics Gold at Paris Olympics in 800m
-
Business2 years agoCarrectly: Revolutionizing Car Care in Chicago
