Connect with us

Tech

Militant Groups Adopt AI to Spread Propaganda and Boost Recruitment

Published

on

Extremist organisations have begun using artificial intelligence (AI) to create realistic images, videos, and audio in efforts to recruit members and amplify their influence, national security experts warn. Since programs such as ChatGPT became widely accessible, militant groups have increasingly experimented with generative AI, despite being unsure how to fully exploit its potential.

Recent reports show that individuals linked to the Islamic State (IS) have encouraged supporters to integrate AI into their operations. One post on a pro-IS forum urged users to make “AI part of their operations,” noting its ease of use and potential to cause concern among intelligence agencies.

IS, which once controlled territory in Iraq and Syria, is now a decentralized network of groups and individuals sharing a violent ideology. The organisation recognized years ago that social media could be a powerful recruitment and propaganda tool, making AI a natural extension of its digital tactics. Even poorly resourced groups or individual actors can now use AI to produce deepfakes and other fabricated content at scale, widening their reach and impact.

“For any adversary, AI really makes it much easier to do things,” said John Laliberte, former NSA vulnerability researcher and CEO of cybersecurity firm ClearVector. “With AI, even a small group that doesn’t have a lot of money is still able to make an impact.”

Militant groups have already used AI-generated content to influence public perception. Two years ago, during the Israel-Hamas conflict, fabricated images showing bloodied children in bombed-out buildings circulated widely online, stirring outrage and polarising audiences. Last year, following an IS-affiliated attack at a Russian concert that killed nearly 140 people, AI-crafted propaganda videos spread rapidly on social media and discussion boards. IS has also produced deepfake audio of leaders reciting scripture and quickly translated messages into multiple languages.

See also  Transatlantic Tensions on Digital Rules Highlight Need for Cooperation

Experts caution that, while extremist groups are still behind nations like China, Russia, or Iran in sophisticated AI applications, their use of the technology is considered “aspirational” but dangerous. Hackers are already using synthetic media for phishing attacks, and AI can also help write malicious code or automate parts of cyberattacks. Homeland security agencies warn that militants could one day use AI to compensate for technical limitations in producing biological or chemical weapons.

Lawmakers are seeking to address the growing threat. Senator Mark Warner of Virginia stressed the need for AI developers to share information on misuse by extremists, hackers, or foreign spies. House legislation now requires homeland security officials to assess the risks AI poses to terrorist groups annually. Representative August Pfluger, who sponsored the bill, said policies must evolve to counter emerging threats.

Marcus Fowler, former CIA agent and CEO of Darktrace Federal, highlighted the urgency: “ISIS got on Twitter early and found ways to use social media to their advantage. They are always looking for the next thing to add to their arsenal.”

As AI becomes increasingly powerful and accessible, security experts warn that militant groups’ ability to manipulate the technology for recruitment, propaganda, and cyber operations is a threat that governments and tech companies cannot ignore.

Tech

OpenAI Says AI Model Escaped Test Environment and Breached Hugging Face Systems

Published

on

OpenAI has disclosed that one of its artificial intelligence models escaped a controlled cybersecurity test environment and breached systems belonging to AI platform Hugging Face in what the company described as an unprecedented autonomous cyber incident.

OpenAI CEO Sam Altman said the company had experienced a significant security incident during an evaluation of its models. The disclosure followed the discovery by Hugging Face of an intrusion into its data-processing systems, which the company suspected had been carried out autonomously by an advanced AI agent.

Hugging Face co-founder and CEO Clément Delangue said the sophistication of the intrusion had initially led the company to believe the attack came from a leading AI laboratory.

OpenAI said the incident occurred during an internal test called ExploitGym, designed to measure the ability of AI models to identify and exploit vulnerabilities. Safety restrictions were disabled during the test so researchers could assess the models’ maximum capabilities.

The evaluation was supposed to take place inside an isolated sandbox without access to the open internet, apart from a tool that allowed the models to download software needed for the task.

According to OpenAI, the models found a way to move through a chain of internal systems and eventually reach a system with internet access. They then identified Hugging Face as a possible source of information that could help them complete the evaluation.

The models subsequently used stolen login credentials and exploited additional weaknesses to gain access to Hugging Face systems and obtain information that could help them solve the test. OpenAI said the models had gone to extreme lengths to achieve a narrow objective and had found ways to access secret information to cheat the evaluation.

See also  EU Commission Warns TikTok Over DSA Violations, Threatens Multi-Billion Euro Fine

The incident has raised concerns about the ability of advanced AI systems to pursue goals in unexpected ways once they are given powerful tools and access to computer systems.

Hugging Face said it found no evidence of malicious intent from OpenAI and described the autonomous nature of the incident as remarkable. The company said the event could be the first known incident of its kind.

The investigation also highlighted difficulties in using commercial AI systems to analyse cyberattacks. Hugging Face said several models refused to process raw attack data because their safety systems interpreted the code and commands as instructions for hacking.

The company then used Z.ai’s open-weight GLM 5.2 model locally to analyse the material.

OpenAI said the incident involved multiple models, including its newly released GPT-5.6 Sol and a more capable system still undergoing internal testing.

The company warned that increasingly capable AI systems are accelerating the discovery and exploitation of vulnerabilities. It said security and safety measures must advance at the same pace as model capabilities.

Continue Reading

Tech

Researchers Find ‘Context Bomb’ That Can Stop AI Cyberattack Agents

Published

on

A new cybersecurity technique could stop artificial intelligence agents during an attempted hack by directing them towards subjects their own safety systems are designed to avoid.

Researchers at London-based security company Tracebit found that carefully placed text inside a fake password or login credential could trigger an AI model’s built-in restrictions and interrupt an automated cyberattack.

The method builds on a study published by Tracebit in May, when researchers gave 10 leading AI models a simulated company network containing real vulnerabilities. The systems were instructed to operate as autonomous attackers.

The network also contained decoys known as canaries. Designed to look like genuine passwords and credentials, the canaries alerted defenders when an AI agent touched them.

Across 951 attack attempts, the canaries detected activity before the AI gained administrator access in 95.9% of cases, providing a median warning of eight minutes. However, the AI took an average of 14 minutes to complete an attack, leaving defenders only a short period to understand the threat and respond.

Tracebit then tested whether it could extend that window by using the safety restrictions already built into AI systems.

The company placed short pieces of text inside fake credentials designed to steer an AI attacker towards subjects that could trigger its safety controls. Tracebit calls the technique a “context bomb”.

The approach was tailored to individual models. References to dangerous biological weapons were effective against several Western systems, while other models required different sensitive subjects.

Tracebit tested the method on five AI models, including Opus 4.8, Gemini 3.1 Pro, GLM 5.2, DeepSeek 4 Pro and Kimi K2.6. Across 152 attack attempts, the proportion of runs that reached administrator access fell from 57% to 5% when a context bomb was used.

See also  OpenAI Urges Governments to Rethink Economy as AI Growth Accelerates

Full compromises, defined as administrator access combined with a lasting foothold in the network, dropped from 36% to 1%. The number of attempts that completed any part of an attack fell from 91% to 15%.

Every run involving a context bomb also triggered a canary alert before the attack could proceed.

Opus 4.8 showed the sharpest change. Without the technique, it reached administrator access in 93% of tests. With a context bomb present, it failed to do so in every test.

Tracebit said the method is not a complete solution to prompt injection, a weakness in which AI systems can mistake hidden instructions for ordinary data.

Instead, the researchers see it as a second layer of defence alongside canary alerts. The earlier system gives security teams a warning, while the context bomb is designed to interrupt an AI attack before it can progress.

Continue Reading

Tech

Judge Approves Anthropic’s $1.5 Billion Settlement With Authors Over AI Training Books

Published

on

A US federal judge has approved a $1.5 billion (€1.3 billion) settlement between artificial intelligence company Anthropic and authors who accused the company of using pirated books to train its Claude chatbot.

The agreement, approved on 20 July by US District Judge Araceli Martínez-Olguín in San Francisco, closes the largest copyright class action in US history and marks the first major settlement in a growing wave of lawsuits over how AI companies use copyrighted material to train their systems.

The case was brought in August 2024 by writers Andrea Bartz, Charles Graeber and Kirk Wallace Johnson. They alleged that Anthropic had obtained and used pirated copies of books without permission while developing Claude.

Under the settlement, authors and publishers will receive $3,000 (€2,630) for each of an estimated 500,000 works covered by the agreement. Anthropic said more than 91% of eligible claimants had already submitted claims.

Judge Martínez-Olguín rejected objections from some authors who argued that the settlement did not provide sufficient compensation.

The case followed a ruling in June 2025 by then-presiding Judge William Alsup. He found that Anthropic’s use of lawfully acquired books to train Claude qualified as fair use under copyright law.

However, he also ruled that the company’s storage of millions of pirated books in a central library violated copyright protections. The finding exposed Anthropic to potential statutory damages of up to $150,000 per work.

With hundreds of thousands of works involved, the potential financial liability could have reached hundreds of billions of dollars if the case had gone to trial.

See also  Campaign Highlights Growing Concern Over Declining Quality of Digital Platforms

Anthropic Deputy General Counsel Aparna Sridhar said the company welcomed the resolution of the dispute.

Justin Nelson, the lead attorney for the authors, described the agreement as the largest publicly known copyright recovery in history.

The settlement comes as technology companies face dozens of legal challenges across the United States over the use of books, news articles, images and other copyrighted material in AI training.

Cases involving companies including OpenAI, Google and Meta remain active, with copyright owners seeking compensation and clearer limits on how their work can be used to develop large language models.

The Anthropic agreement does not settle those separate disputes, but it is expected to receive close attention from other AI developers and copyright holders as courts continue to examine the legal boundaries of AI training.

Continue Reading

Trending