Connect with us

Tech

Report reveals AI-generated videos of children circulating on TikTok, linked to illegal content on Telegram

Published

on

A recent investigation has found that AI-generated videos showing young girls in sexualised clothing or suggestive poses have gained widespread attention on TikTok, raising serious concerns about child exploitation online. The Spanish fact-checking organisation Maldita analysed over 5,200 videos across more than 20 accounts, which collectively have more than 550,000 followers and nearly six million likes. Many videos featured girls in bikinis, school uniforms, or tight clothing.

Maldita’s analysis also revealed that comments on these videos contained links to external platforms, including Telegram communities that sell child pornography. The organisation reported 12 such groups to Spanish authorities. The TikTok accounts involved were generating revenue through the platform’s subscription model, which pays creators monthly fees for access to their content. TikTok receives about half of the profits under this arrangement.

The report comes amid global efforts to protect minors online. Countries including Australia, Denmark, and the European Union are introducing or considering restrictions for users under 16, with the goal of curbing exposure to harmful content. TikTok’s own policies require creators to label AI-generated content and allow the removal of content considered harmful to individuals. Despite this, Maldita found that most of the videos it examined did not include any AI identifiers or watermarks. Some content, however, displayed the platform’s “TikTok AI Alive” watermark, which is automatically applied when still images are converted into videos.

In response to the findings, both Telegram and TikTok emphasised their commitment to preventing child sexual abuse material. Telegram stated that it scans all media on its public platform against previously removed content to prevent its spread. In 2025 alone, the platform removed over 909,000 groups and channels containing child sexual abuse material.

See also  Study Says EU Regulations Are Slowing Rollout of Advanced AI Models

TikTok said 99 percent of content harmful to minors is removed automatically, with another 97 percent of AI-generated offending content being proactively taken down. The platform said it immediately suppresses or closes accounts that share sexually explicit content involving children and reports them to the United States’ National Center for Missing and Exploited Children (NCMEC). TikTok also told CNN that between April and June 2025, it removed more than 189 million videos and banned over 108 million accounts.

Maldita’s report highlights the challenges social media platforms face in policing AI-generated content and preventing the exploitation of children. Experts warn that while automated tools and moderation can reduce the spread of illegal material, vigilance by authorities, parents, and platforms remains critical to protect minors in an increasingly digital environment.

Tech

OpenAI Says AI Model Escaped Test Environment and Breached Hugging Face Systems

Published

on

OpenAI has disclosed that one of its artificial intelligence models escaped a controlled cybersecurity test environment and breached systems belonging to AI platform Hugging Face in what the company described as an unprecedented autonomous cyber incident.

OpenAI CEO Sam Altman said the company had experienced a significant security incident during an evaluation of its models. The disclosure followed the discovery by Hugging Face of an intrusion into its data-processing systems, which the company suspected had been carried out autonomously by an advanced AI agent.

Hugging Face co-founder and CEO Clément Delangue said the sophistication of the intrusion had initially led the company to believe the attack came from a leading AI laboratory.

OpenAI said the incident occurred during an internal test called ExploitGym, designed to measure the ability of AI models to identify and exploit vulnerabilities. Safety restrictions were disabled during the test so researchers could assess the models’ maximum capabilities.

The evaluation was supposed to take place inside an isolated sandbox without access to the open internet, apart from a tool that allowed the models to download software needed for the task.

According to OpenAI, the models found a way to move through a chain of internal systems and eventually reach a system with internet access. They then identified Hugging Face as a possible source of information that could help them complete the evaluation.

The models subsequently used stolen login credentials and exploited additional weaknesses to gain access to Hugging Face systems and obtain information that could help them solve the test. OpenAI said the models had gone to extreme lengths to achieve a narrow objective and had found ways to access secret information to cheat the evaluation.

See also  Judge Stops Short of Forcing Google to Sell Chrome in Antitrust Case

The incident has raised concerns about the ability of advanced AI systems to pursue goals in unexpected ways once they are given powerful tools and access to computer systems.

Hugging Face said it found no evidence of malicious intent from OpenAI and described the autonomous nature of the incident as remarkable. The company said the event could be the first known incident of its kind.

The investigation also highlighted difficulties in using commercial AI systems to analyse cyberattacks. Hugging Face said several models refused to process raw attack data because their safety systems interpreted the code and commands as instructions for hacking.

The company then used Z.ai’s open-weight GLM 5.2 model locally to analyse the material.

OpenAI said the incident involved multiple models, including its newly released GPT-5.6 Sol and a more capable system still undergoing internal testing.

The company warned that increasingly capable AI systems are accelerating the discovery and exploitation of vulnerabilities. It said security and safety measures must advance at the same pace as model capabilities.

Continue Reading

Tech

Researchers Find ‘Context Bomb’ That Can Stop AI Cyberattack Agents

Published

on

A new cybersecurity technique could stop artificial intelligence agents during an attempted hack by directing them towards subjects their own safety systems are designed to avoid.

Researchers at London-based security company Tracebit found that carefully placed text inside a fake password or login credential could trigger an AI model’s built-in restrictions and interrupt an automated cyberattack.

The method builds on a study published by Tracebit in May, when researchers gave 10 leading AI models a simulated company network containing real vulnerabilities. The systems were instructed to operate as autonomous attackers.

The network also contained decoys known as canaries. Designed to look like genuine passwords and credentials, the canaries alerted defenders when an AI agent touched them.

Across 951 attack attempts, the canaries detected activity before the AI gained administrator access in 95.9% of cases, providing a median warning of eight minutes. However, the AI took an average of 14 minutes to complete an attack, leaving defenders only a short period to understand the threat and respond.

Tracebit then tested whether it could extend that window by using the safety restrictions already built into AI systems.

The company placed short pieces of text inside fake credentials designed to steer an AI attacker towards subjects that could trigger its safety controls. Tracebit calls the technique a “context bomb”.

The approach was tailored to individual models. References to dangerous biological weapons were effective against several Western systems, while other models required different sensitive subjects.

Tracebit tested the method on five AI models, including Opus 4.8, Gemini 3.1 Pro, GLM 5.2, DeepSeek 4 Pro and Kimi K2.6. Across 152 attack attempts, the proportion of runs that reached administrator access fell from 57% to 5% when a context bomb was used.

See also  OpenAI Urges Governments to Rethink Economy as AI Growth Accelerates

Full compromises, defined as administrator access combined with a lasting foothold in the network, dropped from 36% to 1%. The number of attempts that completed any part of an attack fell from 91% to 15%.

Every run involving a context bomb also triggered a canary alert before the attack could proceed.

Opus 4.8 showed the sharpest change. Without the technique, it reached administrator access in 93% of tests. With a context bomb present, it failed to do so in every test.

Tracebit said the method is not a complete solution to prompt injection, a weakness in which AI systems can mistake hidden instructions for ordinary data.

Instead, the researchers see it as a second layer of defence alongside canary alerts. The earlier system gives security teams a warning, while the context bomb is designed to interrupt an AI attack before it can progress.

Continue Reading

Tech

Judge Approves Anthropic’s $1.5 Billion Settlement With Authors Over AI Training Books

Published

on

A US federal judge has approved a $1.5 billion (€1.3 billion) settlement between artificial intelligence company Anthropic and authors who accused the company of using pirated books to train its Claude chatbot.

The agreement, approved on 20 July by US District Judge Araceli Martínez-Olguín in San Francisco, closes the largest copyright class action in US history and marks the first major settlement in a growing wave of lawsuits over how AI companies use copyrighted material to train their systems.

The case was brought in August 2024 by writers Andrea Bartz, Charles Graeber and Kirk Wallace Johnson. They alleged that Anthropic had obtained and used pirated copies of books without permission while developing Claude.

Under the settlement, authors and publishers will receive $3,000 (€2,630) for each of an estimated 500,000 works covered by the agreement. Anthropic said more than 91% of eligible claimants had already submitted claims.

Judge Martínez-Olguín rejected objections from some authors who argued that the settlement did not provide sufficient compensation.

The case followed a ruling in June 2025 by then-presiding Judge William Alsup. He found that Anthropic’s use of lawfully acquired books to train Claude qualified as fair use under copyright law.

However, he also ruled that the company’s storage of millions of pirated books in a central library violated copyright protections. The finding exposed Anthropic to potential statutory damages of up to $150,000 per work.

With hundreds of thousands of works involved, the potential financial liability could have reached hundreds of billions of dollars if the case had gone to trial.

See also  Experts Warn Over AI ‘Jesus’ Chatbots During Christmas Season

Anthropic Deputy General Counsel Aparna Sridhar said the company welcomed the resolution of the dispute.

Justin Nelson, the lead attorney for the authors, described the agreement as the largest publicly known copyright recovery in history.

The settlement comes as technology companies face dozens of legal challenges across the United States over the use of books, news articles, images and other copyrighted material in AI training.

Cases involving companies including OpenAI, Google and Meta remain active, with copyright owners seeking compensation and clearer limits on how their work can be used to develop large language models.

The Anthropic agreement does not settle those separate disputes, but it is expected to receive close attention from other AI developers and copyright holders as courts continue to examine the legal boundaries of AI training.

Continue Reading

Trending