Connect with us

Tech

Global Rights Groups Call for AI Companies to Be Held Responsible for Children’s Safety

Published

on

More than 100 international organisations have called on governments to hold artificial intelligence companies directly responsible for protecting children online, warning that existing regulatory approaches are failing to prevent harm.

The appeal, led by the children’s rights organisation 5Rights Foundation and supported by groups including Amnesty International and Save the Children, was issued ahead of the United Nations’ first Global Dialogue on AI Governance. The coalition argues that governments should require technology companies to prove their AI systems are safe for children before they are made publicly available.

The organisations said artificial intelligence is already affecting children in harmful ways and that current regulations often respond only after damage has occurred.

Leanda Barrington-Leach, executive director of the 5Rights Foundation, said children are not opposed to technological progress but want stronger safeguards in place before products reach the market.

“They aren’t asking us to block AI innovation, but it shouldn’t be a case of cleaning up the mess after harm has happened either,” she said.

The statement comes as legal challenges involving AI companies continue to grow. Firms including Character Technologies and OpenAI have faced lawsuits over allegations that AI-powered chatbots, particularly “companion” bots designed to simulate emotional relationships, can negatively affect children. Some claims also argue that these products have been presented as suitable for younger users without sufficient warnings about potential risks.

The coalition believes governments should focus on the commercial incentives that encourage companies to prioritise rapid product development and user engagement over safety.

Among the recommendations are mandatory safety assessments before AI products are released, financial penalties for companies whose systems violate children’s rights, bans on design features that exploit children’s psychological vulnerabilities, and restrictions on the commercial use of children’s images, voices and biometric data.

See also  AI Tools Boost Paper Production but Raise Quality Concerns in Scientific Research

The organisations maintain that governments do not need entirely new legislation to introduce these protections. Instead, they argue that countries should enforce commitments already made under international agreements, including the UN Convention on the Rights of the Child and the Global Digital Compact, which outlines principles for protecting human rights in the digital environment.

Barrington-Leach said stronger accountability is needed to change how AI products are developed and marketed.

“As long as companies are rewarded for speed, engagement and data extraction rather than safety, we’ll keep treating the symptoms while the disease becomes endemic,” she said. She added that respecting children’s rights should become a fundamental requirement for technology companies rather than a voluntary commitment.

The United Nations’ inaugural Global Dialogue on AI Governance is expected to bring together government representatives, technology companies, researchers and civil society organisations to discuss international standards for artificial intelligence. Child safety is likely to be one of the key topics as policymakers seek to balance technological innovation with stronger protections for vulnerable users.

Tech

Lancet Study Warns AI Misuse and Nuclear War Could Threaten Humanity by 2100

Published

on

The malicious use of artificial intelligence and nuclear conflict are among 17 major threats to global health that could put humanity at risk of extinction by 2100, according to a new assessment published in The Lancet.

The study, conducted by the Lancet Commission on 21st-century global threats to health, examines risks ranging from nuclear war and antimicrobial resistance to climate change, pandemics, income inequality, obesity, tobacco use and mental health problems.

The commission brings together 37 experts in health, economics, security and technology. Researchers assessed the potential impact of the threats across 204 countries and territories between 2025 and 2100, using disability-adjusted life years, or DALYs, to estimate the loss of healthy human life.

The measure accounts for years lost through premature death and years lived with illness or disability. The researchers used best-case and worst-case scenarios to examine how much harm each threat could cause and how preventive action might reduce the consequences.

The estimated burden across the 17 threats ranges from 1.02 billion to 23.1 billion DALYs. For comparison, the COVID-19 pandemic caused an estimated 500 million DALYs. Obesity represents the largest cumulative burden that could potentially be reduced through intervention.

The researchers warned that nuclear conflict could cause widespread destruction beyond the immediate effects of weapons, including nuclear famine resulting from the disruption of food production and supply. The malicious use of AI could also create severe dangers, including the development or deployment of biological weapons.

The commission stressed that the assessment is not intended to rank threats or prescribe a fixed order for government action. Instead, it provides a framework for understanding their potential effects, recognising that the findings will change as new evidence emerges.

See also  ByteDance Unveils Household Robot Powered by Advanced AI Amid U.S. Scrutiny

The experts said the threats are closely connected and require coordinated responses rather than separate efforts focused on individual problems. They called for a comprehensive approach based on scientific evidence, human rights and international solidarity.

One key recommendation is for governments to build health systems capable of responding quickly to major emergencies. The COVID-19 pandemic demonstrated the importance of preparedness, adequate resources and effective coordination when confronting a global crisis.

The commission also urged greater investment in potentially transformative technologies, including nuclear fusion, carbon removal and vaccines, which could help address climate change, infectious diseases and other major risks.

Regular monitoring and updated risk assessments are another priority. The researchers recommended sharing findings with international bodies, including the United Nations and the G20, to encourage governments to cooperate before emerging threats develop into full-scale crises.

According to the commission, the current competitive approach to tackling global challenges is limiting the prospects for effective action.

The findings were presented on Sunday at the World Health Summit in Berlin, Germany. The assessment is due to be updated annually to reflect new evidence, changes in existing risks and the emergence of additional threats.

The researchers said early action could help governments limit the potential damage and reduce the likelihood of the worst-case scenarios identified in the report.

Continue Reading

Tech

Denmark Moves to Ban Sharing of Realistic Deepfakes Without Consent

Published

on

Denmark is set to introduce legislation on Thursday that would prohibit the sharing of realistic deepfakes depicting people’s faces or voices without their consent, as governments around the world seek to address the growing risks posed by artificial intelligence.

The proposed amendment to Denmark’s copyright law would give people greater control over digital versions of their appearance and voice. The protections would apply to ordinary individuals as well as artists whose performances could be digitally copied or manipulated.

Deepfakes are digitally generated or altered images, videos and audio designed to make people appear to say or do things they did not. They have increasingly been used to spread false information, damage reputations and create humiliating or abusive material.

Denmark’s Culture Minister Zenia Stampe said the technology allows manipulated content to be produced and distributed on social media with little effort.

One of the government’s key aims is to ensure that major technology companies remove harmful manipulated material quickly, reducing the potential damage to people targeted by such content.

The legislation follows a broad political agreement reached in June 2025 under the previous Danish government. That agreement was aimed at protecting people from unauthorised digital imitations.

The proposed rules would not impose a blanket ban on digitally altered content. Exceptions would cover satire, parody, caricature and criticism of politicians, institutions and society.

Those protections would not apply where misinformation creates serious risks to other people’s rights, essential interests, lives or property.

The Danish government hopes the legislation will come into force at the beginning of 2027.

See also  Meta to Use AI Interactions for Advertising, Raising Fresh Privacy Concerns

The move comes as countries and international institutions introduce new measures to address the misuse of synthetic media.

EU member states covered by the bloc’s directive on violence against women must implement the legislation by June 14, 2027. It requires countries to criminalise the creation of sexually explicit manipulated material and its subsequent public distribution without the consent of the person depicted when the material is likely to cause serious harm.

Denmark is not bound by that directive because it has an opt-out from EU justice and home affairs rules.

France already prohibits the distribution of AI-generated images or audio depicting another person without consent when the artificial nature of the material is not obvious or clearly disclosed. French law also prohibits the non-consensual sharing of sexual deepfakes regardless of whether they are labelled as manipulated.

In England and Wales, creating or requesting non-consensual intimate deepfakes became a criminal offence in February. Sharing such material can result in a prison sentence of up to two years.

Denmark’s proposed law would add to a growing set of national measures aimed at giving individuals greater protection as increasingly realistic digital impersonations become easier to create and distribute.

Continue Reading

Tech

AI Agents Take Centre Stage as Qatar Expands Training and Testing

Published

on

Artificial intelligence agents that can perform tasks on behalf of users were a major focus at the Google Cloud Summit in Doha, as Qatar expands its efforts to train workers and test new AI applications.

The technology is moving beyond generative AI, which produces text, images and answers in response to prompts. AI agents are designed to take additional steps independently to complete specific tasks, creating new opportunities for businesses while raising questions about oversight and the future of work.

Alex Rutter, managing director of Google Cloud’s artificial intelligence business across Europe, the Middle East and Africa, said generative AI is primarily used to create new content through large language models. Agentic AI, by contrast, can be used to carry out processes after receiving instructions.

Rutter cited invoice reconciliation as an example. An AI agent could check information on an invoice against payment and supplier records before a payment is approved. Such repetitive work involving multiple databases could be suitable for automation, he said.

Greater autonomy also increases the need for safeguards. Rutter said Google currently recommends keeping a person involved in reviewing the results produced by AI agents. Instead of checking every piece of data, employees could focus on exceptions identified by the systems.

The level of human oversight would depend on the nature of the task and the risks an organisation is prepared to accept. In fields such as medicine, Rutter said AI should assist clinicians rather than replace their decisions.

The Doha summit also marked three years since Google Cloud opened its cloud region in Qatar. The company announced a new national training programme with Qatar Digital Academy that is expected to provide more than 50,000 learning opportunities in the country by 2030.

See also  Trump Unveils Ambitious US Space Agenda with Moon, Mars and Missile Goals

The programme will target several groups, including workers, executives and software developers, as Qatar seeks to expand its pool of people with skills needed to use and manage AI technologies.

Ghassan Kosta, Google Cloud’s regional general manager for Qatar, Oman, Bahrain and Iraq, said the company was expanding its services to support the growing demands of agentic AI. He said data centre infrastructure would need to develop alongside advances in AI.

Qatar’s Ministry of Communications and Information Technology also announced an innovation lab developed with Google Cloud. The facility will allow AI projects to be tested before they are deployed more widely.

Amna Al-Kaabi, head of emerging technologies at the ministry, said the partnership was intended to connect technology experiments with practical needs in different sectors and help projects progress from early testing to real-world applications.

The increasing ability of AI systems to perform tasks is also prompting questions about employment. Rutter said it was difficult to predict the pace of change, but suggested that managing AI agents could become a responsibility for some workers.

He said future workplaces could include employees managing people, AI agents or both, although businesses are still determining which tasks can safely and effectively be assigned to autonomous systems.

Continue Reading

Trending