In recent years, large technology companies such as Microsoft, Meta, Google, and OpenAI have been focusing on developing generative Artificial Intelligence (AI) tools. These companies have committed to combatting child sexual abuse images (CSAM) resulting from the use of AI technology. They are implementing security measures by design to ensure that AI is used responsibly.
In 2023, an influx of more than 104 million files suspected of containing CSAM was reported in the United States. These AI-generated images pose significant risks for child safety. Organizations like Thorn and All Tech is Human are working with tech giants like Amazon, Google, Meta, Microsoft, and others to protect minors from AI misuse.
The security by design principles adopted by these technology companies aim to prevent the easy creation of abusive content using AI. Cybercriminals can utilize generative AI to create harmful content that can exploit children. Therefore, measures are being put in place to proactively address child safety risks in AI models.
Companies have committed to training their AI models to avoid reproducing abusive content. They are implementing techniques such as watermarking AI-generated images to indicate that they are generated by AI. Additionally, they are working on evaluating and training AI models for child safety before releasing them to the public.
Google has taken a leading role in this issue by deploying detection measures such as hash matching technology and AI classifiers. The company also reviews content manually and works with organizations like the US National Center for Missing and Exploited Children to report incidents of CSAM material spread on their platforms.
By investing in research, deploying detection measures, and actively monitoring their platforms, technology companies are taking steps to safeguard children online. The focus is on ensuring that AI is used responsibly and does not contribute to the exploitation or harm of minors.
In conclusion, while there is still much work to be done in this area of research and development, it’s clear that large technology companies are taking this issue seriously and making efforts to address it head-on through the implementation of security measures by design and the promotion of responsible use of generative artificial intelligence tools within their platforms.