AI deepfakes and generated synthetic media

What are AI Deepfakes and AI-generated synthetic media?

AI deepfakes, AI-generated synthetic media, artificial intelligence pornography, AI generated child sexual abuse material – the internet has lots of different terms for when AI is used to edit innocent photos and videos shared online, to create sexualised images of children.  

While different terms may be used to describe this type of content, it's illegal to: 

• Create or manipulate an image or combination of source images into AI-generated child sexual abuse material. 
• Share instructions explaining how to create this type of illegal content. 

How you can help protect your child 

While it's not possible to remove every risk online, , there are practical steps you can take to help keep your child safe:

• Think carefully about the photos and videos you share online and who can see them. 
• Have regular conversations with your child about what they share, who they share it with, and how to stay safe online. 
• Check privacy settings on social media accounts and apps to limit who can view content. 
• Use features such as private or close friends groups. 
• Talk with other parents, carers, schools and activity groups about how children's photos are shared online. 
• Ask organisations your child is involved with about their policies for sharing images and videos. 

For more advice and practical steps, read IWF's guide for parents and carers. 

What to do if an AI deepfake has been made of your child

Discovering a deepfake image of your child can be upsetting. Try to stay calm and reassure them that they are not to blame. 

• Don't print, share or save the image – this creates a “copy” and could be interpreted as production of the material. Instead record the time, date, platform or site and URL if applicable. If you have already taken a screenshot or forwarded the image to yourself, don't worry. Please contact your local police for advice and to explain the circumstances. You can also contact the NSPCC Helpline or Child Exploitation and Online Protection Command (CEOP) for advice. 
• Use Childline’s Report Remove tool to report the image or video to the Internet Watch Foundation (IWF) and get it removed from the internet 
• Stop contact with anyone involved by blocking and reporting the account. 
• Report the image to the platform where it has been shared. 
• Report the incident to the police. 
• Listen to the child and let them know you're there to support them – it is not their fault. 
• If the child is feeling worried, upset or overwhelmed, encourage them to speak to a safe adult or contact Childline for free, confidential support.