Apple brings child sexual abuse detection tools to the UK

20 April 2022, 18:24

Apple's communications safety in Messages tool, which is launching in the UK
thumbnail_Communication Safety in Messages. Picture: PA

Alerts will warn children when they receive or attempt to send an image believed to contain nudity and offer them support and guidance.

A feature in Apple’s Messages app that can spot and warn children when sexually explicit images are received or about to be sent is to be introduced in the UK.

First launched in the United States last year, the tool blurs out images received that are believed to contain nudity and shows an alert to children which warns them about the image, offers them helpful resources and reassures them it is okay to choose not to view the image, while a similar alert also appears if a child attempts to send photos which contain nudity.

The feature is powered by on-device artificial intelligence, Apple says, with the interventions all processed on-device and without notifying Apple or anyone else in order to protect privacy. However, the feature does include an option for children to message a trusted contact for help if they so choose.

The feature will be rolled out as part of a software update in the coming weeks, Apple confirmed, and will be available in the Messages app on iPhone, iPad and Mac computers.

It is not turned on by default and parents must opt-in in order to use it, the company said, and can only be used for child accounts set up as families in iCloud as part of a Family Sharing plan.

The tool will be joined by other on-screen interventions in searches on Apple’s Safari web browser and those done via virtual assistant Siri or the Spotlight tool, which appear when users search for themes related to child exploitation – a feature that has also previously launched in the US and now comes to the UK for the first time.

The pop-ups explain to users that these topics are harmful and problematic and offer resources from third-party organisations for further help and guidance on the issue.

However, a third proposed protection tool – which was also initially announced alongside the others last year before being delayed after some campaigners raised privacy concerns – remains in development with Apple saying it is continuing to collect feedback and make improvements to it.

That feature uses new systems which would detect child sexual abuse imagery when someone tried to upload it to iCloud, and report it to authorities.

Apple said the process would be done securely and would not regularly scan a user’s camera roll, however, privacy campaigners raised concerns over the plans, with some suggesting the technology could be hijacked by authoritarian governments to look for other types of imagery – something Apple said it would not allow.

The UK rollout of the child protection tools is the latest in a series of major updates from the iPhone maker which it says are aimed at improving user safety, following a number of security updates rolled out over the last year designed to cut down on third-party data collection and improve user privacy when they use an iPhone or other Apple device.

In response to the announcement, online safety group the Internet Watch Foundation (IWF) said it welcomed the move to boost child safety.

“We’re pleased to see Apple expanding the communication safety in Messages feature to the UK,” IWF communications director Emma Hardy said.

“At IWF, we’re concerned about preventing the creation of ‘self-generated’ child sexual abuse images and videos.

“Research shows that the best way to do this is to empower families, and particularly children and young people, to make good decisions. This, plus regularly talking about how to use technology as a family are good strategies for keeping safe online.”

By Press Association

More Technology News

See more More Technology News

Glastonbury Festival 2022

Glastonbury 2022 broke data records, EE says

A child using a laptop computer

Pupils ‘AirDrop nudes in maths and use Google Drive to store images’, MPs told

Over 20 million US dollars were raised by the public for drones to fight the Russian invasion

Tech company to gift Bayraktar drones to Ukraine after millions raised by public

A mixed reality holographic patient

UK medical students training on hologram patients in world-first

Laptop

Warning new internet laws will hand ministers ‘unprecedented’ powers

A battery changing station of Nio brand electrical car (Alamy)

Two dead after Nio electric car they were testing ‘falls from building’

Alexa to expand

Amazon’s Alexa could mimic the voices of dead relatives

Ai-Da at work

Robot painting Glastonbury’s famous faces says festival atmosphere is ‘electric’

Instagram's new age verification tools, which have started being testing in the US

Instagram begins testing new age verification tools

A security surveillance camera is seen near the Microsoft office building in Beijing

Microsoft: Russian cyber spying targets 42 Ukraine allies

Social media apps on a smartphone

Meta removes ‘large numbers’ of upskirting images found on Facebook

Rio Ferdinand poses for photographs with children at 10 Downing Street to celebrate the launch of the Diana Award’s annual anti-bullying campaign Don’t Face It Alone (Stefan Rousseau/PA)

Rio Ferdinand calls for new ‘inspiring’ online platform to combat child bullying

A screenshot of the Microsoft Outlook email service

Microsoft’s Outlook email service hit by outage

Elon Musk

Elon Musk’s proposed £35.8bn Twitter deal gets board endorsement

Apple unveils new products

Guide Dogs launches scheme to provide free iPads to children with sight loss

A woman using a laptop

Cloudflare outage knocks hundreds of websites offline