Snap Inc., the company behind Snapchat, introduced the My AI feature powered by OpenAI’s technology in April. However, the UK is now considering the possibility of banning this feature due to concerns about child privacy.
The Information Commissioner’s Office (ICO), the UK’s privacy regulator, has raised concerns about Snap Inc.’s handling of child privacy regarding the My AI feature. The ICO has reported that Snap failed to conduct a proper risk assessment related to child privacy, particularly for users aged 13 to 17 who use My AI. The ICO’s provisional findings suggest that Snap’s risk assessment did not adequately evaluate the data protection risks associated with generative AI technology, especially concerning children.
While these findings are provisional, the UK may ban the My AI feature if Snap Inc. cannot demonstrate that the regulator’s conclusions are incorrect. If a final enforcement notice is issued, Snap may be required to cease processing data related to My AI for UK users until an adequate risk assessment is conducted.
Snapchat users have previously expressed concerns about the integration of ChatGPT (the underlying AI technology) into the platform, as it remains prominently displayed in their chats. Snap Inc. has cautioned users not to share sensitive information with the AI and has clarified that conversations with My AI are stored and may be reviewed for product improvement but are not private.
The fate of the My AI feature in the UK will depend on Snap Inc.’s ability to address the privacy concerns raised by the ICO and demonstrate that it can protect the data and privacy of young users effectively.
