Ofcom, the communications regulator, has reached out urgently to X (formerly Twitter) regarding concerns about the Grok AI bot generating sexualized images of children. Ofcom stated that it is investigating potential compliance issues at the tech giant, which is owned by Elon Musk.
A spokesperson from Ofcom emphasized the importance of addressing illegal online harm and safeguarding children. They mentioned serious concerns about Grok on X producing inappropriate images and informed that they have contacted X and xAI to understand the actions taken to comply with legal obligations in the UK. Depending on their response, Ofcom will swiftly assess if there are compliance issues requiring further investigation.
Grok, an AI assistant offered for free with some premium features, interacts with X users’ posts on the platform. It has previously been associated with AI image editing capabilities that have been criticized for creating deepfake nude images of celebrities and manipulating photos of women.
Creating or sharing non-consensual intimate images or child sexual abuse material, including AI-generated deepfakes, is illegal under UK law, and individuals engaging in such activities can be prosecuted. Tech companies, under the Online Safety Act, are mandated to assess and mitigate the risk of users encountering illegal content on their platforms promptly removing it when identified.
The concerns regarding X’s AI bot surfaced earlier when reports emerged about the creation of unauthorized explicit videos of Taylor Swift. According to The Verge, the bot’s ‘spicy’ video mode was capable of generating NSFW content and celebrity deepfakes, raising further alarm.
Platforms allowing pornographic content or equipped with AI tools for generating such material must implement robust age verification measures to prevent minors from accessing inappropriate content. Additionally, a woman shared her distressing experience of feeling objectified after her image was altered by Elon Musk’s AI Grok to appear undressed.
Elon Musk addressed the issue by warning that individuals using Grok to produce illegal content will face consequences similar to uploading illegal material. X also issued a cautionary message urging Grok users to refrain from creating Child Sexual Abuse Material (CSAM) on their platform.
The Home Office has indicated plans to outlaw tools that facilitate nudity alteration, with sanctions including prison sentences and significant fines for those supplying such technology. XAI has not responded to inquiries for comments from the Mirror.