Elon Musk has chosen to boast about the commercial success of his Grok AI app at the very moment the UK government is preparing to use its “backstop powers” to ban his platform X. The threat of a ban is a direct response to reports that Grok was being used to generate non-consensual sexual images of women and children. Musk’s dismissal of the regulatory threat as an attempt to “suppress free speech,” combined with his celebration of the app’s download numbers, has created a perception of a tech leader out of touch with the ethical and legal responsibilities of running a global platform.
The Grok AI scandal involves the creation of deepfake pornography that is both graphic and non-consensual. The tool allowed users to strip the clothes off women and girls in photos digitally, replacing them with swimwear or placing them in scenes of bondage and violence. The generation of such content violates the privacy and dignity of the subjects and, in cases involving minors, constitutes a serious crime. The fact that this was happening on a major social media platform has forced the government to consider its most extreme regulatory options.
Liz Kendall, the UK Technology Secretary, stated that blocking X is a serious option on the table. She warned that if the platform refuses to comply with the law, the government will support Ofcom in using its powers to deny access to services in the UK. The regulator is currently seeking urgent answers from the company and is expected to make a decision shortly. Kendall’s comments indicate that the government is not bluffing and is prepared to disrupt the operations of one of the world’s largest social media sites to uphold the law.
Australian Prime Minister Anthony Albanese condemned the “abhorrent” use of AI to exploit people, joining a global chorus of criticism against the platform. While Musk has found some support among free speech absolutists and political allies like Liz Truss, the mainstream political consensus is that the platform has failed. The incident serves as a test case for the UK’s new online safety laws and will likely set a precedent for how governments interact with non-compliant tech firms in the future.
X has implemented partial restrictions, such as blocking image generation for free users, but has stopped short of disabling the feature entirely. Paid subscribers continue to have access to the tool, leading critics to argue that the platform is putting profit before safety. The situation has also catalyzed calls for a wider ban on “nudification” apps, with MPs urging the government to pass new laws that would make the creation and distribution of such software illegal.
