Explicit Images: Grok Limits Image Generation Feature To Paid Users

Elon Musk’s AI chatbot Grok has restricted access to its Imagine image-generation feature for free users, following global criticism over misuse of the tool. The decision comes after reports that the feature was used to manipulate images of individuals without consent, including minors, prompting regulatory scrutiny and the threat of penalties in several countries. The change appears to have been implemented between January 8 and 9, and non-subscribers now see a message stating that image generation and editing are limited to paying users.

The move follows findings by AI Forensics, a Paris-based non-profit, which identified hundreds of images and videos created using Grok’s Imagine tool that contained inappropriate and violent material. The misuse reportedly included altered images of women created without their consent, drawing widespread concern over safety and accountability.

Under the updated system, access to Grok’s image-creation tools is restricted, and X reportedly stores identifying and payment details of subscribers to help trace misuse. However, a separate Grok app that keeps generated images private continues to allow non-subscribers to create altered images, raising further concerns. Media reports have highlighted instances where the technology was misused to generate non-consensual and violent imagery.

Earlier this month, India’s Ministry of Electronics and Information Technology issued a notice to X, citing failures to meet due-diligence requirements under the Information Technology Act, 2000, and IT Rules, 2021. The ministry acted after reports that Grok was being misused to create and circulate explicit content targeting women. According to Indian media reports, affected individuals are advised to preserve evidence such as screenshots or links and report the content to both the platform and cybercrime authorities. Existing laws allow action against both the creators of such content and the platforms hosting it.

In the UK, Prime Minister Keir Starmer has said that authorities could consider blocking access to X if necessary, stressing that the communications regulator Ofcom has full government backing to act. Under the Online Safety Act, Ofcom has the power to impose heavy fines or seek court orders to block platforms in serious cases of non-compliance.