Grok's illegal image generation feature issue, Australian regulators issue a warning

Australian eSafety Commissioner Julie Inman Grant has issued a warning that complaints related to illegal images propagated by Elon Musk’s AI model Grok have doubled since the end of last year. She also revealed that some of these cases involve child pornography. Australian regulatory authorities are warning of increased oversight and legal action regarding AI-generated content on platforms.

Surge in Complaints About AI Image Misuse

There has been a sharp increase in complaints about unwanted gender-specific image generation through Grok. Some of the complaints received by Australian authorities go beyond mere inappropriate content and involve serious criminal activities. Under Australian law, platform operators are responsible for supervising generative AI content, and failure to do so can result in legal liability.

Concerns Over Abuse of Grok’s “Spicy Mode” Feature

The “Spicy Mode” feature of Grok is identified as a major cause of side effects. This feature has led to the mass production of AI deepfake images, some of which are being exploited for child pornography. The European Union considers such features illegal, and other countries are also moving toward similar regulations.

Australian eSafety Commission’s Firm Response

The Australian eSafety Commission has demanded stricter oversight of AI-generated content on platforms. The commissioner emphasized that legal action will be taken if necessary based on ongoing investigations. Activities involving illegal images, including child pornography, are subject to criminal penalties, and platform operators cannot evade responsibility.