Ofcom questions X’s handling of illegal content as Grok faces new restrictions

This report from Ofcom highlights a distinction between the speed of content moderation and its effectiveness. While X has demonstrated faster response times to illegal content, the regulator's ongoing concerns suggest that quicker action does not automatically equate to comprehensive or satisfactory content removal and prevention. The focus on compliance with online safety rules indicates an emphasis on the qualitative aspects of content moderation, beyond mere speed.

The introduction of new restrictions on Grok, X's AI model, reflects a growing regulatory focus on the role of generative AI in content dissemination. Regulators are increasingly scrutinizing how AI systems might inadvertently or directly contribute to the spread of illegal material, requiring platforms to implement safeguards not just for user-generated content, but also for content created or amplified by their own AI tools. This adds a new layer of complexity to online safety efforts.

For platforms operating in Asia, this situation with Ofcom underscores a converging trend in content regulation. As AI models become more integrated into social media and content platforms, regional regulators are likely to adopt similar approaches, examining both the speed and the qualitative efficacy of moderation, alongside the specific controls placed on AI-generated content. This creates a precedent for how platforms might need to adapt their safety protocols globally.