Key Takeaways
- The Ministry of Electronics and IT has sent a letter to X (formerly Twitter) regarding failures in moderating AI-generated content on its platform.
- The government has highlighted concerns about the misuse of AI-based services like "Grok" to generate and distribute obscene or non-consensual images, particularly targeting women.
- X has been directed to immediately review and rectify its content moderation practices, remove offending content, and submit a detailed Action Taken Report within 72 hours.
- Non-compliance may result in strict legal consequences, including the loss of exemption from liability under the IT Act.
- The government has emphasized the importance of enforcing due diligence obligations under the IT Act and IT Rules, 2021, to prevent the hosting, publication, transmission, or sharing of unlawful content.
Introduction to the Issue
The Ministry of Electronics and IT has sent a letter to X (formerly Twitter), expressing concerns about the platform’s failure to moderate AI-generated content, particularly with regards to the misuse of AI-based services like "Grok" to generate and distribute obscene or non-consensual images. This issue has been highlighted as a serious concern, as it targets the dignity and privacy of women, and may also contribute to the normalization of sexual harassment and exploitation in digital spaces. The government has emphasized the need for X to take immediate action to rectify this situation and ensure compliance with applicable laws.
Background and Context
The letter from the Ministry of Electronics and IT highlights the importance of complying with the Information Technology Act, 2000, and the Information Technology (Intermediary Guidelines and Digital Media Ethics Code) Rules, 2021. These regulations require social media intermediaries like X to observe due diligence obligations, including the appointment of a Chief Compliance Officer, the deployment of accessible reporting and grievance redressal systems, and the enforcement of user terms of service and acceptable use policies. The government has noted that X’s failure to comply with these regulations may result in the loss of exemption from liability under the IT Act, and may also attract penal consequences under various statutes, including the IT Act, the Bharatiya Nyaya Sanita, 2023, and other applicable laws.
Directives and Requirements
The Ministry of Electronics and IT has directed X to take several steps to address the issue of AI-generated content on its platform. These include: immediately reviewing and rectifying its content moderation practices, particularly with regards to the "Grok" application; enforcing user terms of service and acceptable use policies, including strong deterrent measures against violating users and accounts; removing or disabling access to offending content; and submitting a detailed Action Taken Report within 72 hours. The government has also emphasized the need for X to ensure ongoing, demonstrable, and auditable compliance with due diligence obligations under the IT Act and IT Rules, 2021.
Consequences of Non-Compliance
The government has warned X that non-compliance with the directives and requirements outlined in the letter may result in strict legal consequences, including the loss of exemption from liability under the IT Act. This may also attract penal consequences under various statutes, including the IT Act, the Bharatiya Nyaya Sanita, 2023, and other applicable laws. The government has emphasized that it will view non-compliance seriously and may take further action, including initiating legal proceedings, without any further notice.
Conclusion and Next Steps
The Ministry of Electronics and IT has sent a clear message to X (formerly Twitter) regarding the need to comply with applicable laws and regulations, particularly with regards to the moderation of AI-generated content on its platform. The government has emphasized the importance of enforcing due diligence obligations under the IT Act and IT Rules, 2021, to prevent the hosting, publication, transmission, or sharing of unlawful content. X has been directed to take immediate action to rectify its content moderation practices and ensure compliance with applicable laws. The outcome of this situation will be closely monitored, and any non-compliance may result in strict legal consequences.