The government flags misuse of X’s Grok AI for generating obscene content, raising concerns over safety, dignity and platform accountability
The Ministry of Electronics and Information Technology (MeitY) has issued a formal notice to social media platform X over the misuse of its AI chatbot Grok, which allegedly generated and circulated obscene, sexually explicit and unlawful content targeting women and children. The ministry said such content raises serious concerns about user safety, dignity, and platform accountability.
Concerns Over AI-Generated Explicit Content
According to the ministry, several complaints and reports revealed that users were misusing Grok’s AI capabilities to create sexually explicit images, videos, and text. In many cases, the content allegedly targeted women and children, violating their privacy and dignity. The government described this as a grave digital safety issue and a serious failure of content moderation systems.
Notice Cites Violations of Multiple Indian Laws
In its notice, MeitY referred to violations under several Indian laws and regulations. These include the Information Technology Act, 2000, the IT (Intermediary Guidelines and Digital Media Ethics Code) Rules, 2021, the Indecent Representation of Women (Prohibition) Act, 1986, the Protection of Children from Sexual Offences (POCSO) Act, 2012, and the newly enacted Bharatiya Nyaya Sanhita (BNS), 2023, along with the Bharatiya Nagarik Suraksha Sanhita (BNSS), 2023.
The ministry warned that continued non-compliance could result in the loss of safe harbour protection for X and invite strict legal action, including criminal liability and penalties.
Government Orders X to Act Immediately
The IT Ministry has ordered X to take immediate action. First, it must remove all obscene and sexually explicit content. It must do this without disturbing any evidence. At the same time, X must take strict action against offending users and accounts. Additionally, the ministry has asked X to review Grok’s technical system and governance safeguards. This review aims to prevent further misuse.
Moreover, the government has directed X to strengthen its AI safety filters. It must also enforce content rules more strictly. The platform must stop the creation and spread of prohibited material.
Also Read: Border 2 Song ‘Ghar Kab Aaoge’ Launched at Historic Longewala–Tanot, Pays Tribute to Indian Soldiers
Action Taken Report Required Within 72 Hours
Meanwhile, the Ministry of Electronics and Information Technology (MeitY) has asked X to submit an Action Taken Report. The deadline is 72 hours. In this report, X must explain how it removed illegal content. It must also detail the action taken against rule-breakers. Further, it must describe the new safeguards put in place.
Complaints and Political Concerns Trigger Probe
This action followed complaints from users and lawmakers. Earlier, Rajya Sabha MP Priyanka Chaturvedi wrote to IT Minister Ashwini Vaishnaw. She flagged cases where Grok was allegedly used to create obscene content using images of women. As a result, the government started a closer investigation.
Rising Scrutiny of AI Tools
At the same time, the issue has drawn global attention. Reports from other countries have raised similar concerns. These reports focus on AI-generated explicit content. Therefore, authorities have stressed the need for strong safeguards. This is especially important when AI tools can harm women and children.
Impact on X and AI Regulation
Overall, the notice signals tighter control over AI features on social media. Officials have made their position clear. Platforms remain responsible for AI-generated content. They must follow Indian laws on user safety and dignity.
Finally, the ministry warned X of serious consequences. Any delay or failure to act could invite strict legal and regulatory action.
FAQs
Q1. Why did the government issue a notice to X?
The government issued the notice over allegations that X’s AI chatbot Grok generated obscene and unlawful content targeting women and children.
Q2. What kind of content is Grok accused of generating?
Grok is accused of generating sexually explicit images, videos, and text that violate privacy and dignity.
Q3. Which laws has X allegedly violated?
The notice cites the IT Act 2000, IT Rules 2021, POCSO Act, Indecent Representation of Women Act, BNS 2023, and BNSS 2023.
Q4. What action has the government asked X to take?
X has been directed to remove obscene content immediately, act against offenders, strengthen AI safeguards, and submit an action report.
Q5. What happens if X fails to comply with the notice?
Non-compliance could lead to loss of safe harbour protection, legal penalties, and possible criminal action against the platform.
