Answer

Generative AI, which creates text, images, and videos, is increasingly exploited to produce Child Sexual Abuse Material (CSAM). India’s laws, including the POCSO Act, 2012, and IT Act, 2000, criminalize CSAM but lack AI-specific provisions. The International AI Safety Report 2025 highlights rising deepfake CSAM, necessitating a review of India’s legal preparedness. 

The Rise of Generative AI and Cybercrimes

• AI’s Role in CSAM Proliferation: Generative AI tools can create hyper-realistic child sexual abuse material (CSAM), bypassing traditional law enforcement methods.
  For example: The Internet Watch Foundation’s 2024 report revealed an increase in AI-generated CSAM being distributed openly online, making detection and removal more complex.
• Blurring of Reality and AI: AI can manipulate real images or generate deepfake CSAM, making it harder to determine the authenticity of the victim.
• Ease of Access and Creation: Open-source AI models enable non-technical users to generate CSAM at scale, reducing reliance on organized criminal networks.
  For example: The World Economic Forum, in a 2023 paper, highlighted how generative AI can create life-like images of children, raising concerns about widespread misuse.
• Anonymity and Encryption Risks: AI-driven encryption and anonymization tools allow criminals to operate in hidden online networks, complicating law enforcement efforts.
• Challenges in Legal Classification: AI-generated CSAM does not involve real children, leading to legal loopholes where offenders claim that no actual abuse occurred.

Adequacy of India’s Current Legal Framework

• Focus on Real Victims: Existing Indian laws criminalize CSAM involving real children, but lack provisions for purely AI-generated material.
  For example: Section 67B of the IT Act punishes publishing or transmitting CSAM but does not explicitly cover AI-generated imagery.
• No AI-Specific Restrictions: Indian laws do not criminalize the possession or creation of AI tools capable of generating CSAM.
  For example: The UK’s proposed law (2025) makes possessing AI tools for CSAM generation illegal, unlike India’s current legal framework.
• Limited Definition of CSAM: The term “child pornography” in Indian laws does not encompass AI-generated or synthetic depictions of abuse.
  For example: The National Human Rights Commission (2023) recommended updating the POCSO Act to replace “child pornography” with “CSAM” for broader coverage.
• Weak Liability for Intermediaries: Indian laws do not explicitly hold VPNs, cloud services, or AI developers accountable for enabling CSAM creation.
  For example: The Digital India Act 2023 (proposed) aims to impose stronger obligations on intermediaries but remains under review.
• Lack of Early Detection Mechanisms: India lacks proactive monitoring systems to detect AI-generated CSAM before dissemination.

Reforms Needed to Future-Proof Child Protection Laws

• Expand CSAM Definition: The POCSO Act must replace “child pornography” with “CSAM” to include AI-generated and synthetic content.
  For example: The European Union’s 2024 Digital Safety Act redefined CSAM to include AI-generated material, closing legal loopholes.
• Criminalize AI CSAM Tools: Laws must ban the creation, possession, and distribution of AI tools designed for generating CSAM.
  For example: The UK’s 2025 law penalizes not just users but also creators of AI models used for CSAM generation.
• Mandatory Reporting by Intermediaries: Digital platforms, VPNs, and cloud services should be legally required to report AI-generated CSAM.
• Develop AI Detection Systems: India should invest in AI-based CSAM detection tools for real-time tracking and blocking of AI-generated content.
  For example: Google’s “Content Safety API” uses AI to detect and flag CSAM before it spreads online.
• Align with Global Conventions: India must adopt the UN Draft Convention on cybercrimes to ensure AI-driven CSAM is tackled globally.
  For example: The UN General Assembly (2025) is expected to introduce an international legal framework to regulate AI-driven child abuse material.

A proactive, multi-stakeholder approach is imperative to combat AI-generated CSAM. Strengthening existing cyber laws, integrating AI-driven detection mechanisms, and promoting global cooperation can build a resilient framework. A dynamic legal system, coupled with technological vigilance and continuous policy adaptation, will ensure robust child protection in the digital age.

DOWNLOAD PDF