Artificial Intelligence is 21st century’s equivalent of nuclear technology. For this prime and unreplaceable asset, the humankind has enrolled itself in the never-ending race to secure the highest position in the field of Artificial Intelligence technology. However, history remains the prime witness to the fact that every time the human race has chased its obsession to run after unsustainable development, the marginal sections have had to pay the price in some way or the other. The International AI Safety Report 2025, conducted by over 96 independent international AI experts led by Yoshua Bengio (a machine learning pioneer) was published with the support of the UK’s Department for Science, Innovation and Technology (DSIT) and coordinated through the UK AI Safety Institute (AISI). This report highlights the risks of using general purpose AI. One of the risks flagged by the report is the rise in malicious use of the Artificial Intelligence to generate Child Sexual Abuse Material (CSAM). In a recent mortifying incident, this risk’s warning was turned true when X’s AI Grok was misused on a large scale for creating sexually explicit images of women and minors by “digitally undressing” them in photos they had uploaded on ‘X’. In this context, the present research paper aims to assess the effectiveness of the existing legal framework in India to prevent and protect the violation of rights of children by the malicious use of Artificial Intelligence technology. In addition to this, the research paper also attempts to explore the possibility of using Artificial Intelligence as a tool for identifying, tracing and curbing the violation of Rights of Children through AI.