IndiaAI Boosts Safe AI with Deepfake Detection, Bias Mitigation and AI Security Tools

IndiaAI selects five breakthrough projects for deepfake detection, bias mitigation and AI penetration testing to ensure trusted AI in India.

Technology Posted on: 2025-10-07 13:41:45 Updated on: 2025-10-07 14:05:02
IndiaAI Boosts Safe AI with Deepfake Detection, Bias Mitigation and AI Security Tools
IndiaAI unveils new projects on deepfake detection, bias audits, and AI security to strengthen safe AI ecosystem.

New Delhi, October 7, 2025 - IndiaAI has unveiled five breakthrough projects designed to reinforce India's vision of a Safe and Trusted AI ecosystem. These initiatives target critical areas such as deepfake detection, bias mitigation, and generative AI security, ensuring that artificial intelligence evolves in a secure, ethical, and inclusive manner.

The announcement marks the outcome of the second round of Expression of Interest (EoI) launched in December 2024 under the Safe & Trusted AI pillar of the IndiaAI Mission. The call drew over 400 proposals from leading academic institutions, start-ups, research organisations, and civil society groups. After a rigorous multi-stakeholder review process, five projects have been selected for implementation.

🔹 The Selected Projects
  • Saakshya (IIT Jodhpur & IIT Madras): A multi-agent, RAG-enhanced framework for detecting and governing deepfakes.
  • AI Vishleshak (IIT Mandi & Himachal Pradesh Forensic Services): Advanced tools to identify audio-visual deepfakes and handwritten signature forgeries, with robustness and explainability.
  • IIT Kharagpur - Real-Time Voice Deepfake Detection: A system capable of spotting manipulated voice recordings in real time.
  • Digital Futures Lab & Karya: A study addressing gender bias in agricultural AI models, creating digital public goods for fair benchmarking and inclusive data use.
  • Anvil (Globals ITES & IIIT Dharwad): A penetration testing and evaluation toolkit for large language models and generative AI applications.
🔹 Why It Matters

Together, these projects demonstrate India's proactive leadership in AI safety. They enable forensic accuracy, promote bias-free AI applications, and establish robust evaluation frameworks to safeguard emerging technologies. Officials emphasized that these initiatives not only strengthen India's technological sovereignty but also set precedents for global AI governance standards.

🔹 The Bigger Picture

IndiaAI, operating as an Independent Business Division under the Ministry of Electronics and IT (MeitY), continues to democratize AI benefits, foster indigenous innovation, and embed trust and transparency into the country's AI ecosystem. By uniting academia, industry, and civil society, the mission ensures that AI solutions serve India's diverse needs while upholding the highest standards of safety and accountability.