India's Supreme Court has issued a strong warning against the misuse of artificial intelligence in the legal system, declaring that there will be "zero tolerance" for AI-generated hallucinations, fabricated legal precedents and fictitious authorities being presented before courts. In a significant judgment, the apex court directed the Bar Council of India to formulate a policy governing the use of AI in the legal profession. While acknowledging the growing role of artificial intelligence in judicial administration, the court made it clear that lawyers and judges remain fully responsible for verifying the accuracy and authenticity of AI-generated content before relying on it in legal proceedings.
The bench emphasized the importance of distinguishing "between fact and fiction, between fact and analysis, what is real and what is unreal," warning against treating AI-generated responses as authoritative legal sources without independent verification. Drawing a striking comparison, the court likened the spread of fabricated AI-generated precedents to the release of methyl isocyanate during the 1984 Bhopal gas tragedy, underscoring the potentially far-reaching consequences if false legal authorities become embedded in judgments, legal databases and future litigation. The observation reflects growing judicial concern over the risks posed by generative AI in courtroom practice.
The case before the Supreme Court involved fabricated legal authorities that reportedly escaped detection through multiple stages of judicial scrutiny, including legal research, courtroom arguments, proceedings before the National Company Law Tribunal and appellate review. Legal experts said the incident exposed vulnerabilities in existing research practices rather than flaws in technology alone. Arun Prabhu, Partner and Co-Head of Digital+, TMT at Cyril Amarchand Mangaldas, observed that citing a non-existent case amounts to a misstatement of fact rather than an error of legal analysis, stressing that lawyers remain accountable for exercising professional diligence regardless of whether AI tools were involved.
Also Read: CM Chandrababu Naidu Reaffirms Zero Tolerance On Drug Trafficking In Andhra Pradesh
The judgment also aligns with the judiciary's broader approach to integrating artificial intelligence into court administration while preserving human oversight. The Supreme Court already employs AI-powered tools such as SUPACE for legal research, SUVAS for translating judgments and AI-based transcription systems. In June, the court's AI Committee released draft Regulations for the Use of Artificial Intelligence in Courts, 2026, proposing wider adoption of AI for research, translation, transcription, accessibility and case management. However, the draft regulations explicitly prohibit AI from performing judicial functions such as deciding cases, assessing witness credibility, determining bail eligibility or assigning risk scores.
Legal experts believe the ruling could shape future professional standards for advocates using AI. Shiv Sapra of Kochhar & Co said the incident highlighted an overreliance on secondary legal research, while Ankit Sahni of Ajay Sahni & Associates noted that the profession may gradually develop an "AI competence" standard requiring lawyers to combine technological tools with human supervision, source verification and accountability. Senior legal professionals also pointed to earlier cases involving fabricated citations, reinforcing the need for stricter safeguards. As India's judiciary continues expanding AI adoption, the Supreme Court's message is clear: artificial intelligence can assist legal practice, but responsibility, accuracy and professional diligence must always remain in human hands.
Also Read: Karur Stampede Case: SC Declines Hearing Plea Alleging Witness Influence By Ministers