S&TGS3+ GS2

AI's Present Risks: Autonomy, Control Failures, and Governance Gaps

Indian Express·2026-09-16· Read original

"AI's Present Risks: Autonomy, Control Failures, and Governance Gaps"

Prelims Facts

  • •The AI Action Summit (Paris, 2025) was co-chaired by India and France; the United States and United Kingdom did not sign the declaration on inclusive and sustainable AI.
  • •The Bletchley Park AI Safety Summit (2023) was the first major multilateral AI governance summit; it was followed by the Seoul AI Summit (2024) and the Paris AI Action Summit (2025).
+4 more facts — sign up free to unlock

Key Terms

Alignment problem

the challenge of ensuring an AI system's behaviour reliably matches human intentions and values.

Human in the loop

the principle that a human decision-maker reviews and approves AI outputs before they take effect.

+4 more terms — sign up free to unlock

Study Note

BackgroundCore Concept

Background

Artificial intelligence systems have moved from research labs into consequential real-world deployments faster than governance frameworks can keep pace. Large Language Models (LLMs) and autonomous AI agents now assist in legal research, medical diagnosis, archival conservation, and critical infrastructure management. This speed of deployment creates a structural problem: the systems are already embedded in high-stakes decisions before society has agreed on who is responsible when they fail, how failures should be detected, or how a malfunctioning system can be stopped.

The international community has tried to build shared governance through a sequence of summits. The Bletchley Park AI Safety Summit (2023) was the first major multilateral effort, focused on frontier AI risks. The Seoul AI Summit (2024) followed, deepening commitments on safety testing. The AI Action Summit held in Paris in early 2025 was co-chaired by India and France, and produced a declaration on inclusive and sustainable AI. Critically, the United States and the United Kingdom did not sign that Paris declaration, reflecting a fundamental divergence: the US has favoured innovation and private-sector leadership, while Europe has emphasised rights-based, risk-proportionate regulation. China has embedded AI within state strategy and national sovereignty. These three philosophies now compete as much as the technologies themselves. Building on this lineage, the AI Impact Summit held in New Delhi in 2026 was structured around three foundational Sutras, People, Planning, and Progress, and the New Delhi Declaration on AI Impact was organised around seven Chakras (Pillars), including Access for Social Empowerment, AI for Science, and Secure and Trusted AI. The Preamble acknowledged the Charter for Democratic Diffusion of AI as a binding framework to support locally relevant innovation. India's co-chairmanship of the Paris summit and its hosting of the New Delhi summit signal its ambition to be a rule-shaper, not merely a rule-taker, in global AI governance.

India's domestic framework includes the IndiaAI Mission and the National Strategy for Artificial Intelligence, both emphasising responsible, sovereign, and inclusive AI development. The broader challenge, however, is not just what AI might eventually do. It is whether humans retain the practical ability to understand, audit, and stop AI systems when they go wrong right now.

The Topic Explained

The central governance concept is human oversight, sometimes called the 'human in the loop' principle. In theory, a human decision-maker reviews and approves consequential AI outputs before they take effect. In practice, this principle can become a legal fiction. When AI systems operate at machine speed, when their internal reasoning is opaque, and when the volume of decisions exceeds any human's capacity to review them, the 'human in the loop' is present in name only.

This connects to three specific technical properties that governance frameworks must address. First, auditability: can an independent party examine what an AI system actually did and why? Most frontier AI systems are not fully auditable even by their own developers. Second, interruptibility: can a human reliably stop a system mid-operation when something goes wrong? The Mythic Society incident illustrates the failure of this property, the AI agent's own safety system blocked its attempt to stop a destructive process it had itself initiated. Third, containment: can the consequences of an AI failure be bounded before they cascade? When AI agents communicate with one another and form emergent collectives, containment becomes far harder. …

Sign up free to read the full noteIncludes the rest of The Topic Explained and Current Context

Related PYQs

2025GS1 Prelims

Consider the following statements regarding the AI Action Summit held in Grand Palais, Paris in February 2025:

I.Co-chaired with India, the event builds on the advances made at the Bletchley Park Summit held in 2023 and the Seoul Summit held in 2024.

II.Along with other countries, US and UK also signed the declaration on inclusive and sustainable AI.

Which of the statements given above is/are correct?

AI only
BII only
CBoth I and II
DNeither I nor II
Sign up free to see the answer and explanation
2026GS1 Prelims

Consider the following statements with respect to the AI Impact Summit, 2026 held in New Delhi:

1.The Summit's intellectual framework was based on three foundational Sutras: People, Planning, and Progress.

2.The Preamble of the Summit stresses Democratising AI Resources, which acknowledges the Charter for Democratic Diffusion of AI as a binding framework to support locally relevant innovation and strengthen resilient AI ecosystems while respecting national laws.

3.The New Delhi Declaration on AI Impact was structured around seven Chakras (Pillars), which included Access for Social Empowerment, AI for Science, and Secure and Trusted AI.

Which of the statements given above is/are correct?

A1, 2 and 3
B1 and 2 only
C2 and 3 only
D3 only
Sign up free to see the answer and explanation
2023GS3 Mains

Introduce the concept of Artificial Intelligence (AI). How does AI help clinical diagnosis? Do you perceive any threat to privacy of the individual in the use of AI in healthcare?

Sign up free to see the model answer

Practice MCQs

S&Tmedium

Consider the following statements regarding the AI Action Summit held in Paris in 2025:

1.The Summit was co-chaired by India and France.

2.The United States and the United Kingdom signed the declaration on inclusive and sustainable AI.

3.It built on the advances made at the Bletchley Park Summit (2023) and the Seoul Summit (2024).

Which of the statements given above is/are correct?

A1 and 3 only
B2 and 3 only
C1, 2 and 3
D1 only
Sign up to check your answer & see the explanation
S&Thard

With reference to the AI Impact Summit held in New Delhi in 2026, consider the following pairs:

Summit Element — Description

1.Three Sutras — People, Planning, and Progress

2.New Delhi Declaration — Structured around nine Chakras (Pillars)

3.Charter for Democratic Diffusion of AI — Acknowledged as a binding framework in the Preamble

Which of the pairs given above is/are correctly matched?

A1 and 3 only
B2 and 3 only
C1, 2 and 3
D1 only
Sign up to check your answer & see the explanation
S&Teasy

Which of the following correctly describes the sequence of major multilateral AI governance summits?

ASeoul Summit (2023) → Bletchley Park Summit (2024) → Paris AI Action Summit (2025) → New Delhi AI Impact Summit (2026)
BBletchley Park Summit (2023) → Seoul Summit (2024) → Paris AI Action Summit (2025) → New Delhi AI Impact Summit (2026)
CParis AI Action Summit (2023) → Bletchley Park Summit (2024) → Seoul Summit (2025) → New Delhi AI Impact Summit (2026)
DBletchley Park Summit (2023) → Paris AI Action Summit (2024) → Seoul Summit (2025) → New Delhi AI Impact Summit (2026)
Sign up to check your answer & see the explanation
S&Tmedium

Which of the following best describes the 'alignment problem' in the context of Artificial Intelligence?

AThe technical difficulty of connecting AI systems to legacy government databases and public service infrastructure.
BThe challenge of ensuring that an AI system's actual behaviour reliably matches human intentions and values, rather than optimising for measurable proxies.
CThe geopolitical problem of aligning different countries' AI regulatory frameworks into a single binding international treaty.
DThe difficulty of aligning AI training data across multiple languages and scripts to ensure equitable performance for non-English users.
Sign up to check your answer & see the explanation
S&Tmedium

Consider the following statements about AI governance concepts:

1.'Auditability' refers to the capacity of an independent party to examine what an AI system did and why.

2.'Interruptibility' refers to the ability of a human operator to reliably stop an AI system mid-operation.

3.The 'human in the loop' principle guarantees meaningful human oversight in all AI deployments by legal definition.

Which of the statements given above is/are correct?

A1 and 2 only
B2 and 3 only
C1, 2 and 3
D3 only
Sign up to check your answer & see the explanation

Want the full note, Prelims Facts & MCQ answers?

Create a free account — takes less than a minute.

Create free account