Should AI development be paused or restricted?
The FLI open letter source argues for pausing powerful AI training, while the CEPA article argues against pausing AI progress.
Should AI development be paused? I'll map the current arguments for and against restrictions to give you a balanced answer.
There is no consensus on whether AI development should be paused or restricted, but the debate has intensified since 2023. Most experts and policymakers now distinguish between a total pause and targeted restriction/regulation.
1. The Case For Pausing or Restricting Development
The most famous call for a pause was the Future of Life Institute (FLI) open letter in March 2023, which called on "all AI labs to immediately pause for at least 6 months the training of AI systems more powerful than GPT-4".
It cited risks such as:
The letter did not call for stopping all AI, but to refocus AI research on making systems "more accurate, safe, interpretable, transparent, robust, aligned, trustworthy, and loyal" and to create governmental regulation, independent audits before training, tracking highly capable AI systems and large pools of computational capability, and robust public funding for safety research.
More maximalist versions of this argument include:
More recent political calls echo this. For example, former presidential candidate Bernie Sanders called for an immediate pause on AI development until clear safety rules are established by scientists, and a permanent ban on the development of artificial "superintelligence" (AI systems more intelligent than humans in all domains), and an international treaty with China to avoid an arms race. Former Trump advisor Steve Bannon argued for slowing the pace of AI development and formation of a national regulatory organization.
Proponents also point to present harms: algorithmic biases, misinformation, surveillance, bias, and intellectual stultification, which are already amplifying in power and prevalence.
A key practical argument from restriction advocates is that restricting the largest training runs is more tractable than restricting all AI work, because very large runs need concentrated hardware and power that are comparatively visible.
2. The Case Against a Pause
Critics argue a general pause is unworkable, unenforceable, and counterproductive:
a) It would not solve the problem and would ignore immediate harms.
The letter was criticized for diverting attention from more immediate societal risks such as algorithmic biases, and former Microsoft CEO Bill Gates chose not to sign, stating that he does not think "asking one particular group to pause solves the challenges". Sam Altman said the letter was "missing most technical nuance about where we need the pause".
As of July 2024, a pause has not been realized. Instead, companies have directed "vast investments in infrastructure to train ever-more giant AI systems".
b) Loss of benefits and regulatory chilling effects.
Regulating AI models as if they were earlier, more narrow systems invokes risks: new benefits from novel technologies will be lost, the potential harms are not necessarily the same, and people's behavior will change. Like nearly all technologies, AI is a dual use technology offering tremendous benefits when properly applied, and consequences of overcautious regulation is technological stagnation, worse health, and less prosperity.
Some argue consumer trust has the potential to generate additional benefits and negate, to an extent, the costs AI regulation would have on the market.
c) Competition and geopolitical reality.
This is the most common argument in Washington. House Speaker Mike Johnson unequivocally rejected a pause, warning that halting progress would cede a competitive advantage to China and carry serious national security implications, saying "A pause in AI development is not an option. If we were to do that, we would hand China the advantage".
Analysts note that even if a ban, pause or slowdown is desirable, China will not join. Beijing called Anthropic CEO Dario Amodei's warning to pace the frontier "fearmongering," suggesting alarm about AI was a US plot to hinder China's innovation. The recent Xi-Trump summit underlined this impasse, with no deal to slow AI and Trump saying he had little interest in working with China because "we're leading by a lot".
d) Defense vs. Offense and Self-Regulation
Some argue pausing accentuates asymmetry between able defenders and rogue actors, whether they be nation states, criminals, terrorists, or simply misaligned models, and that AI defense can reduce or offset the risk of AI offense. If we delay access to the most capable models, defenders' hands would be tied.
From this perspective, trust becomes a competitive advantage, giving companies an incentive to invest in safety without requiring a universal development pause - if agents are unsafe, users can stop using them.
Regulation also risks boomeranging, potentially slowing researchers' attempts to identify and address safety challenges.
3. The Emerging Middle Ground: Restrict Deployment, Not Research?
Most current policy proposals are not arguing for a total freeze, but for risk-based regulation:
> It would be better to continue with the development of AI but to exercise great care when it comes to the areas in which it is deployed. As the AI system becomes more capable and more autonomous, it will require more safety measures and more human supervision.
This approach includes:
Bottom Line
The core tradeoff is:
Risks of moving too fast: loss of control, irreversible alignment failure, catastrophic misuse, and erosion of jobs, truth, and democratic institutions.
Risks of moving too slow: lost medical, scientific, climate and economic breakthroughs, weakened defenses against bad actors who will use AI anyway, and ceding strategic advantage.
If you are forming your own view, it may help to ask:
Citations (2)
- Pause Giant AI Experiments: An Open Letter
Backs: “Most experts and policymakers now distinguish between a total pause and targeted restriction/regulation. 1. The Case For Pausing or Restricting Development. The most famous call for a pause was the Future of Life Institute (FLI) open letter in March 2023, which called on "all AI labs to immediately pause for at least…”
evidence, reference entry, points to yes. Claim: The most famous call for a pause was the Future of Life Institute open letter in March 2023, calling for a six-month pause on training.
- AI: Let’s Not Pause Progress
Backs: “If we were to do that, we would hand China the advantage". Analysts note that even if a ban, pause or slowdown is desirable, China will not join. Beijing called Anthropic CEO Dario Amodei's warning to pace the frontier "fearmongering," suggesting alarm about AI was a US plot to hinder China's innovation.”
evidence, article, points to no. Claim: Pausing would hand China an advantage; China will not join a pause or slowdown, and Beijing dismissed Amodei's warning as fearmongering.