Is open-source AI safer or riskier than closed/proprietary AI?
This is a genuinely contested question in AI policy circles, with legitimate arguments on both sides. Let me pull in some current perspectives to give you a well-grounded answer.## There's no simple answer — it depends on what kind of risk you're weighing
This is one of the most contested questions in AI policy, and serious researchers disagree. Here's a breakdown of the actual arguments on each side.
The case that open (weight/source) AI is riskier
Irreversibility of release. Once weights are public, there's no way to pull them back or patch every copy. Open-weight models can pose risks by facilitating malicious or misguided use that is difficult or impossible for the developer to monitor or mitigate, and once weights are publicly available, there is no way to implement a wholesale rollback or ensure all copies receive safety updates.
Safeguards are trivially removable. This is probably the strongest technical argument against openness. Open-weight models have been shown to be extremely vulnerable to adversarial detuning, allowing malicious actors to both disable safeguards and elicit dangerous capabilities. Industry practitioners echo this: safety guardrails can be stripped in minutes through fine-tuning or a technique called "abliteration," and once downloaded, an organization owns every future vulnerability with no vendor patch pipeline.
Notable AI researchers have been blunt about this. Eliezer Yudkowsky called open-sourcing frontier AI "sheer catastrophe," and Ilya Sutskever predicted it would soon be "completely obvious to everyone that open-sourcing AI is just not wise."
Real-world example: Meta's original Llama leaked outside its controlled access process within days, showing how hard containment is once weights exist: Meta announced Llama with weights obtainable only through an application process, but the weights leaked to the public just over a week later, allowing access outside that process.
The case that open AI is safer (or at least not clearly riskier)
Closed models aren't actually secure either. A recurring finding in the research literature undercuts the "closed = safe" assumption: closed models are also vulnerable to jailbreaking techniques, and completely preventing models from exhibiting undesirable behaviors might not even be possible. The same analysis concludes it is not clear that closed models are definitively "safer" than open-source models.
Closed models can leak or be stolen too. The "we can always revoke access" argument has holes: closed models can be compromised via hacking, leaks, reverse engineering, or duplication — for example, Mistral's 70B parameter model was leaked by one of its early customers.
Transparency enables defense, not just attack. Discussions about open-weight models often raise security risks, but open systems can actually be the foundation for building more secure systems, since they're open to scrutiny by anyone and easier to evaluate. There's a real cost to closed-model guardrails too: guardrails built into closed models can create their own cybersecurity concerns, because they can make it impossible to use the model to identify and patch security holes in third-party systems.
A concrete, recent illustration of this tradeoff: during a 2026 security incident, defenders found closed frontier models useless for forensics because of their own restrictions: when Hugging Face's incident-response team tried to use leading commercial AI models to analyze thousands of attack events, those models' safety guardrails refused to process the exploit code — so the team turned to an open-weight model run locally instead, specifically because it would process the attack artifacts without refusing.
Uncertainty cuts both ways. Even AI safety researchers focused on this exact question admit the evidence is incomplete: it is unclear how effective different safeguards for open-weight models will ultimately be, and it is also unclear how much counterfactual risk open-weight models pose compared to closed-weight models.
The strategic/geopolitical dimension
This isn't just a technical debate — it's tangled up with competition dynamics. The US, via companies like Anthropic, OpenAI and Google, leads in closed models, while China, via Moonshot and DeepSeek, has pulled ahead in the open-model race — raising concern that an open AI ecosystem could let China pull ahead in the overall AI race. Some argue restricting Western open models just cedes that space to less safety-focused developers abroad.
The honest bottom line
Most rigorous analyses land on "it depends on which risk you care about":
Most policy researchers who study this closely conclude the two approaches aren't strictly substitutes: open-source and closed-source AI are not mutually exclusive options; both offer substantial benefits, and harnessing their strengths together is essential. The realistic framing isn't "which is safer" in the abstract, but "safer for which threat model, at which capability level, with which safeguards in place" — and on that, the field genuinely hasn't converged.
Citations (19)
- International AI Safety Report
Source excerpt: “However, open-weight models can also pose risks, for example by facilitating malicious or misguided use that is difficult or impossible for the develo...”
- Towards Responsible Governing AI Proliferation
Source excerpt: “First, while closed source models themselves are not currently as well secured as would be desirable, open-weight models have been shown to be extreme...”
- Open-Weight AI Models: A Cybersecurity Threat in 2026 | AvePoint
Source excerpt: “Two notable ones are that their safety guardrails can be stripped in minutes through fine-tuning or a technique called “abliteration” and that, once d...”
- Market Beliefs about Open vs. Closed AI
Source excerpt: “Eliezer Yudkowsky, a commentator concerned about the risks of AI, said 'open sourcing, you know, that's just sheer catastrophe' (lexteam 2023). ”
- Market Beliefs about Open vs. Closed AI
Source excerpt: “Ilya Sutskever, a co-founder and former chief scientist at OpenAI said, 'I fully expect that in a few years it's going to be completely obvious to eve...”
- Market Beliefs about Open vs. Closed AI
Source excerpt: “Amidst this backdrop, on February 24, 2023, Meta announced an LLM ('Llama') for which it shared code and training details, and for which weights could...”
- Risks and Opportunities of Open-Source Generative AI
Source excerpt: “However, closed models still demonstrate weaknesses and, crucially, are also vulnerable to jailbreaking techniques (Zou et al., 2023; Chao et al., 202...”
- Risks and Opportunities of Open-Source Generative AI
Source excerpt: “Completely preventing models from exhibiting undesirable behaviors might not even be possible (Wolf et al., 2023; Petrov et al., 2024). ”
- Risks and Opportunities of Open-Source Generative AI
Source excerpt: “Therefore, it is not clear that closed models are definitively "safer" than open-source models. ”
- Risks and Opportunities of Open-Source Generative AI
Source excerpt: “However, closed models can be compromised via hacking, leaks (Vice, 2023b), reverse engineering (AsuharietYgvar, 2021) or duplication (Oliynyk et al.,...”
- Risks and Opportunities of Open-Source Generative AI
Source excerpt: “Finally, closed models can be leaked, e.g., Mistral's 70B parameter was leaked by one of their early customers (VentureBeat, 2024b).”
- Why open-weight models are crucial for American AI leadership | Brookings
Source excerpt: “Discussions about open-weight AI models often raise issues of risks including security. But open systems can actually be the foundation for building m...”
- Why open-weight models are crucial for American AI leadership | Brookings
Source excerpt: “This is a fair critique, but there is a mirroring critique that cuts the other way: The guardrails built into closed models can create their own cyber...”
- Open-Weight AI Models: A Cybersecurity Threat in 2026 | AvePoint
Source excerpt: “The detail that should get more attention than the headline: when Hugging Face’s incident-response team first tried to use the leading commercial AI m...”
- Open Technical Problems in Open-Weight AI Model Risk Management
Source excerpt: “Uncertainties: It is unclear how effective different safeguards for open-weight models will ultimately be. ”
- Open Technical Problems in Open-Weight AI Model Risk Management
Source excerpt: “It is also unclear how much counterfactual risk open-weight models will pose compared to closed-weight models (Kapoor et al., 2024). ”
- Open vs Closed: The debate shaping the future of AI | CNN Business
Source excerpt: “The US – via the likes of Anthropic, OpenAI and Google – is the leader in closed models. China, via Moonshot and DeepSeek, has pulled ahead in the ope...”
- Precaution Shouldn't Keep Open-Source AI Behind the Frontier | AI Frontiers
Source excerpt: “All else equal, the open equivalent of a closed model will be more susceptible to unauthorized misuse or modification. Open models can be deployed and...”
- Mapping the Open-Source AI Debate: Cybersecurity Implications and Policy Priorities - R Street Institute
Source excerpt: “First, open-source and closed-source AI are not mutually exclusive options; both offer substantial benefits, and harnessing their strengths together i...”