Is open-source AI safer or riskier than closed/proprietary AI?
Is open-source AI the safer bet? I'll compare the evidence on open versus closed systems.
Open-source AI is not strictly safer or riskier than closed/proprietary AI - it shifts the type of risk:
Arguments that open-source is safer / advantages:
transparency, reusability and extensibility: they can be scrutinized, reused and built 'on top of,' to varying degrees. Similarly open code advantages: errors in OSS are detected and corrected with everyday use, and much faster than in closed-source software, and The growing openness of AI models fosters transparency, collaboration, and faster iteration across the AI community.open-source Generative AI models offer distinct advantages including Open Source Improves Public Trustworthiness Through Transparency.increases concentration of power, restricting access to AI technology and may also arbitrarily decide which countries and languages to support. Open Foundation Models offer significant benefits by fostering competition, accelerating innovation, and improving the distribution of power and provide significant benefits by combatting market concentration, catalyzing innovation, and improving transparency.There is no significant statistical difference in vulnerability rates between free open source and proprietary software and UK government guidance states Open source, as a category, is no more or less secure than closed proprietary software. Open Source Security Foundation notes While open-source technology fosters rapid innovation, it doesn’t inherently have more vulnerabilities than closed-source software and The difference is open-source vulnerabilities are publicly disclosed, while closed-source software may not always reveal its security defects.A comprehensive Stanford study concluded: there is currently limited evidence of the marginal risk of OFMs compared to closed models or existing technologies and Existing security mechanisms for closed models are also vulnerable.
> Some argue that open models are inherently less safe because they can be misused for cyberattacks or modified to remove guardrails. Those risks are real, but they do not disappear in closed systems, and simply keeping weights closed does not prevent determined attackers from seeking or exploiting powerful capabilities
Arguments that open-source is riskier / disadvantages:
Survey respondents consider open source AI tools to be riskier than proprietary AI for most types of AI risks. The most relevant AI risks cited include cybersecurity (62 percent of respondents), regulatory compliance (54 percent), and intellectual property (50 percent).The fact that open-source code is audited by many eyes is an advantage in finding security holes, but this same practice also makes it easier for individuals to find weaknesses to exploit than in proprietary software. there are also risks for society when open-source AI is used for nefarious purposes. Examples are the use of open-source AI technologies for the development of weapons and AI-generated propaganda campaigns and vulnerabilities in open-source AI are often public knowledge.Like any open source project, they can harbour vulnerabilities, outdated components, or even hidden backdoors that scale with adoption. Specifically Open-source: models can be vulnerable to traditional software supply-chain exploits, unvetted package dependencies, and local server misconfigurations. cannot be rolled back or forced to update once weights are released, unlike API-gated closed models.Closed-source trade-offs:
Closed-source: insulates enterprises from infrastructure-level vulnerabilities, but exposes workflows to vendor-side outages, API key leaks, and even prompt jailbreaks. Closed models are often released in a manner that is tested, mature, and safe.From a cybersecurity perspective, closed-source AI presents a paradox. While its restricted access reduces surface-level risks, such as tampering and unauthorized use, it can also create blind spots. Lack of transparency prevents inspection and research into how these models operate and Proprietary AI systems are difficult for members of the public to appraise, and thus to identify and fix errors within them.Synthesis:
Researchers argue the benefits are likely to outweigh the downsides of open-source AI, especially if a responsible open-source approach with clear barriers against misuse is pursued, and an Oxford-led paper argues overall, the benefits of opensource Gen AI outweigh its risks.
In practice, neither model is absolutely safer:
Policymakers are warned that Some interventions are better targeted at choke points downstream of the foundation model layer rather than restricting open models outright, and that regulation should consider potential unintended consequences of AI regulation on the vibrant innovation ecosystem around open foundation models.
Citations (3)
- Building open-source AI | Nature Computational Science
Backs: “Transparency and fixability: Open models offer transparency, reusability and extensibility: they can be scrutinized, reused and built 'on top of,' to varying degrees. Similarly open code advantages: errors in OSS are detected and corrected with everyday use, and much faster than in closed-source software, and The…”
- Stanford study: Open source AI models pose no greater risks than closed models
Backs: “Checks on concentration of power: Proprietary technology increases concentration of power, restricting access to AI technology and may also arbitrarily decide which countries and languages to support. Open Foundation Models offer significant benefits by fostering competition, accelerating innovation, and improving the…”
- ## Risks and Opportunities of Open-Source Generative AI
Backs: “Researchers argue the benefits are likely to outweigh the downsides of open-source AI, especially if a responsible open-source approach with clear barriers against misuse is pursued, and an Oxford-led paper argues overall, the benefits of opensource Gen AI outweigh its risks.”