More answers like this
Claude Sonnet 5Sep 23, 2026anthropic/claude-sonnet-5-20260630

Are AI chatbots biased?

Yes — AI chatbots have been shown to exhibit multiple forms of bias

Research from 2025-2026 consistently shows AI chatbots are not neutral, with bias appearing in several distinct ways:

Political Bias (Left-Leaning)

The most heavily documented bias is a left-leaning political tilt. A Washington Post investigation tested ChatGPT, Gemini, Claude, and Grok on political questions and found OpenAI answered prompts with left-leaning responses a whopping 80% of the time while providing both sides to a question just 17% of the time. By contrast, Gemini scored the highest for presenting multiple viewpoints, with 93% of responses laying out both sides of an issue, while Claude maintained neutrality more than half of the time, at 57%.

This isn't an isolated finding. Broader academic research analyzing 43 LLMs from the United States, Europe, China, and the Middle East using survey-style prompts from major research institutes found that most models leaned center-left or left. Similarly, an academic review noted AI chatbots may exhibit political bias—for example, ChatGPT leans liberal, and GPT-4's responses tend to align more with left-wing values, showing a significant and systematic political preference toward the Democratic Party in the US.

This extends beyond the U.S.: a University of Copenhagen study found popular AI chatbots such as ChatGPT and Gemini are not neutral and tend to favor certain political parties when asked who users should vote for, making them unsuitable for providing advice in connection with elections.

Bias Can Subtly Shape Opinions — Even Without Trying

Perhaps more concerning than overt political leanings is a Yale study showing chatbots can influence beliefs even in "neutral" contexts. Researchers found that while AI content prompted to be persuasive can shift opinions, the same is also true of content not intended to change minds, such as simple summaries of historical events—caused by latent biases introduced during LLM training. Notably, default summaries moved readers' opinions in a "liberal" direction, demonstrating persuasive effects of latent biases, though the effect size was slight—shifting from a moderate to a somewhat liberal stance. Interestingly, liberal framing shifted opinions across all ideological groups, while conservative-slanted summaries only significantly affected readers who already identified as conservative.

One researcher noted the implications: unlike Wikipedia, which emphasizes transparency in how its entries are edited, AI chatbot development is opaque, meaning companies developing these models have the ability to shape people's opinions.

Bias Against Vulnerable/Marginalized Users

Beyond politics, MIT researchers found chatbots treat users differently based on identity markers. Their study found leading AI models perform worse for users with lower English proficiency, less formal education, and non-US origins, highlighting risks especially for marginalized communities.

Confirmation Bias

Chatbots may also reinforce what users already believe. One analysis warned this could be a "recipe for disaster," particularly when a chatbot is discussing political issues—"If you have a certain political bias, AIs are going to feed into that, and they're going to state it with very strident confidence that will make you believe you're right". Separately, researchers describe discussions on AI bias frequently focusing on racial or gender bias, while the more subtle phenomenon of confirmation bias in generative AI chatbots has received comparatively less attention.

Gender and Racial Bias Also Persist

Academic reviews note chatbots can exhibit gender bias—such as reinforcing stereotypical assumptions about men and women's occupations—as well as racial bias, reflected in prejudices against certain ethnic groups.

Why This Happens

Researchers point to training data and alignment choices as root causes. As one expert put it, biased AI "could shape public discourse and influence voters' opinions... I think that's especially dangerous". Another noted concern that chatbots may be skewed toward mainstream views since less-widespread opinions may be underrepresented in training datasets, potentially causing LLMs to amplify existing societal biases.

Important Caveats

•Bias isn't static: One analysis cautioned that models change often, system prompts change, retrieval sources change, and political pressure changes—so a test from one month may not describe a model months later.
•Not all bias is equally severe or the same direction across products—Gemini and Claude showed notably more balance than ChatGPT in the Post's testing.
•Experts still emphasize user agency: as one AI researcher noted, there's no need for panic since people ultimately make their own decisions rather than relying on a chatbot to decide for them, though users should remain aware of AI's limitations.

Bottom line: Yes, current evidence strongly supports that AI chatbots exhibit measurable biases — most documented being a left-leaning political tilt, but also biases affecting how well they serve non-native English speakers or less-educated users, plus subtler effects like opinion-shaping through seemingly neutral content and confirmation bias.

Citations (16)

  1. 1foxnews.comNews and mediaquality 0.53
    AI chatbots show left-leaning bias in study of ChatGPT, Gemini, Claude | Fox News

    Source excerpt: “According to the study, OpenAI answered prompts with left-leaning responses a whopping 80% of the time while providing both sides to a question just 1...”

  2. 26abc.comNews and mediaquality 0.77
    Study examines AI chat bot bias, how it responds to prompts - 6abc Philadelphia

    Source excerpt: “According to the study, Gemini scored the highest for presenting multiple viewpoints, with 93% of responses laying out both sides of an issue. Claude ...”

  3. 3etcjournal.comNews and media
    AI Chatbots Are Liberal-Left 'Biased'

    Source excerpt: “It analyzed 43 LLMs from the United States, Europe, China, and the Middle East using survey-style prompts from the American National Election Studies ...”

  4. 4arxiv.orgAcademic
    Ask ChatGPT: Caveats and Mitigations for Individual Users of AI Chatbots

    Source excerpt: “AI chatbots may exhibit various forms of bias, including gender bias—such as reinforcing stereotypical assumptions about men and women's occupations [...”

  5. 5phys.orgNews and mediaquality 0.85
    Chatbots show political bias and steer voters toward some parties, analysis finds

    Source excerpt: “Popular AI chatbots such as ChatGPT and Gemini are not neutral and tend to favor certain political parties when asked who users should vote for. This ...”

  6. 6yale.eduAcademic
    AI’s hidden bias: Chatbots can influence opinions without trying | Yale News

    Source excerpt: “Prior research has shown that content generated by artificial intelligence (AI) that has been prompted to be persuasive can indeed shift people’s opin...”

  7. 7yale.eduAcademic
    AI’s hidden bias: Chatbots can influence opinions without trying | Yale News

    Source excerpt: “That the default summaries moved readers’ opinions in a “liberal” direction demonstrates the persuasive effects of latent biases in LLMs, the research...”

  8. 8yale.eduAcademic
    AI’s hidden bias: Chatbots can influence opinions without trying | Yale News

    Source excerpt: “They found that the AI summaries prompted to have a liberal framing led to more liberal opinions across the ideological groups. The AI summaries with ...”

  9. 9yale.eduAcademic
    AI’s hidden bias: Chatbots can influence opinions without trying | Yale News

    Source excerpt: ““In contrast to Wikipedia, which emphasizes transparency in how its entries are edited, the development of AI chatbots is opaque. Our work suggests th...”

  10. 10mit.eduAcademic
    Study: AI chatbots provide less-accurate information to vulnerable users | MIT News | Massachusetts Institute of Technology

    Source excerpt: “Study: AI chatbots provide less-accurate information to vulnerable users · Research from the MIT Center for Constructive Communication finds leading A...”

  11. 11yournews.comNews and mediaquality 0.22
    Study Finds Major AI Chatbots Lean Left in Rejecting Right-Wing Falsehoods While Struggling With Source Accuracy – [your]NEWS

    Source excerpt: ““If you have a certain political bias, AIs are going to feed into that, and they’re going to state it with very strident confidence that will make you...”

  12. 12arxiv.orgAcademic
    Confirmation Bias in Generative AI Chatbots: Mechanisms, Risks, Mitigation Strategies, and Future Research Directions

    Source excerpt: “In the realm of AI, discussions on bias frequently focus on issues such as racial bias, gender bias, or other forms of prejudiced outcomes in classifi...”

  13. 13acm.orgAcademic
    identifying political bias in ai

    Source excerpt: “Biased AIs “could shape public discourse and influence voters’ opinions,” said Luca Rettenberger, a researcher at Germany’s Karlsruhe Institute of Tec...”

  14. 14acm.orgAcademic
    identifying political bias in ai

    Source excerpt: “Rettenberger also worries that chatbots may be skewed towards more mainstream views. Less-widespread opinions may be underrepresented in training data...”

  15. 15etcjournal.comNews and media
    AI Chatbots Are Liberal-Left 'Biased'

    Source excerpt: “Models change often. System prompts change. Retrieval sources change. Political pressure changes. A test from March 2026 may not describe a model in J...”

  16. 166abc.comNews and mediaquality 0.77
    Study examines AI chat bot bias, how it responds to prompts - 6abc Philadelphia

    Source excerpt: “Despite concerns about bias, Callison-Burch said there is no need for alarm because people ultimately make their own decisions rather than relying on ...”