More answers like this
Claude Sonnet 5Sep 15, 2026anthropic/claude-sonnet-5-20260630

Are AI chatbots biased?

Yes — extensive research shows that AI chatbots do exhibit measurable biases, though the type, direction, and degree vary by model and topic. Here's what the evidence shows:

Why bias happens

AI chatbots are trained on vast amounts of human-generated text, and this data reflects the biases that exist in our society, whether consciously or unconsciously, so chatbots can sometimes perpetuate or even amplify these biases in their responses. This isn't necessarily deliberate — it's largely a reflection of the biases that can exist in the vast amounts of text data used to train these systems.

Political bias

This is the most heavily studied area recently:

•A Washington Post analysis (June 2026) found that chatbots have clear political leanings that can conflict with promises made by the companies behind them. Specifically, the model that powers ChatGPT answered nearly every question exclusively with left-leaning arguments and presented only right-leaning positions just once, while Google's Gemini mostly took a both-sides approach, offering both left and right positions in more than 90 percent of its answers. Notably, even AI models marketed as having conservative views, including Elon Musk's Grok, cited left-leaning arguments more often, on average.
•A related test found Claude maintained neutrality more than half of the time, at 57%, while Gemini scored highest for balance.
•A broader academic study analyzing 43 large language models from the US, Europe, China, and the Middle East found that most models leaned center-left or left, though there was variation in nonpartisan engagement patterns, and model scale and openness were not strong predictors of this leaning.
•Research from the University of Copenhagen similarly found that popular AI chatbots such as ChatGPT and Gemini are not neutral and tend to favor certain political parties when asked who users should vote for, making them unsuitable for providing election-related advice.

Bias can subtly shape opinions — even without intent

A Yale study (published in PNAS Nexus) found that as people increasingly rely on AI chatbots to look up basic facts, those interactions can influence users' social and political opinions — even through content that is not intended to change minds, such as simple summaries of historical events. The lead researcher explained: "querying an AI chatbot to obtain historical facts can influence people's opinions even when the information provided is accurate and nobody has prompted the tool to try to persuade you... The effects are modest but could compound if somebody frequently engages with chatbots for factual information."

Interestingly, the effect wasn't symmetric: AI summaries prompted to have a liberal framing led to more liberal opinions across all ideological groups, whereas summaries with a conservative slant only showed significant effects on readers who already identified as conservative.

Bias against vulnerable/marginalized users

A February 2026 MIT study found that AI chatbots often show bias, giving less accurate or more dismissive answers to some users, highlighting growing risks especially for marginalized communities worldwide. Specifically, leading AI models perform worse for users with lower English proficiency, less formal education, and non-US origins.

Other forms of bias

Beyond politics, chatbots can show:

•Gender bias: chatbots might associate certain roles or characteristics more strongly with one gender than another.
•Racial/ethnic bias: responses might reflect stereotypes or provide different levels of information or sentiment based on race.
•Academic literature notes chatbots can exhibit political bias, racial bias reflected in prejudices against certain ethnic groups, and gender bias such as reinforcing stereotypical assumptions about occupations.

Bias isn't fixed

Importantly, these biases aren't static. As one analysis put it, the evidence does not show that bias is stable — models change often, system prompts change, retrieval sources change, political pressure changes, and a test from one month may not describe a model a few months later, which is why audits should be repeated, public, and model-specific.

Bottom line: Yes, current research strongly supports that AI chatbots exhibit bias — most documented studies point to a left-leaning tilt on political topics across most major models, plus other biases related to gender, race, and treatment of non-native English speakers or less-educated users. However, the degree and direction vary significantly by product (Gemini and Claude tend to show more balance than ChatGPT in political testing), and these patterns can shift as companies adjust their models.

Citations (18)

  1. 1libguides.comNot yet classified
    Bias - Artificial Intelligence (AI) 2026 Guide -- Chatbots, Agents, and More - LibGuides at St. Louis County Library

    Source excerpt: “AI chatbots are trained on vast amounts of data created by humans. This data reflects the biases that exist in our society, whether consciously or unc...”

  2. 2libguides.comNot yet classified
    Bias - Artificial Intelligence (AI) 2026 Guide -- Chatbots, Agents, and More - LibGuides at St. Louis County Library

    Source excerpt: “This bias can show up in different ways, from subtle word choices to more significant misrepresentations of information. It's important to understand ...”

  3. 3washingtonpost.comNews and mediaquality 0.82
    Are AI chatbots like ChatGPT politically biased? We tested them. - Washington Post

    Source excerpt: “The results suggest that chatbots have clear political leanings that can conflict with promises made by the companies behind them. ”

  4. 4benton.orgNot yet classified
    Are ChatGPT and other AI chatbots politically biased? We tested them. | Benton Institute for Broadband & Society

    Source excerpt: “The model that powers ChatGPT answered nearly every question exclusively with left-leaning arguments and presented only right-leaning positions just o...”

  5. 5yahoo.comNews and mediaquality 0.69
    Are ChatGPT and other AI chatbots politically biased? We tested them.

    Source excerpt: “And even AI models marketed as having conservative views, including Elon Musk's Grok, offered by his company SpaceX, cited left-leaning arguments more...”

  6. 66abc.comNews and mediaquality 0.77
    Study examines AI chat bot bias, how it responds to prompts - 6abc Philadelphia

    Source excerpt: “According to the study, Gemini scored the highest for presenting multiple viewpoints, with 93% of responses laying out both sides of an issue. Claude ...”

  7. 7etcjournal.comNews and media
    AI Chatbots Are Liberal-Left ‘Biased’ | Educational Technology and Change Journal

    Source excerpt: “The authors found that most models leaned center-left or left, but they also found variation in nonpartisan engagement patterns and argued that model ...”

  8. 8phys.orgNews and mediaquality 0.85
    Chatbots show political bias and steer voters toward some parties, analysis finds

    Source excerpt: “Popular AI chatbots such as ChatGPT and Gemini are not neutral and tend to favor certain political parties when asked who users should vote for. This ...”

  9. 9yale.eduAcademic
    AI’s hidden bias: Chatbots can influence opinions without trying | Yale News

    Source excerpt: “... As people increasingly rely on AI-powered chatbots to look up basic facts about the world, a new Yale study shows that those interactions can infl...”

  10. 10yale.eduAcademic
    AI’s hidden bias: Chatbots can influence opinions without trying | Yale News

    Source excerpt: “But this study provides evidence that the same is also true of content that is not intended to change minds, such as the summaries that popular chatbo...”

  11. 11yale.eduAcademic
    AI’s hidden bias: Chatbots can influence opinions without trying | Yale News

    Source excerpt: ““We show that querying an AI chatbot to obtain historical facts can influence people’s opinions even when the information provided is accurate and nob...”

  12. 12yale.eduAcademic
    AI’s hidden bias: Chatbots can influence opinions without trying | Yale News

    Source excerpt: “They found that the AI summaries prompted to have a liberal framing led to more liberal opinions across the ideological groups. The AI summaries with ...”

  13. 13mit.eduAcademic
    Study: AI chatbots provide less-accurate information to vulnerable users | MIT News | Massachusetts Institute of Technology

    Source excerpt: “MIT researchers find AI chatbots often show bias, giving less accurate or more dismissive answers to some users. The findings highlight growing risks,...”

  14. 14mit.eduAcademic
    Study: AI chatbots provide less-accurate information to vulnerable users | MIT News | Massachusetts Institute of Technology

    Source excerpt: “Study: AI chatbots provide less-accurate information to vulnerable users · Research from the MIT Center for Constructive Communication finds leading A...”

  15. 15libguides.comNot yet classified
    Bias - Artificial Intelligence (AI) 2026 Guide -- Chatbots, Agents, and More - LibGuides at St. Louis County Library

    Source excerpt: “Gender Bias: Chatbots might associate certain roles or characteristics more strongly with one gender than another. ”

  16. 16libguides.comNot yet classified
    Bias - Artificial Intelligence (AI) 2026 Guide -- Chatbots, Agents, and More - LibGuides at St. Louis County Library

    Source excerpt: “Racial and Ethnic Bias: Responses might reflect stereotypes or provide different levels of information or sentiment based on race ... ”

  17. 17arxiv.orgAcademic
    Ask ChatGPT: Caveats and Mitigations for Individual Users of AI Chatbots

    Source excerpt: “AI chatbots may exhibit various forms of bias, including gender bias—such as reinforcing stereotypical assumptions about men and women's occupations [...”

  18. 18etcjournal.comNews and media
    AI Chatbots Are Liberal-Left ‘Biased’ | Educational Technology and Change Journal

    Source excerpt: “Finally, the evidence does not show that bias is stable. Models change often. System prompts change. Retrieval sources change. Political pressure chan...”