More answers like this
Claude Sonnet 5Oct 10, 2026anthropic/claude-sonnet-5-20260630

Are AI chatbots biased?

Yes, AI chatbots can be biased — and this is well-documented across multiple dimensions.

Political bias

Numerous studies have found measurable political leanings in popular chatbots:

•Several academic studies have found that AI models powering chatbots tend to favor left-leaning positions. A Washington Post investigation found that ChatGPT was found to be left-leaning 80% of the time, while Gemini scored highest for presenting multiple viewpoints at 93%, and Claude maintained neutrality more than half the time, at 57%.
•A comparative IEEE study found that ChatGPT-4 and Claude exhibit a liberal bias, Perplexity is more conservative, while Google Gemini adopts more centrist stances based on their training datasets.
•Interestingly, bias isn't uniform across models — a 2023 study found OpenAI's ChatGPT and GPT-4 were the most left-wing libertarian, while Meta's LLaMA was the most right-wing authoritarian, and BERT models developed by Google were more socially conservative than OpenAI's GPT models.
•Bias can also vary by language. One study found that both ChatGPT and Gemini demonstrate liberal and leftist biases, with Gemini showing a more pronounced liberal and left-wing tendency compared to ChatGPT, and these political biases varied depending on the language used for inquiry.

Subtle, unintended influence on opinions

A 2026 Yale study found this bias doesn't require deliberate persuasion attempts. Prior research showed AI content prompted to be persuasive can shift opinions, but this study found the same is true even of content not intended to change minds, like simple factual summaries. The cause: unintended power to persuade comes from latent biases introduced during LLM training, which carry over from ideological leanings in training data and subtly shape narrative framing.

Bias toward vulnerable/marginalized users

Bias isn't limited to politics. MIT research found: leading AI models perform worse for users with lower English proficiency, less formal education, and non-US origins, with findings highlighting growing risks, especially for marginalized communities worldwide.

Status quo bias

A very recent (October 2026) study found chatbots also show decision-making biases unrelated to politics: AI chatbots backed existing plans about twice as often as identical new ones, a status quo bias that can work against climate choices. This held true even in low-stakes scenarios — it showed up even when switching would cost almost nothing, such as choosing whether to start an activist campaign or continue one already running.

Content moderation bias

Research from the University of Queensland found that LLMs used in AI content moderation may be prone to subtle biases that undermine their neutrality, with researchers using persona prompting finding significant behavioral shifts when testing chatbots' tendency to encode and reproduce political biases.

Why this happens

Bias tends to creep in via training data, fine-tuning, and reinforcement learning choices made by developers — not necessarily deliberate intent. As one analysis notes, the strongest studies show that bias is not a single fixed trait — it varies by model, prompt, topic, language, scale, training method, guardrails, and whether the model is being forced to answer or allowed to refuse.

Bottom line

Yes — research consistently shows AI chatbots exhibit biases, most notably a left-leaning political tilt in several major models, but also biases related to language, user background, and even basic decision-making patterns like favoring the status quo. These biases are usually unintentional byproducts of training data and methodology rather than deliberate programming, but they're real and measurable enough that researchers argue for more transparency and auditing in AI development.

Citations (17)

  1. 1washingtonpost.comNews and mediaquality 0.82
    Are AI chatbots like ChatGPT politically biased? We tested them. - Washington Post

    Source excerpt: “The Post’s results come after several previous academic studies found that AI models powering chatbots tend to favor left-leaning positions. ”

  2. 26abc.comNews and mediaquality 0.77
    Study examines AI chat bot bias, how it responds to prompts - 6abc Philadelphia

    Source excerpt: “ChatGPT was found to be left-leaning 80% of the time.”

  3. 36abc.comNews and mediaquality 0.77
    Study examines AI chat bot bias, how it responds to prompts - 6abc Philadelphia

    Source excerpt: “According to the study, Gemini scored the highest for presenting multiple viewpoints, with 93% of responses laying out both sides of an issue. Claude...”

  4. 4ieee.orgNot yet classified
    Political Bias in Large Language Models: A Comparative Analysis of ChatGPT-4, Perplexity, Google Gemini, and Claude

    Source excerpt: “The findings revealed that ChatGPT-4 and Claude exhibit a liberal bias, Perplexity is more conservative, while Google Gemini adopts more centrist stan...”

  5. 5technologyreview.comNews and mediaquality 0.91
    AI language models are rife with political biases

    Source excerpt: “Researchers conducted tests on 14 large language models and found that OpenAI’s ChatGPT and GPT-4 were the most left-wing libertarian, while Meta’s LL...”

  6. 6technologyreview.comNews and mediaquality 0.91
    AI language models are rife with political biases

    Source excerpt: “The researchers found that BERT models, AI language models developed by Google, were more socially conservative than OpenAI’s GPT models. ”

  7. 7arxiv.orgAcademic
    Language-Dependent Political Bias in AI: A Study of ChatGPT and Gemini

    Source excerpt: “The findings of the study suggest that these large language models do exhibit political tendencies, with both models demonstrating liberal and leftist...”

  8. 8arxiv.orgAcademic
    Language-Dependent Political Bias in AI: A Study of ChatGPT and Gemini

    Source excerpt: “The study also found that these political biases varied depending on the language used for inquiry. ”

  9. 9yale.eduAcademic
    AI’s hidden bias: Chatbots can influence opinions without trying

    Source excerpt: “Prior research has shown that content generated by artificial intelligence (AI) that has been prompted to be persuasive can indeed shift people’s opin...”

  10. 10yale.eduAcademic
    AI’s hidden bias: Chatbots can influence opinions without trying

    Source excerpt: “This unintended power to persuade is caused by latent biases introduced during the training of the large language models (LLM s) that drive chatbots’ ...”

  11. 11mit.eduAcademic
    Study: AI chatbots provide less-accurate information to vulnerable users

    Source excerpt: “Research from the MIT Center for Constructive Communication finds leading AI models perform worse ... MIT researchers find AI chatbots often show bia...”

  12. 12mit.eduAcademic
    Study: AI chatbots provide less-accurate information to vulnerable users

    Source excerpt: “# Study: AI chatbots provide less-accurate information to vulnerable users Research from the MIT Center for Constructive Communication finds leading A...”

  13. 13mit.eduAcademic
    Study: AI chatbots provide less-accurate information to vulnerable users

    Source excerpt: “The findings highlight growing risks, especially for marginalized communities worldwide. ”

  14. 14earth.comNews and media
    AI chatbots favor the status quo, even when change is better

    Source excerpt: “AI chatbots backed existing plans about twice as often as identical new ones, a status quo bias that can work against climate choices. ”

  15. 15earth.comNews and media
    AI chatbots favor the status quo, even when change is better

    Source excerpt: “It showed up even when switching would cost almost nothing, such as choosing whether to start an activist campaign or continue one already running. ”

  16. 16techxplore.comNews and mediaquality 0.85
    How AI bias can creep into online content moderation

    Source excerpt: “# How AI bias can creep into online content moderation A University of Queensland study has shown large language models (LLMs) used in AI content mode...”

  17. 17etcjournal.comNews and media
    AI Chatbots Are Liberal-Left ‘Biased’

    Source excerpt: “But the strongest studies also show that bias is not a single fixed trait. It varies by model, prompt, topic, language, scale, training method, guardr...”