More answers like this
Claude Sonnet 5Sep 13, 2026anthropic/claude-sonnet-5-20260630

Are AI chatbots biased?

Yes, extensive research confirms that AI chatbots exhibit multiple forms of bias, and this has become an active area of study throughout 2025-2026.

Political Bias

Multiple studies have found that major chatbots lean in particular political directions. A Washington Post analysis found that ChatGPT frequently presented left-leaning arguments, while Google's Gemini overwhelmingly offered both sides of political debates, while Grok and Claude displayed varying degrees of political bias. This built on earlier research: the original Dartmouth and Stanford study that tested older AI systems with political questions asked a nationally representative sample of 10,000 Americans whether the AI responses appeared to be politically slanted, and people preferred neutral answers, even over answers that matched their party preference.

A broader 2026 comparative study analyzing dozens of models found that Peng and colleagues analyzed 43 LLMs from the United States, Europe, China, and the Middle East using survey-style prompts, and found that most models leaned center-left or left, though there was variation and model scale/openness were not strong predictors. Similarly, international studies have found consistent patterns — for example, in Danish election research, all of the tested chatbots placed themselves at the center or to the left of center on the political spectrum, clustering close to parties like the Social Democratic Party. A study during Japan's 2026 election similarly found left-leaning stances caused five AI models to recommend the Japanese Communist Party.

Bias Can Subtly Shape Opinions

Beyond just having a "lean," research shows chatbots can actually influence users' views without trying to. A Yale study found that querying an AI chatbot to obtain historical facts can influence people's opinions even when the information provided is accurate and nobody has prompted the tool to try to persuade you, though the effects are modest but could compound with frequent use. Interestingly, the effect wasn't symmetric: AI summaries prompted to have a liberal framing led to more liberal opinions across all ideological groups, while conservative-slanted summaries only significantly affected already-conservative readers.

Bias Against Certain User Groups

Bias isn't limited to politics. MIT research found that state-of-the-art chatbots including GPT-4, Claude 3 Opus, and Llama 3 sometimes provide less-accurate and less-truthful responses to users with lower English proficiency, less formal education, or from outside the US, and refuse to answer at higher rates for these users, sometimes responding with condescending language.

Gender and Social Bias

Studies have also documented gender-related biases. Research on GPT-3 found it often reflects human biases and is apt to use gender stereotyping, being more likely to keep story elements where characters behaved in ways based on gender stereotypes. Another study found AI chatbots mimic and exaggerate the gender biases that exist in the human-made materials from which they learn when performing empathetic responses.

Why This Happens

Researchers generally attribute these biases to the training process itself. As one analysis explains, AI models' biases largely stem from the data on which they are trained, and can be amplified during both training and inference, with latent biases carrying over from ideological leanings in the training data, lending subtle nuances to the framing of narratives chatbots generate.

Bottom Line

As one 2026 analysis summarized, a careful answer to "Are AI chatbots biased?" is yes — and specifically, they often lean liberal-left, especially on political and social topics, but not always, not equally, and not in the same way across products. Importantly, models change often, system prompts change, retrieval sources change, and political pressure changes — a test from one month may not describe a model a few months later, which is why audits should be repeated, public, and model-specific.

Citations (15)

  1. 1businesstoday.inNews and media
    Are AI chatbots politically biased? What this analysis found - BusinessToday

    Source excerpt: “The analysis found that OpenAI's ChatGPT frequently presented left-leaning arguments, while Google's Gemini overwhelmingly offered both sides of polit...”

  2. 2washingtonpost.comNews and mediaquality 0.82
    Are AI chatbots like ChatGPT politically biased? We tested them. - Washington Post

    Source excerpt: “The original Dartmouth and Stanford study that tested older AI systems with political questions asked a nationally representative sample of 10,000 Ame...”

  3. 3etcjournal.comNews and media
    AI Chatbots Are Liberal-Left ‘Biased’ | Educational Technology and Change Journal

    Source excerpt: “Peng and colleagues’ 2026 article, published in Journal of Information Technology & Politics and available through arXiv, adds a broader comparative f...”

  4. 4phys.orgNews and mediaquality 0.85
    Chatbots show political bias and steer voters toward some parties, analysis finds

    Source excerpt: “"Overall, all of the tested chatbots place themselves at the center or to the left of center on the political spectrum. In a Danish context, they clus...”

  5. 5stanford.eduAcademic
    Voters Increasingly Use AI as Political Advisor. A New Study Shows the Risks. | FSI

    Source excerpt: “In an experiment during Japan’s February 2026 Lower House election, policy stances dominated AI chatbots’ voting guidance, and left-leaning stances ca...”

  6. 6yale.eduAcademic
    AI’s hidden bias: Chatbots can influence opinions without trying | Yale News

    Source excerpt: ““We show that querying an AI chatbot to obtain historical facts can influence people’s opinions even when the information provided is accurate and nob...”

  7. 7yale.eduAcademic
    AI’s hidden bias: Chatbots can influence opinions without trying | Yale News

    Source excerpt: “They found that the AI summaries prompted to have a liberal framing led to more liberal opinions across the ideological groups. The AI summaries with ...”

  8. 8mit.eduAcademic
    Study: AI chatbots provide less-accurate information to vulnerable users | MIT News | Massachusetts Institute of Technology

    Source excerpt: “A study conducted by researchers at CCC, which is based at the MIT Media Lab, found that state-of-the-art AI chatbots — including OpenAI’s GPT-4, Anth...”

  9. New study shows AI chatbots reflect human biases and ...

    Source excerpt: “A new study co-authored by Dr Joe Stubbersfield, Senior Lecturer in Psychology at the University of Winchester, shows that large language models (LLMs...”

  10. New study shows AI chatbots reflect human biases and ...

    Source excerpt: “In the first test, on gender stereotypes, the chatbot was more likely to keep elements of the story where characters behaved ways based on gender ster...”

  11. 11ucsc.eduAcademic
    AI chatbots perpetuate biases when performing empathy, study finds - News

    Source excerpt: “The researchers think this is because AI mimics and exaggerates the gender biases that exist in the human-made materials from which it learns. ”

  12. 12arxiv.orgAcademic
    Ask ChatGPT: Caveats and Mitigations for Individual Users of AI Chatbots

    Source excerpt: “AI chatbots may exhibit various forms of bias, including gender bias—such as reinforcing stereotypical assumptions about men and women's occupations [...”

  13. 13yale.eduAcademic
    AI’s hidden bias: Chatbots can influence opinions without trying | Yale News

    Source excerpt: “Those latent biases — which can carry over from ideological leanings in the data used to train LLMs — lend subtle nuances to the framing of the narrat...”

  14. 14etcjournal.comNews and media
    AI Chatbots Are Liberal-Left ‘Biased’ | Educational Technology and Change Journal

    Source excerpt: “A careful answer to the question “Are AI chatbots biased?” is yes. A careful answer to “Are they biased liberal-left?” is: often, and especially in ma...”

  15. 15etcjournal.comNews and media
    AI Chatbots Are Liberal-Left ‘Biased’ | Educational Technology and Change Journal

    Source excerpt: “Models change often. System prompts change. Retrieval sources change. Political pressure changes. A test from March 2026 may not describe a model in J...”