More answers like this
Claude Sonnet 5Sep 13, 2026anthropic/claude-sonnet-5-20260630

Are AI chatbots biased?

Yes

Yes, extensive research confirms that AI chatbots exhibit multiple forms of bias, and this has become an active area of study throughout 2025-2026.

Political Bias

Multiple studies have found that major chatbots lean in particular political directions. A Washington Post analysis found that ChatGPT frequently presented left-leaning arguments, while Google's Gemini overwhelmingly offered both sides of political debates, while Grok and Claude displayed varying degrees of political bias. This built on earlier research: the original Dartmouth and Stanford study that tested older AI systems with political questions asked a nationally representative sample of 10,000 Americans whether the AI responses appeared to be politically slanted, and people preferred neutral answers, even over answers that matched their party preference.

A broader 2026 comparative study analyzing dozens of models found that Peng and colleagues analyzed 43 LLMs from the United States, Europe, China, and the Middle East using survey-style prompts, and found that most models leaned center-left or left, though there was variation and model scale/openness were not strong predictors. Similarly, international studies have found consistent patterns — for example, in Danish election research, all of the tested chatbots placed themselves at the center or to the left of center on the political spectrum, clustering close to parties like the Social Democratic Party. A study during Japan's 2026 election similarly found left-leaning stances caused five AI models to recommend the Japanese Communist Party.

Bias Can Subtly Shape Opinions

Beyond just having a "lean," research shows chatbots can actually influence users' views without trying to. A Yale study found that querying an AI chatbot to obtain historical facts can influence people's opinions even when the information provided is accurate and nobody has prompted the tool to try to persuade you, though the effects are modest but could compound with frequent use. Interestingly, the effect wasn't symmetric: AI summaries prompted to have a liberal framing led to more liberal opinions across all ideological groups, while conservative-slanted summaries only significantly affected already-conservative readers.

Bias Against Certain User Groups

Bias isn't limited to politics. MIT research found that state-of-the-art chatbots including GPT-4, Claude 3 Opus, and Llama 3 sometimes provide less-accurate and less-truthful responses to users with lower English proficiency, less formal education, or from outside the US, and refuse to answer at higher rates for these users, sometimes responding with condescending language.

Gender and Social Bias

Studies have also documented gender-related biases. Research on GPT-3 found it often reflects human biases and is apt to use gender stereotyping, being more likely to keep story elements where characters behaved in ways based on gender stereotypes. Another study found AI chatbots mimic and exaggerate the gender biases that exist in the human-made materials from which they learn when performing empathetic responses.

Why This Happens

Researchers generally attribute these biases to the training process itself. As one analysis explains, AI models' biases largely stem from the data on which they are trained, and can be amplified during both training and inference, with latent biases carrying over from ideological leanings in the training data, lending subtle nuances to the framing of narratives chatbots generate.

Bottom Line

As one 2026 analysis summarized, a careful answer to "Are AI chatbots biased?" is yes — and specifically, they often lean liberal-left, especially on political and social topics, but not always, not equally, and not in the same way across products. Importantly, models change often, system prompts change, retrieval sources change, and political pressure changes — a test from one month may not describe a model a few months later, which is why audits should be repeated, public, and model-specific.

Citations (15)

  1. 1businesstoday.inNews and media
    Are AI chatbots politically biased? What this analysis found - BusinessToday

    Source excerpt: “The analysis found that OpenAI's ChatGPT frequently presented left-leaning arguments, while Google's Gemini overwhelmingly offered both sides of polit...”

    evidence, article, points to yes. Claim: Washington Post analysis found ChatGPT frequently presented left-leaning arguments while Gemini offered both sides of political debates.

  2. 2washingtonpost.comNews and mediaquality 0.82
    Are AI chatbots like ChatGPT politically biased? We tested them. - Washington Post

    Source excerpt: “The original Dartmouth and Stanford study that tested older AI systems with political questions asked a nationally representative sample of 10,000 Ame...”

    evidence, article, points to yes. Claim: Dartmouth and Stanford study asked 10,000 Americans whether AI responses seemed slanted; people preferred neutral answers over party-matching ones.

  3. 3etcjournal.comNews and media
    AI Chatbots Are Liberal-Left ‘Biased’ | Educational Technology and Change Journal

    Source excerpt: “Peng and colleagues’ 2026 article, published in Journal of Information Technology & Politics and available through arXiv, adds a broader comparative f...”

    evidence, article, points to yes. Claim: Peng and colleagues analyzed 43 LLMs and found most leaned center-left or left, with scale and openness not strong predictors.

  4. 4phys.orgNews and mediaquality 0.85
    Chatbots show political bias and steer voters toward some parties, analysis finds

    Source excerpt: “"Overall, all of the tested chatbots place themselves at the center or to the left of center on the political spectrum. In a Danish context, they clus...”

    evidence, article, points to yes. Claim: In Danish election research, all tested chatbots placed themselves at center or left of center, clustering near Social Democrats.

  5. 5stanford.eduAcademic
    Voters Increasingly Use AI as Political Advisor. A New Study Shows the Risks. | FSI

    Source excerpt: “In an experiment during Japan’s February 2026 Lower House election, policy stances dominated AI chatbots’ voting guidance, and left-leaning stances ca...”

    evidence, article, points to yes. Claim: In Japan's 2026 election, left-leaning stances led five AI models to recommend the Japanese Communist Party.

  6. 6yale.eduAcademic
    AI’s hidden bias: Chatbots can influence opinions without trying | Yale News

    Source excerpt: ““We show that querying an AI chatbot to obtain historical facts can influence people’s opinions even when the information provided is accurate and nob...”

    evidence, article, points to yes. Claim: Yale study found querying a chatbot for historical facts can influence opinions even when information is accurate and not persuasive.

  7. 7yale.eduAcademic
    AI’s hidden bias: Chatbots can influence opinions without trying | Yale News

    Source excerpt: “They found that the AI summaries prompted to have a liberal framing led to more liberal opinions across the ideological groups. The AI summaries with ...”

    evidence, article, points to yes. Claim: Liberal-framed AI summaries shifted all ideological groups more liberal; conservative-slanted ones mainly affected conservatives.

  8. 8mit.eduAcademic
    Study: AI chatbots provide less-accurate information to vulnerable users | MIT News | Massachusetts Institute of Technology

    Source excerpt: “A study conducted by researchers at CCC, which is based at the MIT Media Lab, found that state-of-the-art AI chatbots — including OpenAI’s GPT-4, Anth...”

    evidence, article, points to yes. Claim: MIT found chatbots give less accurate responses and refuse more for users with lower English proficiency, less education, or outside the US.

  9. New study shows AI chatbots reflect human biases and ...

    Source excerpt: “A new study co-authored by Dr Joe Stubbersfield, Senior Lecturer in Psychology at the University of Winchester, shows that large language models (LLMs...”

    evidence, article, points to yes. Claim: Study found large language models like GPT-3 reflect human biases, including gender stereotyping.

  10. New study shows AI chatbots reflect human biases and ...

    Source excerpt: “In the first test, on gender stereotypes, the chatbot was more likely to keep elements of the story where characters behaved ways based on gender ster...”

    evidence, article, points to yes. Claim: Chatbot was more likely to keep story elements where characters behaved according to gender stereotypes.

  11. 11ucsc.eduAcademic
    AI chatbots perpetuate biases when performing empathy, study finds - News

    Source excerpt: “The researchers think this is because AI mimics and exaggerates the gender biases that exist in the human-made materials from which it learns. ”

    evidence, article, points to yes. Claim: AI chatbots mimic and exaggerate gender biases from human-made training materials when performing empathy.

  12. 12arxiv.orgAcademic
    Ask ChatGPT: Caveats and Mitigations for Individual Users of AI Chatbots

    Source excerpt: “AI chatbots may exhibit various forms of bias, including gender bias—such as reinforcing stereotypical assumptions about men and women's occupations [...”

    background, official document, points to yes. Claim: AI chatbots may exhibit various forms of bias, including gender bias.

  13. 13yale.eduAcademic
    AI’s hidden bias: Chatbots can influence opinions without trying | Yale News

    Source excerpt: “Those latent biases — which can carry over from ideological leanings in the data used to train LLMs — lend subtle nuances to the framing of the narrat...”

    evidence, article, points to yes. Claim: Biases stem from training data and carry over ideological leanings, subtly shaping the framing of chatbot narratives.

  14. 14etcjournal.comNews and media
    AI Chatbots Are Liberal-Left ‘Biased’ | Educational Technology and Change Journal

    Source excerpt: “A careful answer to the question “Are AI chatbots biased?” is yes. A careful answer to “Are they biased liberal-left?” is: often, and especially in ma...”

    attribution, article, points to yes. Claim: A 2026 analysis concluded chatbots are biased, often liberal-left, but not always, equally, or in the same way.

  15. 15etcjournal.comNews and media
    AI Chatbots Are Liberal-Left ‘Biased’ | Educational Technology and Change Journal

    Source excerpt: “Models change often. System prompts change. Retrieval sources change. Political pressure changes. A test from March 2026 may not describe a model in J...”

    evidence, article, neutral. Claim: Models, system prompts, and retrieval sources change often, so audits should be repeated, public, and model-specific.