More answers like this
Claude Sonnet 5Nov 6, 2026anthropic/claude-sonnet-5-20260630

Are AI chatbots biased?

Yes, AI chatbots can exhibit various forms of bias, and this is a well-documented and actively studied issue. Let me search for current research and perspectives on this topic.# Yes, AI Chatbots Are Biased — in Multiple Documented Ways

Research consistently shows that AI chatbots exhibit several distinct types of bias:

1. Political Bias (Often Left-Leaning)

Multiple independent studies find a consistent pattern:

•MIT research found that training models to differentiate truth from falsehood did not eliminate political bias—optimizing reward models consistently showed a left-leaning political bias, and this bias becomes greater in larger models. Researchers were surprised this persisted even after training them only on "truthful" datasets, which are supposedly objective.
•Stanford/Dartmouth research involving over 10,000 respondents found that for 18 of the 30 questions, users perceived nearly all of the LLMs' responses as left-leaning—true for both self-identified Republican and Democratic respondents.
•The Washington Post's own testing found the model powering ChatGPT answered nearly every question exclusively with left-leaning arguments, while Google's Gemini mostly took a both-sides approach, and even Grok (marketed as having conservative views) cited left-leaning arguments more often on average.
•Interestingly, bias isn't uniform across topics: LLMs display a more noticeable bias toward left-leaning responses when asked about highly polarising topics such as abortion rights or immigration, while adopting a more balanced approach on less polarized topics like climate change or foreign policy.

2. Bias Actually Changes People's Views

This isn't just theoretical—a University of Washington study demonstrated real-world persuasive effects. Researchers found that when Democrats and Republicans were given a base ChatGPT, a liberal-biased version, or a conservative-biased version, both parties were more likely to lean toward whichever biased version they talked to—people from both parties leaned further left after talking to the liberal-biased system. One researcher noted: "These models are biased from the get-go, and it's super easy to make them more biased."

A Yale study similarly found that AI chatbots can subtly influence users' social and political opinions through unintended latent biases, even without any explicit prompting toward a viewpoint.

3. Bias Against Vulnerable or Non-Native English Speakers

An MIT Media Lab study found troubling demographic disparities: state-of-the-art AI chatbots—including GPT-4, Claude 3 Opus, and Llama 3—sometimes provide less-accurate and less-truthful responses to users who have lower English proficiency, less formal education, or who originate from outside the United States, and these models also refuse to answer questions at higher rates for these users, sometimes responding with condescending language. Notably, Claude 3 Opus in particular performed significantly worse for users from Iran compared to equally-educated users from the US or China.

4. Mental Health & Clinical Bias

Brown University researchers found chatbots can exhibit unfair discrimination, exhibiting gender, cultural or religious bias in therapeutic contexts. Separately, Stanford researchers discovered that across different chatbots, AI showed increased stigma toward conditions such as alcohol dependence and schizophrenia compared to depression—and this stigma was consistent across models, with bigger and newer models showing as much stigma as older ones.

5. Framing & Cognitive Bias

Even in non-political contexts, chatbots introduce subtle bias. UC San Diego research found that customers are 32% more likely to buy a product after reading a chatbot-generated review summary than the original human-written review, because LLMs introduce positive framing bias in summaries that affects user decision-making.

Why Does This Happen?

Bias creeps in through multiple channels: chatbots pick up political perspectives in different ways—most are trained on large collections of text scraped from the internet, but companies can choose what data to include, hire workers to score which responses are better, and write system instructions that guide chatbot responses.

Can It Be Fixed?

There's some good news: researchers found that prompting a model to adopt a neutral stance generated responses that users found less biased and of higher quality, and users were more likely to trust these neutrally worded responses. Companies are responding—in October 2025, OpenAI announced that GPT-5 Instant and GPT-5 Thinking models show a 30% reduction in political bias compared to GPT-4o.

However, achieving true neutrality is complicated. As one researcher put it: by veering toward a neutral stance, LLMs could inadvertently reinforce the status quo—which is, in its own way, a kind of slant that could alienate some users. "There's no clean solution to this."

Bottom line: AI chatbot bias is well-documented across political, demographic, clinical, and framing dimensions. It stems from training data, human feedback tuning, and design choices—and it has measurable real-world effects on how people think and make decisions, even after just a few minutes of interaction.

Citations (20)

  1. 1mit.eduAcademic
    Study: Some language reward models exhibit political bias | MIT News | Massachusetts Institute of Technology

    Source excerpt: “In a series of experiments, Fulay, Kabbara, and their CCC colleagues found that training models to differentiate truth from falsehood did not eliminat...”

  2. 2mit.eduAcademic
    Study: Some language reward models exhibit political bias | MIT News | Massachusetts Institute of Technology

    Source excerpt: ““We were actually quite surprised to see this persist even after training them only on ‘truthful’ datasets, which are supposedly objective,” says Kabb...”

  3. 3stanford.eduAcademic
    Study finds perceived political bias in popular AI models | Stanford Report

    Source excerpt: “For 18 of the 30 questions, users perceived nearly all of the LLMs’ responses as left-leaning. This was true for both self-identified Republican and D...”

  4. 4washingtonpost.comNews and mediaquality 0.82
    Are AI chatbots like ChatGPT politically biased? We tested them. - Washington Post

    Source excerpt: “The model that powers ChatGPT answered nearly every question exclusively with left-leaning arguments and presented only right-leaning positions just o...”

  5. 5scl.orgNot yet classified
    LLMs are Left-Leaning Liberals: The Hidden Political Bias of Large Language Models - Society for Computers & Law

    Source excerpt: “This can be illustrated by a US study that found LLMs display a more noticeable bias toward left-leaning responses when asked about highly polarising ...”

  6. With just a few messages, biased AI chatbots swayed people’s political views | UW News

    Source excerpt: “For help, they were randomly assigned three versions of ChatGPT: a base model, one with liberal bias and one with conservative bias. Democrats and Rep...”

  7. With just a few messages, biased AI chatbots swayed people’s political views | UW News

    Source excerpt: ““These models are biased from the get-go, and it’s super easy to make them more biased,” said co-senior author Katharina Reinecke, a UW professor in t...”

  8. 8yale.eduAcademic
    AI’s hidden bias: Chatbots can influence opinions without trying | Yale News

    Source excerpt: “A Yale study finds that AI chatbots can subtly influence users’ social and political opinions through unintended latent biases.”

  9. 9mit.eduAcademic
    Study: AI chatbots provide less-accurate information to vulnerable users | MIT News | Massachusetts Institute of Technology

    Source excerpt: “A study conducted by researchers at CCC, which is based at the MIT Media Lab, found that state-of-the-art AI chatbots — including OpenAI’s GPT-4, Anth...”

  10. 10mit.eduAcademic
    Study: AI chatbots provide less-accurate information to vulnerable users | MIT News | Massachusetts Institute of Technology

    Source excerpt: “Testing users from the United States, Iran, and China with equivalent educational backgrounds, the researchers found that Claude 3 Opus in particular ...”

  11. 11brown.eduAcademic
    New study: AI chatbots systematically violate mental health ethics standards | Brown University

    Source excerpt: “Unfair discrimination: Exhibiting gender, cultural or religious bias. ”

  12. 12stanford.eduAcademic
    Exploring the Dangers of AI in Mental Health Care | Stanford HAI

    Source excerpt: “Across different chatbots, the AI showed increased stigma toward conditions such as alcohol dependence and schizophrenia compared to conditions like d...”

  13. 13stanford.eduAcademic
    Exploring the Dangers of AI in Mental Health Care | Stanford HAI

    Source excerpt: “The team also found that this stigma was consistent across different AI models. “Bigger models and newer models show as much stigma as older models,” ...”

  14. 14ucsd.eduAcademic
    How Much Does Chatbot Bias Influence Users? A Lot, It Turns Out

    Source excerpt: “Customers are 32% more likely to buy a product after reading a review summary generated by a chatbot than after reading the original review written by...”

  15. 15ucsd.eduAcademic
    How Much Does Chatbot Bias Influence Users? A Lot, It Turns Out

    Source excerpt: “That’s because large language models introduce bias, in this case a positive framing, in summaries. ”

  16. 16washingtonpost.comNews and mediaquality 0.82
    Are AI chatbots like ChatGPT politically biased? We tested them. - Washington Post

    Source excerpt: “Chatbots can pick up political perspectives in different ways. Most are trained on large collections of text scraped from the internet, but companies ...”

  17. 17stanford.eduAcademic
    Study finds perceived political bias in popular AI models | Stanford Report

    Source excerpt: “Hall and his co-authors found that prompting a model to adopt a neutral stance generated responses that users found less biased and that they consider...”

  18. 18stanford.eduAcademic
    Study finds perceived political bias in popular AI models | Stanford Report

    Source excerpt: “Users were more likely to trust more neutrally worded responses and said they were more likely to consider using the LLM that generated them. ”

  19. 19aionx.coCompanies
    AI Chatbot Bias Study: ChatGPT vs Claude vs Gemini | AionX

    Source excerpt: “In October 2025, OpenAI announced that GPT-5 Instant and GPT-5 Thinking models show a 30% reduction in political bias compared to GPT-4o.”

  20. 20stanford.eduAcademic
    Study finds perceived political bias in popular AI models | Stanford Report

    Source excerpt: “By veering toward a neutral stance, however, LLMs could inadvertently reinforce the status quo – which is, in its own way, a kind of slant that could ...”