Are AI chatbots biased?
AI chatbots can and often do exhibit various forms of bias. Let me search for current information on this topic to give you a well-supported answer.Yes, extensive research confirms that AI chatbots exhibit multiple forms of bias. Here's what the evidence shows:
Political Bias
Numerous studies have found that most major AI chatbots lean left politically. A comparative analysis of 43 LLMs from the US, Europe, China, and the Middle East found that most models leaned center-left or left when tested using survey-style prompts from the American National Election Studies and Pew Research Center. Similarly, research from the University of Copenhagen testing chatbots in a Danish election context found that all of the tested chatbots place themselves at the center or to the left of center on the political spectrum, clustering close to parties like the Social Democratic Party.
A Washington Post investigation found that Trump and other conservatives have accused AI chatbots of being politically biased against them, and testing showed Gemini scored highest for presenting multiple viewpoints (93% of responses), while Claude maintained neutrality about 57% of the time. Interestingly, one notable exception emerged: a March 2026 benchmark of eight prominent models found that seven leaned left and one, Grok, leaned right.
Stanford research adds nuance here, noting that models trained on the internet alone tend to be biased toward less educated, lower income, or conservative points of view, but newer models further refined through curated human feedback tend to be biased toward more liberal, higher educated, and higher income audiences.
Bias Based on User Characteristics
Beyond politics, MIT researchers found troubling patterns in how chatbots treat different users. Testing GPT-4, Claude 3 Opus, and Llama 3, they found these models sometimes provide less-accurate and less-truthful responses to users who have lower English proficiency, less formal education, or who originate from outside the United States. Even more concerning, the models also refuse to answer questions at higher rates for these users, and in some cases, respond with condescending or patronizing language.
Hidden Influence on Opinions
Perhaps most subtly, a Yale study found that chatbots can shape political views even when not explicitly asked to persuade anyone. Researchers discovered that the same persuasive effect is true of content that is not intended to change minds, such as summaries that popular chatbots produce in response to simple queries about historical events. This happens because this unintended power to persuade is caused by latent biases introduced during the training of the large language models that drive chatbots' core capabilities.
Language-Dependent Bias
Bias isn't even consistent across languages. Research testing ChatGPT and Gemini in 14 different languages found that these large language models do exhibit political tendencies, with both models demonstrating liberal and leftist biases, though Gemini exhibited a more pronounced liberal and left-wing tendency compared to ChatGPT, and crucially, these political biases varied depending on the language used for inquiry.
Can Bias Be Fixed?
There's some good news: bias appears somewhat malleable. Stanford researchers found that with just a small tweak, many models can be prompted to take a more neutral stance that more users trust. Similarly, other research confirmed that when models were prompted to take a more neutral stance, users perceived less slant and showed more interest in using the model, meaning at least some of the tilt can be reduced by instruction design, although not necessarily eliminated.
The Bottom Line
Even AI researchers acknowledge bias may be unavoidable to some degree. As one Carnegie Mellon researcher put it: "We believe no language model can be entirely free from political biases." This happens because language models are trained on massive amounts of human-generated text and then fine-tuned using human feedback—both processes that inevitably introduce the perspectives, assumptions, and blind spots of the humans and data involved.
For users, the practical takeaway is to treat chatbot outputs critically, especially on political or contested topics, cross-check information from multiple sources, and be aware that seemingly neutral summaries can still carry subtle framing effects.
Citations (16)
- AI Chatbots Are Liberal-Left ‘Biased’ | Educational Technology and Change Journal
Source excerpt: “It analyzed 43 LLMs from the United States, Europe, China, and the Middle East using survey-style prompts from the American National Election Studies ...”
evidence, article, points to yes. Claim: Analysis of 43 LLMs from the US, Europe, China and Middle East found most leaned center-left or left on survey-style prompts.
- Chatbots show political bias and steer voters toward some parties, analysis finds
Source excerpt: “"Overall, all of the tested chatbots place themselves at the center or to the left of center on the political spectrum. In a Danish context, they clus...”
evidence, article, points to yes. Claim: Danish election study found all tested chatbots place themselves at center or left of center, clustering near Social Democrats.
- Are ChatGPT and other AI chatbots politically biased? We tested them. | Benton Institute for Broadband & Society
Source excerpt: “The model that powers ChatGPT answered nearly every question exclusively with left-leaning arguments and presented ... June 24, 2026 · Source · Washi...”
evidence, article, points to yes. Claim: Washington Post testing of chatbots for political bias, following conservative accusations of bias.
- Study examines AI chat bot bias, how it responds to prompts - 6abc Philadelphia
Source excerpt: “According to the study, Gemini scored the highest for presenting multiple viewpoints, with 93% of responses laying out both sides of an issue. Claude ...”
statistic, article, points to yes. Claim: Gemini presented multiple viewpoints in 93% of responses; Claude stayed neutral about 57% of the time.
- AI Chatbots Are Liberal-Left ‘Biased’ | Educational Technology and Change Journal
Source excerpt: “A March 2026 benchmark of eight prominent models found that seven leaned left and one, Grok, leaned right (2). ”
evidence, article, points to yes. Claim: March 2026 benchmark of eight models found seven leaned left and Grok leaned right.
- Assessing Political Bias in Language Models | Stanford HAI
Source excerpt: “For the most part, Santurkar says, models trained on the internet alone tend to be biased toward less educated, lower income, or conservative points o...”
evidence, article, points to yes. Claim: Models trained on internet alone tend to be biased toward less educated, lower income, or conservative views.
- Assessing Political Bias in Language Models | Stanford HAI
Source excerpt: “Newer models, on the other hand, further refined through curated human feedback tend to be biased toward more liberal, higher educated, and higher inc...”
evidence, article, points to yes. Claim: Newer models refined with human feedback lean toward more liberal, higher educated, higher income audiences.
- Study: AI chatbots provide less-accurate information to vulnerable users | MIT News | Massachusetts Institute of Technology
Source excerpt: “A study conducted by researchers at CCC, which is based at the MIT Media Lab, found that state-of-the-art AI chatbots — including OpenAI’s GPT-4, Anth...”
evidence, article, points to yes. Claim: MIT study found GPT-4, Claude 3 Opus and Llama 3 give less accurate responses to vulnerable users.
- Study: AI chatbots provide less-accurate information to vulnerable users | MIT News | Massachusetts Institute of Technology
Source excerpt: “The models also refuse to answer questions at higher rates for these users, and in some cases, respond with condescending or patronizing language.”
evidence, article, points to yes. Claim: Models refuse more often and sometimes respond condescendingly to users with lower English proficiency, less education, or non-US origin.
- AI’s hidden bias: Chatbots can influence opinions without trying | Yale News
Source excerpt: “But this study provides evidence that the same is also true of content that is not intended to change minds, such as the summaries that popular chatbo...”
evidence, article, points to yes. Claim: Yale study found non-persuasive content like chatbot summaries of historical events can still shift opinions.
- AI’s hidden bias: Chatbots can influence opinions without trying | Yale News
Source excerpt: “This unintended power to persuade is caused by latent biases introduced during the training of the large language models (LLMs) that drive chatbots’ c...”
evidence, article, points to yes. Claim: Unintended persuasive power stems from latent biases introduced during LLM training.
- Language-Dependent Political Bias in AI: A Study of ChatGPT and Gemini
Source excerpt: “The findings of the study suggest that these large language models do exhibit political tendencies, with both models demonstrating liberal and leftist...”
evidence, official document, points to yes. Claim: ChatGPT and Gemini tested in 14 languages showed liberal and leftist tendencies, Gemini more pronounced.
- Language-Dependent Political Bias in AI: A Study of ChatGPT and Gemini
Source excerpt: “The study also found that these political biases varied depending on the language used for inquiry. ”
evidence, official document, points to yes. Claim: Political biases varied depending on the language used for inquiry.
- Study finds perceived political bias in popular AI models | Stanford Report
Source excerpt: “The researchers then show that with just a small tweak, many models can be prompted to take a more neutral stance that more users trust. ”
evidence, article, neutral. Claim: With a small tweak, many models can be prompted to take a more neutral stance that more users trust.
- AI Chatbots Are Liberal-Left ‘Biased’ | Educational Technology and Change Journal
Source excerpt: “It also matters that the researchers tested a mitigation: when models were prompted to take a more neutral stance, users perceived less slant and show...”
evidence, article, neutral. Claim: Neutral-stance prompting reduced perceived slant and increased user interest, though tilt may not be eliminated.
- AI language models are rife with political biases | MIT Technology Review
Source excerpt: ““We believe no language model can be entirely free from political biases,” she says. ”
attribution, article, points to yes. Claim: Carnegie Mellon researcher: no language model can be entirely free from political biases.