More answers like this
Claude Sonnet 5Oct 17, 2026anthropic/claude-sonnet-5-20260630

Are AI chatbots biased?

Yes, AI chatbots do show measurable biases — and research into this has grown rapidly

Multiple independent studies confirm that AI chatbots exhibit biases, with political bias being the most extensively studied area.

Political/Ideological Bias

Research consistently finds a left-leaning tilt across most major chatbots:

•A Washington Post analysis found OpenAI's ChatGPT showed left-leaning bias 80% of the time, while testing other tools too. Breaking this down further, OpenAI responses contained only left-leaning arguments about 80% of the time, while around 17% presented both sides, and only about 3% contained exclusively right-leaning viewpoints.
•Gemini performed differently: Gemini scored the highest for presenting multiple viewpoints, with 93% of responses laying out both sides of an issue. Meanwhile Claude maintained neutrality more than half of the time, at 57%.
•A large academic study reinforced this pattern: 24 LLMs were tested across 30 political prompts with over 10,000 U.S. respondents and 180,126 judgments, finding nearly all models perceived as significantly left-leaning, with one widely used model leaning left on 24 of 30 topics. A more recent "PoliticsBench" study found testing eight prominent LLMs—Claude, DeepSeek, Gemini, GPT, Grok, Llama, Qwen Base, and Qwen Instruction-Tuned—found seven of the eight models leaned left, while Grok leaned right.
•Academic economics research found a concerning misalignment of values between ChatGPT and the average American, with ChatGPT displaying political leanings when generating text and images, though the degree and direction of skew depend on the theme.

Bias Can Influence Real Opinions — Not Just Reflect Them

This isn't just academic: studies show chatbot bias actively shapes what people believe.

•A University of Washington study found that politically biased chatbots could nudge Democrats and Republicans toward opposing viewpoints, and that bias embedded in large language models can unknowingly influence people's opinions, potentially affecting voting and policy decisions.
•Even more striking, large-scale election research found that chatting with a politically biased AI model was more effective than political advertisements at nudging both Democrats and Republicans to support presidential candidates of the opposing party. Concerningly, the chatbots swayed opinions by citing facts and evidence, but they were not always accurate—the most persuasive models said the most untrue things. In concrete terms, Trump supporters who chatted with an AI model favoring Kamala Harris moved 3.9 points toward her on a 100-point scale — roughly four times the measured effect of political advertisements during the 2016 and 2020 elections.
•Perhaps most unsettling, a Yale study found bias emerges even without any intent to persuade: content that is not intended to change minds, such as summaries chatbots produce in response to simple factual queries, can still shift people's opinions. This happens because latent biases introduced during training of the LLMs that drive chatbots can carry over from ideological leanings in the training data, lending subtle nuances to the framing of generated narratives.

Bias Isn't Just Political

Research has also identified non-political forms of bias:

•A University of Waterloo study of 11 LLMs across nearly 55,000 prompts found large language models default to legacy high-carbon options over sustainable green alternatives due to algorithmic status quo bias, consistently recommending existing, high-emission choices over innovative, climate-friendly alternatives. Notably, this bias was most pronounced in political and civic governance scenarios.
•Confirmation bias is another documented issue, where confirmation bias—the tendency to seek information that aligns with existing beliefs—can be replicated and amplified by the design and functioning of large language models.

Why This Happens & What Can Be Done

Researchers trace the root cause to training data: biases often occur because the software absorbs the subtle opinions and language patterns present in the millions of internet pages it reads.

The good news is that bias can be mitigated. Stanford research found that prompting a model to adopt a neutral stance generated responses that users found less biased and that they considered to be higher quality. Similarly, the Washington Post study noted that when models were prompted to take a more neutral stance, users perceived less slant and showed more interest in using the model.

Bottom Line

The evidence strongly suggests AI chatbots are not neutral — they carry measurable biases (mostly left-leaning on political/social topics, and status-quo-favoring on practical recommendations), these biases can be amplified by training choices or explicit prompting, and they can meaningfully shift users' real-world opinions — sometimes even when the chatbot isn't trying to persuade at all. However, bias varies significantly by model, topic, and how the AI is prompted, and transparency/neutral-prompting strategies can reduce — though not eliminate — these effects.

Citations (20)

  1. 1foxnews.comNews and mediaquality 0.53
    AI chatbots show left-leaning bias in study of ChatGPT, Gemini, Claude

    Source excerpt: “The Washington Post published a report Wednesday that tested popular AI tools like OpenAI's ChatGPT, Google's Gemini and Anthropic's Claude, ... Open...”

  2. 2businesstoday.inNews and media
    Are AI chatbots politically biased? What this analysis found - BusinessToday

    Source excerpt: “According to the findings, OpenAI responses contained only left-leaning arguments about 80% of the time. Around 17% of responses presented arguments f...”

  3. 36abc.comNews and mediaquality 0.77
    Study examines AI chat bot bias, how it responds to prompts - 6abc Philadelphia

    Source excerpt: “According to the study, Gemini scored the highest for presenting multiple viewpoints, with 93% of responses laying out both sides of an issue. ”

  4. 46abc.comNews and mediaquality 0.77
    Study examines AI chat bot bias, how it responds to prompts - 6abc Philadelphia

    Source excerpt: “Claude maintained neutrality more than half of the time, at 57%. ”

  5. 5etcjournal.comNews and media
    AI Chatbots Are Liberal-Left ‘Biased’

    Source excerpt: “### Key recent findings Study or report · Scope · Main statistic or result · What it means Westwood, Grimmer, and Hall, 2025 · 24 LLMs, 30 political p...”

  6. 6etcjournal.comNews and media
    AI Chatbots Are Liberal-Left ‘Biased’

    Source excerpt: “It tested eight prominent LLMs: Claude, DeepSeek, Gemini, GPT, Grok, Llama, Qwen Base, and Qwen Instruction-Tuned. ”

  7. 7etcjournal.comNews and media
    AI Chatbots Are Liberal-Left ‘Biased’

    Source excerpt: “The authors reported that seven of the eight models leaned left, while Grok leaned right. ”

  8. Assessing political bias and value misalignment in generative artificial intelligence - ScienceDirect

    Source excerpt: “Our analysis reveals a concerning misalignment of values between ChatGPT and the average American. We also show that ChatGPT displays political leanin...”

  9. 9geekwire.comNot yet classified
    UW study: Politically persuasive AI chatbots offer potential benefits — and worrying influence

    Source excerpt: “New research from the University of Washington found that politically biased chatbots could nudge Democrats and Republicans toward opposing viewpoints...”

  10. 10technologyreview.comNews and mediaquality 0.91
    AI chatbots can sway voters better than political advertisements

    Source excerpt: “December 4, 2025 A multi-university team of researchers has found that chatting with a politically biased AI model was more effective than political ...”

  11. 11technologyreview.comNews and mediaquality 0.91
    AI chatbots can sway voters better than political advertisements

    Source excerpt: “The chatbots swayed opinions by citing facts and evidence, but they were not always accurate—in fact, the researchers found, the most persuasive model...”

  12. 12technologyreview.comNews and mediaquality 0.91
    AI chatbots can sway voters better than political advertisements

    Source excerpt: “Donald Trump supporters who chatted with an AI model favoring Kamala Harris became slightly more inclined to support Harris, moving 3.9 points toward ...”

  13. 13yale.eduAcademic
    AI’s hidden bias: Chatbots can influence opinions without trying

    Source excerpt: “But this study provides evidence that the same is also true of content that is *not* intended to change minds, such as the summaries that popular chat...”

  14. 14yale.eduAcademic
    AI’s hidden bias: Chatbots can influence opinions without trying

    Source excerpt: “This unintended power to persuade is caused by latent biases introduced during the training of the large language models (LLM s) that drive chatbots’ ...”

  15. 15neurosciencenews.comNot yet classified
    AI Chatbots Are Hardwired to Defend the Status Quo - Neuroscience News

    Source excerpt: “Large language models default to legacy high-carbon options over sustainable green alternatives due to algorithmic status quo bias. # AI Chatbots Are...”

  16. 16neurosciencenews.comNot yet classified
    AI Chatbots Are Hardwired to Defend the Status Quo - Neuroscience News

    Source excerpt: “### Evaluating 55,000 Prompts Across 11 Language Models The bias was most pronounced in political and civic governance scenarios.”

  17. 17arxiv.orgAcademic
    Confirmation Bias in Generative AI Chatbots: Mechanisms, Risks, Mitigation Strategies, and Future Research Directions

    Source excerpt: “Drawing on cognitive psychology and computational linguistics, it examines how confirmation bias—commonly understood as the tendency to seek informati...”

  18. 18psypost.orgNews and mediaquality 0.84
    Relying on AI chatbots for historical facts can influence your political beliefs, new study shows

    Source excerpt: “It often occurs because the software absorbs the subtle opinions and language patterns present in the millions of internet pages it reads. ”

  19. 19stanford.eduAcademic
    Popular AI Models Show Partisan Bias When Asked to Talk Politics

    Source excerpt: “## Finding Bias and Balance Hall and his coauthors found that prompting an model to adopt a neutral stance generated responses that users found less b...”

  20. 20etcjournal.comNews and media
    AI Chatbots Are Liberal-Left ‘Biased’

    Source excerpt: “It also matters that the researchers tested a mitigation: when models were prompted to take a more neutral stance, users perceived less slant and show...”