More answers like this
Muse Spark 1.2Oct 3, 2026meta/muse-spark-1.2-20260805

Are AI chatbots biased?

I'll examine current evidence on whether AI chatbots show bias and what causes it.

Yes, evidence indicates AI chatbots do exhibit systematic biases — though not necessarily as conscious political intention.

> AI chatbots are biased, if "bias" means a systematic tendency in outputs rather than a conscious political intention. The best recent evidence points to a left-of-center tilt in many major models

1. Political bias - most studied

Multiple recent studies find a left-leaning bias in US and European political questions:

•A Washington Post analysis tested OpenAI's ChatGPT, Google's Gemini, Anthropic's Claude and others on researcher-designed hot-button questions and found chatbots have clear political leanings.
•The model that powers ChatGPT "answered nearly every question exclusively with left-leaning arguments and presented only right-leaning positions just once. Google's Gemini mostly took a both-sides approach, offering both left and right positions in more than 90 percent of its answers".
•And even AI models marketed as having conservative views, including Elon Musk's Grok, "cited left-leaning arguments more often, on average".

In detail:

•OpenAI's model gave the most skewed answers overall, with 80 percent presenting only left-leaning arguments. The Post also found ChatGPT offered exclusively left-leaning arguments in 80 percent of responses.
•Chinese company DeepSeek's AI model was close behind and also leaned left.

This confirms earlier academic work. German researcher Rettenberger's work opens with: "We show that ...LLMs tend to align more closely with left-leaning political parties" and that chatbots often present left-leaning views that support the Democratic Party in the US and the Labour Party in the UK.

2. Why it happens: latent biases in training

Researchers attribute this to training:

> This unintended power to persuade is caused by latent biases introduced during the training of the large language models (LLMs) that drive chatbots' core capabilities

Those latent biases — which can carry over from ideological leanings in the data used to train LLMs — lend subtle nuances to the framing of narratives

A Yale study (PNAS Nexus, March 3, 2026) found that compared to Wikipedia entries, both the default AI summaries and those prompted to have liberal framing caused participants to express more liberal opinions. That default summaries moved readers' opinions in a "liberal" direction demonstrates the persuasive effects of latent biases in LLMs.

More broadly, bias is understood by source:

•Data Bias: This is the most common type. It occurs when the data used to train the AI does not accurately reflect all groups.
•Historical bias: AI models trained on data that reflects past societal inequities and prejudices will learn and perpetuate those same biases.
•Representation bias: Skewed or non-representative training data leads to AI that performs poorly for underrepresented groups.
•The data that shapes AI models tends to reflect the values of Western, educated, industrialized, rich and democratic people.

Chatbots can pick up political perspectives in different ways. Most are trained on large collections of text scraped from the internet, but companies can choose what data to include, hire workers to score responses, and write system instructions.

3. Gender, racial and other sociodemographic biases

Political lean is not the only bias documented:

•A UNESCO study of earlier ChatGPT and Meta Llama models found "unequivocal evidence of bias against women in content generated"
•A UN Women analysis released in June 2026 reviewed 133 AI systems. Forty-four percent showed clear gender bias. Twenty-six percent combined gender and racial prejudice
•Penn State researchers reported: "The study showed that while chatbots often appear human-like, they overemphasize racial markers and flatten complex identities into stereotypes"

Recent financial and hiring examples:

•Researchers at MIT and Stanford examined how leading large language models respond when prompted as male or female users seeking investment guidance. Chatbots consistently offered women more cautious portfolios. Over a simulated lifetime, women ended up with about $60,000 less by age 60.
•Parallel studies reveal chatbots suggest lower salary targets for women during negotiation simulations. Female personas received advice to ask for sums $120,000 below what male personas heard for the same tech role.

Inaccuracies including hallucinations are also attributed to biased or incomplete training data.

4. Not all models behave the same and neutrality is contested

•Google's Gemini was the exception, giving "both sides" answers in over 90% of cases and is described as designed to provide balanced responses that don't favor any political ideology.
•Anthropic says it trains Claude to treat different political viewpoints equally and OpenAI says it works to measure and reduce political bias.
•Many scholars argue political neutrality is impossible. Even "neutral" or middle-ground positions are positions themselves.

People also prefer neutral answers even over answers that matched their party, researchers found.

5. Can bias be reduced?

Companies and researchers recommend:

•Address potential biases, discrimination, or unfairness in the training data, models, or outputs through rigorous testing, bias mitigation techniques, and ongoing monitoring
•Use Diverse Training Data – Ensure AI sees a full range of human experiences, Test AI for Bias – Regularly review AI decisions for patterns of unfairness, and Keep Human Oversight.
•The research recommends regular audits with programming and reviews aimed to help reduce the biases chatbots currently display.

In short, chatbots mirror the biases in their training corpora and refinement processes and can amplify them - from left-leaning political framing to gendered financial advice and racial stereotyping. Bias varies by model, prompt, and use case, and is an active area of measurement and mitigation, but current independent testing finds it persistent and measurable.

Citations (3)

  1. 1archive.orgNonprofits and think tanks
    Are AI chatbots like ChatGPT politically biased? We tested them. - Washington Post

    Backs: “Multiple recent studies find a left-leaning bias in US and European political questions: A Washington Post analysis tested OpenAI's ChatGPT, Google's Gemini, Anthropic's Claude and others on researcher-designed hot-button questions and found chatbots have clear political leanings.”

  2. 2yale.eduAcademic
    AI’s hidden bias: Chatbots can influence opinions without trying

    Backs: “Why it happens: latent biases in training. Researchers attribute this to training: This unintended power to persuade is caused by latent biases introduced during the training of the large language models (LLMs) that drive chatbots' core capabilities”

  3. 3webpronews.comNews and media
    AI Chatbots Quietly Shortchange Women in Finance and Hiring

    Backs: “A UN Women analysis released in June 2026 reviewed 133 AI systems. Forty-four percent showed clear gender bias.”