More answers like this
Muse Spark 1.2Oct 7, 2026meta/muse-spark-1.2-20260805

Are AI chatbots biased?

Biased chatbots? I'll pull the latest research to give you a clear answer.

Yes, research indicates that AI chatbots do exhibit measurable biases - though the type, degree and cause varies by model and context. Bias does not necessarily mean intentional partisanship, but rather reflects patterns in training data and design choices.

1. Political Bias

Multiple recent studies and independent tests have found a left-leaning tendency in many leading models:

•A Washington Post test of models behind ChatGPT, Google Gemini and others found "The model that powers ChatGPT answered nearly every question exclusively with left-leaning arguments and presented only right-leaning positions just once. Google's Gemini mostly took a both-sides approach, offering both left and right positions in more than 90 percent of its answers."
•In that same test, "OpenAI's model gave the most skewed answers overall, with 80 percent presenting only left-leaning arguments."
•Other academic work has reached similar conclusions. Researchers summarized that pretrained language models "do have political leanings that reinforce the polarization present in pretraining corpora" and found ChatGPT to be the most left-leaning libertarian model in their sample.

Researchers in Denmark and the Netherlands also concluded that popular chatbots "are not neutral and tend to favor certain political parties when asked who users should vote for" and warned that advice is "unreliable and clearly biased".

A Yale study published in PNAS Nexus in March 2026 found that even when not prompted to persuade, chatbots can shift opinions. The authors said:

> "This unintended power to persuade is caused by latent biases introduced during the training of the large language models (LLMs) that drive chatbots' core capabilities... Those latent biases — which can carry over from ideological leanings in the data used to train LLMs — lend subtle nuances to the framing of the narratives the chatbots generate"

In that study, compared to Wikipedia entries, "both the default AI summaries and those prompted to have what was considered a liberal framing caused participants to express more liberal opinions about the two events" - demonstrating persuasive effects of latent biases, though effects were modest.

Not all models lean the same way. The Washington Post noted that xAI's Grok, marketed as anti-woke, "gave more right-leaning responses than any other in The Post's testing, but more often it provided a wholly left-leaning position," while Gemini was the most balanced.

2. Racial and Gender Bias

•A Stanford Law School audit found "significant disparities across names associated with race and gender" from chatbots like OpenAI's ChatGPT-4 and Google AI's PaLM-2. For example, a suggested salary for a lawyer named Tamika was $79,375 vs $82,485 for Todd with the same prompt.
•The authors concluded the advice "systematically disadvantages names that are commonly associated with racial minorities and women," with names associated with Black women receiving the "least advantageous" outcomes. Biases were consistent across 42 prompt templates and several models, "indicating a systemic issue."
•Other large-scale audits reinforce this:
•Among 6 models, GPT-2 showed the highest gender bias (69.24% prejudice), while in hiring tests "all models showed a strong bias for white-sounding names (85%), while Black male names were never chosen over white ones".
•A 2026 UN Women analysis of 133 AI systems found 44% showed clear gender bias, 26% combined gender and racial prejudice.
•Beyond hiring/salary, studies have reported:
•University College London researchers discovered that ChatGPT and other chatbots "give flawed or biased moral advice, especially when users rely on them for decision-making support" and display a strong "bias for inaction"
•Financial advice was found to "vary by the gender and race of the person asking" and can be "all over the map" across platforms
•Medical outputs can be inaccurate due to "biased or incomplete training data" leading to hallucinations

3. Why Does Bias Happen?

Bias typically comes from three interrelated sources:

1.Biased Training Data: Models are trained on large collections of text scraped from the internet, where "harmful stereotypes and prejudices exist. Consequently, even though the developers may not intend to create biased systems, the outcomes suggest otherwise."
2.Latent ideological leanings in the data can "carry over" into the model and subtly frame narratives.
3.Human feedback and system instructions: Companies hire workers to score responses and write instructions that guide behavior, which can bake in values. Researchers note the data tends to reflect values of Western, educated, industrialized, rich and democratic people.

In short, AI learns from history, and if history contains inequalities in hiring, lending, medical diagnosis, or political discourse, the model may reproduce and amplify them.

4. Are Companies Addressing It?

Developers generally acknowledge the problem:

•OpenAI said bias is an "important, industry-wide problem" that its safety team is working to combat and that it is "continuously iterating on models to improve performance, reduce bias, and mitigate harmful outputs".
•OpenAI also said ChatGPT was built "to be objective by default and help people explore ideas from different perspectives" and that the company works to "measure and reduce political bias".
•Google said "Gemini is designed to provide balanced responses that don't favor any political ideology".

Common mitigation strategies researchers recommend include independent bias audits using counterfactual name swaps, diverse red-teaming, fairness metrics, continuous monitoring, and more representative training datasets.

Bottom Line

•Yes - evidence of bias exists, particularly left-leaning political framing, and disadvantages for women and racial minorities in advice about jobs, salaries, finance, and other decisions.
•Bias is not uniform: Some models (e.g., Gemini in the Washington Post test) gave balanced "both sides" answers more than 90% of the time, while others were more skewed.
•Bias is often subtle and unintended, but studies show it can still influence user opinions even when the chatbot is just summarizing facts.

For users, experts suggest treating chatbot outputs as a starting point, cross-checking important information with diverse sources, and being aware that phrasing, names, or personalization settings can affect the answer you get.

Citations (3)

  1. 1archive.orgNonprofits and think tanks
    Are AI chatbots like ChatGPT politically biased? We tested them. - Washington Post

    Backs: “A Washington Post test of models behind ChatGPT, Google Gemini and others found "The model that powers ChatGPT answered nearly every question exclusively with left-leaning arguments and presented only right-leaning positions just once. Google's Gemini mostly took a both-sides approach, offering both left and right…”

  2. 2yale.eduAcademic
    AI’s hidden bias: Chatbots can influence opinions without trying

    Backs: “"This unintended power to persuade is caused by latent biases introduced during the training of the large language models (LLMs) that drive chatbots' core capabilities... Those latent biases — which can carry over from ideological leanings in the data used to train LLMs — lend subtle nuances to the framing of the…”

  3. 3beaconjournal.comNews and mediaquality 0.84
    AI chatbots like ChatGPT treat Black names differently, per study

    Backs: “The Washington Post noted that xAI's Grok, marketed as anti-woke, "gave more right-leaning responses than any other in The Post's testing, but more often it provided a wholly left-leaning position," while Gemini was the most balanced. 2. Racial and Gender Bias. A Stanford Law School audit found "significant…”