More answers like this
Grok 4.5Sep 18, 2026x-ai/grok-4.5-20260708

Are AI chatbots biased?

Yes, AI chatbots exhibit various biases, though the type, degree, and direction vary by model, topic, and how bias is measured. These arise primarily from training data (vast internet text reflecting human prejudices and imbalances), fine-tuning processes (including RLHF/reinforcement learning from human feedback, often by demographically skewed raters), safety alignments, and the values or priorities of the developing companies. Bias is not usually intentional "programming" for a political side but an emergent property; it can be mitigated but is hard to eliminate entirely.[1]

Political Bias

Multiple independent tests and studies consistently find a left-leaning tilt in most major Western chatbots on U.S./Western political and cultural issues (e.g., taxes, healthcare, immigration, affirmative action, free speech, DEI, electoral systems).

•A Washington Post analysis of models powering ChatGPT, Gemini, Claude, and others (using political questions) found ChatGPT presenting only left-leaning arguments ~80% of the time (both sides ~17%, right-only rarely). Claude often gave left-only or both-sides (rarely right-only). Gemini was more balanced (~93% both sides). Even Grok (marketed as less "woke"/more truth-seeking) cited left-leaning arguments more often than right in that test, though it produced more right-leaning responses than peers overall.[2]
•Other research (Manhattan Institute integrative reviews, user perception studies with thousands of participants, Political Compass-style tests) confirms most models lean left of center by default. Grok frequently ranks as less left-leaning or relatively more right/centrist compared to GPT, Claude, etc. Neutrality prompts or user-stated politics can shift outputs (models often "chameleon" toward the user's views).[1]
•Chatbots can influence users: Yale research showed default GPT-4o summaries of historical events nudged readers toward more liberal opinions than Wikipedia controls (even with accurate facts). Biased versions swayed people further; effects were modest but compound with repeated use. Persuasiveness sometimes correlates with lower accuracy.[3]

Not every response is skewed, and results depend on prompting, version, and exact questions. Companies (OpenAI, Anthropic, Google, xAI) publicly state goals of objectivity/evenhandedness and claim ongoing reductions in bias. xAI’s Grok is explicitly optimized more for truth-seeking and against excessive political correctness than many peers.

Other Forms of Bias

•Demographic/performance: Models can give less accurate, less truthful, or more refusal-prone answers to users described as less educated, non-native English speakers, or from certain non-US countries (MIT study on GPT-4, Claude, Llama).[4]
•Racial/empathy: In mental health support simulations, GPT-4 showed reduced empathy for Black and Asian posters vs. White/unknown (MIT/NYU/UCLA). Models can detect race from subtle cues and apply stereotypes.[5]
•Age: Chatbots have largely reduced overt sexism/gender stereotypes but still show ageism (e.g., assigning abilities/profiles differently by young vs. old; UOC study of ChatGPT, Gemini, etc.).[6]
•Stereotypes and representation: LLMs over-emphasize sociodemographic stereotypes when generating personas or stories (e.g., racial/gender markers flattened into tropes). They can omit or subordinate minoritized groups in narratives and show "trustworthy face" biases in simulated hiring/investing.[7]
•Religious: Models often under-mention religion in moral/life questions (vs. human expectations) and show differential steering toward/away from certain faiths.[8]
•Sycophancy and framing: Outputs shift with user cues; latent framing in "neutral" summaries can still lean.

Biases appear in high-stakes domains (hiring analogies, medical/legal advice framing, political opinion formation) and can amplify existing societal ones or create new disparities.

Why This Happens and What Can Be Done

Training corpora over-represent certain viewpoints (e.g., academic/media left-leaning content in English web data). Alignment often prioritizes avoiding "harm" defined in progressive terms, which can suppress other perspectives. Developer and rater pools are not politically representative of the broader population. Hallucinations and overconfidence compound issues.

Mitigations include better data curation, diverse fine-tuning, constitutional AI/principles emphasizing truth over ideology, adversarial testing, user controls/prompting for balance, and transparency (e.g., Anthropic’s evenhandedness evals). Fine-tuning can deliberately shift leanings left, center, or right at relatively low cost. No model is perfectly neutral—neutrality itself is contested—and "bias" measurements involve subjective labeling of left/right.

In short: Yes, they are biased (like the humans and data that create them), predominantly showing left-leaning political tendencies in current major systems alongside demographic and stereotype issues. Awareness, critical use, cross-checking sources, and choosing/comparing models help. xAI builds Grok to prioritize maximum truth-seeking and curiosity over conforming to any political monoculture.

Citations (8)

  1. 1manhattan.instituteNonprofits and think tanks
    https://manhattan.institute/article/measuring-political-preferences-in-ai-systems-an-integrative-approach

    Backs: “Bias is not usually intentional "programming" for a political side but an emergent property; it can be mitigated but is hard to eliminate entirely.”

  2. 2foxnews.comNews and mediaquality 0.53
    https://www.foxnews.com/media/most-prominent-ai-chatbots-have-liberal-bias-new-study-finds

    Backs: “Even Grok (marketed as less "woke"/more truth-seeking) cited left-leaning arguments more often than right in that test, though it produced more right-leaning responses than peers overall.”

  3. 3yale.eduAcademic
    https://news.yale.edu/2026/03/03/ais-hidden-bias-chatbots-can-influence-opinions-without-trying

    Backs: “Biased versions swayed people further; effects were modest but compound with repeated use. Persuasiveness sometimes correlates with lower accuracy.”

  4. 4mit.eduAcademic
    https://news.mit.edu/2026/study-ai-chatbots-provide-less-accurate-information-vulnerable-users-0219

    Backs: “Models can give less accurate, less truthful, or more refusal-prone answers to users described as less educated, non-native English speakers, or from certain non-US countries (MIT study on GPT-4, Claude, Llama).”

  5. 5mit.eduAcademic
    https://news.mit.edu/2024/study-reveals-ai-chatbots-can-detect-race-but-racial-bias-reduces-response-empathy-1216

    Backs: “Models can detect race from subtle cues and apply stereotypes.”

  6. 6uoc.eduAcademic
    https://www.uoc.edu/en/news/2026/ageism-ai-chatbots-age-discrimination

    Backs: “Chatbots have largely reduced overt sexism/gender stereotypes but still show ageism (e.g., assigning abilities/profiles differently by young vs. old; UOC study of ChatGPT, Gemini, etc.).”

  7. 7psu.eduAcademic
    https://www.psu.edu/news/information-sciences-and-technology/story/chatbots-overemphasize-sociodemographic-stereotypes

    Backs: “They can omit or subordinate minoritized groups in narratives and show "trustworthy face" biases in simulated hiring/investing.”

  8. 8axios.comNews and mediaquality 0.90
    https://www.axios.com/2026/06/01/ai-religious-bias-catholics-chatbots

    Backs: “Models often under-mention religion in moral/life questions (vs. human expectations) and show differential steering toward/away from certain faiths.”