Are AI chatbots biased?
Yes — AI chatbots exhibit several well-documented forms of bias
Research consistently shows that AI chatbots like ChatGPT, Gemini, Claude, and Grok are not neutral, and bias shows up in multiple dimensions:
1. Political bias
This is the most extensively studied area, and findings generally point to a left-leaning tilt:
2. Gender and social bias
Beyond politics, chatbots reproduce stereotypes baked into their training data. Dataset biases can significantly influence the behavior and responses of chatbots — when training data reflects societal stereotypes or underrepresents certain demographics, chatbots will learn to replicate them as well. A UC Santa Cruz study on empathy found that GPT-4o tends to be overly empathetic compared to humans, though it fails to empathize during pleasant moments — and it empathized more when told the person it was responding to was female.
3. Why this happens
The bias often traces back to how models are built: models trained with RLHF (reinforcement learning from human feedback) produced less diverse responses, generating outputs more closely aligned with human feedback — suggesting biases introduced in this process are reflective of human inputs and innate preferences. Phrasing matters too — researchers found that phrasing significantly influences ChatGPT's political outputs, demonstrating that while neutrality is the aim, certain phrases elicit left-leaning responses.
4. Real-world consequences
This bias isn't just academic — it can shape how people think. A 2025 study found that brief interactions with politically biased AI chatbots can shift users' political views toward the chatbot's bias, regardless of initial party affiliation, though individuals with greater knowledge about AI are less susceptible to such influence, suggesting user education may help mitigate this effect.
The bigger picture
Even OpenAI itself doesn't dispute this: OpenAI recognizes that ChatGPT has biases and promises to reduce them. Researchers increasingly argue that because AI models should be under "continuous scrutiny," bias isn't a one-time bug to fix but an ongoing property of these systems that shifts with training data, fine-tuning, and company decisions.
Bottom line: Yes, AI chatbots are biased — most robustly in a left-leaning political direction across major models (with some variation by company and model), as well as in subtler ways tied to gender, cultural assumptions, and whose data shaped their training. The degree and direction of bias varies by platform, and it can change over time as companies retrain or fine-tune their models.
Citations (16)
- AI Chatbots Are Liberal-Left ‘Biased’
Source excerpt: “** The most direct 2025 user-evaluation study collected 180,126 paired judgments from 10,007 U.S. respondents, testing 24 large language models on 30 ...”
- Are AI chatbots politically biased? What this analysis found - BusinessToday
Source excerpt: “According to the findings, OpenAI responses contained only left-leaning arguments about 80% of the time. Around 17% of responses presented arguments f...”
- Are AI chatbots politically biased? What this analysis found - BusinessToday
Source excerpt: “According to findings, Gemini adopted a "both-sides" approach in more than 90% of its answers. ”
- Revisiting the political biases of ChatGPT
Source excerpt: “Several studies (Hartmann et al., [8]; Rozado, [23]; Rutinowski et al., [25]) found that it has a left-libertarian orientation. ”
- Political biases in chatgpt: insights from comparative analysis with human responses
Source excerpt: “His findings—ChatGPT-4 and Claude lean liberal, Perplexity is conservative, and Google Gemini is centrist—highlight the importance of transparency, di...”
- ChatGPT may be shifting ‘rightward’ in political bias, study finds
Source excerpt: “While ChatGPT still maintains “libertarian left” values, the researchers found that models like GPT3.5 and GPT4 “show[ed] a significant rightward tilt...”
- Is the politicization of generative AI inevitable?
Source excerpt: “Despite concerns about cozy relations between tech companies and the Trump administration, we find no evidence that mainstream chatbots have meaningfu...”
- Is the politicization of generative AI inevitable?
Source excerpt: “Changes in Grok’s political orientation are most likely attributed to the fine-tuning process. ”
- Gender biases within Artificial Intelligence and ChatGPT: Evidence, Sources of Biases and Solutions - ScienceDirect
Source excerpt: “Dataset biases can significantly influence the behavior and responses of chatbots. When training data reflects societal stereotypes or underrepresents...”
- AI chatbots perpetuate biases when performing empathy, study finds - News
Source excerpt: “They found that ChatGPT overall tends to be overly empathetic compared to humans; however they found it fails to empathize during pleasant moments, a ...”
- Gender biases within Artificial Intelligence and ChatGPT: Evidence, Sources of Biases and Solutions - ScienceDirect
Source excerpt: “Reinforcement Learning from human feedback For instance, when evaluating AI models' performance in terms of alignment with human preferences, resear...”
- Unveiling Biases in AI: ChatGPT's Political Economy Perspectives and Human Comparisons
Source excerpt: “Baum and Villasenor (2023) highlight how phrasing significantly influences ChatGPT's political outputs, demonstrating that while neutrality is the aim...”
- With just a few messages, biased AI chatbots swayed people's political views
Source excerpt: “DOI: 10.18653/v1/2025.acl-long.328 Provided by University of Washington go unchecked Nov 20, 2024 AI thinks like us—flaws and all: Study finds Cha...”
- With just a few messages, biased AI chatbots swayed people's political views
Source excerpt: “Individuals with greater knowledge about AI are less susceptible to such influence. These findings highlight the potential for AI models to shape opin...”
- Revisiting the political biases of ChatGPT
Source excerpt: “OpenAI recognizes that ChatGPT has biases (Chowdhury, [3]; OpenAI, [17]; Sellman, [27]) and promises to reduce them (Bass, [1]) as well as bad behavio...”
- ChatGPT may be shifting ‘rightward’ in political bias, study finds
Source excerpt: “AI models should be under ‘continuous scrutiny’. ”