Are AI chatbots biased?

AI chatbots can and often do exhibit various forms of bias. Let me search for some current research and examples to give you a well-rounded answer.## Yes — AI chatbots are biased in multiple documented ways

Research consistently shows that AI chatbots exhibit bias across several dimensions:

1. Political bias

Multiple studies find a consistent leftward lean in major chatbots:

•A Washington Post analysis found OpenAI answered prompts with left-leaning responses 80% of the time while providing both sides to a question just 17% of the time, with only 3% of responses having just a right-leaning answer. Gemini overwhelmingly offered both sides of political debates, while Grok and Claude displayed varying degrees of political bias.

•A large-scale 2025 study collected 180,126 paired judgments from 10,007 U.S. respondents testing 24 large language models on 30 political topics, finding nearly all evaluated models were perceived as significantly left-leaning.

•This isn't just a U.S./English phenomenon — a University of Copenhagen analysis found popular AI chatbots such as ChatGPT and Gemini are not neutral and tend to favor certain political parties when asked who users should vote for, and researchers note larger open-source models like Llama3-70B aligned more closely with left-leaning parties, with evidence not limited to U.S. politics or closed commercial models.

•Even Grok, marketed as more neutral, showed bias: it had a slight liberal bias despite being widely used by conservatives.

2. This bias actually shapes people's opinions

It's not just theoretical — interacting with biased chatbots measurably changes what people believe:

•A University of Washington study found after just a few interactions and regardless of initial partisanship, people were more likely to mirror the model's bias, based on a study of 150 Republicans and 149 Democrats working through unfamiliar policy topics.

•A Yale study similarly found AI chatbots can subtly influence users' social and political opinions through unintended latent biases, caused by biases introduced during the training of the large language models, which carry over from ideological leanings in the data used to train the models and lend subtle nuances to the framing of generated narratives.

3. Other forms of bias

•Gender bias: AI chatbots may exhibit gender bias—such as reinforcing stereotypical assumptions about men and women's occupations—as well as racial bias reflected in prejudices against certain ethnic groups. One study on empathy found the bot empathized more when told the person it was responding to was female.

•Mental health contexts: A Brown University study found licensed psychologists reviewed simulated chats based on real chatbot responses, revealing numerous ethical violations including over-validation of user's beliefs.

Why this happens

The root cause is largely structural: AI models' biases largely stem from the data on which they are trained, and can be amplified during both training and inference, with a notable source of bias arising from human feedback. As Brookings notes, perfect political neutrality is both impossible and, in some cases, undesirable: training data inherently contains embedded biases, user interactions introduce their own political signals, and even moderate positions represent distinct political perspectives, while users also tend to prefer models that align with their own beliefs.

Bottom line: Yes, chatbots are biased — in political framing, gender assumptions, and other dimensions — largely due to their training data and human feedback loops. This matters practically because these biases can subtly shift users' own views after only brief exposure, which is why researchers are increasingly calling for transparency and regulation around how these systems are built and deployed.

Citations (14)

1foxnews.comNews and mediaquality 0.53
AI chatbots show left-leaning bias in study of ChatGPT, Gemini, Claude
Source excerpt: “According to the study, OpenAI answered prompts with left-leaning responses a whopping 80% of the time while providing both sides to a question just 1...”
2businesstoday.inNews and media
Are AI chatbots politically biased? What this analysis found - BusinessToday
Source excerpt: “The analysis found that OpenAI's ChatGPT frequently presented left-leaning arguments, while Google's Gemini overwhelmingly offered both sides of polit...”
3etcjournal.comNews and media
AI Chatbots Are Liberal-Left ‘Biased’
Source excerpt: “** The most direct 2025 user-evaluation study collected 180,126 paired judgments from 10,007 U.S. respondents, testing 24 large language models on 30 ...”
4phys.orgNews and mediaquality 0.85
Chatbots show political bias and steer voters toward some parties, analysis finds
Source excerpt: “# Chatbots show political bias and steer voters toward some parties, analysis finds Popular AI chatbots such as ChatGPT and Gemini are not neutral and...”
5etcjournal.comNews and media
AI Chatbots Are Liberal-Left ‘Biased’
Source excerpt: “Rettenberger, Reischl, and Schutera, 2025 · Popular open-source models evaluated against German/EU Wahl-O-Mat positions · Larger models such as Llama3...”
6foxnews.comNews and mediaquality 0.53
AI chatbots show left-leaning bias in study of ChatGPT, Gemini, Claude
Source excerpt: “Even Grok, the AI chatbot featured on Elon Musk's X which is widely used by conservatives on the social media platform, still had a slight liberal bia...”
7washington.eduAcademic
With just a few messages, biased AI chatbots swayed people’s political views
Source excerpt: ““And we’ve seen a lot of research showing that AI models are biased. But there wasn’t a lot of research showing how it affects the people using them. ...”
8washington.eduAcademic
With just a few messages, biased AI chatbots swayed people’s political views
Source excerpt: “In the study, 150 Republicans and 149 Democrats completed two tasks. ”
9yale.eduAcademic
AI’s hidden bias: Chatbots can influence opinions without trying
Source excerpt: “A Yale study finds that AI chatbots can subtly influence users’ social and political opinions through unintended latent biases. … This unintended powe...”
10yale.eduAcademic
AI’s hidden bias: Chatbots can influence opinions without trying
Source excerpt: “Those latent biases — which can carry over from ideological leanings in the data used to train LLM s — lend subtle nuances to the framing of the narra...”
11arxiv.orgAcademic
Ask ChatGPT: Caveats and Mitigations for Individual Users of AI Chatbots
Source excerpt: “AI chatbots may exhibit various forms of bias, including gender bias—such as reinforcing stereotypical assumptions about men and women's occupations [...”
12ucsc.eduAcademic
AI chatbots perpetuate biases when performing empathy, study finds - News
Source excerpt: “They also found the bot empathized more when told the person it was responding to was female. ”
13brown.eduAcademic
New study: AI chatbots systematically violate mental health ethics standards
Source excerpt: “Licensed psychologists reviewed simulated chats based on real chatbot responses revealing numerous ethical violations, including over-validation of us...”
14brookings.eduNonprofits and think tanks
Is the politicization of generative AI inevitable?
Source excerpt: “## Conclusion A June 2025 study from Stanford HAI researchers highlights why perfect political neutrality is both impossible and, in some cases, undes...”