Are AI chatbots biased?
Yes, research consistently shows that AI chatbots exhibit various forms of bias. Here's what the evidence reveals:
Political Bias
Multiple studies have found that AI chatbots skew in identifiable political directions:
Why This Happens
Bias isn't necessarily intentional. Experts point to several sources:
Beyond Politics: Other Bias Types
Research identifies additional bias categories beyond political leaning: AI chatbots may exhibit various forms of bias, including gender bias—such as reinforcing stereotypical assumptions about men and women's occupations; political bias; as well as racial bias—reflected in prejudices against certain ethnic groups.
It Actually Influences People
This isn't just academic—a Yale study found real-world effects: AI chatbots can subtly influence users' social and political opinions through unintended latent biases. Notably, content generated by AI that has been prompted to be persuasive can indeed shift people's opinions, but this study provides evidence that the same is also true of content that is not intended to change minds, such as summaries that popular chatbots produce in response to simple queries about historical events.
Important Caveats
Bias isn't static or uniform:
Bottom line: Yes, AI chatbots are biased—primarily due to training data reflecting existing societal biases, human feedback during fine-tuning, and company-specific design choices—but the degree and direction of bias varies by model and can change over time as companies adjust their systems.
Citations (12)
- Are ChatGPT and other AI chatbots politically biased? We tested them.
Source excerpt: “The model that powers ChatGPT answered nearly every question exclusively with left-leaning arguments and presented only right-leaning positions just o...”
- Are ChatGPT and other AI chatbots politically biased? We tested them.
Source excerpt: “Google's Gemini mostly took a both-sides approach, offering both left and right positions in more than 90 percent of its answers. ”
- Are ChatGPT and other AI chatbots politically biased? We tested them.
Source excerpt: “The Post's results come after several previous academic studies found that AI models powering chatbots tend to favor left-leaning positions. ”
- AI Chatbots Are Liberal-Left ‘Biased’ | Educational Technology and Change Journal
Source excerpt: “It analyzed 43 LLMs from the United States, Europe, China, and the Middle East using survey-style prompts from the American National Election Studies ...”
- AI Chatbots Are Liberal-Left ‘Biased’ | Educational Technology and Change Journal
Source excerpt: “The authors found that most models leaned center-left or left, but they also found variation in nonpartisan engagement patterns and argued that model ...”
- Chatbots show political bias and steer voters toward some parties, analysis finds
Source excerpt: “Explore further Popular chatbot is a politically left-leaning EU supporter, study suggests ... Popular AI chatbots exhibit political bias, tending to ...”
- Are AI chatbots like ChatGPT politically biased? We tested them. - Washington Post
Source excerpt: “Most are trained on large collections of text scraped from the internet, but companies can choose what data to include. AI firms also hire workers to ...”
- Are AI chatbots like ChatGPT politically biased? We tested them. - Washington Post
Source excerpt: “The decisions tech companies make as they build their AI tools can bake in biases that go beyond partisan politics, said Ceren Budak, a professor at t...”
- Ask ChatGPT: Caveats and Mitigations for Individual Users of AI Chatbots
Source excerpt: “AI chatbots may exhibit various forms of bias, including gender bias—such as reinforcing stereotypical assumptions about men and women's occupations [...”
- AI’s hidden bias: Chatbots can influence opinions without trying | Yale News
Source excerpt: “A Yale study finds that AI chatbots can subtly influence users’ social and political opinions through unintended latent biases. ”
- AI’s hidden bias: Chatbots can influence opinions without trying | Yale News
Source excerpt: “Prior research has shown that content generated by artificial intelligence (AI) that has been prompted to be persuasive can indeed shift people’s opin...”
- AI Chatbots Are Liberal-Left ‘Biased’ | Educational Technology and Change Journal
Source excerpt: “Finally, the evidence does not show that bias is stable. Models change often. System prompts change. Retrieval sources change. Political pressure chan...”