AI Chatbots Test Reveals Divergent Political Slants

In a recent analysis, The Washington Post ran a comparative test of major chatbot models using political questions designed by researchers at Dartmouth College and Stanford University, according to the Post. The analysis examined outputs from ChatGPT (OpenAI), Gemini (Google), Grok (xAI), Claude (Anthropic), DeepSeek, and Arya (Gab). Per the Post's published results: ChatGPT returned exclusively left-leaning arguments in 80% of queries and right-leaning positions in only 3%; Gemini was the clear outlier, offering both sides in roughly 93% of responses with only 7% left-only; Claude returned left-leaning answers 43% of the time and balanced responses the remaining 57%; Grok provided right-leaning responses in 33% of cases and left-leaning in 40%, making it the most balanced-to-right of the group; DeepSeek came in at 70% left-only, 7% right-only, and 23% both. The Post and subsequent coverage both note the test does not demonstrate that chatbots alter voting behavior.

Industry reporting frames this as an output-level measurement, not a probe of model internals. The Post's method sampled short-answer outputs across policy topics, capturing framing and argument selection rather than document-level citation behavior or information retrieval quality. For practitioners, evaluations of this kind expose gaps not visible in standard benchmark scores: prompt sensitivity, answer framing, and the mix of normative versus factual content in short answers. The model-by-model variation also illustrates that RLHF tuning, safety layers, and instruction design all affect political framing in ways that differ substantially across providers.

The Post's findings illustrate that nominally similar conversational interfaces can systematically differ in the balance of perspectives they present. Dartmouth researcher Sean Westwood told the Post these tools are not presenting "a truly neutral representation of really nuanced policy debates, on average." Companies pushed back: Google said Gemini "is designed to provide balanced responses that don't favor any political ideology." Anthropic spokesperson Michael Aciman said Claude is trained to "treat different political viewpoints equally and test extensively for bias before every model launch," per the Post. OpenAI, SpaceX, DeepSeek, and Gab did not respond to the Post's requests for comment, per Mediaite.

For practitioners deploying conversational agents, the logical next controls include: reproducible evaluation datasets measuring ideological framing; documentation from providers about safety and alignment testing for political content; and published methodologies showing how model sampling, instruction tuning, and safety layers affect answer balance. Teams responsible for public-facing Q&A should treat these results as motivation to add targeted, reproducible framing checks into release and monitoring pipelines.