How Synthetic Polling Replaces Human Respondents With AI Personas
As survey response rates collapse, researchers are using language models to simulate human opinions—but independent tests reveal severe limits to algorithmic consensus.
Share this story
In short
- Survey response rates have dropped from 36 percent in 1997 to roughly 1 percent today, driving the polling industry toward AI alternatives.
- Researchers use language models to create 'silicon samples' that simulate the opinions of specific demographic groups.
- While synthetic respondents perform well on basic questions, independent tests show they fail at complex tasks like tracking opinion changes over time.
Out of every 100 people a researcher tries to contact for a community survey today, fewer than two will actually complete it—a response rate that has collapsed from 36 percent in 1997 to roughly 1 percent in 2026. To bridge that 99-person gap without spending millions of dollars on field operations, the polling industry is testing a radical replacement: synthetic respondents.[4]
Instead of calling human beings, researchers feed demographic and behavioral data into large language models to create what the industry calls "silicon samples." A prompt defines the persona—for example, a 45-year-old female nurse in Ohio who voted for a specific candidate and attends church weekly. The model then answers the survey questions as that persona, generating thousands of responses in minutes.[1]
The foundational logic for this shift was established in a September 2022 paper published in Political Analysis, titled "Out of One, Many." Researchers demonstrated that the algorithmic bias within language models is fine-grained and demographically correlated. When properly conditioned, the models exhibited "algorithmic fidelity," accurately emulating the response distributions of specific human subgroups.[1]
The commercial appeal is entirely structural. Traditional field polls take weeks to turn around and cost tens of thousands of dollars. Synthetic polling platforms, such as Civly, generate simulations of real registered voters anchored to certified election results, delivering a full survey in minutes without a single phone call.[2][3]
Market research firms are rapidly commercializing the concept. In August 2026, Breakthrough Research launched "Modeled Communities," a product that builds synthetic respondent panels from extensive interviews with real consumers. The company positions the tool as a way to pre-test ideas, vet hypotheses, and reach harder-to-recruit audiences before committing to a full human study.
Proponents argue that behaviorally grounded synthetic respondents show high correlation with real human answers. Civly, for instance, back-tests its models against certified election results, reporting that its average county-level simulation lands within 1.7 points of the actual 2024 presidential margin.[2]
But independent evaluations reveal severe limitations when the questions move beyond basic top-line preferences. A July 2026 study by the UK analytics group Strat7 tested synthetic respondents against a real 3,000-person sample to determine if the technology was genuinely ready for complex research.
The results were mixed. On top-line headline results, the artificial intelligence was only two to three percentage points away from the human baseline. However, when asked to track changes in opinion over time, the synthetic surveys had a 47 percent success rate—statistically worse than a coin toss.
The Strat7 evaluation also exposed a distortion in economic modeling. When the synthetic respondents were given a pricing exercise to determine their willingness to pay for a product, they generated prices 16 percent higher than the real human participants, a margin that would ruin a product launch if relied upon by a corporate board.
Academic researchers are finding similar boundaries in civic applications. Studies presented at the Massachusetts Institute of Technology in 2026 investigated whether language models accurately weight intersecting demographic variables when simulating local electoral behavior. The research found that the models default to broad geographic and racial heuristics, overwhelming the finer-grained local signals that drive actual municipal voters.[4]
The output is also highly sensitive to how the artificial intelligence is prompted. In one experiment, prompting a model to behave as a "senator" caused it to strictly follow party lines, while prompting it as a "citizen" produced greater willingness to compromise. The model does not have an opinion; it simply plays the role it is assigned.[4]
Critics, including prominent polling analysts, warn that synthetic polling risks creating a feedback loop. If synthetic data is based on past polls, and future polls incorporate synthetic data, actual shifts in public opinion will be lost. A synthetic respondent cannot change its mind based on a new event that occurred after its training data was collected.[3][4]
The debate ultimately centers on what a poll is supposed to be. Optimists view synthetic polling as a way to unlock public wisdom and overcome declining civic participation. Skeptics argue that polling draws its legitimacy from participation itself—the act of asking and hearing real people. Swapping in digital twins replaces the democratic social contract with computational guesswork.[4]
For now, the industry consensus treats synthetic respondents as an augmentation tool rather than a replacement. "Our approach has always been in building custom market research solutions for our clients' most challenging business questions," said Dan Braker, President of Breakthrough Research, when launching the company's synthetic panels. "Our modeled communities apply that same rigor to a faster, more flexible format. This is a complement to a strong people-informed research program, not a replacement for one."
As the technology scales into the 2026 midterm elections, the deciding factor will be transparency. The market will soon test whether campaigns and corporations are willing to disclose when their data comes from a silicon sample, or if the allure of instant, frictionless consensus will quietly overwrite the need to ask humans what they think.[4]
Key terms
- Synthetic Polling
- The practice of using artificial intelligence to simulate human responses to survey questions, rather than polling actual people.
- Algorithmic Fidelity
- The degree to which a language model accurately reflects the complex patterns of ideas, attitudes, and socio-cultural contexts found in real human populations.
- Silicon Sample
- A virtual population of respondents generated by an AI model, designed to mirror the demographic makeup of a specific real-world group.
- Large Language Model (LLM)
- An artificial intelligence system trained on vast amounts of text data, capable of generating human-like responses based on specific prompts.
Reader questions
What is a synthetic respondent?
A synthetic respondent is an artificial intelligence persona programmed with specific demographic and behavioral traits to simulate how a real human would answer a survey.
How accurate are synthetic polls?
They are highly accurate on basic, top-line questions, often landing within 2 to 3 percentage points of real human surveys. However, independent tests show they struggle significantly with complex tasks, such as tracking opinion changes over time or pricing exercises.
Why are researchers using AI instead of real people?
Traditional survey response rates have collapsed to roughly 1 percent, making it extremely expensive and time-consuming to reach real people. Synthetic polling offers a nearly instant, low-cost alternative for testing ideas.
Where opinion splits
The Efficiency Argument
Proponents argue that synthetic polling solves the crisis of collapsing survey response rates.
For decades, the polling industry relied on the assumption that a random sample of humans could be reached by phone. With response rates now hovering around 1 percent, that model is financially and logistically broken. Synthetic polling advocates argue that language models, trained on vast amounts of human data, can accurately simulate the missing 99 percent. By generating thousands of responses in minutes, organizations can test messages, screen concepts, and gauge public sentiment at a fraction of the cost of traditional field operations.
The Methodological Warning
Independent analysts warn that synthetic data fails when applied to complex or novel situations.
While an AI model can accurately regurgitate the prevailing sentiment on established issues, it struggles to simulate human behavior in novel scenarios. Studies from Strat7 and MIT demonstrate that language models often default to broad stereotypes rather than nuanced local realities. Furthermore, because a synthetic respondent cannot experience a new event or change its mind based on real-world developments, relying on AI to track shifting public opinion risks locking decision-makers into a feedback loop of outdated assumptions.
The Democratic Concern
Civic advocates worry that replacing human respondents with AI undermines the purpose of polling.
Polling is fundamentally a civic technology designed to give citizens a voice in the democratic process. Critics argue that swapping real people for digital twins severs this social contract. If politicians and corporations begin tailoring their platforms to please algorithmic personas rather than actual voters or consumers, the resulting policies will reflect the biases of the training data rather than the genuine, evolving needs of the public.
- Synthetic Optimists
- Believe language models can accurately simulate human subgroups, reducing costs and overcoming declining survey response rates.
- Methodological Skeptics
- Argue that synthetic data fails on complex tasks, defaults to stereotypes, and cannot replace real human validation.
- Hybrid Adopters
- View synthetic respondents as a useful tool for pre-testing and hypothesis generation, but insist on human validation for high-stakes decisions.
Perspectives this story doesn't cover
- Voters whose opinions are being simulated without their direct input
- Regulators tasked with overseeing AI use in political campaigns
Sources
[1]arXivSynthetic OptimistsOut of One, Many: Using Language Models to Simulate Human Samples
Read on arXiv →
[2]CivlySynthetic OptimistsSynthetic Polling: AI simulations of real registered voters
Read on Civly →
[3]Campaign TrendHybrid AdoptersCan You Trust a Poll No Human Ever Took?
[4]Factlen Editorial TeamMethodological SkepticsSynthesis by Factlen editorial team
Read on Factlen Editorial Team →
More in Community
See all →Public Opinion
Majority of Israelis and Palestinians Believe Peaceful Coexistence is Impossible, Pew Poll Finds
5 sources
Survey Methodology
The Semantic and Syntactic Mechanisms That Cause Question Wording Effects in Public Opinion Surveys
7 sources
Polling Mechanics
The Fear of Social Isolation That Causes the 'Spiral of Silence' and Distorts Public Opinion Polls
5 sources
Data Center Zoning
St. Louis Enacts Nation-Leading Data Center Zoning Law With 100% Renewable Energy Mandate and Water-Use Ban
6 sources
Comments
Every angle. Every day.
Get Community stories with full source coverage and perspective breakdowns, free every day.




