What a synthetic respondent can (and can't) tell you
By The Panelia team5 min read
A synthetic panel isn't a cheaper human panel. It's a different tool, with real strengths and owned limits. Here's where to trust it, and where to back it up.
A synthetic respondent doesn't think, feels nothing and has never bought anything. Presenting it as a real person would be dishonest. The right frame is different: it's a model that reproduces patterns of reaction observed in real humans, calibrated to stay close to that data. Once that frame is set, you know what to ask it.
What it does very well
Comparing options. This is its most solid ground. Across five names, three messages or two packagings, the relative ranking is reliable and stable. When the goal is to sort and eliminate, the synthetic panel shines.
Delivering volume instantly. Hundreds of reactions in minutes, with held segments and quotas. Where human fieldwork imposes delays, the synthetic approach lets you iterate several times in the same day.
Surfacing themes. The generated verbatims aren't real quotes, but they reveal recurring themes: objections, motivations, barriers. That's excellent raw material to refine a concept before facing the real world.
What to ask of it carefully
A single absolute number in isolation. "47% intent" on its own is worth less than "A leads B by 12 points." The relative is more robust than the absolute. That's why calibration and confidence intervals matter so much.
A category with no data. Reliability depends on how densely the category is calibrated. A well-documented market gives a safer signal than an untried niche. A serious tool shows that uncertainty rather than hiding it.
What it can't replace
Radical novelty. Facing a product with no precedent, nothing comparable in the data, no model can extrapolate with confidence. The right move remains a targeted field test.
The final high-stakes call. For a multi-million decision, the synthetic prepares and narrows the field; it doesn't sign the check for you.
The right use
Think of the synthetic panel as radar, not an oracle. It sweeps fast, spots leads, eliminates the bad ones, and tells you where to look more closely. Used this way, upstream and as a complement, it saves a lot of time without pretending to be what it isn't. Credibility doesn't come from inflated promises: it comes from limits clearly stated.