← Research notes
Perspective · ~6 min

Why not just prompt ChatGPT or Claude?

By the Echo research team · Updated 1 October 2026

You can ask ChatGPT or Claude how your customers feel, and you'll get a fluent answer. But a general chatbot answers from the model's average picture of people, gives you one voice instead of many, and can't tell you how close it is to reality. Echo grounds hundreds of distinct twins in your data and measures them against real interviews.

THE DARTBOARD PROBLEMA chatbot: roughly the right direction, scattered, unscoredEcho: your board, 300 throws, every hit counted

Can't I just ask a chatbot?

Every buyer asks this. It's a fair question, so try it.

Ask a chatbot how an overworked, overstimulated new parent feels about your new product. You get one fluent, confident paragraph. It will feel relevant. But there's no way to know if it's correct.

That's the problem in one sentence. Not that the answer is bad, but that you can't tell.

The dartboard problem

Picture a dartboard.

A general chatbot throws darts with great confidence. The throws look good, and they all land close together. But they land on the centre of the model's own board: its general picture of people, built from everything it has read. Not on your board. And nobody checks where they land.

Echo throws at your board: your audience, your data, your market. And it does it 300 times, once for every twin in your audience, each with its own background and point of view. Then it counts the hits, by comparing the results with real interviews.

Same darts. Different board. And a scorecard.

Four things a prompt can't give you

1. Grounding in your customers

A chatbot answers from the model's average: its general idea of "a new parent" or "a B2B buyer". Echo answers from your customers' own data, plus public data and our own research data, retrieved fresh for every question (see How we create accurate digital twins).

2. Many voices instead of one

One prompt gives you one blended voice. Real customers disagree, hesitate and contradict themselves. Echo builds hundreds of distinct twins, with personalities, sub-groups discovered from your data, and deliberate edge cases.

This matters more than it seems. Research shows that default models, asked without guidance, lean towards the views of some groups more than others (Santurkar et al., 2023). An unguided prompt is exactly what the science warns against.

3. Consistency across a full study

Ask a chatbot ten questions and the "customer" it plays drifts from one answer to the next. Each Echo twin keeps a stable profile from the first question to the last, so you can follow one person's reasoning through a whole study.

4. A measure of accuracy

This is the big one. A chatbot can't tell you how close its answer is to reality. Echo is scored against real human interviews, with an accuracy of 85–93% across our customer engagements (see Measuring the echo).

Isn't Echo just a chatbot with extra steps?

No. The model is one part of Echo. What turns it into research is everything around it:

  • Audience building: turning your brief or data into a population of grounded twins
  • Research design: sharpening the questions with our research team
  • Scale: hundreds of complete interviews per audience, not one paragraph
  • Analysis: themes, sentiment and differences between segments
  • Validation: scoring against real people

A chatbot generates text. Echo runs a study.

When should you use which?

Use a chatbot when you want to… Use Echo when you need to…
Brainstorm angles or ideas Know how your audience reacts
Draft questions or copy Compare segments with evidence
Get a quick general opinion Defend a decision internally
Explore a topic on your own Test concepts, messages or prices at scale

Both have their place. Just don't mistake one for the other.

The short version

A chatbot gives you an answer. Echo gives you your customers, and tells you how close it gets.


Frequently asked questions

Can ChatGPT or Claude replace customer research? Not on their own. A general model answers from its average picture of people, in one voice, with no way to check accuracy. It's useful for brainstorming, not as evidence.

What is the difference between Echo and ChatGPT? Echo uses AI models inside a research process: grounded digital twins built from your data, hundreds of distinct respondents, analysis by segment and validation against real interviews.

Does Echo use ChatGPT? Echo is built on commercial AI model APIs from major providers, wrapped in its own research architecture.

See the difference on your own question. Try Echo free.

Try Echo free