Cognitive Interviews: How to Learn What Users Really Think

Users will happily tell you what they think about your product. The trouble is that their explanations are mostly fiction: rationalizations constructed after the fact by a mind that did not witness its own automatic processes. Cognitive interviews, a core method in John Whalen’s Design for How People Think, are how you get closer to the truth.

What is a cognitive interview?

It is a research session built around real behavior rather than reported opinion. Instead of asking “would you use this feature,” you give the user a real task and observe, then probe the thinking behind what you saw. The method borrows from cognitive psychology and, yes, from how detectives interview witnesses: the goal is reconstructing what actually happened in the mind, not collecting judgments.

How do you run one?

1. Start with a real task. Behavior first, talk second. “Show me how you would renew your subscription” beats “what do you think of our subscription page.”

2. Watch for the tells. Hesitations, hovering, rereading, backtracking. Each is a visible trace of invisible cognition.

3. Probe in the moment. “What are you looking for right now?” “What did you expect to happen?” Short, neutral, immediate.

4. Chase the assumptions. When users misread a label, the interesting question is what they thought it meant and why.

5. Separate observation from inference. Write down what you saw before you decide what it means.

What do designers gain?

The difference between knowing that users fail and knowing why. “Thirty percent abandoned checkout” is a metric. “They thought the CTA was an ad because it sat below a banner” is a fix. Cognitive interviews produce the second kind.

Why does Tremoloo share this book?

Because the quality of research findings depends on the quality of the probing, and this book teaches probing better than anything else we have found. It has raised the bar for how our own researchers run sessions.

Want research that explains the why behind your metrics? Book a research session with us.