Expertise · Evidence and reliability of conclusions

Choose the right method for each type of conclusion.

Surveys, interviews, mystery shopping, or social media scanning: each method answers a different question, and using them interchangeably can lead to incorrect conclusions from the data.

Quick summary

You choose methods not based on habits but on the questions that need answering: if you want to know what percentage, use surveys; if you want to understand why, conduct interviews; if you want to see how the service experience unfolds, conduct anonymous purchases; if you want to hear customers speak freely without being prompted, scan social media. A reliable brand audit typically combines multiple methods so that each layer has the right type of evidence.

Quick comparison
You should choose this direction when
  • need percentage data for comparison: use surveys
  • needs deep and emotional reasons: use qualitative interviews
  • need to measure actual service experience: use anonymous test purchases
Not needed when.
  • use a single method for all types of conclusions
  • scan social media and consider it representative of the entire customer base
Quick glance
Commonly used industries
retailF&B chainservice

The most common mistake in the brand diagnosis phase is not a lack of data but using the wrong data collection method for the question that needs answering. You survey when you should be interviewing, or trust social media comments as if they represent the entire customer base. The result is having numbers but not being able to make decisions, or making the wrong decisions due to incorrect evidence.

Four methods and questions each can answer

Each method is created to answer a specific type of question. If used incorrectly, data may be available but it won't lead to the necessary conclusions.

  • Survey (quantitative research): answers the questions "what percentage" and "what ratio." Use it when you need numbers to compare two points in time, two customer groups, or need data convincing enough for internal or partner use.
  • Qualitative interviews: Answering the questions "why" and "what is really going on in the customer's mind." Interviews uncover motivations, attitudes, and beliefs hidden behind behavior, things that surveys cannot reach.
  • Buy mystery shopping: Answer the question "how does the actual service experience unfold at each touchpoint?" This is observational research, recording what really happens, independent of what customers remember or choose to recount.
  • Social media scanning and platform evaluation: answer the question "what do customers say about the brand when not prompted". Useful for capturing natural language and genuine concerns of customers, but it is important to understand the inherent biases of this channel.

When to choose which direction, when to combine two directions

Concluding on ratios and scale: choose surveys. For example: "What percentage of customers recognize the brand before and after the campaign?" Surveys need to design neutral questions, avoiding leading questions as they create artificially appealing numbers that do not reflect reality.

Concluding on reasons and emotions: choose qualitative interviews. For example: "Why do customers choose competitors even though our prices are lower?" Survey numbers show phenomena, interviews explain causes.

Concluding on the quality of touchpoints: combining anonymous test purchases and surveys. Test purchases to measure what really happens, surveys to gauge customer perceptions of the same touchpoint. The two dimensions complement each other: test purchases reveal staff not conveying the right message, while surveys show customers feel lacking in information.

Concluding on customers' natural language: start by scanning social media and reviews to gather terminology, then verify through interviews. Do not conclude directly from social media as it only represents the group willing to write publicly.

Common mistakes when selecting a method

  • Using one method for all conclusions: often surveys because they are familiar and cheap. The result is a percentage but no understanding of the cause, leading to misguided interventions.
  • Leading survey question: ask "Are you satisfied with our professional service?" instead of asking neutrally. It looks better but does not reflect reality.
  • Viewing social media as representative of the entire audience: Public writing groups often lean towards extremes, either praising or criticizing strongly. Regular customers rarely speak up.
  • Skipping anonymous test purchases to save costs: The consequence is never seeing which touchpoints are genuinely failing. Surveys cannot replace this step because customers do not remember or do not fully articulate what happened.

No method can cover everything on its own. Good practice is to combine testing for service accuracy, surveying for feedback, and interviewing for depth.

Intouch Insight, guide to coordinating research methods

How Sinh Vũ combines methods by layer

In Sinh Vũ's five-layer audit, the method chosen is based on the layer being examined, not simply on habits or budget.

  • Brand perception layer: focuses on surveys to measure recognition, associations, and trust levels.
  • Touchpoint layer: use real samples and conduct mystery shopping. Sinh Vũ collects between 30 to 50 real touchpoint samples during the collection week, from packaging, invoices, to customer service calls.
  • Positioning layer: based on interviews with leaders combined with competitor comparisons, as positioning is a strategic assessment that requires depth, not just ratios.

In the collection week, Sinh Vũ listens to both customers and the internal team to get both sides. The team often describes how touchpoints operate theoretically; customers share what they actually encounter. The discrepancies between the two sides are the real issues that need to be addressed.

You do not need to run all four methods at the same time. Start by clearly defining the question that needs to be answered, then choose the most suitable method for that question. If you need multiple types of conclusions, layer additional methods rather than applying one method to all.

The tool brings back.

Decision checklist

Topic: Choosing a method for collecting brand data. Sinh Vũ guide, sinhvu.com

0 more than 7 items

Select each item you find appropriate, then print or save as PDF to take with you.

Sign indicating that you should take action
Questions to answer before deciding

If you have marked most of the signs above, this is the time to discuss in more detail. Sinh Vũ can help you review and propose a direction.

References

Greenbook, How Does Mystery Shopping Work; Cast & Hue, Qualitative vs Quantitative Consumer Research; Intouch Insight, What is Mystery Shopping; practical experience in brand auditing from Sinh Vũ Studio.

Frequently asked questions

Are online surveys sufficient to conclude how customers perceive the brand?

Surveys can measure rates and compare groups, but they cannot dig into the deeper reasons behind the numbers. If you need to understand why customers feel that way, qualitative interviews are necessary. Leading questions in surveys can easily create misleading statistics, so it is essential to design neutral questions.

Is mystery shopping expensive, and is it necessary?

Anonymous purchasing is the only way to capture what really happens at the touchpoint, rather than what customers remember or recount. If you skip this step, you won't see which service points are truly failing. Sinh Vũ typically records 30 to 50 real touchpoint samples in the collection week for comparison.

Do social media comments represent the entire customer base?

No. Social media only captures the voices of those who write publicly, often leaning towards extremes, either strong praise or strong criticism. This data is useful for understanding the natural language and concerns of customers, but cannot be considered representative of the entire group.

← Back to Brand Audit