How to use quantitative research
Quantitative research is where you capture large amounts of data about your customers. It’s where you survey large groups of customers to get a view of the total market. The focus is on quantity. You use this research approach to confirm answers to your research questions. It’s important to learn how to use quantitative research, because quantitative research results help you make better marketing decisions.
This guide covers where and when to use quantitative research, and the pros and cons of this approach. You’ll learn how to make this research happen, including key steps like sample size and questionnaire design. We’ll share example quantitative research results, and how they link to better marketing activity. And we’ll end with advice on how to find a quantitative research company.
Table of Contents
What is quantitative research?
Quantitative research is the market research approach you use when you’ve a range of possible answers to your research questions, but need to confirm which of those answers are best.
In simple terms, you ask a representative sample of customers to “score” your range of answers. You use the data from these “scores” to make statistically-based marketing decisions.
This representative sampling is an important part of quantitative research. It would take too long and cost too much money to speak to every customer.
Sampling a representative group of customers gives you a statistically reliable view of the total market.
You ask each sample group to answer a pre-defined set of questions, usually through completing a questionnaire. These are structured and scripted lists of questions and possible answers.
The questions are usually closed. The respondents choose from a list of answers, rather than provide their own answers. Individual responses are added up and analysed to show the view of the group. The results are shown based on this aggregated data and analysis.
Where and when to use quantitative research
You would normally use quantitative research for major marketing activities.
These would be the activities where you spend the most money, and where the consequences of the decisions have long-lasting impact.
Quantitative research helps you understand the scale of what’s going on with customers. You should use it to better understand what has happened, what is happening or what will happen.
So for example, in terms of what has happened, use it to understand what drove historic purchase behaviour. e.g. Which of these factors influenced your decision to buy (product name)? (price, quality, advertising etc)
Or, you could also use it understand the impact current activity has on buying behaviour. e.g. Is this TV advert from (product name) more likely to make you buy?
Or, you can even use it to forecast the impact of a future activity. e.g. If (product name) price increased to $x, how likely would you be to keep buying it?
You’ll have noticed with each of these, there’s something specific to test. So, in these examples, factors that might drive product choice, an advertising campaign or a price increase.
This is important. To do quantitative research, you need some existing ideas about what’s going on in your market. You need hypotheses to test. The research results will show if your hypotheses are valid or not. These hypotheses are only what you believe, not what you know. What you believe, and what you know are not always the same thing. The results give you a level of certainty.
But where and how do you come up with these ideas and hypotheses?
Sources of ideas and hypotheses
So, one obvious source, could be from feedback, comments and ideas that customers already give you as part of your customer experience set-up.
So, satisfaction surveys, social media interactions and e-mail surveys for example can give you ideas about what customers think.
Another source could be previous research that you carried out or bought. You can often re-interpret old research with new research questions.
Check out our secondary research guide to learn more about storing, indexing and research results.
And of course, as we cover in our market research process guide, it’s very common to generate ideas and hypotheses with secondary and qualitative research, and then use quantitative research to quantify and validate them.
A simple example
Say you have 100 customers.
And, you know it’s possible that some buy based on price, and others based on reliability.
But you don’t know how many buy on price, and how many on reliability. Your “guess” is as good as ours. But if you use quantitative research to ask those customers which one drives choice the most, then there’s no “guess” work any more.
You know which one to focus on.
Your marketing plan would look very different if 99 / 100 customers buy on price compared to to if 99 / 100 buy on reliability. That type of knowledge impacts all parts of your marketing mix.
Confidence and certainty
Without quantitative research, you have to base your marketing decisions on a limited view of the market.
With quantitative research, you have a representative view of the total market from the sample you select. You can have much more confidence and certainty that your decisions are based on validated facts.
Quantitative research gives you clear direction and facts on the size and scale of what your customers think, feel and do.
It helps you identify where and how to focus your marketing activities. And it helps you understand the scale of any problems or threats.
Think of quantitative research as your way of taking a regular census check of your customers.
It moves you from “possible” to “probable” answers, and that leads you to make better marketing decisions. You’ll prioritise better, be more like to carry out relevant and impactful activity, and it’ll help keep you ahead of competitors.
Continuous quantitative research
You can carry out quantitative research to understand a question at a specific point in time, or you can carry out multiple surveys over a period of time to understand and track trends.
This is called continuous research.
If you need to keep a regular view of what’s happening with customers, you can use this to track their attitudes and behaviours over time. Use continuous research to measure the impact of marketing activity on customers. Not just your marketing activity, but also that of your competitors.
Continuous research helps you measure the awareness of your advertising and media, for example. It helps you track specific elements of your brand identity like your values and personality. You can easily see if customers “get” these from your marketing activity.
Continuous research takes a representative sample of customers and asks the same questions at regular intervals. The questions need to stay the same, so you can check the differences between responses at different points in time. That’s where you see trends happening.
The most common example among marketing businesses would be brand health studies.
These would typically have a range of attributes to describe brands in the market. “Offers good value for money”, “Is high quality”, “Cares about its customers” and so on. The studies happen monthly or quarterly, so brands can check how they and their competitors perform against these brand attributes.
Check out our guide to brand activation, where we cover why this is an important part of your brand performance tracking.
The pros of quantitative research
The biggest “pro” of quantitative research is that it’s based on a statistically representative sample of the total market. Because the results are based on data and numbers, it’s more objective. The analysis is more specific and definite.
It’s also usually much clearer in how results are presented. Most business people are used to seeing graphs, charts and diagrams and using them to make decisions.
So, in this example, you can easily see the impact of different advertising campaigns on different segments of the market.
This basis in fact usually leads to greater confidence in the results. There’s much less chance of getting “wrong” answers about the market.
And this confidence is helpful when you need to persuade or influence decision makers. It’s particularly helpful when you have to build a business case, for example.
The fact-based approach cuts down on subjective opinions about marketing activity. You’re making decisions based on real feedback from customers.
Because the questionnaires are structured, and the answers are usually multiple choice, there’s no need for respondents to come up with their own answers. This means respondents answer questions faster. So, you can usually ask more questions than say, qualitative research.
You also have more control over the responses. You can avoid unhelpful answers, say actions that you can’t actually deliver against. If your product only comes in three colours, say, you can make sure respondents can only pick one of those colours.
The cons of quantitative research
So, there’s lots of pros to quantitative research. In particular, the confidence it gives you to make decisions is compelling. But, it’s not always appropriate as a research approach, as it also comes with a few cons.
Firstly, it’s usually the most expensive research approach. Think about it. It costs you money every time you research a customer. And, quantitative research is the approach that talks to the biggest number of customers.
And of course, the more customers you talk to, the longer it takes. So, quantitative research is also usually the slowest research approach. Not so much, when you have continuous research running, but certainly if you’re starting a new research project from scratch. It takes longer to find the respondents, ask the questions and analyse the results.
This also then means there’s often a time lag between capturing the data and seeing the results. The more data, the longer it takes to analyse and present the results. It’s not unusual to see results one to two months after quantitative research takes place. In some categories, that’s fine, but in others, that lag can mean you miss opportunities or are late to identity problems.
Finally, quantitative research also limits the scope of your research to existing answers and knowledge. But if you don’t have existing ideas and hypotheses to test, quantitative research won’t really help you find new or different answers.
How do you do quantitative research?
Based on the questions in the brief, and how you’ll use the results, you and the research team decide that quantitative research is the best approach.
You’ll have agreed on the need for quantifiable results that validate ideas and hypotheses about the market.
The results need to paint a clear picture of the total market. They need to validate, rather than generate ideas. They need to make clear recommendations of what marketing actions to take. So, where do you start?
Find respondents to interview
The first task is to find respondents to interview. But you need to make some key decision about who you’ll recruit and how many people you’ll need.
So, for example, you’ll need to agree a sample size. How many respondents do you need to create a statistically significant sample of the total customer group?
For this you need three things.
You need to know how many people are in the total group of customers. If you can’t get the actual number, try to make your estimate as accurate as you can.
Then, you need to decide on a margin of error. Because, you take a sample group out of the total group, there’s always going to be a degree of error between the sample and the total. The margin of error is the tolerance you’ll accept because of this. It’s usually somewhere between 2% and 5%, but it’s something you should agree with the research company.
You can reduce the margin of error by increasing the size of the sample group, but obviously this adds both time and cost. Smaller sample groups will have larger margins of error.
An example of margin of error
So, let’s say for example, your research shows 70% of respondents agree with a specific statement about your product. The margin of error is the range of results that the total group answer lies in. So, if it’s 70% with a 5% margin of error, the total group answer should be between 65% and 75%, i.e. plus or minus 5%.
However, there’s a further complicating factor.
There still remains a small chance the true group answer is outside that range. This small chance is quantified using what is called a confidence level.
The confidence level is how confident you want to be that the survey result falls with your margin of error. It’s usually calculated at 90%, 95% or 99%. If you want a higher confidence level, you’ll need to use a bigger simple size.
The research company will normally have statistical experts who’ll work out these calculations for you. However, it’s worth knowing the basics of what’s involved, and you can even use online tools to work out your own sample sizes.
You’ll also need to agree with the market research company how broad or detailed the definition of the respondent group needs to be.
Too broad (e.g. “men”, “old people”) and you can end up with too wide a range of opinions. You won’t get the specific insights you need.
Too detailed though (e.g. “men aged 57, who wear hats, get the bus on Tuesdays and don’t like KFC) and you won’t find enough customers to hit your sample size target.
There’s usually a middle ground.
You agree broad enough demographic information to make customers easy to find, but with some specific behavioural or attitudinal attributes to get more focus.
So, “men over 50, who live in London, get the bus at least once a month and never eat fast food” is a reasonable level of detail for example.
Finally, you also need to agree the mechanism by which respondents will actually answer the questions.
In the past, this would have been mainly driven by street interviews – interviewers with clipboards stopping people on the street – or phone interviews – interviewers phoning up to ask questions and record answers.
Neither of these methods are ideal. They are relatively intrusive. Many people don’t let getting stopped on the street or called at home by strangers. The people who are happy to answer questions in the street or on the phone, may not be representative of the total population.
These days, most of these types of surveys have moved to online panels.
Here, respondents sign up in advance to take part in surveys (they get paid for each survey completed). The respondents can complete the survey at a time that suits them. No annoying phone calls when you’re in the middle of making dinner, for example. These panels are generally more representative, and have higher completion rates.
Online surveys also remove the need to have interviewers. This reduces costs, and eliminates any bias that might come from the buyer. It reduces any recording errors.
Respondents fill in the answers directly on screen, and get exactly the same questioning experience. This reduces errors and makes the research more consistent.
So, once you know who will answer the questions, and how they’ll do it, you then to create the questionnaire. These are all the questions and possible answers you want to validate.
Questionnaire design one of the most important tasks in quantitative research.
You need to group questions together around specific topics. And you need to organise the order so that there’s a natural and logical flow.
The better the flow of the questions, the easier it is for the respondent to answer them.
Another way to make it easier for the respondent is to mainly use closed questions. These are questions, where there are only a limited number of responses. Questions that have only a Yes / No answer for example are closed. Multiple choice questions where respondents pick from a list of options are closed questions.
You can choose to only allow one answer (e.g. agree / disagree), or to allow multiple answers to a question.
So, for example, “Thinking about yourself as a parent of an infant, which of these words describe how you feel most days”. You could then have a list of relevant descriptive phrases – happy, tired, optimistic, in control, protective, caring – that respondents choose from.
Closed questions are helpful because respondents need to think less to answer them. This means they can answers questions more quickly than say in qualitative research.
However, there is a limit to how many questions in total a respondent can reasonably answer in a survey. They will eventually tire and lose concentration.
A typical quantitative research survey might take 30 to 45 minutes. And each question can take anywhere from 10 seconds to one minute, depending on how many options you offer.
Closed questions also help to make analysis and presentation of the results easier and faster. With open questions, you can have a wide range of answers and need to spend time interpreting the answers and looking for common themes. With closed questions, all you need to do is add up the selections and organise the totals.
With closed questions, and automated online surveys, it’s important to make sure there’s no ambiguity in the questions. They need to be super clear. Ambiguity comes when a question could be interpreted in different ways.
You want to avoid this.
So, for example, let’s say you ask customers a question like “Are value for money and good quality important in your buying decision?”
In that question, value for money and good quality are two different criteria. But, what if only one is important? How do you answer the question then?
You’d want these to be two separate questions so it wasn’t ambiguous.
In general, double barrelled questions are the most ambiguous. You should check if they word “and” appears in the question. If it doesn’t there’s a good chance the question will be ambiguous.
You want respondents to answer specific questions, so you capture specific answers.
It’s important to makes sure you don’t ask leading questions where you “hint” at expected answers. You want the question to be relatively neutral and not push the respondent in a certain direction.
This can come if you use overly emotional language in your question. So “do you think it’s shameful that companies don’t pay more tax?” for example.
The emotive word “shameful” makes it clear that you think it’s shameful, and you’re trying to get the respondents to agree.
Or, let’s say “do you agree with environmental experts that global warming is one of the most challenging situations this country faces?”.
By putting in “experts”, it’s much harder to disagree with the statement. You are leading the respondent to agree with “experts”.
Similarly, biased questions try to overly influence the direction of answers. This can be misleading and lead to incorrect results.
So, for example, there’s the self-serving bias. With this bias, you try to make yourself seem or look more successful than you actually are. You overly favour anything that puts a more positive spin on your actions, and overly reject anything that puts a more negative spin on your actions.
So, for example, imagine you came up with this question, “on a scale of 1 to 5, how effective do you think the award-winning advert from (Product X) was?”.
In that example, “award-winning” is clearly self-serving and introduces bias. Respondents will see “award-winning” and think, “oh this must be a good advert if it one awards.” So, you’d get an unrealistically positive view of the advert.
Then, there’s the false-consensus bias. This is where you believe your views are the same as most other people, even if they aren’t. This is because you spend the most time with people who have similar views. You follow consumer media and news from sources that share your view of the world. You overestimate these views as “what everyone else thinks”.
In questionnaires, this can come though in questions like “do you agree with the majority of people that Product X is the best on the market”.
In that case “majority of people” introduces bias. When respondents are considering Product X normally, they don’t know what the majority thinks.
The way this question is worded will produce overly positive responses. It’s biased.
Interpreting quantitative research
There are a couple of final things to consider, when it comes to commissioning and knowing how to use quantitative research.
First, you need to consider the context of the survey process.
Quantitative research doesn’t usually replicate “real” buying conditions. In real-life buying situations, customers don’t have a list of ready answers to choose from.
So, you’ll always have a slightly artificial view of the buying process. That’s important to bear in mind when it comes to how to use qualitative research.
Then you need to consider that most of the “answers” you see will be numbers-based (the number of people who answered questions in a particular way). So to understand the numbers better, it’s also helpful to understand basic statistical terms used in quantitative research.
Understanding basic statistical terms
You don’t need to be a statistician to understand quantitative research. But, an understanding of basic statistical terms helps a lot. These help you analyse and interpret the numbers you see in the results. And, they help you make sure that there’s statistical validity behind the research itself.
So, here’s a few statistical terms you should know, when it comes to how to use quantitative research.
This is the sum of the values of a question divided by the total number in the population.
Let’s say we ask three people what they would pay for a product, and they respond $10, $12 and $16. The mean is the sum of the values ($38) divided by the total number (3 people) or $38/3 = $12.67.
This is also called the ‘average’. But, for some reason statistical experts prefer to call it the ‘mean’. Perhaps they do that to be mean?
The variance is the sum of the squared deviations about the mean divided by the number in the population.
This is where most non-statistical people start to get confused. But let’s pick that definition apart one step at a time, using our simple $10, $12 and $16 example.
The deviations are the difference between the actual values and the mean. The mean’s $12.67 in this case.
So here, the deviations would be -$2.67 ($10 – $12.67), -$0.67 ($12 – $12.67) and $3.33 ($16 – $12.67).
The sum of the ‘squared’ deviations would be each of those numbers squared and then added up. So, $-2.672 + $-0.672 + $3.332. The actual calculation then is 7.13 + 0.45 + 11.09, to give us a total variance of 18.67.
The variance then is the average, so the total variance divided by the number of responses. So, $18.67 / 3 or $6.22.
The standard deviation
In reality, variance is rarely referred to except in market research. But the square root of the variance is referred to often as this number is called the standard deviation.
In the above case, the square root of $6.22 is 2.49 so our standard deviation is 2.49.
These three statistical terms form the basis of the statistical calculations that drive sample sizes (which we covered previously when talking about how many customers you need), margins of error and confidence intervals.
What confidence intervals do, based on calculations around the standard deviation, is calculate the likelihood of the sample you picked out falling within the standard deviation range you calculated.
These calculations have important ramifications on your business decisions.
How to use quantitative research example - launch / don’t launch
Let’s look at a simple example.
Say, you plan to launch a new product, but for the business case to justify the investment, 50% of customers need to buy it in the first year.
If less than 50% buy, it won’t generate enough sales.
So, let’s say you’ve done some quantitative research, and it shows that 50% of customers will buy.
But, there’s a 5% margin of error on that answer at a 95% confidence interval.
So, in actual fact, your sales from the total group of customers could be as low as 45%. But they could also be as high as 55%. You’re 95% confident, that they’ll be in that range.
Is that good enough to launch?
In actual fact, we think you probably would launch. But some would argue against this. There’s the possibility sales will be between 45% and 49%.
If you really wanted a definitive “go launch” target, then you need to make sure the worst case margin of error result is above your actual target.
In this case, you’d want the research to show a 55% result, with a 5% margin of error. Because then even in the worst case (55%-5%), you’re 95% confident you’ll hit your 50% target.
Don’t worry if this is hard to follow. It’s probably the most complicated part of the market research process.
Most quantitative market research companies will have experts in statistical and numerical analysis. Ask them to explain their calculations in a way that you’ll understand. It’s usually much easier when you have actual numbers to work with .
We’re going to leave the statistics there for now, but do check out other sites, if you want to find out more.
How to use quantitative research – Case study introduction
The purpose of quantitative research is to generate statistically valid results which prove or disprove your ideas and hypotheses about customers. These ideas could relate to any part of your marketing plan.
So, your advertising, for example. What impact does it have with customers? Or if could be your sales promotions. What’s the right type of offer to drive sales? You can pretty much test anything with customers with quantitative research.
In very simple terms, you look for opportunities and threats in the results. Are there gaps where needs are unmet, or trends are going positively?
Or, is the research showing customers just don’t like what you’re doing?
So, let’s look at an example from some real quantitative research.
Case study example - online shopping
In this study, there’d been some qualitative research done before the quantitative research.
It identified a list of 15 different reasons that the target audience might choose to shop online.
The business needed to identify which of these 15 reasons were the most important.
They couldn’t create 15 different strategies and run 15 different advertising campaigns, after all.
The aim of this quantitative research question was to identify where the business should focus its efforts.
High scoring answers – where to focus
In this case, you can see that the top 4 questions scored significantly higher than the others. It was clear looking at these results the four areas where the business should focus.
And actually, if you look at those answers together, you could summarise them into a single theme of ‘convenience’ – shop anytime, saves time, easier – are all about convenient ways to shop.
You’d prioritise activities that make buying online more convenient for customers. And your advertising messages would then focus on the convenience benefits of online shopping.
Low scoring answers – what to avoid
If you compare that to say the answers at the bottom of the chart, e.g. booking a delivery slot and Click and Collect, these clearly have less appeal to this group of online shoppers.
So, you know what to avoid or ignore in your marketing plan.
Click and Collect, for example still requires you to visit the store. And this is not actually always very convenient. This is also important information.
You can’t do everything.
So, when customers tell you what they DON”T like or want in quantitative research, that helps make your prioritisation decisions much easier. You can comfortably ignore these options, and focus on the ones that make the biggest difference.
How to use quantitative research to solve your business problem
As we said right at the start of this article, it’s your business problem than drives the decision to do quantitative research. And it’s generally, when your business problem is that you want to understand something that has happened, something that is happening or something that will happen.
Let’s look at some past, present and future scenarios where understanding how to use quantitative research could solve your business problem.
Quantitative research is particularly helpful with brand identity as you can see if customers perceive your brand in the same way you intend it to come across.
How customers perceive you brand comes from what you’ve done in the past, and what you are doing now.
They will have mental associations and memories, both positive and negative.
You can understand the scale of these associations and memories across the total market with quantitative research.
So, for example, you could include questions like this to understand brand identity.
Question : “On a scale of 1 to 5, where 1 is disagree and 5 is agree, how much do you agree with each of these statements about Product x?” Example answers : it’s high quality; it’s good value; it’s made by experts, it’s innovative, it cares about its customers etc.
If customers don’t recognise the attributes in your brand identity you want to stand for, then you need to review if those are the right attributes. Or, you need to communicate them in a better way.
Prior purchasing behaviour
You can also dig into prior purchasing behaviour.
Quantitative research can show which marketing channels customers were exposed to before the bought, for example.
So, you could ask questions like this to understand purchasing behaviour.
Question : “Which of these activities did you do, before you bought product x?”
Example answers : Saw a TV advert, searched online visited the website, saw a Facebook post, spoke to a sales representative, read a review etc.
If, some marketing activities appear to have no impact on sales, then consider whether you should actually be doing them at all. You should focus your spend in the channels that have the biggest impact on sales.
Occasions and usage
You can also draw out quantifiable information about occasions and usage. So, how often customers buy a product, and where and when they use it for example.
If you are using occasions as a variable in segmenting the market, quantitative research is where that information comes from.
So, for example.
Question : “How regularly do you buy Product x?”
Example answers : Every day / a few times a week / a few times a month etc
This type of insight helps you work out which types of customers drive the most amount of sales. So, it may be that your most regular customers might only be 20% of your total number of customers, but account for 80% of purchases. (this 80:20 effect, called the pareto principle, comes up fairly often in all types of market research)
Product launches, new packaging and advertising campaigns
But you’d also want to understand which activities are driving these sales, and for that, you’d use quantitative research.
Your sales numbers are the “symptom”, but quantitative research is the diagnosis process that helps you identify underlying “causes”.
You can ask questions to see if customers understand the features and benefits of your new offer, for example. And if they do understand them, are they relevant and inspiring enough to make them want to buy?
These insights help you understand what’s working and what’s not working, so you can adjust your marketing plan. Often, when companies carry out continuous quantitative research like brand health studies, they’ll compare result from “before” new activities took place, and “after” to see what impact those activities actually had.
Forecast the impact of future activities
Finally, you can use quantitative research to help predict future attitudes and behaviours.
So, for example, you could research different price points for a new product. For each price point, you could identify how many customers would buy at that price point, and work out which price point will generate the most sales.
So, let’s use a very simple example. Say 10 customers will buy at $10. But, 6 customers will still buy at $20. You’d price at $20, because your total sales (6 x $20) is better than selling at the lower price (10 x $10).
Finding a quantitative market research company
We have a whole separate detailed guide on market research companies. But to close this article, out, we wanted to share a couple of specific thoughts on quantitative researchers.
As a first step, we recommend you go online and check-out the relevant market research industry association website.
Firstly, these sites will have lots of useful information on how to use quantitative research. But, they’ll also have a Company Directory with links to market research companies who are official members.
In Australia, there are two associations. There’s the Research Society and the Association of Market and Social Research Organisations.
You can search the Company Directories on both sites to find market research companies who cover specific industries or offer specific research services. From there, you can check out the company websites to find out more about them, and how to contact them if they seem like a good fit.
What makes them a good fit?
Well, obviously they need to have the technical skills in quantitative research if that’s your need. So, look for any example of this type of work, or articles, case studies and client testimonials they give.
You also want to try and find a research company that suits your working style, and budget. Our guide to market research companies covers this in much more detail.
How to use quantitative research – Conclusion
In this guide, we’ve covered what quantitative research is and where and when you might use it.
We’ve outlined the pros and cons of this research approach. In simple terms, it’s great for confirming and valiant existing ideas and hypotheses. It’s less helpful when you need to explore concepts of find new ideas and hypotheses.
We also covered the main aspects of how quantitative research is done.
Your market research company will normally handle most of these details. But it’s important you understand the basics of what goes on in quantitative research.
It’s important to understand questionnaire design for example. And it’s important to have at least a basic grasp of key statistical and numerical terms that quantitative research uses.
Quantitative research gives you as reliable a picture of your customer as you can get without speaking to all of then. It gives you a strong understanding of where the biggest opportunities are, and what the common attitudes and behaviours are. This understanding can give you a real competitive advantage when it comes to how to use quantitative research.
As quantitative researchers would say, it’s a research approach you can really count on.
Three-brains and market research skills
We coach and consult to help businesses improve their market research skills. We can help you set up and optimise your quantitative research skills, so that you ask the right questions and get the best answers to drive your marketing activity.
3 pages including a blank template, a guide to completing each section and an example brief from the vegan ice cream case study in our secondary research skill guide.
Powerpoint and Keynote versions of this document available on request.