UX Research and Market Research

A Conversation with Apala Lahiri Chavan

Chief Oracle and Innovator
Human Factors International
 User Experience Research and Market Research

The most important thing for user experience professionals to know

is when marketing research is needed, and when user experience
research is needed. If you understand how these two methodologies
work together through a product lifecycle, you will be able to work
effectively with marketing departments. You can demonstrate the
value of including user experience research in their projects because
you are able to explain how it complements the market research they
are already conducting.

Share this white paper:

User Experience Research and Market Research

Apala Lahiri Chavan, Chief Oracle and Innovator of Human Factors International,
talks about the synergy and differences between user experience research and
market research.

How do you define market research versus user experience research?

There is a lot of overlap and blurring of the line between the two.

Market research Market research is primarily about understanding what people will buy. It uses
tends to involve both qualitative and quantitative methods, but the ultimate goal is always to
understand what people want to buy.
large numbers and
large samples. It Market research is useful in two phases of a projectthe initial strategy and
planning phase, and then when validating concepts/designs. It is very important
focuses on what
as an input mechanism to decide strategy at the beginning of a project. Inputs
people will buy. It from market research could be used to identify a certain segment of the
focuses on what population as a target for a new product, or for determining if a new market is
available altogether. You definitely need some hard numbers to make a business
people say, rather case for these kinds of questions.
than what they do.
Its also very important to understand that market research focuses on large
samples and verifies its insights with large numbers. Furthermore, in order to
provide input to business strategy, these large samples must be statistically
balanced in order to give confidence to decision makers within an organization.
After a survey with 10,000 people, it is possible to use sophisticated statistical
techniques, and one can be confident about the results.

To summarize, market research is important in providing business insight early

on. It tends to involve large numbers and large samples. It also focuses on what
people will buy. Finally, an important aspect of market research is that it focuses
on what people say, rather than what they do. This is the essence of market
research.

We can use this definition to help distinguish market research from user
experience (UX) research. In fact, UX research is exactly the opposite.

Share this white paper:

White Paper User Experience Research and Market Research 3

User Experience Research and Market Research

User experience research is not about markets, trends, what people say they will
buy, their demographics, or how the market can be segmented apart and
analyzed. Rather, user experience research looks at what a person feels about
using a product or service. Its not about looking at trends that capture
generalizations. Its about looking at very specific, deep-dive information about
users.

User experience research is more valuable in providing direction about how a

User experience solution should be designed. Its less about pricing and more about design. What
aspects of a solution will meet the needs that we identify during our user
research is not experience research? What feelings are users having about the product we are
about markets, interested in? Its not so much about buying as it is about using a product or
trends, what people service.

say they will buy, Therefore, user experience research focuses on smaller sample sizes. This is
demographics, or because we are not interested in looking at statistically valid, large samples from
which we can see what price ranges ought to be targeted. We use small samples,
how the market can but we go deep into the psyche of the user to discover how the user relates to a
be segmented apart product or service. We see much more than what they say; in user experience
research, we can see what people do. User experience research is more focused
or analyzed. on how a person uses a product, not on what they may or may not buy.

Market Research User Experience Research

What people say What people do
What people will buy How people use a product or service
Large samples sizes Small sample sizes
Broad insight Deep, focused insight

Share this white paper:

White Paper User Experience Research and Market Research 4

User Experience Research and Market Research

What is the relationship between market research and user experience research?

This is also a very interesting question. Ive noticed from my experience that
what works well is to use market research and user experience research to gain
different kinds of insight. Market research can be used for initial market sizing,
analyzing competition, getting an idea about trends and product/service areas
that people are interested in, and also for identifying approximate price points.
From that initial research, user experience research will dive into the focus area
we want to understand more deeply.
User experience
For example, people might say that they want to use washing machines, and
research helps a market research will identify price ranges to sell those machines in certain
company design a geographic regions. Then, user experience research takes this knowledge and
conducts a deep dive study inspired by ethnographic methods, with smaller
product that people samples to understand what people do with washing machines. We might ask
want to use, and in questions like, What problems do washing machines solve other than just
washing clothes? Are there reasons why people are expressing interest in buying
fact, may not exist washing machines? Is there an unmet need that we can fulfill?
in the
Because of the expertise and techniques used by user experience researchers,
marketplace.
we can gain insight into the unsaid and unknown needs of washing machine
users. This helps the company design a product that people want to use, and in
fact, may not exist in the marketplace.

There is an interesting relationship between market research and UX research

happening here. Market researchers may be able to identify a strong market for
washing machines as opposed to microwaves, stoves, etc. They can show the
company that certain price ranges could be more competitive than others, and
that certain demographic groups are worth targeting. User experience
researchers can then provide insight into innovation, designs, and iterations of a
particular product idea.

Once the product is designedat this end stagemarket research again plays a
critical role. An organization might have several designs to choose from. Market
research can reach out and evaluate which of those concepts are most likely to
sell successfully and identify price ranges that buyers are willing to pay.

Share this white paper:

White Paper User Experience Research and Market Research 5

User Experience Research and Market Research

It sounds like market research gives an organization an area to focus on, or an

idea of a product line that could be profitable. Then, user experience research
provides more insight about why a person might choose specific features and
other, deeper understanding about the motivations of the buyer. What is the
interplay between market research and user experience research? What is the
lifecycle of that process?

Its useful to divide the product lifecycle into three distinct phases.

The first phase is strategizing, where an organization is exploring whether or not

to design a certain kind of product or enter a new market. During this stage, both
methods are usedthat is, market research and user experience research. In this
phase, there is more emphasis on market research, because this is where large
The techniques studies are done to slice and dice the market to identify segments,
demographics, and price ranges. You consider age groups, income ranges,
used in large geographic information, and so on. Market research is very useful for these
surveys are indirect insights.

methods. You cant Once that information is clear and the business formulates a specific market
possibly go and strategyfor example, to sell washing machines in Asiathat specific formulation
directly interview can be validated with a round of user experience research. In HFI, we experience
this often. Clients usually ask us to do deep dive research with small samples to
10,000 people. validate that the market research done before that is correct. And, since were
doing the fieldwork anyway, they have us gather the information about what
exactly about that product is so important. So, even if we conclude that we dis-
agree with the market research findings, we can often provide input to give the
company another direction to pursue.

However, this is one of the dangers of market research. The techniques used in
large surveys are indirect methods. You cant possibly go and directly interview
10,000 people. Its too costly and time consuming. Instead, market researchers
will often send out questionnaires, do phone surveys, and so on. Companies that
are mature understand this problem. You could get in big trouble when survey
respondents say, Yes, I would like this washing machine, but they dont actually
mean it! Thats the problem with just believing what people say.

Share this white paper:

White Paper User Experience Research and Market Research 6

User Experience Research and Market Research

More than 60% of participants said

they were likely or very likely
to buy a kitchen appliance
in the next 3 months.

8 months later, only 12% had.

A mature
How Customers Think, Gerald Zaltman, 2003
organization will http://www.slideshare.net/Optimal.Usability/why-user-experience-is-more-important-than-marketing

look for validation

and deeper insight. A mature organization will look for validation and deeper insight. Thats where
Thats where the the user experience researcher comes in. We can see what people actually do
with a washing machine. That will validate whether what people say is actually
user experience what they meant when they gave their inputs to the market researchers.
researcher comes Therefore, in the strategy phase, it is not unusual to have market research results
passed to user experience researchers, and a more focused ecosystem research
in.
conducted.

I have seen in our work that 80% of the time, the market research data is pretty
accurate. Thats great! We come back (after the UX research) and provide a lot of
additional rich information about the user groups, which really helps during the
next phase of design.

But, in about 20% of cases, we find something more surprising. It might even be
true that the product or service that the market research suggests will be
profitable is actually not wanted by the consumers. In these cases, the user
experience research provides great value, because it has prevented the company
from investing a great deal of time and money in an idea which is actually not
viable.

Share this white paper:

White Paper User Experience Research and Market Research 7

User Experience Research and Market Research

During the strategizing stage, there is a lot of interplay between market and user
experience research. During the design phase, it is all user experience research;
there is no market research during the design process. In this phase, we are
designing iteratively based around the feedback we get from small samples
users.

Depending on what we are designinga product like a website, for examplewe

Often, user use methods like usability testing to do our iteration and get the design right. We
do this by directly working with the people who are within the target user group.
experience This involves observations, in-person conversations, etc. If we are dealing with a
researchers help physical product design, then we have other methods. For example, we could
create interesting prototypes based on storyboards. But, its important to
design the survey remember that its all small sample research during this phase. We are iterating
instruments used and tweaking the concept/design.
by market
Then, we move onto the last phase of product development, which is the
researchers. validation phasethe final assessment that we have the design right. Its also an
opportunity to understand the interplay between the different concepts we have
come up with. We may have several different designs or ideas that can be
combined according to data we gather, and then create a final concept which
emphasizes the desirable aspects of all the concepts we have identified.

In the validation phase, we have the opportunity to identify the ideal price points
and the right combination of features. This phase is largely market research
driven, but the ideal situation is to have market and user experience researchers
working together. As user experience researchers, we do not have the core
competency of running the large scale, quantitative surveys. We pass that on to
market researchers who have many different methods for gaining insight into our
concepts using large scale feedback and statistical analysis.

Often, user experience researchers help design the survey instruments used by
market researchers. Even though its an indirect methodthat is, we dont work
directly with the people we study in this phaseuser experience researchers can
greatly help with the instrument design. Once the survey is designed, the market
researchers essentially take over with the execution and analysis of the study.

Share this white paper:

White Paper User Experience Research and Market Research 8

User Experience Research and Market Research

It sounds like market research and user experience research are definitely dis-
tinct disciplines. But, there seems to be a lot of interplay between them, as well
as between the professionals in those fields.

Yes, you are absolutely right. In general, market researchers categorize

themselves as either qualitative or quantitative professionals. It makes a lot of
sense given the nature of the work they do. Quantitative research is really driven
by an understanding of statistics and an ability to work with very large data sets.
A qualitative researcher isnt necessarily expected to have a high level of
expertise in those areas, but is instead, better with skills such as in-person
There is a clear interviewing, conducting group sessions, etc.
divide between
quantitative My experience is qualitative researchers are professionals who most often
conduct focus groups. They are usually not interacting one-to-one and doing
research and UX deep dive research. They might be working with people directly, but working with
work, but often a group requires a very different skill set than working with individuals in a deep
way like we do as user experience professionals.
there is confusion
about the And even if they do in situ observation or one-on-one interviews, they do not
observe or probe from the perspective of how the solution will actually be
differences between designed, how the user experience will be crafted.
qualitative research
and UX research. Although the lines are blurredclients will often tell us that the market research
agencies they work with do qualitative researchwe sometimes have to explain
that the kinds of insights we can provide are very different. There is a clear
divide between quantitative research and UX work, but often there is confusion
about the differences between qualitative research and UX research.

A major difference is that large group sessions happen inside facilities where
participants are not in the context where they actually use the product or service
you want to investigate. That loss of context is crucial because we cant get the
kinds of insights we get when doing in-home visits and actually see how people
interact with products in a familiar and natural setting. We can do a much deeper
level of probing and questioning, because we see the issues they face in actual
real life situations.

Share this white paper:

White Paper User Experience Research and Market Research 9

User Experience Research and Market Research

Lets say Im an executive trying to decide what kind of research I need to do.
Generally speaking, are there any indicators about when I should be using user
experience research? How can I be confident that it will provide information that
is valuable and actionable in my decision making process?

If you want attitudinal information about your market or about a target

Attitudinal population, this requires market research. If you just need people to express
information requires their opinions, its quite simple. Do you think this washing machine would be
useful? Yes or No? Do you think a washing machine will save you time? Yes or
market research ... No? Those are attitudinal questions.
behavioral research
On the other hand, behavioral research is a question best left to user experience
is best left to user researchers. How do people actually behave while they are washing clothes?
experience What kinds of problems do they run into? These questions of behavior cannot be
researchers. completely understood through market research alone. When you really want to
know what people will do as opposed to what they just say, thats when you need
insight on the behavioral level and should consult user experience researchers.
When you want to understand the why behind your attitudinal insights, then
you have no other way but to use user experience research methods.

Share this white paper:

White Paper User Experience Research and Market Research 10

User Experience Research and Market Research

In depth research would have revealed that piles of merchandise and chaos
are associated with low prices and provide social proof.

It sounds like understanding the behavioral aspect can give a lot of insight into
the design process.

Yes. Market research will answer questions about general trends, opinions,
market sizes, these kinds of things. User experience research, on the other hand,
looks at the entire ecosystem of the user. This includes the environment, actors
and artifacts, needs and desires, barriers and blocks, core values, cultural
aspects, and how all these interact and influence usage and purchase decisions.

Share this white paper:

White Paper User Experience Research and Market Research 11

User Experience Research and Market Research

As you just indicated, it seems the idea of understanding the behavioral aspect of
product research is an area where demographics, cultural influences, and the
overall ecosystem become important.

Thats right. Because ecosystem is something that market research doesnt

confront very well. Its very difficult for market research techniques to uncover
the entire ecosystem and how different issues are linked together.

Ecosystem research is a key part of HFIs approach to user experience research.

Ill give you an example. We worked very closely with a washing machine
Ecosystem is manufacturer last year. It really displayed the differences between market and
something that user experience research. The company came to us with a large amount of very
good market research. They asked us to do ecosystem research, but they wanted
market research us to be informed by the market research they had already completed. When we
doesnt confront viewed the presentation by the market researchers, it was slide after slide telling
us things like: what percentage of women in India wash clothes by hand; their
very well... it is a income levels; which cities they lived in; the percentage of women who passed
key part of HFIs the job along to servants; and so on. It was all about percentages, down to the
approach to user last detail.

experience At the end of the whole presentation, I still had no clue what people really
research. wanted. Did they really want washing machines? What was it we were taking from
this research? My takeaway was that many Indian women still hand wash clothes,
and a lot of Indian women use their maid servants to wash their clothes. Sure,
that is interesting, but this is common knowledge in India. Did you need to invest
so much time and money to validate that? Im not so sure. At the end of the
presentation, the market researcher suggested creating a washing machine that
specifically deals with germs and bacteria in a way other washing machines
do not.

We did use that information to guide our research. But, immersed in the
ecosystem, we found that nobody worries about germs and bacteria. At the end
of the study, we did hear one thing from the users we studiedthey would worry
about germs if there was an infant in the house.

Share this white paper:

White Paper User Experience Research and Market Research 12

User Experience Research and Market Research

Otherwise, there was almost no concern at all. Some of the housewives even said
that products that claim to fight germs and bacteria were untrustworthy and not
effective in the Indian environment. They even felt that their families needed to
be exposed to some amount of germs and bacteria to develop strong immune
systems.

These findings were very different from the findings of the market researchers,
and thats because certain things are very difficult to understand through indirect
or group research alone. If somebody asked you, Would you like to have a
Certain things are washing machine that kills germs and bacteria? would you say No? But, when
you visit the homes and see what they are like and talk to the families, you get a
very difficult to much clearer perspective about how high a priority this really is.
understand
Furthermore, you get into deep conversations about all of the issues surrounding
through indirect or their clothes washing habits. In fact, these conversations happen as part of the
group research research process, providing insight into many aspects of their lives. People are
open to telling you what bothers them, what makes them feel angryand its not
alone.
just about washingits about everything. And everything influences their
decisions to buy and use something. Hence, if you rely solely on market research,
youre missing a huge opportunity to learn about countless factors surrounding
usage and purchase decisions.

When you invest in user experience research, it seems you develop not only
deeper insight, but you learn things that are immediately practical. This is very
valuable and can save organizations time and resources by helping them make
wise decisions more effectively early on.

Absolutely! We have helped clients avoid investment disasters through the unique
insight user experience research brings to the table. Organizations dont just
need high level insightbut they also need specific information about the product
or service in question. It might be something as simple as, You need to improve
the panel on the washing machine, that can make a huge difference to the
people who are buying your products.

Share this white paper:

White Paper User Experience Research and Market Research 13

User Experience Research and Market Research

Lets say Im a UX professional, and Im really excited by this topic. What do I

need to understand about marketing research and how I can work effectively
with these professionals?

The most important thing for user experience professionals to know is when
With all of the marketing research is needed, and when user experience research is needed. If
economic growth you understand how these two methodologies work together through a product
lifecycle, you will be able to work effectively with marketing departments. You
and resulting power can demonstrate the value of including user experience research in their projects
shift to emerging because you are able to explain how it complements the market research they
countries, there is are already conducting.

likely to be a shift But, a user experience professional who has no idea about the strength of
in value systems. market research might be viewed as uninformed. Marketing departments are
already accustomed to working with large data sets and statistical analysis, but
they might not understand the need for deep insight. Be clear that although you
arent an expert in that area, you understand its importance in the organization.
Youll probably need to work with marketing research data to do your work
effectively.

HFI often takes insights from market research and uses them as a starting point
for user experience research. In fact, some of our most successful projects have
leveraged the synergy between marketing research and user experience
research. Marketing and UX both have a role to play, and both groups must be
able to clearly articulate the value of their research and how it fits within the
product lifecycle.

Share this white paper:

White Paper User Experience Research and Market Research 14

User Experience Research and Market Research

About Apala Apala Lahiri Chavan, MA, MSc, CUA, CXA

Chief Oracle and Innovator
Human Factors International

Apala is active on Twitter @FuturistApala

Apala Lahiri Chavan has been responsible for growing Human Factors
Internationals UX consulting operations across Asia (Mumbai, Bangalore,
Pondicherry, Shanghai, and Singapore) since joining HFI in 2000.

She is an award winning designer (International Audi Design Award) and

specializes in the area of Cross Cultural Innovation and Design.

Beginning as Managing DirectorIndia and Vice PresidentAsia. Apala has

taken on a new role recently in HFI as Chief Oracle and Innovator.

Apala and her Contextual Innovation team have helped designers, marketers,
product managers, and ethnographers in Fortune 500 companies apply her
innovative techniques to develop exciting new concepts and products.

She systematically guides the ideation process to uncover subtle patterns in

ethnographic and market data to reveal the exciting breakthrough ideas that
can drive business and generate more revenue and profit on the one hand,
and improve quality of life for users on the other hand.

Recently, her focus has been on the emerging markets. She has co-edited a
book on this subject, Innovative Solutions: What Designers Need to Know For
Todays Emerging Markets.

Share this white paper:

White Paper User Experience Research and Market Research 15

Human Factors
International

410 West Lowe, P.O. Box 2020

Fairfield, IA 52556
Phone: 800.242.4480
Fax: 641.472.5412
hfi@humanfactors.com
www.humanfactors.com

2012 Human Factors International, Inc.