Sampling in Qualitative Research: Improving The Quality of Research Outcomes in Higher Education
Sampling in Qualitative Research: Improving The Quality of Research Outcomes in Higher Education
Sampling in Qualitative Research: Improving The Quality of Research Outcomes in Higher Education
1 Introduction
Before we turn to look into sample size and sampling designs, we need to
explore what qualitative research is and its importance.
170
Makerere Journal of Higher Education
171
J. Omona: Sampling in Qualitative Research
172
Makerere Journal of Higher Education
173
J. Omona: Sampling in Qualitative Research
the qualitative researcher should collect data that reaches data saturation (Flick,
1998; Morse, 1995), theoretical saturation (Strauss &Cobin, 1990), or
informational redundancy (Lincoln & Guba, 1995). In support of the above,
Stake (2000) noted that in “intrinsic case study, researchers do not avoid
generalisations. They generalise to happenings of their cases at times yet to
come and in other situations” (p.439). All these suggest that sampling
considerations always are pertinent in qualitative research.
Another importance of sampling designs and sample size and usually ignored
is that these are multidimensional (Onwuegbuzie & Leech, 2005). Not only do
they pertain to cases, but they also pertain to units of data (e.g. interview data,
observational data). Thus for instance, a one hour interview will yield different
amounts of quality of data, and, in turn, should extract more meaning than will
a one-minute interview. Therefore one would expect that a longer interview
would be more appropriate if a researcher was interested in a person’s life
history, than if the researcher was interested in the person’s account of specific
event. Therefore, qualitative researchers should make sampling decisions such
as how many interviews or focus groups to conduct, how many sets of
observations to conduct, and how long each observation period should be.
These decisions should be made with the goal of attaining prolonged
engagement and persistent observations (Lincoln & Guba, 1985). Prolonged
engagement and persistent observations represent sampling concepts. If not
enough observational units or textual units are sampled, the quality of data will
be affected and data will not be sufficiently rich and thick, making it more
difficult to find meaning (Onwuegbuzie & Leech, 2005).
While quantitative researchers use complex mathematical formulae to make
sample size considerations, and they promote the use of random sampling, the
sample size considerations in qualitative studies are neither mathematical nor
systematic. Rather, they involve making series of decisions not only about how
many individuals to include in a study and how to select these individuals, but
also about the conditions under which this selection will take place. These
decisions are extremely important (Curtis et al., 2000). Sampling is also
important to confront the crisis of representation (Denzin & Lincoln, 2005).
The crisis of representation refers to the difficulty for qualitative researchers in
adequately capturing lived experiences. Poor representation means that the
researcher has not adequately captured the data (Onwuegbuzie & Leech, 2004;
Onwuegbuzie & Frels, 2012). A good sample size and design must mitigate this
crisis.
It can be concluded that within a particular qualitative study, sampling often
may represent an iterative process, as is particularly the case in grounded and
ethnographic studies. Choosing a sample size and sampling design should
represent an active process of reflection that is based on many factors, including
the context, method of collecting data, and type of generalisation needed. Thus
174
Makerere Journal of Higher Education
Although there is little consensus about what qualitative research is and how it
should be undertaken (Schwandt, 2000; Sandelowski & Barroso, 2003), there is
general agreement that the goal of qualitative research is not to generalise
beyond a sample to the population. Yet some qualitative researchers find it
difficult to resist the temptation to generalise findings to some population
(Onwuegbuzie & Leech 2005). Such practices are flawed unless a
representative sample has been selected.
The lack of sample size consideration in qualitative research likely stems
from the scant discussion in this area (Onwuegbuzie & Leech, 2007). In general
the sample sizes in qualitative research should not be too small that it is
difficult to achieve saturation. At the same time, the sample should not be too
large that it is difficult to make deep, case-oriented analysis (Sandelowski,
1995). Qualitative research can however utilize large sample, as in case of
program evaluation research. Moreover, to associate qualitative data analyses
with small sample is to ignore the growing body of literature in the area of text
mining-the process of analyzing naturally occurring text in order to discover
and capture semantic information (cf: Del Rio et al., 2002; Liddy, 2000; Powis
&Cairns, 2003; Srinivasan, 2004; Onwuegbuzie, & Frels, 2012).
More specifically, Creswell (2002) has recommended that qualitative
researchers should, (a) study one cultural-sharing group in ethnography, (b)
examine three to five cases in a case study, (c) Interview 15-20 people during a
grounded theory study (d) explore the narrative stories of one individual in
narrative research. In addition, Creswell (1998) recommended interviews with
up to 10 people in phenomenological research and interviews with 20-30
people in grounded theory. Johnson & Christensen (2004) surmise that focus
groups usually contain 6-12 persons, whereas Langford et al., (2002) and
Morgan (1997) recommends 6-10 individuals. Krueger (2000) recommends 6-9
focus group members and groups with more than 12 participants tend to “limit
each person’s opportunity to share insights and observations” (p.78).
Furthermore, Morgan contends that focus groups with less than 6 participants
make it difficult to sustain a discussion, whereas groups containing more than
12 members make it difficult for a moderator to manage the discussion.
According to Kruger, focus groups must be small enough for everyone to have
175
J. Omona: Sampling in Qualitative Research
their voices represented but yet large enough to capture a range of voices.
Morgan also states that 3-5 focus groups typically are sufficient to reach
saturation. Kuzel (1992) recommends that 6-8 data sources or sampling units
often will be sufficient when homogeneous samples are selected in qualitative
research and that 12-20 data sources generally are necessary. Morse (1994)
suggests that qualitative researchers use at least six participants in
investigations where the goal is to understand the essence of experience. Morse
also recommends 30-50 interviews and/or observations for ethnographies and
grounded theory research, and approximately 100-200 units of observation in
qualitative ethnographical studies. Although these guidelines are helpful, the
authors did not state how they arrived at these estimates. Thus the
metasummaries and metasyntheses are needed to gather evident-based data
regarding suitable sample sizes. Such data should help guide qualitative
researchers to establish minimum sample sizes based on the number of
participants needed (Onwuegbuzie & Leech, 2005). Furthermore, sample size
selection involves more than the number of participants included in the study; it
is a process that incorporates the number of participants, the number of contacts
with each person, and the length of the contact. Thus, it is important when
considering sampling in Higher Educational research that these issues are
considered.
Before delving into the specifics of the sampling designs (other authors
variously call them techniques, approaches, strategies, schemes- cf: Rubin &
Babbie, 2001; Onwuegbuzie & Leech, 2005; Mugenda & Mugenda, 2003); it is
important to provide the typology of sampling designs for qualitative
researchers. The typology is based on their used in comparing data and these
are:
(a) Parallel sampling designs, which represent a body of sampling designs
that facilitate credible comparisons of two or more different subgroups that are
extracted from the same level of study. These designs can involve comparing
each case to all others in the sample (i.e., pair wise sampling designs) or it can
involve comparing subgroups of case (i.e. sub-group sampling designs).
Pairwise sampling designs traditionally have been the most common types of
qualitative sampling designs. They are called ‘pairwise” because all the selected
case are treated as a set and their voice is compared to all other cases one at a
time in order to understand better the underlying phenomenon, assuming that
the collective voices generated by the set of cases lead to data saturation
(Onwuegbuzie & Leech, 2007). In contrast to pair wise sampling designs,
176
Makerere Journal of Higher Education
subgroup designs involve the comparisons of different subgroups (e.g. girls vs.
boys) that are extracted from the same level of study (e.g. third year University
students) and their voices are compared. The table below shows the example of
a research on third year students on the same course involving different
nationalities (Sub-groups).
(b) Nested sampling designs, are sampling designs that facilitate credible
comparisons of two or more members of the same subgroup, wherein one or
more members of the sub-group represent a sub-sample of the full sample. The
goal of this sub-sampling is to obtain a sub-sample of cases from which further
data can be extracted. This sub-sampling often takes the form of theoretical
sampling, which involves the sampling of additional people, incidents, events,
activities, documents and the like in order to develop emergent themes; to
assess the adequacy, relevance, and meaningfulness of themes; to refine ideas;
and to identify conceptual boundaries (Charmaz, 2000). According to Charmaz,
(Ibid.), the aim of theoretical sampling is to refine ideas, not to increase the size
of the original sample. Because theoretical sampling is the hallmark of
grounded theory designs (Glaser & Strauss, 1967), nested sampling designs are
particularly pertinent for grounded theories. Nested sampling designs are most
commonly used to select key informants as well as conducting member checks
on a sub-sample of the study participants. Findings from key informants are
generalised to the other non-informant sample members. Random sampling
might be appropriate for nested sampling designs. In addition, the following
purposive sampling designs are applicable in nested sampling: maximum
variation, critical case sampling, theory-based sampling, typical case sampling,
random purposeful sampling, multi-stage purposeful random sampling and
multi-stage purposeful sampling (Onwuegbuzie & Collins, 2007).
c) Multilevel sampling designs represent sampling designs that facilitate
credible comparisons of two or more sub-groups that are extracted from
different levels of study (Onwuegbuzie & Leech, 2007). For example, a
qualitative researcher might be interested in comparing the perceptions of
students regarding standardised tests to those of their lecturers. The student and
lecturer samples represent some form of hierarchy. Because of this hierarchy,
the sampling designs and sample sizes used for the lower- level and upper-level
177
J. Omona: Sampling in Qualitative Research
178
Makerere Journal of Higher Education
179
J. Omona: Sampling in Qualitative Research
180
Makerere Journal of Higher Education
Christensen, 2004). Opportunistic sampling takes place after the study begins in
order to take advantage of developing events. This form of sampling is
particularly useful when the researcher is unable or unwilling to declare in
advance of the inquiry every case that will be included in the investigation.
n) Mixed purposeful sampling. This method of sampling involves the mixing
of more than one sampling design. For example, the researcher might begin by
selecting two samples: one via extreme case sampling and the other via critical
case sampling. The researcher could then compare the results emerging from
both samples. Consequently, mixed purposeful sampling can help to triangulate
data (Miles & Huberman, 1994).
o) Convenience sampling. Convenience sampling is used by researchers
involves in selecting individuals or groups that happen to be available and are
willing to participate in the research at the time. It is also referred to as
“volunteer sampling” or ‘accidental sampling” (Mugenda & Mugenda, 2003).
Selecting a roommate or a neighbour is an example (Mugenda & Mugenda,
Ibid.).
p) Quota sampling. In quota sampling, the researcher decides on the specific
characteristics and quotas of sample members to be selected. For example, a
researcher may want to include a certain religion or social class in the sample
and therefore picks quotas of each (Mugenda & Mugenda, 2003). The
researcher then purposively picks subjects to fit the quotas identified. A main
limitation of this method of sampling is that only those who are accessible at
that time of selection have a chance of being selected.
q) Random purposive sampling. In random purposive sampling, the
researcher chooses cases at random from the sampling frame consisting of a
purposefully selected sample. That is, the researcher first obtains a list of
individuals of interests for the study using one of the other methods of
purposive sampling, and then randomly selects a desired number of individuals
from the list. According to Miles & Huberman (1994, p. 28), random
purposeful sampling “adds credibility to sample when potential purposeful
sample is too large”.
r) Multi-stage purposeful random sampling. This involves selecting a
sample in two or more stages, in which the first stage is random, and
subsequent stages are purposive. In multi-stage random purposeful sampling
the first stage often involves cluster sampling, whereas subsequent stages
involve one of the above purposive sampling schemes outlined (Onwuegbuzie
& Leech, 2007).
s) Multi-stage purposeful sampling. Multi-stage purposeful sampling also
involves selecting a sample in two or more stages. However, all stages
incorporate purposive sampling, unlike the multi-stage purposeful random
sampling. Multi-stage purposeful sampling is different from mixed purposeful
sampling in that the former is always sequential; whereas the latter typically
181
J. Omona: Sampling in Qualitative Research
Acknowledgements
The author wishes to acknowledge the contributions of the following two
individuals in particular for helping write this paper: Anthony J. Onwuegbuzie,
Professor at Sam Houston State University and Rebecca K. Frels, Assistant
Professor at Lamar University. Both were resource persons during the 17-22
September OSSREA Workshop on Research Methodology in Dar es Salaam,
which the author attended. They did not only provide the insights and
inspiration but the relevant and authoritative reading materials on qualitative
research method most of which helped in compiling this paper. The author also
thanks the Editor and Reviewers of this Journal for their help in improving the
quality of this paper.
References
182
Makerere Journal of Higher Education
183
J. Omona: Sampling in Qualitative Research
184
Makerere Journal of Higher Education
185