Data Condensation-Because They Affect Later Analysis by Ruling Out Certain
Data Condensation-Because They Affect Later Analysis by Ruling Out Certain
Data Condensation-Because They Affect Later Analysis by Ruling Out Certain
At the proposal stage and in the early planning and start-up stages of a
qualitative research project, many design decisions get made—some explicitly
and precisely, others implicitly, some unknowingly, and still others by default.
The qualitative researcher begins to focus on the study’s issues, the participants to
be observed, the data to be collected, and how these data will be managed and
analyzed.
This book is about analysis, but we also need to discuss research design. Study
design decisions can, in a real sense, be seen as analytic—a sort of anticipatory
data condensation—because they affect later analysis by ruling out certain
variables and relationships and attending to others; they prefigure your analytic
moves. Some design decisions are mainly conceptual: the conceptual framework
and research questions, sampling, case definition, instrumentation, and the nature
of the data to be collected. Others, though they appear in the guise of management
issues, are equally focusing: how data will be stored, organized, and processed
and what computer software may be used to support the work.
We cannot deal thoroughly here with qualitative research design; see the
Appendix for recommended titles on the subject. In this chapter, we discuss the
analytic issues that arise as a study is focused and organized. We provide specific
examples but want to emphasize that these issues must be dealt with uniquely and
flexibly in any particular study. Someone else’s qualitative research design is not
always replicable by others. And initial design decisions nearly always lead to a
redesign.
Display 2.1
A First-Draft Conceptual Framework for a Case Study Teacher and
the Influences on Her Practice
A display such as this might be considered partly confirmatory if
the researcher is able to visit other Language Arts teachers within the
same school and within other schools outside the district to determine
if their spheres of influence also include the same factors. A working
hypothesis for field testing that the researcher developed after studying
and analyzing this display is this: The mandates of education
manifest themselves primarily as prescriptive products imposed on
educators and their students. Overall, what Display 2.2 illustrates is
that conceptual frameworks evolve as a study continues and the bigger
picture becomes clearer.
On our continuum from exploratory to confirmatory designs,
Display 2.1 is closer to the exploratory end and Display 2.2 to the
more confirmatory one. Let’s have a look at an entirely new study with
a conceptual framework about midway between the exploratory–
confirmatory continuum (see Display 2.3).
This framework is of particular interest in that it lays out the
“school improvement study”1 from which we (Miles and Huberman)
draw many of our subsequent displays (see also Huberman & Miles,
1983, 1984). Take some time to review the display to see how all the
pieces fit together and to see what leads to what as we’ve laid out the
directional arrows. This is our initial conceptual framework of how
we felt an educational program innovation was going to unfold
throughout a number of school sites across time.
Rather than bins of people and documents, we labeled our bins as
events (e.g., “Prior history with innovations”), settings (e.g.,
“Community, district office”), processes (e.g., “Changes in user
perceptions and practices”), and theoretical constructs (e.g.,
“Organizational rules, norms . . .”). Some of the outcomes are
hypothesized (“Degree of institutionalization”), but most are open-
ended (“Perceived gains and losses”). The directional arrows follow
the time flow, but some bets still are being made that most assistance
comes early and that reciprocal changes will occur among the
innovation, its users, and the
organization.
Display 2.2
Major Influences on a Language Arts
Teacher’s Practice
Display 2.3
Conceptual Framework for a Multicase “School Improvement” Field
Study, Initial Version
Source: Huberman, A. M., & Miles, M. B. (1984). Innovation up close: How school
improvement works. New York: Plenum.
Example
Our (Miles and Huberman’s) school improvement study shows how
a conceptual framework hooks up with the formulation of research
questions. Look back at Display 2.3, where the main variable sets of
the study were laid out. Look at the third column, labeled “Adoption
Decision.” Its component parts are listed inside the bin: the decision to
adopt, the plan for implementation, and support for the implementation.
The task, then, is to decide what you want to find out about these
topics. The procedure we used was to cluster specific research
questions under more general ones, as shown in Display 2.4.
Notice the choices being made within each topical area. For
example, in the first two areas, the main things we want to know about
the decision to adopt are who was involved, how the decision was
actually made, and how important this project was relative to others.
All of the questions seem to be functional rather than theoretical or
descriptive—they have to do with getting something done.
Display 2.4
General and Special Research Questions Relating to the Adoption
Decision (School Improvement Study)
How was the adoption decision
made?
Who was involved (e.g., principal, users, central office people,
school board, outside agencies)? How was the decision made (top-
down, persuasive, consultative, collegial-participative, or delegated
styles)?
How much priority and centrality did the new program have at the
time of the adoption decision?
How much support and commitment was there from administrators?
How important was it for teachers, seen in relation to their routine,
“ordinary” activities, and any other innovations that were being
contemplated or attempted?
Realistically, how large did it
loom in the scheme of things?
Was it a one-time event or
one of a series?
Advice
1. Even if you are in a highly inductive mode, it is a good idea
to start with some general research questions. They allow you
to get clear about what, in the general domain, is of most
interest. They make the implicit explicit, without necessarily
freezing or limiting your vision.
2. If you are foggy about your priorities or about the ways they
can be framed, begin with a foggy research question and then
try to defog it. Most research questions do not come out right
on the first cut, no matter how experienced the researcher or
how clear the domain of study.
3. Formulating more than a dozen or so general research
questions is looking for trouble. You can easily lose the forest
for the trees and fragment the collection of data. Having a large
number of questions makes it harder to see emergent links
across different parts of the database and to integrate findings.
As we saw in Display 2.4, a solution to research question
proliferation is the use of major questions, each with
subquestions, for clarity and specificity. It also helps to
consider whether there is a key question, the “thing you really
want to know.”
4. It is sometimes easier to generate a conceptual framework after
you’ve made a list of research questions. You look at the list for
common themes, common constructs, implicit or explicit
relationships, and so on, and then begin to map out the
underlying framework joining these pieces. Some researchers
operate best in this mode.
5. In a multiple-case study, be sure all field-workers understand
each question and see its importance. Multiple-case studies
have to be more explicit, so that several researchers can be
aligned as they collect information in the field. Unclear
questions or different understandings can make for
noncomparable data across cases.
6. Once the list of research questions is generated and honed,
look it over to ensure that each question is, in fact,
researchable. Delete those questions that you or your
participants have no real means of answering, or you of
measuring (qualitatively or quantitatively).
7. Keep the research questions in hand, and review them during
fieldwork. This closeness will focus data collection; you
will think twice before noting down what participants have
for lunch or where they park their cars. Unless something has
an obvious, direct, or potentially important link to a research
question, it should not fatten your field notes.
Examples
What are some examples of cases? Sometimes the “phenomenon”
may be an individual in a defined context, as suggested by Displays
2.1 and 2.2: a Language Arts teacher and her series of classes with
junior-level high school students during an 18-week spring semester
—the same semester her students will take a state-mandated
standardized “high-stakes” test in language arts. Note that the “heart”
here is the teacher. The boundary defines her students and school site
as the major contexts. The researcher will not, for example, interview
the teacher’s mother or visit the child care facility where the teacher
leaves her own child during workdays. The bounding is also by time:
No information will be gathered after the spring semester ends in 18
weeks and the standardized test scores have been reported.
Display 2.5
The Case as the Unit of Analysis
Source: Miles, M. B., & Huberman, A. M. (1994). Qualitative data analysis: An expanded
sourcebook (2nd ed.). Thousand Oaks, CA: Sage Publications.
Single cases are the stuff of much qualitative research and can be very
vivid and illuminating, especially if they are chosen to be “critical,”
extreme or unique, or “revelatory,” as Yin (2009) suggests. But the cases
may not be monolithic. Yin further points out that cases may have subcases
embedded within them. A case study of a school may contain cases of
specific classrooms; a case study of a hospital ward may have cases of
specific doctor–patient relationships within it.
We suggest that multiple cases offer the researcher an even deeper
understanding of the processes and outcomes of cases, the chance to test (not
just develop) hypotheses, and a good picture of locally grounded causation.
The question of just which cases to include in a sample is discussed below.
A comment on notation: We sometimes prefer—and use here and there in
this book—the word site because it reminds us that a “case” always occurs
in a specified social and physical setting; we cannot study individual cases
devoid of their context in the way a quantitative researcher often does.
Advice
1. Start intuitively, but remember the focus and build outward. Think of
who and what you will
not be studying as a way to firm up
the boundaries.
2. Define the case as early as you can during a study. Given a starting
conceptual framework and research questions, it pays to get a bit
stern about who and what you are defining as a case; that will help
clarify further both the framework and the questions.
3. Remember that sampling will define the case(s) further.
4. Attend to several dimensions of the case: its conceptual nature, its
social size, its physical
location, and its temporal extent.