AR Boudah PDF
AR Boudah PDF
AR Boudah PDF
Research in Education
The field of education is full of debates on many topics. As Chester Finn (2000) said,
Phonics or whole language? Calculators or no calculators? Tracked or mixed-
ability classrooms? Should teachers lecture or “facilitate”? Ought education be
content-centered or child-centered? Do high-stakes exams produce real gains or
merely promote “teaching to the test”? Which is the most effective reform:
Reducing class size? Expanding pre-school? Inducing competition through
vouchers? Paying teachers for performance?
And on and on and on. Within each debate, moreover, we regularly hear each
faction citing boatloads of “studies” that supposedly support its position. Just
think how often “research shows” is used to introduce a statement that winds up
being chiefly about ideology, hunch or preference. (para 1–2)
1
2 C o n d u c t i n g E d u cat i o na l R e s e a r c h
Ideology, hunch, or preference often seems to drive the debates in education. One
reason is that people often disagree about the professionalism of education. Is
teaching truly a profession like medicine, where knowledge is built by studying
certain phenomena and determining the most effective and efficient ways to deal
with them, or is teaching more of a creative vehicle for individuals doing what they
think is right? Different groups answer this question in different ways, usually
incorporating varying degrees of science and art.
If arguing that teaching is art or craft, then a body of educational knowledge
would be developed by individuals potentially through idiosyncratic means.
Unfortunately, this concept of teaching limits it as a profession. That is, if knowledge
of teaching and effective practices were only transmitted by individual trial and error
and not through data-based inquiry, then it would be very difficult to call teaching a
true “profession” similar to law, medicine, engineering, and others. Merriam-
Webster defines profession as “a calling requiring specialized knowledge and often
long and intensive academic preparation” (Merriam-Webster’s Collegiate Dictionary,
2003). Moreover, knowledge is defined as applying to “facts or ideas acquired by
study, investigation, observation, or experience” (Merriam-Webster’s). Thus, for a
profession to have specialized knowledge, the facts and ideas of that field must be
validly and reliably documented, generalized, and shared—something that is impos-
sible on any scale using only individual trial and error. That is why science and sci-
entific inquiry are so important to the field of education.
Science is an approach to the development of a consistent, documented system
of knowledge, based on rigorous, systematic, objective observations that lead to
hypotheses or theories that are then tested and refined in an iterative process
(Vaughn & Damman, 2001). To identify effective practices for teaching students,
for instance, scientific inquiry or research is essential.
Research, then, is a broad term that usually means the systematic and rigorous
process of posing a targeted question, developing a hypothesis or focus, testing
the hypothesis or focus by collecting and analyzing relevant data, and drawing
conclusions. Research methods vary, but the goal of research is almost always the
same: to answer a question or group of related questions. The questions may range
from “Does A cause B?” to “What is A like?” Researchers answer these questions
by using a systematic process of identifying relevant phenomena and evaluating
them. Educational research answers questions important to students, teachers,
administrators, parents, and other stakeholders. Table 1.1 lists several examples of
the uses of educational research.
Chapter 1 Research in Education 3
Policy To address grant proposal What components are necessary for effective
criteria reading instruction?
All of these components add more time and hard work to an already long school
day. The overriding purpose, however, is to improve outcomes for students and
contribute to professional growth.
Congress has tried to reduce or bridge the research-to-practice gap through
legislation. Both the reauthorization of the Elementary and Secondary
Education Act as the No Child Left Behind Act and the reauthorization of the
Individuals with Disabilities Education Act require that schools be held
accountable for student progress and the use of instructional methods derived
from scientifically based research. Therefore, it is imperative that education
professionals know what scientifically based instruction is, how to determine
if a practice is research based, how to implement it in schools, and how to
document its effectiveness.
The connectedness of research with practice is vital for sustaining and improv-
ing both teaching specifically and education in general. Therefore, the primary
purpose of this book is to help you understand, conduct, and share research. The
secondary purpose is to aid in the development of practitioners who conduct and
use scientific inquiry to better the field of education, whether they be administra-
tors, teachers, guidance counselors, or other educational service providers.
Some very practical examples do exist regarding the impact that relevant research
can have on instruction at both the policy and classroom levels. For example, in
2000 the National Reading Panel (NICHD) issued a report, Teaching Children to
Read, which identified the effective components of early reading instruction. The
Panel reviewed 100,000 studies of reading to determine that
Chapter 1 Research in Education 5
Thus, programs that do not include the elements of phonemic awareness, pho-
nics instruction, oral reading, vocabulary instruction, and reading comprehension
instruction were largely dismissed as ineffective. Combined in a coherent pro-
gram, these effective components have improved the reading performance of all
types of students. These elements are now the basis of the evaluation of reading
programs at many levels, including those that have received grants through the
Department of Education.
Careful review of research has given teachers the tools for effective early read-
ing instruction. However, it is often difficult for teachers to give up programs or
practices they feel comfortable with, even if the practices do not have the elements
identified by the National Reading Panel. This is why objective evaluation of prac-
tices and decisions about instructional techniques are needed. This is why educa-
tors and other stakeholders must collect data about student performance as part of
professional practice. When evidence indicates students are not improving, educa-
tors need to find better alternatives.
•• Johnny is defiant.
•• Madeleine can’t read at grade level.
•• Esmerelda just can’t get it in my class.
The reality is that these statements do not provide anyone with much informa-
tion. What does it mean to say Johnny is defiant? How often is he defiant? What
does he do? Are there certain times and situations in which Johnny is defiant?
6 C o n d u c t i n g E d u cat i o na l R e s e a r c h
Does Johnny’s behavior occur in other classrooms or situations? The same is true
for the statements about Madeleine and Esmerelda. How would anyone make a
decision about instructional solutions based on these statements?
Defining problems and conducting classroom-based or high-quality “action
research” allows teachers and others to (a) make data-based decisions, (b) monitor
student progress, (c) change instruction, and (d) reflect on practice (Crockett,
2004). In addition, school-based educators can implement a systematic process for
carrying out Response to Intervention (RTI) (e.g., Deshler, Mellard, Tollefson, &
Byrd, 2005).
Making Data-Based Decisions. The statements about Johnny, Madeleine, and
Esmerelda are probably not based on data but on a teacher’s response to events or
anecdotes from the classroom. The information collected in an anecdote is affected
by a teacher’s tolerance level, the classroom setting, and the content, but the infor-
mation collected from reliable data should not be affected by these factors. When
a teacher makes these kinds of statements about students, she is indicating that
they are somehow standing out in the classroom. Collecting data about how the
students stand out will then help the teacher to make more objective and more
effective decisions about what to do.
For example, clearer, more data-based statements would be these:
When data are presented, as in the examples just given, they remove much of
the potential misinterpretation or teacher bias in defining student behavior. Many
a teacher has been humbled to find that the defiant child actually shouted out no
more than the gifted child. We are all human in our preferences, but when making
decisions about students, we, as education professionals, must attempt to create
clearer understanding and eliminate bias as best we can.
Monitoring Progress. Once a classroom or school situation has been docu-
mented with data, strategies can be put into place to help the student. Are the
strategies working? By collecting data similar to that collected when the problem
was identified, a teacher would be able to answer that question. So, to continue
with Madeleine, the teacher decides to try repeated readings with her to improve
her fluency. After trying this strategy, the teacher assesses Madeleine’s reading
progress by having her read connected text in a second-grade book for 1-minute
Chapter 1 Research in Education 7
intervals. Two weeks later, she is reading at 55 words per minute with 2 errors—
still below her peers but making gains.
Changing Instruction. If Madeleine’s teacher did not administer timed readings,
she may not have a valid way of knowing whether Madeleine’s reading was
improving. If the teacher knows Madeleine’s reading is not improving, however,
he would know it was time to make an instructional change. In another example,
if students must pass an end-of-year writing exam, a teacher can monitor the prog-
ress of the students on the appropriate skills by testing periodically and tracking
performance. Fuchs and Fuchs (2002) found that teachers who used data to make
instructional decisions made more changes to their instruction than those who did
not. Their students also showed greater academic gains.
Reflecting on Practice. Data can also come from records that teachers keep
about their teaching. These records can be in many forms, but typically teachers
compile student grades, test scores, and other information in response to their
practice. This allows teachers to document, for example, how instruction went,
what disasters occurred, and what successes they might want to repeat. In addition
to allowing a teacher to review areas of strength and weakness, keeping this type
of data allows teachers to compare practices and outcomes across classrooms and
students.
Therefore, in an effort to encourage research-based instruction and promote
better informed policy and systemic decision making, many university teacher and
administrator education and school-related programs require graduate students
(and sometimes undergraduate students) to conduct research in order to learn its
value and to practice the necessary skills. For example, individuals who are
working toward Master of Education, Master of Teaching, Master of Science in
Administration, Doctor of Education, and similar degrees are generally required
to complete a project that involves identifying a relevant question, reviewing the
literature base for information, developing a research or project plan, collecting
and analyzing data, and drawing conclusions. This book is intended to help gradu-
ate students and school-based educators who want to engage in research so that
they can be systematic and data based in their decision making. This text provides
guidance in the following:
Types of Research
For ease of discussion, research is categorized into two major types:
experimental and descriptive. Within each type, there are varying designs and
methodologies.
Experimental Research. Simply stated, the goal of experimental research is to
identify cause-and-effect relationships; whether by doing X, the result is Y.
Following is an example of an experimental study that includes many important
associated terms and ideas presented in bold.
A teacher named Jennifer may want to know if using Technique A will increase
the number of words read by second graders in 1 minute. In this example,
Technique A is the independent variable—the variable that is manipulated and
controlled by the researcher in the hope of causing an effect. The dependent
Survey research
Correlational research
Chapter 1 Research in Education 9
classrooms. Tiana observes each teacher and classroom on many occasions and for
a reasonable duration. She also interviews the teachers several times. She then
reviews the new curriculum guides. As Tiana collects the data from observations,
interviews, and document reviews, she examines them for themes, categories, and
theories about instructional actions. Tiana must identify and describe her proce-
dures for collection and analysis of her data in detail so that the study is judged to
be trustworthy or completed using appropriate techniques. After completing the
study, she will be able to describe these teachers’ actions in relation to their beliefs
and the curriculum, but because the sample size is so small, it may not broadly
generalizable.
In sum, the broad categories of experimental and descriptive provide an orga-
nizing framework for the purposes of research. To determine cause-and-effect
relationships, a study is either experimental or quasi-experimental. To provide
information about what exists, a study is descriptive. As presented in the research
examples, research also varies by the method used.
Research Methodologies
In addition to dividing research into experimental and descriptive, many educa-
tors organize research by the methods used and kinds of data collected. Here, two
broad categories of methods and data exist: quantitative and qualitative.
Quantitative Methods. Quantitative methods are used in both experimental
and quasi-experimental research, as well as some forms of descriptive research.
Quantitative methods involve assigning numbers to sequential levels of variables
being studied for purposes of statistical analysis. For example, researchers may
use test scores (e.g., 86 on a scale of 0 to 100) to indicate reading achievement.
Participants may rate their level of exertion during activities (1 is no exertion, 2 is
mild exertion, 3 is moderate exertion, etc.).
Researchers compare these numbers for a variety of purposes. In experimental
or quasi-experimental research, the purpose may be to determine if an independent
variable led to a significant change in a dependent variable. For example, consider
these possible results from the earlier example of the second-grade reading inter-
vention: “Following intervention, there was a statistically significant difference in
the number of words read in one minute by second graders. This difference favored
the group that received Technique A.” In this example, Technique A was the inde-
pendent variable, and the number of words read per minute was the dependent
variable, measured quantitatively.
Now take a look at the possible outcomes of Superintendent Andre’s survey.
After analyzing the data, Andre may be able to say that the teachers in the sample
12 C o n d u c t i n g E d u cat i o na l R e s e a r c h
have an average age of 40 and, on average, have taught for 5 years in the district.
The average rating of satisfaction with paperwork level is 3.5, in the satisfied
range. Andre may also be able to calculate correlations to let him know that the
older the teacher, the more satisfied with the level of paperwork. Andre is able to
describe quantitatively what exists among the teachers in his district but not to
determine cause-and-effect relationships since his was descriptive and not experi-
mental research. Chapters 5 and 9 provide guidance on experimental research, and
Chapters 7 and 11 detail descriptive research and methods.
Qualitative Methods. Qualitative methods are used in descriptive research.
Qualitative researchers analyze language, written or oral, and actions to determine
patterns, themes, or theories in order to provide insight into certain situations.
Qualitative data include personal interviews, observations, and document review.
The qualitative researcher works at “capturing what actually takes place and what
people actually say” (Patton, 2002, p. 26). There are many data analysis techniques
available in qualitative inquiry, including naturalistic inquiry, grounded theory,
case study analysis, and others. Consider a possible outcome of Tiana’s curriculum
investigation.
Tiana concludes that teachers using the new curriculum talk about its imple-
mentation using three general themes: (a) developing materials, (b) managing
students, and (c) creating interest. The instructional actions she observed included
many mundane tasks, such as teaching students where to find their folders, as well
as intriguing discussions based upon character analyses. Chapters 6 and 10 pro-
vide more direction on qualitative research and methods.
T e c h n o l o g y IN RESEAR C H
Given the variety of questions and designs, there is no one way to conduct research in educa-
tional settings. What you will read over and over again in this book is that the research design
and methods must be appropriate to explore the initial research question. In other words, you
should not say, “I am a qualitative researcher,” or, “I am a quantitative researcher.” The reality
is that different types of research may work together coherently to achieve better understand-
ing of a research question or educational situation. The balance of this book begins with guid-
ance in developing and focusing research questions so that the most appropriate research type
and design will be apparent. Once you choose a type of research to answer a specific research
question, you can begin the task of designing the study using appropriate methods.
collecting and analyzing relevant data. This definition leads to an outline for the research
process that is broken down into seven important steps:
These steps are explained in detail in subsequent chapters. (See Figure 1.1 for the
alignment of steps and chapters.) It is important again to emphasize that this book is a
guide for the completion of less complex research projects, not a book that identifies and
describes every aspect of educational research. It will provide information both practical
and helpful to anyone completing a graduate-level research study in education.
Summary
This chapter has highlighted how important research is to education and noted that the
purpose of this text is to guide your completion of a master’s degree or some doctoral-level
research studies. The current research-to-practice gap has contributed to too few educators
accessing and relying on proven, effective practices as they work with students and in
schools. Therefore, one of the important related purposes of this book is to help administra-
tors, teachers, and related service providers develop and use scientific inquiry in their
practice. This chapter identified two primary types of research, experimental and descrip-
tive, and highlighted quantitative and qualitative methods. It also introduced a number of
important terms and concepts commonly used in research, including the following:
Research Random assignment
Independent variable Experimental group
Dependent variable Control group
Sample Statistically significant
Population Quasi-experimental design
Representative sample Survey research methods
Generalize Focus group
Validity Trustworthy
Fidelity Qualitative research methods
Reliability Quantitative research methods
Please refer to the glossary at the end of the text for specific definitions.
Chapter 1 Research in Education 15
Step 1: Identify a
Chapter 2: Identifying a Research Problem and Question and
research problem
Searching Relevant Literature
and question.
Step 3: Develop a
hypothesis.
Step 7: Communicate
Chapter 12: Writing Research Reports
the findings to others.
Finally, the chapter described the seven steps necessary in completing a research
project:
3. Develop a hypothesis.
Activity
2. ___________ is a broad term that usually means the systematic and rigorous process
of posing a focused question, developing a hypothesis or focus, testing the hypoth-
esis or focus by collecting and analyzing relevant data, and drawing conclusions.
3. The ___________ __________ is the variable that the researcher manipulates and
controls in the hope of causing an effect.
4. ___________ is a term associated with a study that does what it claims to do.
5. The ___________ ___________ is the group that receives the independent variable.
6. ___________ methods are often used in descriptive research; these include per-
sonal interviews, observations, and document review.
7. ___________ is a term associated with study methods that can occur similarly
across participants and time.
8. The ___________ __________ is the variable that may change because of the
independent variable.
10. The ___________ __________ is the group that does not receive the independent
variable.
11. ___________ is a term associated with qualitative procedures in a study that were
completed using appropriate techniques.
_________________________________________________________________
_________________________________________________________________
________________________________________________________________
_________________________________________________________________
_________________________________________________________________
________________________________________________________________
_________________________________________________________________
_________________________________________________________________
________________________________________________________________
At this point in your reading, you should be thinking about how research fits into
your everyday practice. As you consider this, you will be able to determine an area
of focus that will be useful in developing your research study. Start by thinking about
the following questions:
18 C o n d u c t i n g E d u cat i o na l R e s e a r c h
__________________________________________________________________
__________________________________________________________________
__________________________________________________________________
__________________________________________________________________
__________________________________________________________________
__________________________________________________________________
__________________________________________________________________
__________________________________________________________________
__________________________________________________________________
•• In what ways do I use anecdotal evidence instead of data-based evidence? How can
I change this?
__________________________________________________________________
__________________________________________________________________
__________________________________________________________________
Further Reading
This classic research book is an excellent reference for finding examples of real-world
application research studies. This book also provides examples of problems previous
researchers have experienced and describes how to avoid those difficulties in one’s own
research. This book provides an excellent discussion of the advantages and limitations of
using quasi-experiment research methodologies. Knowing the advantages and limitations
helps researchers focus on what exactly they are hoping to find, achieve, or resolve and
how this particular methodology will facilitate that process.
Patton, M. Q. (2002). Qualitative research & evaluation methods (3rd ed.). Thousand
Oaks, CA: Sage.
This book is written to benefit a wide variety of audiences. Students, researchers, and even
practitioners can find this book beneficial to their research. This book focuses on the rising
interest in qualitative research methods. It addresses the main concepts of problem identifica-
tion, participant inclusion and observation, interviewing and note taking, decoding of mes-
sages, data analysis, and reporting of results. Included are interview guides and questions that
researchers can reference when conducting their own studies. In addition, Patton provides
personal narratives of his own experiences and struggles with research studies.
References
Boudah, D. J., Logan, K. R., & Greenwood, C. Finn, C. E., Jr. (2000). Foreword. In D. Carnine,
R. (2001). The research to practice proj- Why education experts resist effective
ects: Lessons learned about changing practices (and what it would take to make
teacher practice. Teacher Education and education more like medicine). Retrieved
Special Education, 24, 290–303. May, 5, 2010, from http://www.edexcel-
Carnine, D. (1997). Bridging the research-to- lence.net/detail/news.cfm?news_id=46
practice gap. Exceptional Children, 63, Fuchs, L. S., & Fuchs, D. (2002). Curriculum-
513–521. based measurement: Describing compe-
Cook, T. D., & Campbell, D. T. (1979). Quasi- tency, enhancing outcomes, evaluating
experimentation: Design and analysis treatment effects, and identifying treat-
issues for field settings. Boston: Houghton ment nonresponders. Peabody Journal of
Mifflin. Education, 77, 64–84.
Crockett, J. (2004). Taking stock of science in Greenwood, C. R., & Abbott, M. (2001). The
the schoolhouse: Four ideas to foster effec- research to practice gap in special educa-
tive instruction. Journal of Learning tion. Teacher Education and Special
Disabilities, 37, 186–188. Education, 24, 276–289.
Deshler, D. D., Mellard, D. F., Tollefson, J. M., Landrum, T. J., Cook, B. G., Tankersley, M., &
& Byrd, S. E. (2005). Research topics in Fitzgerald, S. (2002). Teacher perceptions of
responsiveness to intervention: Introduction the trustworthiness, usability, and accessibil-
to the special series. Journal of Learning ity of information from different sources.
Disabilities, 38, 483–484. Remedial and Special Education, 23, 42–28.
20 C o n d u c t i n g E d u cat i o na l R e s e a r c h
Merriam-Webster’s Collegiate Dictionary (11th ed.). Patton, M. Q. (2002). Qualitative research &
(2003). Springfield, MA: Merriam-Webster. evaluation methods (3rd ed.). Thousand
National Institute of Child Health and Human Oaks, CA: Sage.
Development (NICHD). (2000). Reportof Vaughn, S., & Damman, J. E. (2001). Science
the National Reading Panel: Teaching chil- and sanity in special education. Behavioral
dren to read. Retrieved May 5, 2010, from Disorders, 27, 21–29.
http://www.nichd.nih.gov/publications/
nrp/smallbook.cfm
Activity Answers