How Foreign Language Teachers Georgia Evaluate Their Professional Preparation: A Call For Action
How Foreign Language Teachers Georgia Evaluate Their Professional Preparation: A Call For Action
How Foreign Language Teachers Georgia Evaluate Their Professional Preparation: A Call For Action
37
Abstract: The purpose of this article is to report on a collaborative project among members of
colleges of education, colleges of arts and sciences, and high schoolforeign language departments.
The project involved conducting an online survey of 341 current foreign language teachers in
Georgia in order to determine how these K-12 teachers perceived and evaluated the effectiveness
of their professional preparation. Close to 60%of the teachers in the sample were graduates of colleges and universities in Georgia. Most of the others had received their training from various other
colleges and universities in the United States, and 51 individuals reported that they had graduated from foreign institutions. The survey consisted of 42 questions asking teachers to evaluate their
preparation in language skills, knowledge of foreign language standards, planning for instruction,
methodology, using technology in instruction, meeting the needs of socially and economically
diverse students, classroom management skills, and professional growth. The survey results
strongly suggest that foreign language teacher development programs should include (1) more
Thomas C. Cooper (PhD, Florida State University) is Associate Professor of Foreign Language
Education at the University of Georgia, Athens, Georgia.
Joan Kelly Hall (PhD, State University of New York, Albany) is Professor of Linguistics and
Applied Language and Education at Pennsylvania State University, University Park,
Pennsylvania.
Anne Hawkins (MEd, University of Georgia) is a teacher of French and Latin at Grayson High
School, Loganville, Georgia.
Richard A. LuFleur (PhD, Duke University) is Franklin Professor of Classics at the University of
Georgia, Athens, Georgia.
Brigitte Rossbacher (PhD, University of Cali$wnia, Davis) is Associate Professor of German at
the University of Georgia, Athens, Georgia.
Carmen Chaves Tesser (PhD, Mississippi State University) is Professor of Romance Languages at
the University of Georgia, Athens, Georgia.
Joel C. Walz (PhD, Indiana University) is Professor of French at the University of Georgia,
Athens, Georgia.
Melissa Young (PhD, University of Georgia) is a teacher of Spanish at Brookwood High School,
Snellville, Georgia.
SIKING 2004
38
time spent in carefully supervised and monitored prestudentteaching field experiences; (2) more careful mentoring of
student teachers during the student-teaching internship; (3)
more time spent in language learning experiences in countries where the target language is spoken; (4) more emphasis on developing foreign language proficiency in the requisite university classes; and (5) more effort spent on teaching
effective classroom management.
Introduction
One distinct point of consensus has clearly emerged from
foreign language professionals discussions of teacher
development over the last few years: Teacher preparation
programs must be the result of collaborative approaches
designed to maximize the effects of any and all strategies
for improvement (ACTFL, 2002; Raymond, 2002; Schulz,
2000). As Schulz stated, alluding to a long-standing
argument on this matter:
Part of the problem is that teacher development programs are isolated in schools or colleges of education
and that the long-standing schism between education
and FL departments has resulted in mutual namecalling; the responsibility for teacher training must be
shared equally by the schools (administrators and
practicing teachers), the disciplinary departments
(specialists in literature, cultural studies, language,
linguistics, and applied linguistics), and colleges of
education. (p. 518)
The belief that teacher preparation can be improved
through collaborative efforts is also one of the guiding
principles of the Georgia Systemic Teacher Education
Program (GSTEP), a grant initiative funded by
the U. S. Department of Education and the Georgia
Department of Education involving three institutions
of higher learning in Georgia: Albany State University,
the University of Georgia, and Valdosta State University.
The purpose of the grant is to enhance and improve
all phases of teacher preparation by summoning the
collaboration of all entities and departments involved.
To work on this initiative in the area of foreign
languages, a committee was formed at the University of
Georgia that consisted of representatives from the
Departments of Language Education, Classics, Romance
Languages, and Germanic and Slavic Languages, as well as
from from the foreign language departments of Grayson
High School and Brookwood High School in metro
Atlanta.
The purpose of this article is to report on a
collaborative project of the FL GSTEP committee
that conducted an online survey of current foreign
language teachers in Georgia in order to determine
how these K-12 teachers perceived and evaluated
the effectiveness of their professional preparation.
Previous Literature
There is a precedent for evaluating teacher education programs with questionnaires that obtain data on various
aspects of the programs and elicit suggestions for program
improvement. Although most of the published evaluative
reports concentrate on teaching fields other than foreign
languages (Bensley & Pope, 1992; Israelite Q
Hammermeister, 1986; Joyner, 1991; Panyan, Hillman, &
Liggett, 1997; Parker & Spink, 1997), a study by Lange and
Sims (1990) dealt with foreign language teacher preparation. These researchers sent a questionnaire to 800
Minnesota foreign language teachers to ascertain their perceptions of the quality and usefulness of their preprofessional preparation in the areas of general or liberal arts
background, the foreign language major, general preservice
professional preparation, preparation to teach a second language, and student teaching. Although the questionnaire
return rate was 60%, only 95 questionnaires met predetermined criteria for the quantitative and qualitative methods
of analysis chosen.
The results of analysis of these 95 questionnaires, especially the teachers comments in the open-ended response
sections, are pertinent to foreign language teaching today
Regarding the foreign language major, for instance, teachers stated that (1) extended target culture living experiences should be mandatory, (2) there should be an
increased emphasis on listening and speaking skills, and
(3) in the foreign language courses literary analysis tends
to be over-emphasized (Lange Q Sims, p. 299). In their
comments about general preservice professional preparation, respondents emphasized that more attention should
be paid to matters of discipline, classroom management,
and practical psychology (p. 300). They also indicated
that courses in the history and philosophy of education
were not terribly useful, that theory courses were not very
relevant, and that introduction to education courses left
much to be desired (p. 300). Respondents thought that
student teaching was a positive and useful experience but
strongly recommended that it be longer than the typical 11week quarter and become more like an internship (p. 310).
The present study can be viewed as a follow-up and
expansion of the Lange and Sims study over a decade later,
since we surveyed a larger sample of teachers, whose average length of work experience was greater that the two to
four years of Lange and Sims subjects. From their unique
vantage point, teachers in the field can give us the type of
feedback from hands-on experience that ought to be taken
seriously as we work on refining and revising our teacher
education programs.
Method
survey
The survey consisted of 42 questions asking teachers to
Procedures
The survey was conducted between March 6 and April 19,
2002. From a total of 1,611 foreign language teachers in
Georgia, advance letters inviting participation in the study
were sent to 1,005 teachers. The remaining 606 teachers
received an e-mail invitation to participate. A second wave
follow-up of all nonrespondents was conducted two weeks
after the initial attempt. From these two sources, 60
advance letters were undeliverable and 108 e-mail addresses were inaccurate. Thus, the actual size was reduced to
1,443, of which 437 teachers responded to the initial invitation. Of those responding initially, 208 (48%) were from
the e-mail invitation group, while 229 (52%) came from
the advance letter invitation group. The overall response
rate for the study was 30.2% (437/1,443); such a rate compares favorably to mail survey response rates using this
level of follow-up (Dillman, 2001). Of those individuals
responding to the survey, 23 visited the Web site and did
not answer any questions. Of the remaining 414 who did
begin the survey, 341 (82%) indicated that they were current K-12 public school teachers. These 341 teachers constitute the sample upon which this study was based.
However, in the reporting of the survey results below, the
number of responses for one item may not be the same as
those for another item. This is because the respondents
always had the choice not to answer a question. Thus, the
total number of respondents who answer specific questions
varies from item to item.
Survey Respondents
About 60% of the respondents in the sample were gradu-
39
Data Analysis
In the quantitative analysis phase, the dependent variable
was the teachers perception of their professional preparation: that is, with what degree of satisfaction, as measured
on a 5-point scale, did these teachers assess the effectiveness of their training to become foreign language teachers,
both in terms of the courses they completed during their
university study (see Appendix, questions 12-23) and in
terms of the teaching competencies they acquired during
their university coursework as a whole (see Appendix,
questions 27-37).
The independent variables consisted of (1) gender, (2)
years of teaching experience, (3) language taught, (4)
native speaker status of the teachers, (5) type of school
(i.e., private or public), and (6) highest degree earned. In
order to look at the influence of these background factors
in an integrated way likely to show the effects of the six
independent variables as well as any interactions, the study
employed a 6-way ANOVA design and a probability level of
.05 was selected.
In the qualitative analysis phase, the responses to the
open-ended questionditems were analyzed to identify
underlying themes and patterns. The GSTEP committee
members took part in this phase of the data analysis. To
assure interrater reliability, the committee met regularly to
discuss the results obtained and resolve any differences in
their interpretation. To assure objectivity further, another
evaluator, a foreign language teacher with 25 years of classroom experience, analyzed the aggregate of the responses
to the items as a whole. Separate coding and interpretations
SPRING 2004
40
Mean
Standard Deviation
3.21
3.47
3.69
3.69
3.57
4.23
4.11
3.91
4.06
4.09
3.91
4.00
1.11
1.10
1.17
1.15
1.28
0.98
1.07
1.19
1.07
1.04
1.10
1.10
3.80
3.44
2.94
3.44
3.13
3.69
3.25
3.23
3.35
3.37
2.88
0.89
0.96
1.05
0.96
0.97
0.96
0.92
0.95
0.85
0.90
0.95
3.58
0.60
Evaluation of courses
12
13.
14.
15.
16.
17.
18.
19.
20.
21.
22.
23.
Educational foundations
Educational psychology
Methods (pre-kindergarten-8th grade)
Methods (high school)
Cross-cultural communication
Student teaching
FL conversation and comDosition
FL linguistics
FL phonetics
FL literature (pre-20th century)
FL literature (20th century and beyond)
FL cultural studies
Evaluation of FL teaching competencies
27.
28.
29.
30.
31.
32.
33.
34.
35.
36.
37.
41
niques (question 29) and using technology in foreign language teaching (question 37)-received scores below 3.00
(2.94 and 2.88, respectively), indicating that teachers felt
that they were not as well prepared in these areas as they
could have been.
Table 2 presents the means of the scores for questions
12 to 23 and 27 to 37 by comparison groups and gives
global satisfaction scores for the effects of the independent
variables. Global satisfaction scores consist of the average
of the separate satisfaction scores for questions 12 to 23
and questions 27 to 37. As such, they combine the rating
for the specific courses taken by each respondent in a
teacher education program with the rating for how well
the respondent thought he or she had acquired the competencies necessary for effective foreign language teaching.
Unless otherwise indicated, the differences between
the means shown in Table 2 are not statistically significant.
Regarding the variable of gender, for example, female
teachers rated their professional preparation higher than
male teachers (3.59 vs. 3.54). For the group of teachers
Gender (question 2)
Years of teaching
(question 3)*
Language taught
(question 4)
French
(n = 92)
3.61
Female
(n = 290)
3.59
(n = 51)
3 years or less
(n = 53)
3.48
4 years or more
(n = 276)
3.60
German
(n = 30)
3.71
Latin
Spanish
(n = 29)
(n = 171)
3.57
3.57
NS of L2
(n = 69)
3.64
Trpe of school
(question 7)**
Male
3.54
NNS of L2
(n = 259)
3.57
Public
(n = 296)
3.60
(n = 35)
Private
Masters
(n = 164)
3.61
Specialist
(n = 18)
3.54
3.41
~~
Highest degree
(question 8 )
Bachelors
(n = 130)
3.52
*p < .04, interaction between years of teaching experience and language taught
**p < .02, public schools versus private schools
Doctorate
(n = 17)
3.75
42
speakers of the language were more satisfied than nonnative speakers (3.64 vs. 3.57). Teachers working in public
schools were more satisfied with their professional training
than those working in private schools (3.60 vs. 3.41), and
this difference was significant at the p c .02 level (df = 1/239,
F = 5.79). The averages for the degree variable are, from the
highest to the lowest: doctorate, 3.75; masters degree, 3.61;
specialist degree, 3.54; and bachelors degree, 3.52.
Why were some groups more satisfied with their professional preparation than others? Any conclusions based
on these results remains, of course, largely speculative,
both because the data are self-reported and because due to
the confidentiality of the survey, it was not possible to interview the respondents to determine why they answered as
they did.
The teachers most satisfied with their professional
development and training were those holding a doctorate
(3.75). This result is perhaps not surprising since these
individuals were most likely very motivated to have completed a course of study involving a considerable investment of time, energy, and financial resources.
The German teachers in the sample were second in
terms of satisfaction with their training (3.71), while the
scores of teachers of the other foreign languages were fairly close together: French teachers, 3.61; Latin teachers,
3.57; and Spanish teachers, 3.57. The significant interaction between the language taught and years of teaching
experience (p c .04, df= 3/239, F = 2.88) points to a lack of
consistent results across levels, which may be related to the
varylng satisfaction scores among the language groups.
The teachers who were native speakers of the foreign
language had higher satisfaction scores than the nonnative
speakers (3.64 vs. 3.57). These individuals may have constituted a special group. Teachers who were native speakers
of the target language and who completed their professional training in the United States may have been more enthusiastic and engaged students than their American counterparts and more motivated than others to succeed in education, because they had to overcome the difficulties of completing university training in a foreign country, the United
States. Thus, when they reflected on their professional
SPRING 2004
43
44
SPRING 2004
Acknowledgments
We wish to thank Dr. Joe Wisenbaker, Associate
Professor of Educational Psychology at the University of
Georgia, for his patience and expert assistance in the
quantitative analysis of the survey data.
Notes
1. The members of the FL GSTEP committee were: Dr. Thomas
Cooper and Dr. Joan Kelly Hall (the Department of Language
Education, the University of Georgia, Athens, Georgia), Ms.
Anne Hawkins (the Foreign Language Department, Grayson
High School, Loganville, GA), Dr. Richard LaFleur (the
Department of Classics, the University of Georgia, Athens,
Georgia), Dr. Brigitte Rossbacher (the Department of
Germanic and Slavic Languages, the University of Georgia,
Athens, Georgia), Dr. Carmen Tesser and Dr. Joel Walz (the
Department of Romance Languages, the University of Georgia,
Athens, Georgia), and Dr. Melissa Young (the Foreign
Language Department, Brookwood High School, Snellville, GA).
2. The names of the 1,611 teachers were compiled from membership lists of professional associations such as the AATs, the
Classical League, and the Foreign Language Association of
Georgia. Other names of foreign language teachers were
obtained from county foreign language and language arts
supervisors in Georgia.
3. In the tables reporting the results, the 1-5 scale has been
reversed so that 5 represents the highest rating and 1 the lowest.
4. Teachers may think, first of all, of direct, overt application
of things learned in college classes, such as effective management techniques. They may not credit literature classes, for
example, with providing them with content and/or cultural
understanding that should be part of their teaching, or they
may not credit linguistics classes for helping them diagnose
pronunciation difficulties and teach students new vocabulary
through morphological recognition.
5. For example, the committee has also created a Web site (not
yet complete, however) that serves as a resource for foreign
language educators and students. This site contains teaching
resources, such as links to online worksheets, dictionaries
and classroom materials, and can be found at
http://www.gstepfl.uga.edu. The creation of a schools liaison
position designed to connect the College of Arts and Sciences
to the Department of Language Education in the College of
Education was another accomplishment of the committee.
This new position was written into departmental by-laws and
will consequently remain in effect past the life of the GSTEP
45
References
American Council on the Teaching of Foreign Languages.
(2002). ACTFUNCATE program standards for the preparation of
foreign language teachers. (2002). Yonkers, NY: ACTFL.
Bensley, L. B., Q Pope, A. (1992). A self-study instrument for
program review of graduate programs in health education.
Journal of Health Education, 23(6), 344-46.
Dillman, D. (2001). Mail and internet surveys: The tailored
design method. New York: Wiley.
Israelite, N. K., Q Hammermeister, E K. (1986). A survey of
teacher education preparation programs in education of the
hearing impaired. American Annals of the Deaf, 131(3), 232-37.
Joyner, Y G. (1991). Research into practice: The use of a student teaching study to develop and improve mathematics
methods courses for pre-service teachers. School Science and
Mathematics, 91(6), 236-39.
Lange, D. L., Q Sims, W R. (1990). Minnesota foreign language teachers perceptions of their pre-professional preparation. The Modem LanguageJoumal, 74(3), 297-310.
National Standards in Foreign Language Education Project
(1999). Standards for foreign language learning in the 21st
century. Yonkers, NY: Author.
Panyan, M. Y, Hillman, S. A,, Q Liggett, A. M. (1997). The role
of focus groups in evaluating and revising teacher education
programs. Teacher Education and Special Education, 20( l ) ,
37-46.
Parker, J., Q Spink, E. (1997). Becoming science teachers: An
evaluation of the initial stages of primary teacher training.
Assessment and Evaluation in Higher Education, 22( 11, 17-31.
Raymond, H. C. (2002). Learning to teach foreign languages:
A case study of six preservice teachers. NECTFL Review, 51,
16-25.
Schulz, R.A. (2000). Foreign language teacher development:
MLJ perspectives-1916-1999.
Modem Language Journal,
84(4), 494-522.
SPRING 2004
46
Appendix
Online Survey
Invitation to Participate in the Online Survey
Dear Foreign Language Educator:
The Survey Research Center at the University of Georgia, in conjunction with the Department of Teacher Education, invites
you to participate in an important state-wide project called GSTEP (Georgia Systemic Teacher Education Program) to study and
recommend ways to improve foreign language teacher education in the state of Georgia.
You have been selected to participate in this study due to your association with foreign language education, and we value
your experience and knowledge as an educator. Please give us a clear picture of what is currently good about teacher training
programs in foreign languages as well as what can be improved in these programs. The survey should take only 10-15 minutes
of your time.
All data that you provide will be kept strictly confidential, to the extent possible using the Internet as a data collection
medium; only summary data will be reported at the conclusion of the study. To increase confidentiality of data, a unique ID
number is contained below. This ID number serves as a password to allow entry into the survey and to protect confidentiality.
At the conclusion of the study, all identifying information is deleted.
grade).
1. Yes
2. N o
2.
Wed like to begin by asking you some demographic questions so that we can compare your answers with others across
the state.
What is your gender?
1. Male
2. Female
3. Choose not to answer
3.
4.
5.
years
Do you teach at a
1. Private school
2. Public school
3 . Choose not to answer
This next section is about your educational background and teacher preparation.
8. What is the highest level of education youve attained?
1. Bachelors degree
2. Masters degree (M.A., M.S., M.Ed., etc)
3 . Specialist degree (Ed.S.)
4.
5.
9.
47
SPRING 2004
48