Professional Documents
Culture Documents
California State University, Northridge: Journal of Research On Leadership Education March 2011, Volume 6, Issue 3
California State University, Northridge: Journal of Research On Leadership Education March 2011, Volume 6, Issue 3
60
Auerbach / IT’S NOT JUST GOING TO COLLECT DUST ON A SHELF
61
Auerbach / IT’S NOT JUST GOING TO COLLECT DUST ON A SHELF
only the Ed.D.—thus raising the need Ed.D. research methods courses to
for differentiation elsewhere. provide an “overview” of research,
The Ed.D. program at the focusing on “data collection skills for
University of Southern California (USC), action research, program measurement,
for example, was deliberately designed and program evaluation,” while six
to differ from its Ph.D. by equipping Ph.D. methods courses would specialize
students with “cognitive and in quantitative or qualitative methods,
interpersonal skills” for successful covering design, analysis, and
leadership, taking its cue more from the measurement theory (p. 6). Young did
needs of “educational settings rather not elaborate on the nature of the
than academic content” (Marsh & disagreement on research for the Ed.D.
Dembo, 2009, p. 73). Accordingly, It would appear that the applied
research skills were to be used to solve dissertation in Ed.D. programs remains
professional problems and “enhance a contested and unresolved issue in the
students’ professional competences” field.
rather than contribute to the knowledge Indeed, there are various factors
base (p. 78), and literature was that complicate efforts to carve out a
consulted to shed light on the problem coherent approach to applied
rather than to detect gaps that a dissertations. Even traditional
traditional dissertation could address. dissertations in academe have grown
Not surprisingly, Marsh and Dembo out of unspoken norms in the
(2009) point to designing appropriate apprenticeship model between chairs
research courses as the greatest and students; faculty are rarely trained
challenge of the USC program to date. in how to guide dissertations (Barnes &
“Although we have an applied focus for Austin, 2008). These norms, in turn, are
the inquiry methods courses in our internalized by faculty with doctorates
Ed.D. program,” they write, “issues who teach in Ed.D. programs. A 2005
remain about the nature and depth of study of doctoral advising, including in
knowledge students must acquire to use the field of education, found that a key
inquiry skills effectively in their work influence on advisors was the example
environments and to complete their of the institution where they received
dissertations” (pp. 83-84). This suggests their doctorates and their personal
that even in practitioner-oriented Ed.D. experience as doctoral students (Barnes
programs that are considered innovative & Austin, 2008). This implies a need for
and exemplary (Shulman et al., 2006), programs pursuing uncharted paths,
there is uncertainty about the nature of like that of applied dissertations, to have
the applied dissertation. open discussion about faculty
Similarly, when Young (2006) assumptions and expectations.
shared her model differentiating Ed.D. Applied dissertations on
from Ph.D. programs with colleagues at problems of practice at programs geared
15 UCEA institutions, the main area of to working professionals raise issues of
disagreement was regarding research practitioner research. Research done by
and the Ed.D. The model calls for three administrators at their own institutions
62
Auerbach / IT’S NOT JUST GOING TO COLLECT DUST ON A SHELF
clearly has potential to improve practice were expected to submit plans for
and directly address pressing launching an Ed.D. program according
educational problems. It is also more to the guidelines and timetable set by
likely to be seen as relevant and useful the CO, as well as the accreditation
by Ed.D. candidates, who typically requirements of the Western Association
prefer to do studies at their own of Schools and Colleges (WASC).
workplaces (Anderson & Jones, 2000). Individual programs and faculty that
But such research raises wished to transform the nature of
epistemological, ethical, political, and dissertations in educational leadership
methodological dilemmas (Anderson & had to do so within the expectations of
Herr, in press; Anderson & Jones, 2000), the CO for the traditional dissertation
beyond those of practitioner research by format and of accrediting agencies for
teachers. This greater complexity evidence of “doctoral culture.”
derives from administrators’ vested
interest and position of power in the Conceptual Framework
research setting, which could This study is guided by
compromise the integrity of the data, as conceptual frameworks in the areas of
well as the voluntary consent of policy implementation and sociocultural
research participants. “Administrators theory, which have a common concern
have barely begun to address the issues with the building of institutional
that arise around power and politics cultures. The launching of doctoral
when they study their own sites,” programs in the CSU has challenged a
according to Anderson and Herr (1999, formerly master’s-granting institution to
p. 19), and Ed.D. research methods create a doctoral culture grounded in
courses and dissertation committees are rigorous inquiry. This study examined
of little help (Anderson & Jones, 2000). the early stages in this long-term
While addressing practitioner research process through faculty conceptions of
dilemmas is beyond the scope of this the dissertation as a key artifact of
paper, these issues further complicate doctoral culture.
how faculty conceptualize applied The story of doctorates in
dissertations. leadership education in the CSU is in
When state legislatures enter the part a story of how actors at the local
debate, as they have in California, level negotiate and make meaning of
approaches to the applied dissertation policy that has been imposed from
by state institutions are constrained by above by state-level actors in the
mandates. The CSU Ed.D. programs had Legislature and Chancellor’s Office. This
their origins in California Senate Bill paper assumes that policy is
724, passed in 2005, which was further implemented not only through technical
refined in Executive Order 991 and Title steps in a chain of command but
5 regulations from the CSU Chancellor’s through a process of negotiation and
Office (CO) (Andre-Bechely, 2009), with interaction to build consensus around
the input of faculty and external norms. Even under the pressure of
advisory committees. All campuses system-wide mandates, reform entails a
63
Auerbach / IT’S NOT JUST GOING TO COLLECT DUST ON A SHELF
64
Auerbach / IT’S NOT JUST GOING TO COLLECT DUST ON A SHELF
65
Auerbach / IT’S NOT JUST GOING TO COLLECT DUST ON A SHELF
66
Auerbach / IT’S NOT JUST GOING TO COLLECT DUST ON A SHELF
and the dilemmas I faced in the research problems through the application of
process through analytical memos to “professional knowledge” and the
examine how they shaped my questions “integration of theory, research, and
and interpretations (Peshkin, 1988). practice” that leads to “change” or
“transformation” in education.
“It’s not just going to sit on the shelf”: Asked about the purpose of the
Views of the Applied Dissertation dissertation, participants spoke in a
Findings suggest that overall, the similar mix of language. On the one
first-wave programs were adhering hand, all described it as a rigorous
closely to the state legislation and work, most saying it should be just as
system directives regarding the applied rigorous as a Ph.D. dissertation and two
dissertation in their second year. All saying that it should demonstrate that
directors pointed to the legislation as a graduates knew how to do “credible
key influence on their program’s research.” All expected the dissertation
approach. However, there was variation to follow scholarly conventions in
in approaches that can be linked to matters such as academic writing,
individual and institutional factors at literature reviews, and data analysis, as
each campus, from a more traditional well as the dissertation structure and
academic orientation to a more format. On the other hand, most
applied/practitioner orientation, as we participants did not see its purpose as
will see. These orientations often hinged making an original contribution to
on the extent to which faculty saw the scholarship. One director stressed to
Ed.D. as comparable to the Ph.D. and faculty the difference between academic
the extent to which they made these and professional dissertations. Unlike a
assumptions explicit in dissertation Ph.D. dissertation focused on
guidelines. knowledge for knowledge’s sake and
Scholarship and Comparisons to the often testing or refining theory, the
Ph.D. There was general agreement purpose of the Ed.D. dissertation, this
among participants and program person and other participants said, was
documents that the dissertation should to contribute to professional knowledge
be a scholarly work that addresses and practice. For example, they spoke of
important problems of educational dissertation findings being “applied
practice or policy. Most descriptions of locally” to “local problems,” “having an
the dissertation on program web sites or impact” on practice and policy, “making
in student handbooks reflected the a difference” for students, being
language of the Executive Order, “meaningful in their [work] setting,”
dubbing the dissertation an “original” and “advancing equity.” “It’s an
work that uses “rigorous” methods to opportunity to influence the
study a “significant problem,” in a [educational] enterprise, to speak to
traditional five-chapter format. Program leaders within it,” said one director.
documents referred variously to Another called the applied dissertation
dissertations addressing “practical,” a “capstone intellectual experience” that
“real-world,” or “extremely relevant” “sets the stage for them [candidates] to
67
Auerbach / IT’S NOT JUST GOING TO COLLECT DUST ON A SHELF
take intellectual leadership, not just half of the outcomes. Campus C SLO’s
programmatic leadership, in the field.” also highlighted candidates doing their
Further comparisons to the Ph.D. own research of “local problems,” while
help to clarify what participants saw as other program SLO’s referred more
distinctive to the Ed.D. Several faculty generally to “engaging in scientific
across three campuses evoked the image methods to assess practice,” “promoting
of Ph.D. dissertations that “collect dust research and evaluation,” and working
on a shelf,” while conversely, they with data-based decision-making (at
envisioned Ed.D. dissertations as living Campuses B, A, and E, respectively).
documents of immediate use in local Most first-wave program SLO’s
institutions. “The dissertation is meant emphasized aspects of school leadership
to contribute back to the community,” development rather than readiness to do
said one faculty member. “It’s not just rigorous original research. This
going to sit on the shelf, but be variation in attention to research in the
something that a student could go in, SLO’s was roughly reflected in the
look at what’s happening in a school, number of research methods courses in
and [use it] to make a difference in that each program (excluding field-based
particular setting.” A program director courses that vary in function).
went further, saying that Campuses A, C, and F had four or more
“superintendents, principals, deans, and research-related courses, while
chancellors will be able to call up [the Campuses B, D, and E each had three.
doctoral program] and say: ‘I Dissertation Guidelines. Some of
understand someone did a study on X. the programs had specific expectations
We’re doing strategic planning now and for dissertations contained in chapter
need to consider those issues. Can we guidelines, checklists, and rubrics, while
get a copy of that study?’” others were “still feeling our way,” that
Participants agreed that Ed.D. is, in the process of refining policies at
dissertations should exhibit the same the time of the study. As with
rigor in research design and analysis as documents required by the CO and
a traditional Ph.D. dissertation. “There WASC for program approval, program
is an urgency for getting students directors often based their dissertation
grounded in research” from the start, guidelines and rubrics on those of other
said one director, and most first-wave CSU programs, leading to a certain
programs built in dissertation or uniformity in expectations—at least on
research support classes starting in the paper. For example, Campus C
first year for this purpose—“to keep the developed chapter-by-chapter
end in mind, to develop a research guidelines, which Campus D then used
passion,” as another director put it. as a model; a faculty member felt the
However, only one program, Campus F, guidelines would help keep students
featured research prominently in its focused and on task:
Student Learning Outcomes (SLO’s),
focusing on graduates being skilled We spent a lot of time trying to
consumers and producers of research in come up with a document that
68
Auerbach / IT’S NOT JUST GOING TO COLLECT DUST ON A SHELF
69
Auerbach / IT’S NOT JUST GOING TO COLLECT DUST ON A SHELF
70
Auerbach / IT’S NOT JUST GOING TO COLLECT DUST ON A SHELF
given the three-year timeframe, certain I don’t want students to cut corners, I
methods were not feasible, such as long- want them to do quality research. If you
term ethnographic and have the opportunity to gather more
phenomenological studies. For the same data [at more sites], take it.” At
reason, there was not sufficient time to Campuses A, C, and F, some
train Ed.D. students for sophisticated participants’ hesitancy about students
experimental or quasi-experimental using their own site for a case study was
studies. “If we’re honest,” said one influenced by the norms for master’s
director, “data collection will be at most theses or projects at those universities.
six months and in many cases as short “Our M.A, program has the option of a
as two to six weeks . . . I tell prospective thesis, generally at your own site; this
students, this is not the program for would have to be ratcheted up
longitudinal studies.” Another director considerably to be dissertation quality,”
felt that the tight timeframe made it observed a Campus A director. Thus,
unrealistic to expect dissertations to be though students were free to choose any
original contributions to scholarship. significant topic for the dissertation,
A key indicator of a more applied some topics were seen as too narrowly
orientation to the dissertation would defined if they pointed to a case study
seem to be formal or informal policies design at one site. On the other hand,
that welcome students doing research at some participants felt that the
their own institutions, with dissertation appropriateness of a student’s preferred
topics growing organically from topic, method, or site for dissertation
problems students encounter in their research should be completely at the
work lives. When asked if this was discretion of the dissertation chair—a
acceptable, some participants responded matter that becomes complex when
readily without caveats, or indicated chairs are drawn from faculty across
that this was the whole intention of the departments and there is limited time
program. For example, a faculty for cross-campus faculty discussion or
member at Campus F, said, “That’s orientation.
what we want [students] to do,” and a Practices and Policies for Applied v.
director at Campus C said that case Traditional Approaches. Participants from
studies of their own site were common. Campus A and Campus B were notable
Other participants said research at one’s for articulating their vision of applied
own site was possible but that students dissertations at the level of specific
would need to meet various criteria to program policies and practices,
justify it to their chair; these faculty suggesting that they may be more
expressed concern about expanding the committed to that orientation—or
scope of the study and its perhaps simply further along in the
generalizability. “My first thought process of clarifying an applied
would be, why not [study] all the direction. For example, a director at
schools in your district?” said one Campus A said:
faculty member. “There may be a
reasonable justification for just one site.
71
Auerbach / IT’S NOT JUST GOING TO COLLECT DUST ON A SHELF
72
Auerbach / IT’S NOT JUST GOING TO COLLECT DUST ON A SHELF
like the local flavor and are tying dissertation checklist adapted from
to encourage students to look Creswell’s (1994) text, used by both
more broadly. . . . I think it Campus F and Campus B, were: “Is the
depends on whether or not they topic likely to be publishable in a
are primarily practitioners. scholarly journal?” and “Does the study
(a) fill a void, (b) replicate, (c) extend, or
At Campus F, in contrast to A (d) develop new ideas in the scholarly
and B, there was more emphasis on the literature?”—both reflective of a more
scholarly rather than the applied nature traditional dissertation orientation.
of the Ed.D. dissertation. Two of three Influences on Dissertation Expectations
Campus F participants discussed the What led the first-wave programs
importance of producing research that to their approaches to the Ed.D.
was generalizable in order to ensure the dissertation? Among the most important
likelihood of publication. This was seen influences in the views of participants
as demonstrating that students knew were the legislation and Chancellor
how to do “credible research” and that Office mandates, faculty background
the program was adhering to WASC and training, and precedents set in their
accreditation standards. As one said: institution’s master’s program or joint
doctorate program. In addition, the CO
A lot of students say, “I’m only representative cited the influence at the
interested in the problem for my system level of faculty and external
district or my school.” But that advisory committees.
doesn’t really add anything to the State-Level Influences. Most
field. . . . That’s just a snapshot in participants said they followed the lead
time. To do it [a study] at one site of the state legislation and the
doesn’t tell you anything. . . . Chancellor’s Office mandates, especially
That’s what I try to emphasize to in initial program planning when
faculty: if you look at a problem timelines were extremely tight; some
in a narrow context, you won’t had since made modifications. First-
know if it’s generalizable and it wave programs were repeatedly told of
won’t be publishable. the need for dissertations to be of
“University of California quality”
Some dissertation chairs at Campus F because UC representatives had
required students to try to publish parts opposed the legislation and would
of the dissertation with them in an submit the first wave of graduates to
arrangement that they said was “close scrutiny.” Some reported that
mutually beneficial: the student CSU officials initially stressed that the
disseminates their work and the dissertations be traditional works of
professor has an incentive for advising scholarship: “there was no way, you
dissertations (i.e., they gain a weren’t going to move outside of that
publication toward the minimum parameter.” The push toward
number required of core doctoral traditional dissertations was reinforced
faculty). Two of the items on the by WASC accreditation criteria, which
73
Auerbach / IT’S NOT JUST GOING TO COLLECT DUST ON A SHELF
74
Auerbach / IT’S NOT JUST GOING TO COLLECT DUST ON A SHELF
magnitude. Thus, if single case studies innovate. But one noted that “elite”
or evaluations were the rule in a private institutions like some members
master’s program, a doctoral program of the Carnegie initiative had greater
might tend to encourage studies of latitude to experiment than did the CSU.
multiple sites. As another director said, “We’re
The joint doctoral programs were worried about how WASC will see our
also cited as a foundation that the new program if we’re too project-oriented”
Ed.D.s had built on, adding new rather than traditional.
features such as dissertation support Some programs had engaged
seminars or dissertation rubrics. faculty and students in substantive
Generally, however, dissertations in the discussion on these issues, while others
joint programs were characterized as assumed it would be covered in
being more traditional in purpose and research classes or the Institutional
approach than those of the new Review Board (IRB) Human Subjects
independent programs, with the notable approval process. In the latter case,
exception of Campus B. absent meaningful faculty discussion
Options for Alternative Approaches . across departments, it is difficult to see
The Carnegie Project on the Education how faculty teaching dissertation
Doctorate (CPED), which includes seminars or advising individual
representatives from the CSU programs, dissertations would reach a consensus.
mainly influenced views of the Several participants expressed keen
dissertation by exposing directors to interest in how their colleagues on other
some alternative approaches and, in the campuses were handling the dilemmas
view of the CO representative, of applied dissertations, and felt it
“legitimizing” the thematic dissertation. would be helpful to discuss these
Many participants were enthusiastic regularly across the CSU programs.
about the option of thematic or parallel Analysis and Conclusions
dissertations done by a small group of As we have seen, the first-wave
students working on related topics, as at CSU doctoral programs were in various
USC. As one former administrator stages of building Wenger’s (1998)
noted, the team approach was valuable communities of practice around the
because it reflected how administrators artifact of an applied dissertation. In
actually work in the field; another felt how they went about this, each sought a
Ed.D. students might do their best work particular balance between rigor and
under this model. Some participants relevance, or traditional and applied
were cautious, however, commenting approaches. While Campuses A and B
that “the jury is still out” on the rigor of showed the clearest evidence of an
alternatives or that “we need to go applied orientation, and Campus F
through a full cycle first” with showed a clearly more academic
completed dissertations before making orientation, the other campuses were a
major changes. Participants agreed that mix of approaches or in the process of
over time, the CSU programs would refining guidelines. Each campus’
evolve with greater flexibility to institutional culture, policies, and
75
Auerbach / IT’S NOT JUST GOING TO COLLECT DUST ON A SHELF
conditions shaped how each program dissertation was researched and written,
approached the dissertation and how rather than as part of the process of
local policy actors co-constructed it with doing it. Participants agreed that the
broader policy mandates. purpose of Ed.D. dissertations was to
Overall, the programs were still address problems of practice, often
“feeling our way,” as some participants within local educational institutions
said, in creating a distinctive approach (before), and hoped that that the net
to dissertations appropriate to impact of such work would be the
educational leaders. In Wenger’s (1998) improvement of educational leadership
terms, the community of practice was at practice (after). However, dissertation
the early stages in these programs with research methods as well as the format
group norms not yet fully realized for and content of the document were
its shared repertoire, including the conceived as largely traditional. Thus, if
dissertation. Most of the programs did pursuing a hybrid dissertation model, it
not have structures in place or time built was more by default rather than by
into their plans to facilitate mutual design.
engagement or reinforce a sense of joint This study suggests factors and
enterprise among doctoral faculty. dynamics that may tend to facilitate or
Perhaps large, teaching-centered constrain an applied approach to the
institutions like the CSU with heavy dissertation in CSU Ed.D. programs.
teaching loads and service obligations Facilitating factors moving first-wave
and large numbers of part-time faculty programs toward a more applied
are difficult contexts in which to approach were the commitment to
cultivate joint enterprise. With the “making a difference” with local
exception of a few program directors institutions and communities; CSU
who took explicit steps to nurture group mandates, such as the requirement of a
norms around the dissertation or K-14 practitioner on each dissertation
doctoral culture, the growth of these committee; the priorities of more
communities of practice was largely left practitioner-oriented faculty; the three-
to chance in a wait-and-see rather than a year timeframe ruling out a more
proactive stance. For example, several scholarly, in-depth approach, and
participants did not foresee changing student pressures or preferences. This
their approach to the dissertation set of factors opened the way for
beyond CSU system directives until reinventing the education doctorate to
they had gone through a three-year be more distinct from the Ph.D. and
cycle with their first graduates. more relevant to practice and the needs
It is possible that the first-wave of practitioners.
CSU programs were developing a Some of the factors constraining
hybrid model, retaining elements of an applied approach were the state
traditional dissertations while infusing legislation, CSU mandates for
them with some applied elements. They traditional dissertations based on
appeared to focus on applied aspects of rigorous research, WASC accreditation
the dissertation before and after the requirements, the need to differentiate
76
Auerbach / IT’S NOT JUST GOING TO COLLECT DUST ON A SHELF
77
Auerbach / IT’S NOT JUST GOING TO COLLECT DUST ON A SHELF
78
Auerbach / IT’S NOT JUST GOING TO COLLECT DUST ON A SHELF
79
Auerbach / IT’S NOT JUST GOING TO COLLECT DUST ON A SHELF
Anderson, G. L., & Jones, F. (2000). California State University Office of the
Knowledge generation in Chancellor. (2006). Doctor of
educational administration from Education Degree, Executive
the inside-out: The promise and Order 991, 1-20. Long Beach, CA:
perils of site-based, administrator Author.
research. Educational
Administration Quarterly, 36(3), California State University Office of the
428-464. Chancellor. (2007). The CSU
Ed.D. programs for educational
André Bechely, L. (2009). Capturing leaders. Retrieved June 1, 2008,
change in the making: The policy from www.calstate.edu/EdD
contexts for independent Ed.D.s at
California State University. Paper Datnow, Amanda, Hubbard, Lea, &
presented at the annual meeting Mehan, Hugh. (1998).
of the American Educational Educational Reform
Research Association, San Diego, Implementation: A Co-
CA. Constructed Process. UC
Berkeley: Center for Research on
Barnes, B. J., & Austin, A. E. (2008). The Education, Diversity and
role of doctoral advisors: A look Excellence. Retrieved from:
at advising from the advisors’s http://escholarship.org/uc/item
perspective. Innovations in higher /1470d2c8
education 2009, 33(5), 297-315.
80
Auerbach / IT’S NOT JUST GOING TO COLLECT DUST ON A SHELF
Elmore, R. (2004). School reform from the Kahne, J. (1996). Reframing educational
inside out: Policy, practice, and policy. New York: Teachers
performance. Cambridge, MA: College Press.
Harvard Education Press.
Levine, A. (2005). Educating school
Furman, G., Grogan, M., Sernak, K., & leaders. New York: Education
Osterman, K. (2009). From promise Schools Project, Teachers College,
to practice: Implementing the action Columbia University. Retrieved
research dissertation in educational April 1, 2005, from
leadership. Paper presented at the http://www.edschools.org/repo
annual conference of University rts_leaders.htm
Council for Educational
Administration (UCEA), Marsh, D. D., & Dembo, M. H. (2009).
Anaheim, CA. Rethinking school leadership
programs: The USC Ed.D.
Hall, P. (1995). The consequences of program in perspective. Peabody
qualitative analysis for Journal of Education, 84(1), 69-85.
sociological theory: Beyond the
microlevel. Sociological Quarterly, Merriam, S. (1988). Case study research
36(2), 397-423. in education: A qualitative
approach. San Francisco: Jossey-
Hargreaves, A. (1985). The micro-macro Bass.
problem in the sociology of
education. In R. G. Burgess (Ed.), Miles, M. B., & Huberman, A. M. (1994).
Issues in educational research: Qualitative data analysis: An
Qualitative methods (pp. 21-47). expanded sourcebook (2nd ed.).
London: The Falmer Press. Thousand Oaks, CA: Sage.
81
Auerbach / IT’S NOT JUST GOING TO COLLECT DUST ON A SHELF
82