Download as pdf or txt
Download as pdf or txt
You are on page 1of 11

Research Evaluation, 2022, 1–11

https://doi.org/10.1093/reseval/rvac018
Special Issue Paper

Devices of future excellence: Detaching


excellence recognition from ‘eminent men’

Downloaded from https://academic.oup.com/rev/advance-article/doi/10.1093/reseval/rvac018/6712276 by guest on 29 October 2022


1, 2,3
Roland Bloch * and Alexander Mitterle
1
Center for School and Educational Research, Martin-Luther-University Halle-Wittenberg, Franckeplatz 1, Haus
31, 06099 Halle, Germany, 2Department of Social Sciences, University of Hamburg, Max-Brauer-Allee 60, 22767
Hamburg, Germany and 3Institut für Mittelstandsforschung, University of Mannheim, L9, 1-2, 68161 Mannheim,
Germany
*Corresponding author. Email: roland.bloch@zsb.uni-halle.de.

Abstract
The global diffusion of the graduate school organizational model has shifted the way future academic
excellence is identified from a paternalistic master–disciple relationship to a collective organizational
decision. ‘Eminent men’ used to recruit PhD students on the firm belief that they could identify excel-
lence and integrate it in their own scientific endeavor. Graduate schools formalize such judgments and
transform them into an organizational decision. They establish admission devices to assure criteria-
based collective decisions. To understand this shift, the article draws on the example of two German
graduate schools that proclaim to search for outstanding doctoral candidates. As a latecomer in the
transformation to graduate schools, the German case allows to observe the shift in statu nascendi. The
article highlights the distinct role multi-site admission devices play. In both cases, they redistribute
agency and excellence through the construction of competitive social fields. Documents, grades, com-
mittee deliberations, interviews, and excel files mobilize a social space in which applicants are qualified
as acting holistically and competitively against each other in order to identify those most likely of future
excellence. Admission is not predefined but the result of a cascade of socio-material fielding practices
that purify a comparative social space, qualify applicants competitively, and infuse them with site-
specific agency that increasingly authenticates them as field actors. Building on the work of Michel
Callon and colleagues, we understand such formatting of future excellence as field agencements.

Key words: competition; agencement; admission; graduate schools; field; Germany

I approached the honorable man in June 1914 in a frock coat and paternalistic relationship between master and disciple that has trad-
top hat as it was suitable for a student at that time and was greeted itionally shaped doctoral education in Germany. Everything, from
by him at his home Am Hohenweg; the mansion still stands today. the professor’s forehead, the student’s clothing to the mansion
Of his professorial appearance, with a hoary beard and a thin reced- underlines the status difference in this relationship. It is built on two
ing hairline, the well-formed, slightly bulged-out forehead and the premises: Husserl sees in Plessner a follower of his analytical ap-
sunken-in temples were the most enthralling. He received the young proach—phenomenology—and, with a wink, a potential genius.
and intimidated visitor with warmth and paternal friendliness and Excellence at that time was an attribute of position (cf. Peter 2014:
indicated that he personally welcomed and supported his decision to 34ff) but one that emanated from the master to the disciple through
leave Heidelberg and to pursue his doctorate in Göttingen. . . . The a process of socialization.
phenomenology provided ‘room for a thousand geniuses’ Husserl While professors today are rarely approached in frock and top
told me right at my first visit, with a slightly ironic wink hat, the underlying premises have remained firmly in place. German
professors choose their PhD students based on subjective judgments.
(transl.1 Plessner 2003: 344, 352)
They recruit on the firm belief that they can identify excellence and
Famous sociologist Helmuth Plessner’s description of the first en- integrate it in their own scientific endeavor.
counter with his to-be doctoral advisor (in German Doktorvater ¼ This understanding of identifying excellence is widespread in
doctoral father) Edmund Husserl exemplifies in great detail the academia (Lamont 2009). It however is only one criterion of many
C The Author(s) 2022. Published by Oxford University Press.
V 1
This is an Open Access article distributed under the terms of the Creative Commons Attribution-NonCommercial-NoDerivs licence (https://creativecommons.org/licenses/
by-nc-nd/4.0/), which permits non-commercial reproduction and distribution of the work, in any medium, provided the original work is not altered or transformed in any
way, and that the work is properly cited. For commercial re-use, please contact journals.permissions@oup.com
2 Research Evaluation, 2022, Vol. 00, No. 0

in recruiting PhD students. In most countries, the identification of constitutionally granted freedom of research and teaching, profes-
future excellence is framed and mediated through formal organiza- sors cannot be instructed to supervise PhD students. Even if the lat-
tional procedures of universities. The global diffusion of the organ- ter fulfill the formal requirements, supervision, and with that
izational model of the graduate school (Nerad and Heggelund 2008; admission, remains a professorial decision to which no formal crite-
Nerad and Evans 2014) has detached the recognition of excellence ria apply.2 To this day, admission to the PhD has remained a ‘blind
from a paternalistic master–disciple relationship and transformed it spot’ in law that leaves it to a presupposed ‘basic trust in the integ-
into a collective organizational decision. In Germany, graduate rity of all actors’ involved (Gärditz 2015: 284, 288).
schools have been in place only since the mid-2000s. German uni- The growth of the research associate was not paralleled by an
versities are still organized around chairs and PhD students are typ- equal growth of professorial positions. Between 1972 and 2020, the

Downloaded from https://academic.oup.com/rev/advance-article/doi/10.1093/reseval/rvac018/6712276 by guest on 29 October 2022


ically recruited by the professor. The German late-coming to number of professors at German public universities quadrupled
graduate schools thus allows to observe a process that has taken from 6,300 to 25,000, while the number of research associates
place across the globe in statu nascendi: the transition in the identifi- increased 13 times from 13,000 to 173,000.3 Career perspectives
cation of future excellence from the intimate socialization through are bleak. With such a relatively low success rate in the academic
‘eminent men’ to admission devices in an increasingly rationalized system, excellence today is validated retrospectively—through
university (Ramirez 2006). By singling out two case studies of becoming a professor—rather than by the subjective judgment of
German graduate school admission, the article highlights the distinct university professors that often are known only to a small number
role multi-site admission devices play and the way they redistribute of interactants in their discipline. While the pre-1960s professor as a
agency and excellence through the construction of social fields. In widely recognized and thus eminent man legitimized his subjective
building on the work of Callon et al., future excellence is increasing- choice qua social position, there is nothing glamorous about the re-
ly established in what we call field agencements. cruitment of research associates in over-crowded universities. If they
do not succeed in securing a permanent position—usually a profes-
sorship—they are unceremoniously strained out by law after 12
1. Graduate schools as a new way of organizing years. The mass system lacks both organizational arrangements to
admission frame doctoral education and a clear framework to identify
To account for the recent transformation in German doctoral educa- excellence.
tion, it is important to understand how the paternalistic relationship Such forms of self-referential reproduction run counter to a
between ‘eminent men’ and disciples survived the transformation to growing engagement of nation states and their universities to foster
mass higher education. The 20th century saw a differentiation of research excellence and to attract talent in the increasingly competi-
academic degrees in German higher education. During the 19th cen- tive environment of the ‘knowledge economy’ (Paradeise and
tury, the PhD and the state exam had been the only academic Thoenig 2015). The German Excellence Initiative, a competitive
degrees. Through the upgrading of technical and business schools to scheme for distributing public research funds, responded to this
universities at the turn of the 20th century and academic differenti- need by integrating so-called ‘Graduate Schools of Excellence’ as a
ation after the Second World War, the lower academic degrees dip- core condition for institutional funding. Among the funding criteria
loma and magister spread. The doctoral degree’s significance was was the implementation of formal and competitive admission proce-
reduced to an elite status symbol and to a qualification for an aca- dures. In a very short period, the field of German doctoral education
demic career. With the advent of higher education expansion in the was restructured towards a large number of graduate schools in
1960s, universities increasingly lacked qualified academic personnel hope of funding. Today, all public universities in Germany have at
to teach growing numbers of students. There were not enough PhDs least one graduate school or comparable doctoral program (Bloch
to fill the vacant postdoctoral positions. To accommodate the de- 2018).
mand for academic teachers, universities increasingly used a lower
academic position: the research associate (wissenschaftlicher
2. Methodological perspective: on devices,
Mitarbeiter). In consequence, academic degrees were vertically dif-
ferentiated, with a first academic degree (state exam, diploma,
agencements, and field construction
magister) becoming the prerequisite for both the PhD (Vom Bruch German higher education has a long tradition of identifying academ-
2007) and the research associate position. Universities however did ic excellence through the subjective judgment of the professor. The
not develop a clear framework for doctoral education (Enders formal organization of admission to doctoral education consequen-
1996). Research associates were firmly integrated in the teaching tially integrates such subjective judgments but transforms them into
and research work of professorial chairs as the basic organizational a rationalized and collective choice by the graduate school.
unit of German universities. The intimate choice of disciples To understand this transformation, the article draws on a
remained unchanged and became normalized on a large scale since range of analytical perspectives from After-Actor-Network-Theory
in most cases, both the research associates’ work contract and their that theorize devices. Graduate schools will be analyzed through
doctorate depended on the support of the same professor. In con- the interconnection of three distinct concepts: device, agencement,
trast to other higher education systems, the double dependency on and field. The device refers to the concrete form of an admission
the professor as PhD student and research associate strengthened the procedure, the agencement to its operational logic, and field to the
chair system and the neo-feudal relationship with the chair’s distinct operational logic of agencement in an admission device.
occupant. In studying markets, researchers at the Ecoles de Mines in Paris
Consequentially, PhD students are recruited by professors, not have developed a tool-set to describe the fine-grained processes and
universities. Labor law applies to the position of the research associ- performative effects taking place in socio-technically framed and
ate but does not extend to PhD admission. Protected by the directed spaces (Callon 2021). They have formed a wide-ranging
Research Evaluation, 2022, Vol. 00, No. 0 3

research program to analyze the functioning of markets. Rather devices and sites, ‘a coordinated action around a strategic goal as . . .
than bifurcating between an economic science that invokes concep- in the case of market agencements’ (Callon 2021: 361). Callon thus
tions of markets and economic rationality and the social embedded- integrates a form of power-analysis into the study of markets.
ness of markets, Michel Callon and colleagues aim at thinking the Agencement explicates the success of integrating an economic state-
scientific, social, and material aspects that institute distinct markets ment into its socio-technical context. It denotes a process that builds
as entangled (C¸alışkan and Callon 2009). Starting with concrete on trials, tools, equipment, valuation systems, procedures, etc. In
markets—such as strawberry or derivative markets—they investi- this sense, it is agencement that renders a device economic—as mar-
gate how these operate: ‘their design, implementation, management, ket device (Muniesa, Millo and Callon 2007: 3; C¸alışkan and Callon
extension and maintenance—in short . . . their dynamics’ (C¸alışkan 2010: 9).

Downloaded from https://academic.oup.com/rev/advance-article/doi/10.1093/reseval/rvac018/6712276 by guest on 29 October 2022


and Callon 2010: 19). Markets may seem abstract, but they are Beyond the descriptive and thus diffuse definition of agencement,
enacted through what they call devices. Such a market device may the agencements in market devices have specific features in com-
be a program, a bank, a scorecard, etc. A device is a separable socio- mon: they analyze how market goods are established through ob-
technical instrument that can be meticulously investigated and its jectification, singularization, and qualification (as the most
inner workings exposed (Muniesa, Millo and Callon 2007). While significant variables). For markets to operate, a ‘thing’ has to be
the everyday meaning of device refers to a technical instrument that identified and singularized as a passive but moveable market object
extends or facilitates our agency—a TV remote control (change with distinct and valued properties (C¸alışkan and Callon 2010). It is
channels), a weapon (kill), a smart-phone (call)—the term also extracted, translated, and reformatted to fit a framed market setting
alludes to a distinct socio-philosophical tradition. Callon and (Callon and Muniesa 2005: 1235). It is made a good. This can be a
Muniesa’s (2005) as well as Latour’s (1987) ‘inscription devices’ are basket of strawberries but also a service that lacks ‘physical reality’
rooted in the works of Michel Foucault and Gilles Deleuze. The (Callon and Muniesa 2005: 1233). The price of the passivated good
French equivalent of a device, the dispositif, was developed by as the result of these various (but open) framings is what ultimately
Foucault as a distinct discursive and strategic formation. Deleuze’s qualifies the agencement as a market agencement.
interpretation (1991) provided it with a socio-material spin. Callon Given the selection of PhD students does not come with a price-
and colleagues then adapted the term to describe the socio-technical tag on their work, understanding graduate school admission as part
arrangements that frame markets (cf. Callon 2007; Cochoy 2016). of a market agencement would assume markets where they do not
A device in this sense is thus more than a purposeful facilitator. exist. Callon calls this counter-agencement and failure. Admissions
Devices actualize scientific theory. They are world-building arrange- indeed establish a competitive and time-bound space to identify fu-
ments. They comprise the architecture that translates economic mar- ture excellence but, as we will see, at no point do these arrangements
kets from the imaginative world of scientific formulas to the way in single out and passivate market goods. Callon does address such
which distinct goods or services are exchanged. Translations always spaces but only as a qualifying void that stabilizes markets. He calls
come with betrayal (Latour 1996: 376). In adhering to the formula, spaces that ‘are free from all internal commercial transactions’ but
they necessarily deviate from it to make it work. Here, the wider no- come with a number of qualifications ‘transaction free zones’
tion of the Foucauldian-made Deleuzian device becomes apparent. (Callon 2021: 370). One example of such a space is the ‘world-
Devices institute their own subjectivities and objects. In this way, championship for baristas’, an international competition in which
they perform people, regulations, and techniques as an ensemble in ‘all the efforts converge to qualify a coffee without a price’ (Callon
the multiple ways discussed above. 2021: 371). Cafes that adhere to the formal standards of the com-
While inspired by Foucault, the device is not a dispositif. Callon petitive ‘playing field’4 can argue they are serving good coffee
(2021: 357) especially opposes the interpretation of dispositif as a (Callon 2021).
formatting apparatus of ‘living beings’. Precisely because devices Treated as non-commercial qualifier for goods, assigning the
perform their own subjectivities and objects (the socio-material term ‘transaction free zones’ might be adequate. In view of the over-
spin), Callon and colleagues aim to avoid any pre-imposed under- lapping and intermeshing of agencements, these competitive spaces
standing of (human) agency and intent in socio-technical arrange- ought to be themselves understood as a carefully adjusted agence-
ments. Rather, they emphasize the collective but contingent agency ment. The main purpose of the world-championship of baristas is,
that relates statements and formulas to their socio-technical actual- as the name indicates, not to judge the quality of coffee but the abil-
ization in devices. They call this socio-material intermeshing agence- ity of a barista to brew coffee.
ment. Again, the term agencement (translated in English to The realization of competitive standards in a local cafe allows to
assemblage) traces back to Deleuze, namely his collaborative work evaluate the local barista as if it was the world championship: given
with Felix Guattari (2004) in ‘Thousand Plateaus’. An agencement same standards her or his brewing may be worse than next door. By
‘conveys the idea of a combination of heterogeneous elements that singling out a range of standards and testing procedures, cafes and
have been carefully adjusted to one another’ (Callon 2007: 319). their employees are drawn together as local expressions of and posi-
The choice of the terms ‘device’ and ‘agencement’ leads to an analyt- tions in a competitive field in coffee brewing. What is crucial is the
ic problem. Deleuze’s agencement also originates in his reading of role of competitive standards. By defining what counts, everything
Foucault’s dispositif (Deleuze 1992; Callon 2021: 358). In order to else is scrutinized as the ability of the barista. Anything in the com-
break away from these ‘treacherous translation[s]’, Callon suggests petition can become relevant but only as the agency of the person
narrowing the device to the socio-technical reading above and to use assessed. S/he is singled out and made comparable. In contrast to a
the term agencement for an overreaching ‘realistic simplification . . . market that passivates and mobilizes goods, the social space empow-
determining the most significant variables, rather than simply cele- ers and mobilizes social units. The space over-socializes its subjects
brating the world’s complexity’ (Callon 2021: 360). The heterogen- in that it values ceteris paribus nothing but situated agents along
ous elements in devices are ‘carefully adjusted’ to provide the taste and more or less defined criteria. Rather than folding (the repu-
agencement with a distinct but mutable form, framed across various tation of) market-actors into separated objects (exchange goods),
4 Research Evaluation, 2022, Vol. 00, No. 0

objects are either standardized (the machine) or folded into actors as very extensive, we put a lot of effort into it. And yes, you can say
qualities (cf. Mitterle 2022). that . . . we get the best. (Professor, Scheelheim Graduate School,
In this way these ‘transaction free zones’ transcend their com- Interview 1, lines 126–31)
petitive purpose and are not just barista championships. Each cafe We have a very, very strict admission process, very competitive.
. . . And when you look at the students we have attracted and
that adheres to the standards operates as a device to imagine this dis-
accepted, then this is an extremely good selection, we have ex-
tinct social space. They are not merely ‘zones’ but empirical manifes-
tremely good students at Gen-Ius. . . . We have no mainstream
tations of the psychological and sociological concept of the social people, we have people who think interdisciplinarily . . . we sim-
field. Deriving from magnet theory, fields have become analytical ply have exceptionally smart students. (Professor, Gen-Ius
forms of reducing complex interrelations to their social components Graduate School, Interview 19, lines 163–75)

Downloaded from https://academic.oup.com/rev/advance-article/doi/10.1093/reseval/rvac018/6712276 by guest on 29 October 2022


(cf. Martin 2003). Space is ‘directed’ (Lewin, 1917) towards social
relations, their patterned diffusion (DiMaggio and Powell 1983), Those who found a graduate school at a German research uni-
and at establishing contested positionality among actors and social versity aim to recruit excellent doctoral students. They thus reinvig-
aggregates (Bourdieu 1998; Wooten and Hoffman 2008). While in orate the idea of recognizing excellence so remarkably exemplified
sociology and psychology social fields are primarily used to explain by Plessner. The eminent men’s claim of excellence recognition stuck
social interaction, these explanations leave traces of validity that re- to the new procedures. While the recruitment of research associates
form social space towards their theoretical frame. Bourdieu’s corres- maintained an ambivalent relationship to excellence—graduates
pondence analysis of the French Grandes Écoles for example did not were recruited as disciples but also as deplorable and easily dispos-
just describe the structure of French elite higher education but able workforce—graduate schools are built around an organization-
reduced it to meaningful relations in the field. He thereby positioned al model that not only provides formation but also establishes a
these schools towards each other so that we can grasp them collect- distinct organizational border to elevate its selection. Crucially, the
ively but also to make each of their actions a positioning in this puri- graduate school model is a major revision of the German chair sys-
fied social space. The impressive visuality allowed to transfer the tem. For the first time, PhD student positions are implemented in
model to other higher education systems. While positionality is not universities that are formally attached to an organizational unit ra-
rank order, the way rankings are constructed today imagines higher ther than individual chairs: supervisor and employer are split apart.
education as a field of competitive actors rather than locally In line with the Anglo-Saxon model, the purpose of organized ‘doc-
embedded state institutions (cf. Bloch and Mitterle 2017). toral admissions [is] . . . about identifying rising stars’ (Posselt 2016:
Sociological and psychological research as well as changing cultural 74). This takes place through a cascade of changing selection stages
perceptions and technical innovations have made it increasingly pos- which increasingly narrow down the number of applicants (cf.
sible—beyond the specific sociological frame of analysis—to per- Bloch et al. 2015). In stark contrast to the intimate selection by the
ceive social relations as taking place in social fields. professor or the mass recruitment of non-tenured doctoral research-
Admission processes are thus not mere selection processes in ers, this cascading border zone of the graduate school operates as a
which excellence can be intimately recognized or tested but they socio-material device to identify future excellence for the school and
themselves are devices that ‘impose a view of the social that estab- its professors.
lishes strict distinctions’ (Callon 2021: 356). Commonly referred to In the following, we examine the way admission devices select
as a ‘field of applicants’ (Bewerberfeld), they resemble the way field applicants drawing on two organizational case studies of German
concepts structure space. In contrast to After-ANT’s emphasis on graduate schools that were funded by the Excellence Initiative from
bringing the socio-material ordering in especially the natural scien- 2007 to 2018. The case studies were conducted within the larger
ces to light, this approach emphasizes the agencement of sociological framework of a research unit that investigated emerging stratifica-
and psychological concepts. Field agencement is a distinct way of tions across different levels of the German educational system
using socio-material instruments to build fields that are nothing but (2011–7). Within an ongoing vertical differentiation of German
social. Social fields as analytical concepts and as material devices higher education, Graduate Schools of Excellence have become a re-
source for positioning universities in excellence competitions and be-
share a complicity to reduce a factual space to meaningful and
yond. The cases were selected along the distinction established by
shared relations of social units. The shared relations restrain but
the Excellence Initiative and included two Graduate Schools of
also hold potentiality for directed improvement. These spaces are
Excellence located in different (inter-)disciplinary contexts. The case
not predetermined but bounded spaces for ordering (Mannheim
studies built on reviewing formal documents (curricula, PhD regula-
1958). In this sense, it is agencement that formats the admission de-
tions) and self-accounts for advertising purposes, and ethnographic
vice into a field of comparable actors which procedurally positions
observations of core organizational processes in the graduate
the applicants vertically to draw the most excellent from its pool.
schools (here: the meetings of the selection committee, in one case
Agencement renders admission a fielding device.
also the interviews with candidates). To understand the decision
making and the rationale of graduate school members in these proc-
3. Admission devices and future excellence—the esses, we further conducted 24 problem-centered interviews with the
cases and methods schools’ faculty, administration, and students (cf. Table 1).
Problem-centered interviews prestructure the narrative (cf.
With the implementation of so-called Graduate Schools of
Witzel 2000) in order to integrate parts of the process that are diffi-
Excellence came the call for not only formally organizing admission
cult to observe, to which access is denied, or to reveal the cognitive
but also for framing it as a competitive procedure to select the best.
dimension of organizational processes (here: identifying excellence
And basically, the selection . . . is highly competitive. Well, by in admissions). Formal documents, interviews, and observations
now we get applications worldwide. We have received 270 appli- were used as ‘entry points’ to building thick socio-material descrip-
cations for nine positions. And that is a multi-stage process, very, tions (Nespor 1994) of the admission processes and to identify the
Research Evaluation, 2022, Vol. 00, No. 0 5

Table 1. Interviews by position, gender, discipline, and graduate school

Gen-Ius graduate school Scheelheim graduate school

Total Female Social sciences Natural sciences Total Female Humanities Social sciences

Faculty 5 0 2 3 5 1 2 3
Administration 3 3 – – 1 1 – –
PhD students 3 2 1 2 7 4 2 5
Total 11 5 3 5 13 6 4 8

Downloaded from https://academic.oup.com/rev/advance-article/doi/10.1093/reseval/rvac018/6712276 by guest on 29 October 2022


Names of persons and schools have been pseudonymized to allow for a better reading. The gender composition of the interviewees reflects general gender
inequalities in German academia. Faculty members and PhD students were chosen to cover the range of disciplines involved in the graduate school. In both
schools, the head of administration was interviewed. At Gen-Ius, further administrative staff for specific tasks such as admission were interviewed.

multiple ways in which the schools construct themselves as sites of pretty clearly in these things. Of course, they can also be forged
excellence. Following the way academics make their decisions, how etc. That is possible, too. But somehow you can see a lot in them.
they integrate standardized admission documents, use calculation (Professor, Gen-Ius Graduate School, Interview 24, lines 134–40)
devices, and attribute legitimacy, the case descriptions abductively
In stark contrast to the differentiated list of prerequisites, the
explicate that the graduate schools attribute excellence through the
first comparison of applicants in the admission procedure does not
factual construction of a competitive social field.
rely on distinct criteria but diffuse characteristics of Gen-Ius.
Professors holistically reconstruct the person through documents:
4. Fielding devices I: holistic reviews, drawing on the statement of purpose, an interesting personality, the
matching with the graduate school, or a lack of structure can be
commensuration, and authentification
‘pretty clearly’ identified. They can ‘see’ whether applicants ‘really
Gen-Ius is a Graduate School of Excellence that combines disciplines have the interest and competency to look beyond the rim of their
from the social sciences and the natural sciences. The school was tea-cup’, as a professor (Gen-Ius Graduate School, interview 16,
founded to establish not only a new interdisciplinary research field lines 233–4; emphasis added) exclaims. Even the research idea is
but also a new discipline. The admission procedure begins by requir- seen as a mere expression of the applicant’s ability. The various
ing applicants to provide a dossier of documents designed to present texts, images, and references are folded into ‘the person behind this
themselves: a CV, a research proposal, a statement of purpose, a statement’.
standard-language test, and letters of recommendation. These pre- To allow for comparison among applicants, not all potential in-
requisites for being considered as applicant take an increasingly formation is accessible, but the format allows for excessive combin-
rationalized and standardized form. They allow to address various ation. It is also strongly advised that applicants talk to potential
competencies of the applicants and to render them comparable in a supervisors beforehand which provides additional contextual infor-
competitive admission setting. As Hamann and Kaltenbrunner (in mation. In this sense, the setting provokes agency among the frag-
this issue) show, CVs have changed from a narrative to dense but mented selves: the way each primarily document-constructed
easily navigable bullet points that provide a wide perspective on pro- individual is able to perform a stable and authentic personality—one
fessional accomplishments, or—as we will see—voids. that does not lack a ‘clear idea’ or seem ‘forged’—relates to its com-
The research proposal, while generally expected in the social sci- petitors and perceptions of agency through those selecting (Rothe
ences and humanities, is uncommon in the natural sciences. There, 2013: 64).
doctoral candidates are usually recruited to conduct third-party In the ways such situated and fragmented experience allows to val-
funded research projects within a professor’s research group. The idate a competitive selection, it is complicit in transforming admission
dissertation emerges as the research project progresses. For the ad- into a social field. The endeavor roots in early 20th century
mission process, the research proposal allows to formally compare Gestaltpsychologie which assumed that from structured experimental
applicants from natural and social sciences while also projecting ex- social field settings, holistic personality traits could be derived
cellence and selectivity for the program. (Highhouse 2002). The careful analysis of documents, group inter-
Admission heavily expands into individual timeframes before the action, or interviews thus allows to perform and judge authentic behav-
actual selection process, urging applicants to create differentiated ior of applicants. More than that, in contrast to the psychoanalysis of
dispositions that are directed at this procedure. This qualification impulses or to assuming individual predispositions—as it was common
for admission is what allows to span a common comparative space in the 1940s and 1950s—Gestaltpsychologie contended that personal-
of information and testable selves for the purpose of preselecting ity traits could only be derived and understood in situ. Early propo-
applicants. The first stage of the admission procedure draws on pro- nents of this approach—such as field theorist Kurt Lewin—developed
fessorial members of the school to review the dossier. It is predomin- test formats that were the forefathers of what today is known as assess-
antly paper-based: ment centers (Horn 2002; Rothe 2013). Such review formats are
directed at identifying distinct leadership traits or at least personnel suf-
There is a person behind this statement of purpose. What does
this person want to do? Well, on two pages you can somehow al-
ficiently fit to the task, not future research excellence. Gen-Ius admis-
most immediately see, is this an interesting person, is this person sion does not spell out how future excellence might be assumed. In this
maybe in the wrong place here, or in the right place, or is it some- sense, it is more likely that the selection procedure did not build on psy-
how somebody who wants to do something here but has no clear chological expertise—in fact lacking the participation of expert psy-
idea what exactly that could be. That is something you can see chologists as it is common in assessment centers—but mimetically
6 Research Evaluation, 2022, Vol. 00, No. 0

borrowed elements common to admissions in US graduate education. At the field site of the preselection committee meeting, a reviewer
The admission thus highlights the expansion and legitimacy of proce- and potential PhD-supervisor’s judgment is tested and reproduced in
dures to measure situated and competitive action (fields) for judging front of an audience. Professor Vandenberg challenges Professor
abilities despite a lack of evidence that these procedures serve the pur- Wellingshausen’s judgment that having published before starting a
pose adequately (cf. Highhouse and Kostek 2013). The admission de- PhD contradicts the identification of future excellence. Professor
vice at Gen-Ius is loosely built on a paper-based, individual-centered Wellinghausen contextualizes his review by relating his own experi-
selection process known as ‘holistic review’ (Stevens 2009: 186ff). ence from the informal preselection interview (‘pompadour’) with a
Holistic review—again rooted in the situational phenomenology of formulation from the proposal (‘shape tomorrow’s science’), and the
Gestaltpsychologie—became the state-of-the-art admission practice at CV (age, missing publications). The lack of publications in his CV is

Downloaded from https://academic.oup.com/rev/advance-article/doi/10.1093/reseval/rvac018/6712276 by guest on 29 October 2022


US universities because it made it possible to weigh criteria such as di- treated as a sign of authenticity, revealing the applicant as overstat-
versity without using quotas or over-valuing standardized measures (cf. ing his abilities. Drawing on information that is not accessible to all
Posselt 2016: 56). Lacking any functionality beyond narrowing down members of the preselection committee, Professor Wellinghausen
the number of applicants without incurring high travel or organization- argues for the applicant’s rejection which other committee members
al costs, the holistic review highlights a critical element of the admis- then can confirm. The different elements are folded into the appli-
sion procedures. What creates ‘exceptionally smart students’ at Gen- cant’s personality; they are brought together in order to cross-check
Ius are not distinct formal criteria that would allow for a common the applicant’s authenticity and confirm individual judgments
frame of excellence recognition. It is simply the ‘belief’ (Highhouse and through a collective decision.
Kostek 2013: 565) in the holistic sorting power of the evoked competi- The informal meeting between a ‘pompadour’ and Professor
tive social field. Wellinghausen here is distinguished from Plessner’s encounter with
While in the US this ‘belief system’ is in its extreme form directed Husserl. Instead of the initiation of an intimate relationship between
at valuing each applicant as an individual in a deliberative process the master and his disciple, the applicant is tested on a strategic self
that the potential supervisor had derived from a dossier. Having
among admission staff (cf. Stevens 2009), at Gen-Ius, the paper-
established their incongruence, they do not simply part, but the un-
based judgments of reviewers are translated into a commensurable
willing supervisor has to write a review and possibly defend his deci-
vertical order. Each applicant is assigned three reviewers who pro-
sion before his colleagues from different disciplines on grounds that
vide a holistic rating of the abilities and fit of the applicant for the
are not related to the content itself. While Plessner was recognized
graduate school. The assumption of a common organizational scale
by Husserl because he had already published a book, this was nei-
that aligns judgments from the social and the natural sciences allows
ther a judgment of authenticity nor a competitive mark against other
to draw all review-triplets together as a field. Each applicant holds a
applicants: Husserl already knew Plessner and Plessner sought
relative position towards and is determined by the others. This field
Husserl because he wanted to be affiliated with his school of
position is accompanied by a brief biographical summary formu-
thought. The meeting was a source of reminiscences, not of later
lated by the admission administration, a written judgment by the
field site enactment.
reviewers and, where applicable, a statement by a potential super-
Different to common holistic review formats which directly lead
visor. This positioning process is necessary to make the applicant
to an admission decision, the preselection committee’s decision
discussible on the admission site, in the preselection committee
determines the applicants for in place interviews. All professorial
meeting.5 Rather than just narrowing down information or reducing
members of the graduate school are invited to participate in these.
it to the scale, the procedure adds new information from reviewers,
Applicants present their proposal and are questioned in front of an
admission staff, and potential supervisors, and thereby renders intimidating group of professors from different disciplines. This field
applicants from widely differing disciplines commensurable. The ap- site again adds information to the selection process by having appli-
plicant has become requalified to again assume agency on the next cants embody their respective dossiers under time constraints. The
admission site. committee observes 22 interviews in one day. In order to reach a
At the preselection committee meeting, the decision-making is final decision by the end of the day and assure comparability, the
structured through the vertical order of grades. They provide the timeframe for the presentation and the questioning is meticulously
field structure that leads to a range of high-graded cases being monitored and abided by. Again, the committee members follow the
accepted on-site. Yet due to the careful requalification, the site tran- selection pattern of the first two sites.
scends this order. As all committee members can see more than the
grade before them, some applicants can enroll ‘speakers’ on their be- The criteria are that you have an excellent education. . . . That
half to challenge the gradings. These ‘speakers’ reopen and discuss you have an interest in interdisciplinarity, and maybe also al-
ready have shown some activities here. And that you can inspire
judgments from the first site:
through your proposal, which you have to present. And I must
At position 25 [Prof. Vandenberg] asks what exactly the say, this inspiration through the proposal and the way, how you
reviewer’s critique means: ‘That he has not published anything present yourself; that is the bottom line. (Professor, Gen-Ius
yet?’ [Prof. Wellinghausen] recalls the applicant as ‘a thirty-year- Graduate School, Interview 19, lines 179–83)
old with a pompadour [Fönwelle]’ whose manner had been ‘very
The quote indicates a distinct pattern throughout the admission
self-conscious, even swanky [großkotzig]’. That is why he had
noted missing publications as a negative point. He cites from the
device as the socio-technical arrangement of sites. By narrowing the
applicant’s proposal: ‘I will shape tomorrow’s science. . .’ [Prof. field of applicants from each site to the next, the authentic embodi-
Wellinghausen] insists that despite this claim not even a [paper] ment of the applicant is judged by ever more committee members.
abstract exists. [Prof. Mitterlich] considers this to be ‘very suspi- While at the first stage, only some of the possible future supervisors
cious’. The applicant is rejected. (Observation transcript, first saw applicants in person, they were then embodied on the preselec-
meeting of selection committee, Gen-Ius Graduate School) tion site as a narrative for all to hear when necessary. Now the
Research Evaluation, 2022, Vol. 00, No. 0 7

committee is opened to the faculty and all members have the oppor- contrast, Candidates 7 and 14, both ranked ninth with the same
tunity to judge for themselves whether the applicants are able to ‘in- score, cannot be accepted both. Professor Pander aims to resolve the
spire through [their] proposal which [they] have to present’. The issue with a vote on Candidate 14 but the discussion shifts to requa-
‘person behind’ the proposal becomes manifest to be judged in a lifying the applicant. By sheer coincidence, it turns out that
competitive setting as true to the proposal. This setting also allows Candidate 14 was a disciple one professor sought to place in the
to explicate how interdisciplinarity is tested. While it remains un- school. The case thus highlights how through an alignment of field
clear how a distinct PhD proposal could be judged through sites the master–disciple-relationship is reframed in a field
reviewers from different disciplines, the way committee members agencement.
address interdisciplinarity is by interrogating how applicants see Professor Kaiser and the Professors Deichmann and Heinemann

Downloaded from https://academic.oup.com/rev/advance-article/doi/10.1093/reseval/rvac018/6712276 by guest on 29 October 2022


themselves. By having each committee member provide a grade, explicate two diverging rationales for the graduate school. For the
interdisciplinarity is established by procedure. In stark contrast to latter two, the graduate school is more than its parts: admission is
the master–disciple setting of the German university, the only person an authentification of personal qualities (bad presentation) and the
excluded from the vote is the potential supervisor. The field site pro- applicant’s willingness to embrace and integrate their research into
duces a decision for her or him to which s/he is expected to abide. the school’s agenda to establish a new discipline. Professor Kaiser
Despite the rational organizational framing, the decision is pre- on the other hand sees the school primarily as made up of its profes-
dominantly structured through time. Due to time constraints, the sorial parts. The graduate school’s research mirrors the research of
committee members barely engage in discussions between inter- the ‘eminent men’ involved. He aims at placing his candidate in the
views. They quickly provide grades which the admission staff assem- graduate school. Not only had he already accepted to supervise the
bles in an excel table. After a long day of interviews with applicants, candidate but, as a brief exchange before the candidate’s interview
the committee convenes to make a final decision. Instead of engag- indicated, he seemed also to have co-inspired the candidate’s re-
ing in an open discussion about applicants and decisions, the com- search proposal. Through his intervention, he not only speaks for
mittee members turn to the excel table for it to decide for them. the applicant but reattaches himself to her, adding a quality that is
not available for stand-alone applicants: to reject his candidate
The committee members study the Excel table. [Prof.
Heinemann] states that there is ‘no cut’ [in the rank order]. [Prof. means to reject not only his judgment about the candidate’s excel-
Pander] asks where they should make the cut. [Prof. Heinemann] lence but also his research, and ultimately himself. The conflict is
concedes that if they were to admit candidate 4 [ranked 7th] then resolved through Professor Kaiser’s factual withdrawal of the candi-
they would need to admit also candidate 8 [ranked 8th] because date from the competitive field site before risking a vote against
both display the same score. He suggests to admit the first eight. him. He draws on other resources to secure funding for his disciple.
[Prof. Pander] asks about candidates 7 and 14 who share the Candidate 14 takes Candidate 7 with him who after the intervention
ninth position with the same score. He asks who is in favor of is not even discussed. The first eight candidates are accepted solely
admitting candidate 14. [Prof. Vandenberg] objects because it is
based on grades, the discussion of the ninth is resolved through a
not a basic research project. [Prof. Heinemann] considers this not
lack of resources, alternative placement options, and rule extension.
to be an argument but the presentation had been bad and candi-
date 14 had shown no relation to Gen-Ius. [Prof. Deichmann] The discussion indicates that eminent men still take up powerful
asks if there are sufficient resources for eight grants. [Mrs. positions. Though applicants may be judged independently as future
Wolter, head of administration] responds that resources are con- excellent researchers, some of them are still understood as attached
strained . . . [Prof. Kaiser] asks why candidate 14 has no relation to a professor and disciples of a specific school of thought. Yet, the
to Gen-Ius. [Prof. Heinemann] elaborates that the candidate had distinct conditions, the supervisors’ exclusion from the vote on their
not responded to the respective question. [Prof. Kaiser] takes this own candidate (which in the case of Candidate 14 might have made
personally [it is his candidate] and states that he could leave now the difference), and the need to discuss a candidate based on the
because he then neither has a relation to Gen-Ius. . . . [Prof.
rules of a purified and competitive field site would transfer the emi-
Pander] and [Prof. Heinemann] conciliate that they are far from
nent men to the admissions pit. If he had not withdrawn, Professor
implying this. . . . [Prof. Bernhard] argues that because candidate
14 has a transitional grant they could maybe admit her anyway. Kaiser would have become a quality of the applicant on which the
. . . To have a grant cannot be a criterion, objects [Prof. Pander]. other committee members would have voted on. The field agence-
. . . [Prof. Kaiser] concedes that he could place candidate 14 ment does not sieve out these candidates from academia but deflects
somewhere else, it would not need to be Gen-Ius. . . . It is decided them into funding positions that are closer attached to the professor.
to admit the first eight according to the ranking. (Observation The distinct framing of applicants as acting in various qualities
notes, second meeting of the admissions committee, Gen-Ius across consecutive field sites and judged by professors themselves
Graduate School) has established a hiatus between eminent men and their disciples.
The calculative function of a simple charting device provides the
means for structuring the field of applicants. The excel table is
5. Fielding device II: academic grading practices,
expected to perform a rank order of applicants in relation to an ap-
commensurating topics, and renaming the
proximate intake number of eight or nine. As several candidates
share the same scores and thus position in the ranking or just differ
grades
by decimals, there is ‘no cut’. Initially, the grades stir the discussion Scheelheim Graduate School is a Graduate of School of Excellence
to the point at which the ‘cut’ in the rank order should be made. The in the humanities and the social sciences. Again, the admission pro-
discussion is then confined to candidates with identical grade scores cess is structured through multiple levels of selection. It starts with a
beyond the minimum intake number of eight. Given the two candi- formal process in which all applicants have to provide a CV, a letter
dates sharing the seventh place were within the range of funded of motivation, a letter of recommendation, and a research proposal
positions, they were admitted without further discussion. In within a strict format and page limit. A high number of applications
8 Research Evaluation, 2022, Vol. 00, No. 0

are turned down simply because they did not conform to the formal applicants if they get an especially strict reviewer. She would
criteria. double-check those with exceptionally bad grades (zero points).
Similar to Gen-Ius, Scheelheim emphasizes the importance of the (Observation transcript, first meeting of selection committee,
research proposal to identify future research quality. The process Scheelheim Graduate School)
however differs. Rather than combining the documents for a holistic Different to Gen-Ius, the grades do not institute a common order
review that authenticates an applicant’s motivation and claim,
from which those to be invited for interviews are picked. Each com-
Scheelheim singles out the proposal for evaluation. Purified from
mittee member assembles a list of nine candidates and seven substi-
any information about origin, (inter-)disciplinary background, and
tutes for the preselection meeting. While acknowledging that each
motivation, the nameless applicants are enrolled as their research
proposal is qualified ‘differently’, the sheer number of applicants

Downloaded from https://academic.oup.com/rev/advance-article/doi/10.1093/reseval/rvac018/6712276 by guest on 29 October 2022


projects in a blind review by professorial members of the faculty.
makes the committee member turn to the common grading scale to
This anonymity is regularly contested by faculty, and their rumbling
narrow the field of applicants. It is herself who transforms a grade
will eventually surface later in the admission process. Yet at this
into the decisive structuring quality of the field: the better the grade,
stage, ‘the reviewers . . . do not get the CV’ (Interview 6, head of ad-
the higher the applicant’s ability to achieve future excellence
ministration, line 325). They receive only the proposal that comes
(defined along the three criteria of the reviews). Other members
with a set of predefined criteria and a grading scale.
with less time restrictions or a deeper distrust in grading practices as
There are key questions for the review. First, related to the re- the dean might have used different criteria to structure the field of
search question. Then, the theoretical-methodological framing. applicants. By accepting graded academic quality as a backbone for
Input. Is the topic connected to the discussion in the specific aca- selection, the applications are reduced to a formal frame that
demic field? Is it feasible? That is, we require a detailed work neglects the specificity of the research proposal. Through the com-
plan and timeline. And is the project feasible at all within a cer- mensuration process, a research project that for example investi-
tain timeframe? (Head of administration, Scheelheim Graduate gates the social effects of 19th century building law in Bavaria is
School, Interview 6, lines 399–404)
positioned against one on the diffusion of global diplomacy practi-
Different to Gen-Ius, the criteria are made explicit. They resem- ces. From an organizational viewpoint, the core issue of a disserta-
ble general scientific standards known to the reviewers from other tion, its novelty, or creativity that plays such a decisive role for the
selection procedures (e.g. professorial appointments, third-party master to accept his or her disciple, is subjected to a score and post-
funded research). The criteria are graded on a 15-point-scale. In this poned for later iteration. Indeed, it is likely that the dean did scrutin-
sense, the academic ability of each applicant is tested within a frame ize the applicants she put on her shortlist, but the procedure
that allows for qualitative comparison among cases. Despite this exemplifies the organizational distance that arises from a committee
framing, the sheer number of formally correct applications restricts which selects applicants who will not necessarily be supervised by
such a field-building exercise. Each proposal is reviewed by only one those making the decisions. Most applicants remain nameless and
person and compared to a maximum of two others. While the grades one-dimensional as a grade. Only those that enter the shortlist are
operate on the same scale, the ratings do not qualify the applicants unfolded, scrutinized, and tested holistically.
comparatively. Their legitimacy derives not from the admission pro- Independent of the field-structuring ability of the academic
cedure itself but from their similarity with common grading practi- grade, the focus on the proposal in the first stage influences how
ces in the social sciences and humanities. Derived from the applicants are addressed for preselection. In the committee discus-
constitutionally granted freedom of teaching which effectively shel- sions, first in three subgroups and then in the plenary, the applicants
ters teaching from both external authorities and formal organiza- are enrolled as abbreviations of their proposal titles (like ‘building
tion, German mass higher education assumes a fictitious equivalence law’ or ‘diplomacy’). Despite being rejoined by their personal
in the grading by ‘eminent (wo)men’. Rather than integrating an names, applicants maintain to be the novelty, originality, or creativ-
intersubjective component—as at Gen-Ius—admissions at ity of their research projects. What initially was a metrologically
Scheelheim thus draws on the presumed professionality of each pro- constructed field turns into a veritable social field during the discus-
fessor to adequately grade any piece of discipline-specific work laid sion in which documents perform an interactive agency of the appli-
out before her or him. The relationship might not be intimate, but cants. Beyond stabilizing the comparative structure of a field, the
the professor alone can grade excellence if s/he sees it. three subgroups’ shortlists overlap in such a way that they coinci-
In order to allow for a preselection, the proposals then are dentally match the threshold (28) for the number of interviews. The
attached to the applicants’ dossiers. Score and review as well as a shortlists further structure the field as the committee decides without
short profile compiled by admission staff requalify the applicant to further discussion to take the next eight rank positions as substi-
allow for a setting in which all applicants can be compared competi- tutes. Through the interaction of grades, cascades of restricted short-
tively. These dossiers are distributed among a preselection commit- lists, document agency, and the comparison of a decreasing number
tee of 10 members, representing different academic status groups of applicants the admission device has reduced the applicants with-
and disciplines. Like at Gen-Ius, the committee selects the candi- out the need of the committee to finalize a collective decision.
dates for the interviews. The interviews take place for three days in front of the whole
committee. In 40-minute-timeframes, the performance of each appli-
During the break, the dean [a committee member] says that be-
cant is authenticated against the schemes the members have con-
cause of the sheer amount of applications she could not have
structed of them through the dossiers. In view of the committee, a
read all of the 181 reviews [of the proposals], and had therefore
sorted out the applications with the worst evaluations. ‘If a pro- document-based field of applicants materializes. It spans a compara-
ject scores in all areas only three [of 15] or less points there is no tive frame across individual performances.
chance that it will pass’. However, the reviewers would handle The day after the interviews, the committee reconvenes to reach
the grading scale differently so that it’s simply bad luck for some a collective decision on whom to enroll. Against the administration’s
Research Evaluation, 2022, Vol. 00, No. 0 9

advice to ensure transparency, the professorial committee members the research proposal. Only at the preselection meeting is the pro-
negate formal criteria and decision schemes and carry forth the hol- posal translated into a quality of the applicant.
istic perspective the interviews had established: ‘We want to talk Thus, not every site constructs a field among applicants, but it
about names—now!’ (observation transcript, second meeting of se- provides evaluations that at a later stage qualify applicants as actors
lection committee, Scheelheim Graduate School). Having material- in a distinctively engineered social field. Despite multiple differences
ized as persons in the interviews, the applicants cease to be across the cases and sites, four common processes can be identified.
addressed by their topic and are called by their names. This is mir- The first purifies a social space to allow for comparison (purifica-
rored by the grading scale that is used in the final discussion. tion) and the second structures and engineers qualities of applicants
Different to Gen-Ius, Scheelheim does not operate with grade points to characterize and compare them against each other (qualification).

Downloaded from https://academic.oup.com/rev/advance-article/doi/10.1093/reseval/rvac018/6712276 by guest on 29 October 2022


but with letters. Differences are not metrical but ordinal: A (accept), Through a set of formatted devices, time restrictions, practices of
B (to be discussed), and C (reject). This form of selection is much commensuration, and metrical/ordinal gradings, a common selec-
more aligned to a holistic admission as it obliges the committee to tion space is purified to allow that applicants with highly specialized
discuss those that are not clearly rated as A or C. Consequentially, research endeavors and across disciplines can be competitively
the discussion in the committee is extensive—all ‘names’ are now on selected as carriers of future excellence. Third, each site institutes a
the table. Confronted with the same problem of two ‘equally quali- distinct form of situated agency towards being selected that is attrib-
fied’ applicants like at Gen-Ius, again the alignment to the principles uted to applicants in this social field (agentification). Fourth, while
of the school is discussed. However, here the discussion deflects each site to some degree has its own way of imagining a field among
from the project itself to ascriptive criteria. applicants, their alignment and order allow to successively build the
perception among those selecting that the applicants indeed have the
Professor Boerne argues that candidates 3 and 16 are equally qualities they are weighing and that these are the decisive qualities
qualified so this would be a case for applying ‘other’ criteria. It is for estimating future excellence (authentication). True to holistic
a ‘pity’ that both are not female. Candidate 16 is an international
perceptions of Gestaltpsychologie, fragmented forms of agency
PhD student, but the adequate representation of the disciplines
allow to adequately evaluate the ‘person behind’ the documents,
[involved in the school] is also important. . . . Professor Epstein
grades, and (embodied) performances. While none of the committee
elaborates that candidate 16 is a ‘very fast worker’ and ‘very
young’—this shows how fast he has acquired knowledge but also members are Gestaltpsychologists, social-psychological field
that he surely will get further opportunities for a grant. In the theory’s way of explaining social interaction has inspired assessment
end the discipline is important, too, which speaks for candidate centers and holistic reviews, which again has left traces of validity
3. (Observation transcript, second meeting of selection commit- from which the graduate school members draw. They believe in the
tee, Scheelheim Graduate School) facticity of the field of applicants and the transcendence of their
choices despite it being built only for this purpose.
The quote shows that within the frame of the field site, ascriptive
The admission device thus organizes access to a competitive so-
criteria are transformed into a field specific merit. The disciplinary cial field of applicants that transcends the distinct local purpose. In
affiliation of Candidate 3 beats the personal quality of the ‘very fast correspondence with sociological and psychological approaches that
worker’ Candidate 16. While here no affiliations to ‘eminent men’ likewise impose such frames for analytic reasons, we understand this
in the committee are visible, criteria decide about admission that are polymorphic process as field agencement.
detached from a discipline-specific master–disciple relationship and Paradoxically, it is the enormous organizational effort to artifi-
attached to positioning practices of the school which casts itself as cially make a field among applicants visible and comparable that
gender equal, international, and interdisciplinary. Not least because legitimizes the procedures. In the sense of triangulation, each site
these criteria had co-valuated the school as excellent in the enhances the gaze at the field of applicants to allow for a valid selec-
Excellence Initiative. tion. Crucially, none of the schools reflects whether the selection
process does indeed identify future excellence. Not least because
both processes lack any agreed upon objective criteria—such as in
6. Discussion: field agencements of organized
placement records or cognition tests—to which excellence could be
admission
attributed. In fact, this procedure allows to maintain the role of
The two cases explicate how graduate school admission processes ‘eminent (wo)men’. Their professional role in the university allows
operate as devices. The devices draw together multiple sites at which for single grading, competitive decision-making on applicants, and
in situ various parts of applicants’ dossiers or applicants themselves even overthrowing predefined selection criteria, as Scheelheim
are evaluated. In situ means that the evaluation is not preconceived shows. Both cases demonstrate that the field agencement does not
but dependent on the distinct interplay of criteria that qualify a pro- only establish legitimacy for fielding admissions to identify excel-
posal or the interplay of documents of a dossier and individual per- lence but also folds the applicants into abilities of the school they
ceptions. The sites are aligned in such a way that earlier site-based are enrolled in. They thereby confirm the school’s position in the
decisions qualify applicants to be competitively compared at the competitive field of otherwise non-comparable graduate schools
next site. The choices made on each site show that both cases war- that had made Scheelheim and Gen-Ius excellent in the first place.
rant very different results, even if applied to the same group of appli-
cants. The number of in situ decisions increases the contingency of
the procedure. While Gen-Ius emphasizes authentication proce- 7. Conclusion
dures—possibly because research proposals do not have the same The organizational effort and the emphasis on recruiting outstand-
importance in the natural sciences—Scheelheim explicitly excludes ing future researchers returns excellence to the spotlight. While the
everything from the review on the first site that is not derived from worldwide diffusion of the graduate school model makes doctoral
10 Research Evaluation, 2022, Vol. 00, No. 0

education look similar across the globe and among increasingly Discourses, Policies, and Strategies of Excellence and Stratification in
rationalized universities, the cases discussed here show that there is Higher Education, pp. 299–324. Cham: Palgrave Macmillan.
Bloch, R., Gut, M., Klebig, K., and Mitterle, A. (2015) ‘Die Auswahl der
not a common understanding for selecting the best PhD students.
Besten? Auswahlverfahren an Sich Stratifizierenden Einrichtungen Und
Each example institutes an admission device that operates on its
Programmen im Hochschulbereich’, in Helsper, W. and Krüger, H.-H. (eds)
own logics: across the schools the criteria are specified according to Auswahl der Bildungsklientel. Zur Herstellung von Selektivität in
the local setting and disciplinary traditions. ,Exklusiven‘Bildungsinstitutionen, pp. 185–206. Wiesbaden: VS Verlag für
But compared to the way Husserl approached his disciple in an Sozialwissenschaften.
intimate paternalistic way and as a potential follower of his school, Bloch, R. and Mitterle, A. (2017) ‘On Stratification in Changing Higher
the cases display strong commonalities. The admission devices pur- Education: The ‘Analysis of Status’ Revisited’, Higher Education, 73: 929–46.

Downloaded from https://academic.oup.com/rev/advance-article/doi/10.1093/reseval/rvac018/6712276 by guest on 29 October 2022


ify (1) a social space for selection, qualify (2) applicants as compar- Bourdieu, P. (1998) State Nobility: Elite Schools in the Field of Power.
Stanford: Stanford University Press.
able social units of this space, provide them with a site-specific
C¸alışkan, K. and Callon, M. (2009) ‘Economization, Part 1: Shifting Attention
agency (3) for a shared but competitive goal—be selected—, and
from the Economy towards Processes of Economization’, Economy and
mobilize social units across sites that consistently authenticate (4) Society, 38: 369–98.
themselves through the sites as what they truly are. What for C¸alışkan, K. and Callon, M. (2010) ‘Economization, Part 2: A Research
Husserl would have been an outrageous way of identifying academic Programme for the Study of Markets’, Economy and Society, 39: 1–32.
excellence has become a valid form of selecting PhD students that Callon, M. (2007). ‘What does it mean to say that economics is performative?’,
are less known to individual professors and come from different dis- in: MacKenzie, D. A., Muniesa, F. and Siu (Hrsg.), L. (eds). Do Economists
make Markets? On the Performativity of Economics, pp. 311–357. Princeton:
ciplines. For the lack of prices, this process does not institute a mar-
Princeton University Press.
ket of some form, as Callon et al. have investigated across a range of
Callon, M. (2021) Markets in the Making. Rethinking Competition, Goods,
economic devices, but the manifestation of a social field—a field and Innovation. New York: Zone Books.
agencement—of potential PhD students from which those most like- Callon, M. and Muniesa, F. (2005) ‘Peripheral Vision: Economic Markets as
ly to provide future research excellence can be sought. Fields do not Calculative Collective Devices’, Organization Studies, 26: 1229–50.
necessarily exist, as Karl Mannheim (1958: 349) pointed out, but Cochoy, F. (2016) ‘On the Marketization of Curiosity: The Shop Window as a
they are increasingly ‘built into’ an organized world of higher educa- ‘Captation’ Device’, in Conrad, C. and Schmidt, A. (eds) Bodies and Affects
in Market Societies, pp. 145–65. Tübingen: Mohr Siebeck.
tion to mediate excellence competitions of various forms.
Deleuze, G. Foucault, Frankfurt a.M.: Suhrkamp, 1992.
Deleuze, G. (1991) ‘Was Ist Ein Dispositiv?’, in Ewald, F. and Waldenfels, B.
Notes (eds) Spiele der Wahrheit: Michel Foucaults Denken, pp. 154–62. Frankfurt
1. All sources in German have been translated to English by the a. M.: Suhrkamp.
authors. Deleuze, G. and Guattari, F. (2004) A Thousand Plateaus: Capitalism and
2. PhD admission is thus utterly different from appointment pro- Schizophrenia. London: Continuum.
cedures for professorships where the adherence to formal regu- DiMaggio, P. J. and Powell, W. W. (1983) ‘The Iron Cage Revisited:
lations is sanctioned by law and universities can be sued for Institutional Isomorphism and Collective Rationality in Organizational
rule violation. Fields’, American Sociological Review, 48: 147–60.
Enders, J. (1996) Die Wissenschaftlichen Mitarbeiter: Ausbildung, Beschäftigung
3. Federal Statistical Bureau, Personnel in Higher Education,
Und Karriere der Nachwuchswissenschaftler und Mittelbauangehörigen an den
Fachserie 11 Reihe 4.4.
Universitäten. Frankfurt a. M. [a.o.]: Campus-Verl.
4. https://worldcoffeeevents.org/evolving-the-wbc-2016/ Gärditz, K. F. (2015) ‘Die Nachrationalisierung Des Promotionsrechts Durch
5. The committee selects the candidates for interviews. Die Rechtsprechung Des Bundesverwaltungsgerichts’, Wissenschaftsrecht,
48: 269–94.
Highhouse, S. (2002) ‘Assessing the Candidate as a Whole: A Historical and
Acknowledgements Critical Analysis of Individual Psychological Assessment for Personell
We thank the three anonymous reviewers for their effort and their comments Decision Making’, Personal Psychology, 55: 363–96.
that have been extremely helpful for clarifying and sharpening our argument. Highhouse, S., and Kostek, J. A. (2013) ‘Holistic Assessment for Selection and
We would also like to thank the editors Julian Hamann, Anna Kosmützky, Placement’, in Geisinger, K. F. (ed.) APA Handbook of Testing and
and Frerk Blome as well as Jelena Brancovic for commenting on earlier ver- Assessment in Psychology, Vol. 1. Test Theory and Testing and Assessment
sions of this article. in Industrial and Organizational Psychology, pp. 565–577. Washington:
APA Books.
Horn, E. (2002) ‘Test und Theater: Zur Anthropologie der Eignung im 20.
Funding Jahrhundert’, in Bröckling, U. and Horn, E. (eds) Anthropologie Der Arbeit,
pp. 109–26. Tübingen: Narr.
This article is based on research conducted within the project “Elite Lamont, M. (2009) How Professors Think: Inside the Curious World of
Formation and Universities” as part of the Research Unit “Mechanisms of Academic Judgment. Cambridge: Harvard University Press.
Elite Formation in the German Educational System” (FOR 1612), funded by Latour, B. (1996) ‘On Actor-Network Theory: A Few Clarifications’, Soziale
the German Research Foundation (DFG). Welt, 47: 369–81.
Latour, B. (1987) Science in Action: How to Follow Scientists and Engineers
Conflict of interest statement. None declared.
through Society. Cambridge: Harvard University Press.
Lewin, Kurt. (1917) ‘Kriegslandschaft’, Zeitschrift Für Angewandte
Psychologie, 10: 440–7.
References
Mannheim, K. (1958) Mensch und Gesellschaft im Zeitalter des Umbau.
Bloch, R. (2018) ‘Stratification without Producing Elites? The Emergence of a Darmstadt: Wissenschaftliche Buchgesellschaft.
New Sector of Doctoral Education in Germany’, in Bloch, R., Mitterle, A., Martin, J. L. (2003) ‘What Is Field Theory?’, American Journal of Sociology,
Paradeise, C., and Peter, T. (eds) Universities and the Production of Elites: 109: 1–49.
Research Evaluation, 2022, Vol. 00, No. 0 11

Mitterle, A. (2022) Stratifikationen der Hochschulbildung. Unpublished Posselt, J. R. (2016) Inside Graduate Admissions: Merit, Diversity, and
manuscript. Freiburg. Faculty Gatekeeping. Cambridge: Harvard University Press.
Muniesa, F., Millo, Y., and Callon, M. (2007) ‘An Introduction to Market Rothe, K. (2013) ‘Spekulative Praktiken: Zur Vorgeschichte des Assessment
Devices’, The Sociological Review, 55: 1–12. Centers’, ilinx - Berliner Beiträge zur Kulturwissenschaft, 3: 58–73.
Nerad, M. and Evans, B, eds (2014) Globalization and Its Impacts on the Stevens, M. L. (2009) Creating a Class: College Admissions and the Education
Quality of PhD Education: Forces and Forms in Doctoral Education of Elites. Cambridge: Harvard University Press.
Worldwide. Rotterdam: Sense Publishers. Ramirez, F. O. (2006) ‘The Rationalization of Universities’, in Djelic, M.-L. and
Nerad, M. and Heggelund, M., eds (2008) Toward a Global PhD? Forces Sahlin-Andersson, K. (eds) Transnational Governance: Institutional Dynamics
and Forms in Doctoral Education Worldwide. Seattle: Center for of Regulation, pp. 225–44. Cambridge: Cambridge University Press.
Innovation and Research in Graduate Education, University of Vom Bruch, R. (2007) ‘Akademische Abschlüsse im 20. Jahrhundert’, in

Downloaded from https://academic.oup.com/rev/advance-article/doi/10.1093/reseval/rvac018/6712276 by guest on 29 October 2022


Washington. Schwinges, R. C. (ed.) Examen, Titel, Promotionen: Akademisches und
Nespor, J. (1994) Knowledge in Motion: Space, Time, and Curriculum in Staatliches Qualifikationswesen vom 13. bis zum 21. Jahrhundert, pp.
Undergraduate Physics and Management. London, Washington, DC: 195–210. Basel: Schwabe.
Falmer Press. Witzel, A. (2000) ‘The Problem-Centered Interview’, Forum Qualitative
Paradeise, C. and Thoenig, J.-C. (2015) In Search of Academic Quality. New Social Research, 1. http://nbn-resolving.de/urn:nbn:de:0114-fqs0001228
York [a.o.]: Palgrave Macmillan. (last accessed 6-9-2022)
Peter, T. (2014) Genealogie der Exzellenz. Interventionen. Weinheim: Beltz Wooten, M. and Hoffman, A. J. (2008) ‘Organizational Fields: Past, Present and
Juventa. Future’, in Greenwood, R., Oliver, C., and Suddaby, R. (eds) The SAGE
Plessner, H. (2003) Schriften zur Philosophie: Gesammelte Schriften IX. Handbook of Organizational Institutionalism, pp. 130–47. Los Angeles,
Frankfurt a.M.: Suhrkamp. London: Sage.

You might also like