Posselt, Julie R - Inside Graduate Admissions - Merit, Diversity, and Faculty Gatekeeping-Harvard University Press (2016)
Posselt, Julie R - Inside Graduate Admissions - Merit, Diversity, and Faculty Gatekeeping-Harvard University Press (2016)
Posselt, Julie R - Inside Graduate Admissions - Merit, Diversity, and Faculty Gatekeeping-Harvard University Press (2016)
t
Inside Graduate Admissions
j u l i e r. p o s s e l t
Cambridge, Massachusetts
London, England
2016
Copyright © 2016 by the President and Fellows of Harvard College
All rights reserved
Printed in the United States of America
First printing
Preface ix
It has been about twelve years since I first imagined conducting research
on graduate admissions, and almost exactly five years since I began de-
signing and conducting the study described in this book. In this time span,
I have transitioned from being a college administrator and lecturer, to a
doctoral student, to an assistant professor on the tenure track. My interest
in understanding doctoral admissions from the faculty point of view origi-
nated in a problem of practice—a simple question from an advisee that, at
the time, I was ill equipped to answer. I was new to my job with the Mc-
Nair Scholars Program, and she had just decided to apply to graduate school.
She wanted to learn what reviewers would be looking for in her application,
and I had little more for her than a boilerplate response about strong GRE
scores, letters of recommendation, research experience, and fit. I promised
to get back to her after reviewing the literature.
It surprised me to discover that the research literature offered little more
detail than I had offered my student. Scholars have been examining under-
graduate admissions from the institutional point of view since the early
1970s, but until this project there had been only one study—a chapter in
Robert Klitgaard’s 1985 text Choosing Elites—that offered an empirically
grounded explanation of what was important to admissions decision makers
at the graduate level and why. The seed for a research study on faculty
evaluation in graduate admissions was planted for me that day in 2003,
and it has been a privilege and pleasure to see it come to fruition through
x Preface
t
Introduction
Gatekeeping Reconsidered
programs nationally.3 This book tells the story of how faculty in ten top-
ranked doctoral programs draw the almost imperceptibly fine line between
those whom they admit and those whom they reject. Two years of ob-
serving and interviewing graduate admissions committees in core academic
disciplines—astrophysics, biology, classics, economics, linguistics, philos-
ophy, physics, political science, sociology—gave me a unique window into
the evaluation and selection processes that go into graduate admissions.
My research revealed faculty members’ nebulous, shifting ideals about
student quality; how departmental, disciplinary, and personal priorities are
woven into judgments of admissibility; and the implications of it all for eq-
uity and the health of the academy.
Changes in society, the applicant pool, and the labor market have fun-
damentally altered the markets for graduate education and for people with
graduate degrees, yet the criteria associated with admission to degree
programs have changed little. Of the three strongest determinants of access
to graduate education—college grades, Graduate Record Examination (GRE)
scores, and the reputation of a student’s undergraduate institution—the
latter two are part of a conventional notion of student quality that fails on
at least two counts.4 GRE scores and college prestige fail to reliably pre-
dict whether a student will complete the PhD, and disproportionately ex-
clude some of the very groups whom our mission statements and websites
claim we wish to attract. What is more, the structure of the academy in the
twenty-first century will not sustain many of the positions that admissions
decision makers themselves hold. If faculty do not adapt their mindsets to
meet changes in the academy, labor market, and society, they will select and
train students for jobs that do not exist. For graduate education to fulfill its
promise of developing leaders for today’s knowledge economy and diverse
democracy, many faculty will need to rethink how they evaluate prospec-
tive students and draw the line in admissions. Let’s consider these dy-
namics in greater detail.
Worldwide, pursuit of the PhD continues to grow. The PhD is not only the
central prerequisite for faculty careers; credential inflation has also rendered
graduate degrees necessary for access and promotion in many professions
that once required only a bachelor’s degree.5 Economic and technological
development outside the United States has also sparked interest in grad-
uate education from international students, whose share of doctorates
awarded in the United States has more than doubled in the last forty years.6
Introduction 3
Overall, the proportion of adult women (thirty to sixty years old) in the
United States with graduate degrees grew almost tenfold from 1965 to
2005, from 1.1 percent to 9.68 percent.7 And from 2000 to 2010 alone,
the number of master’s degrees earned by African American and Latino/a
students more than doubled.8
Yet aggregate statistics like these conceal considerable complexity about
the state of equity in graduate education. Gender and racial inequities are
persistent and pervasive in doctoral education, for example, despite the
progress in closing gaps in master’s degrees awarded. Women and U.S. resi-
dents of color remain less likely than men and whites to attend research
universities, and they continue to receive fewer doctorates than we would
expect given their shares of both the overall population and the popula-
tion of baccalaureates awarded.9 African Americans and Latinos comprised
13 percent and 16 percent, respectively, of the U.S. population in the 2010
Census, but received just 6 percent and 7 percent of the doctorates awarded
that year—numbers that reflect little change from the previous decade.
Meanwhile, Native American doctoral attainment has fallen to its lowest
point in twenty years.10
Gender and racial/ethnic representation also varies by academic field of
study.11 The well-known disparities in science, technology, engineering, and
math (STEM) disciplines are evident in many humanities and social science
fields as well. In the humanities, for example, only 3 percent of PhDs in 2009
were awarded to African American students and only 5 percent were
awarded to Latino students.12 Table 1 displays data from the Survey of
Earned Doctorates (SED) about the number of PhDs awarded in 2012, by
gender and race, for a selection of fields. Philosophy, which is not represented
in SED data, awarded only 29 percent of their PhDs to women in 2009. It
is notable that fields of study with continued racial and gender inequities also
have some of the lowest admission rates, nationally.13
Like the population of graduate students, the range of careers pursued by
persons who have earned a PhD has diversified.14 As a result, most graduate
programs are preparing, ad hoc, a much broader group of professionals
than the next generation of faculty researchers. For example, applied intel-
lectual and technical expertise is instrumental in today’s economy, and the
diffusion of public research into industry has created a whole sector of
PhD-level researchers outside the academy. Less than half of engineering
doctoral students now expect to enter academia.15 Specialized intellectual
inquiry is the heart of doctoral education, but viable alternatives to the aca-
demic track are necessary because there are far fewer tenure-track faculty
positions than PhDs looking for jobs. Just one academic track faculty
position is posted for every twelve PhDs produced in science, technology,
Table 1 Doctoral Degree Attainment by Gender and Race in Selected Disciplines, 2012
African Native
Academic Amer./ Amer. Indian/ Hispanic/ Asian Hawaiian/
Discipline Gender Black Alaska Native Latino White Amer. Pacific Island. Other Total
Gatekeeping Reconsidered
badge or diploma is stamped upon him, and in which bare personality will be
a mark of outcast estate. It seems to me high time to rouse ourselves to con-
sciousness, and to cast a critical eye upon this decidedly grotesque tendency.
He charged that faculty and universities had been complicit in these trends,
allowing the patina of prestige and the vanity of titles to distract them from
the university’s educational mission. Elite doctoral programs had responded
to rising student demand by raising standards rather than expanding
enrollments, he concluded, which preserved their status but heightened
competition and created a mismatch between the degree requirements they
publicized and those they put into practice. James wrote:
Defining Merit
People are also anxious about how admission is carried out because it is
thought to provide a barometer for how selective educational institutions
are fulfilling the ideal of allocating opportunities equitably and on the basis
of “merit.” In the United Kingdom, these twin standards constitute what
is known as fair access to higher education. Merit is always a conditional,
not an absolute, assessment. No one inherently merits admission. They do
so because they are judged to possess attributes that decision makers have
deemed legitimate grounds for drawing the line between the many who
would like to enroll and the few who should be given the opportunity. In
the United States, potential for strong academic performance is one such
attribute, but as this book will show, it is hardly the only one.
As in other academic competitions, the conditions under which someone
is judged to merit admission to graduate school are bound up with ideals
of individual or organizational quality. What does and should count as merit
is therefore deeply contested. Is there a single, proper standard we should
be working to define and defend? Is it legitimate if different academic dis-
ciplines use different standards? Why should we elevate individual academic
performance over qualities that may contribute to the common good? Is
merit open to reinterpretation as times and conditions change?24 Personal
opinions and conventional wisdom about these and other questions abound,
but the current research record offers little in the way of clear answers.
Graduate education may play an increasingly important role in shaping
professional opportunities, but we suffer from a relatively one-dimensional
research literature about graduate admissions, especially compared to the
well-developed literature on selective undergraduate admissions.
By examining graduate admissions in practice, from the perspective of
those who make the decisions, I see merit differently than most previous
scholars of graduate admissions. The vast majority of previous research has
tried to statistically model whether applicant characteristics, especially
scores on the GRE and TOEFL, predict various indicators of student suc-
cess.25 Some scholars have been motivated by concern about decision
makers’ use of “explicit cutoffs or tacit minima” when weighing standard-
ized test scores.26 They want to understand just how risky that practice may
be in excluding students with lower mean test scores, who nonetheless
might be academically successful. Others want to determine whether test
scores can be counted upon to deliver satisfactory returns on the investment
that admission represents.27
Whether focused on a single field or a range of disciplines, results of
predictive validity analyses have been mixed. Maria Pennock-Roman
8 I N S I D E G R A D U AT E A D M I S S I O N S
and involves layers of inferences made from seemingly minor details in the
application. Although statistical methods would be unlikely to pick up on
these details because they are idiosyncratic to individual cases, they are cru-
cial to evaluative cultures of the disciplines and specific academic programs.
Whether in research or in practice, conflating the quality of an applicant
with a narrow set of academic achievements thus misses some of the most
interesting parts of the story about graduate admissions. However, this
definition of merit has other important limitations that also bear men-
tioning. For example, assuming the most accomplished applicants are the
best candidates reduces doctoral education from a developmental process to a
scholarly finishing school, and implies that mentoring relationships and
learning environments matter little to students’ success.33 Focusing atten-
tion solely on student qualities also misses the broader context of who is
defining what is desirable in applicants, how and why they determine this,
and what the consequences are of those choices. Finally, the tendency to focus
on the validity of common admissions criteria ignores important reviewer
effects that also affect the fairness of the admissions process, such as sus-
ceptibility to fatigue and to cognitive and implicit biases.
Reconsidering merit may seem like a radical proposal. By glimpsing the
deliberations of the committees in this book, however, it will become clear
that, already, faculty operate on a more expansive notion of merit than that
of simple academic achievement and academic potential. I found that ad-
missions may start with the official goal of identifying applicants who are
likely to succeed, but organizational interests such as prestige, diversity,
collegiality, efficiency, and fiscal responsibility also drive the process and
endow it with legitimacy in the eyes of important stakeholders.34 Revealed
preferences therefore vary across time and place in response to changes in
applicant pools, the political environment, the mission of the program, and
who is making the decisions. Program and disciplinary priorities, the bal-
ance of student characteristics in an emerging cohort, as well as other pref-
erences that are idiosyncratic to specific committees and reviewers, all frame
judgments of who the “best” or “most qualified” student prospects are.35
For example, under a purely student-centered view of merit and academic
view of quality, one might admit the students who rate highest on criteria
that best predict first-year grades in graduate school. Under this standard,
however, the proportion of students from China in many American doctoral
programs would skyrocket to levels that, to some, would appear unaccept-
able. Cohorts that contain very large or small numbers of any one popula-
tion are often seen as undesirable by faculty and students alike because
they send the message that the program has skewed interests. Diverse
student bodies, on the other hand, are thought to reflect balanced interests
10 I N S I D E G R A D U AT E A D M I S S I O N S
and the richness of our society. A political scientist nicely summarized the
tension between assessing quality in terms of student characteristics versus
cohort characteristics:
For these reasons, I argue that we need to rethink how we talk about
merit in graduate admissions. Discussions about merit can’t be one-sided.
How we understand and recognize merit makes sense only in light of the
larger organizational challenges, goals, and missions that faculty face.
Therefore, we can’t talk about student achievement and potential unless
we also talk about the organizational context that determines how achieve-
ment and potential will be defined. Further, we shouldn’t treat “merit” as
Introduction 11
I wrote this book with three audiences in mind: faculty across the disci-
plines who are engaged in graduate admissions work, scholars of higher
education and sociology, and administrators with whom faculty coordinate
to facilitate admissions. Prospective graduate school applicants will also no
doubt be curious to learn how faculty evaluate files and deliberate behind
Table 2 Sample Demographic Characteristics by Program and Subject Area
Humanities
Classics 5 40 40 0 0 0
Linguistics 7 29 29 14 0 2
Philosophy (University 1) 6 33 33 0 0 0
Philosophy (University 2) 7 29 14 14 14 0
Subtotal 25 33 26 7 4 2
Social Sciences
Economics 6 0 33 0 0 0
Political Science 8 25 38 13 0 3
Sociology 10 20 33 34 10 0
Subtotal 24 15 35 16 4 3
Natural Sciences
Astrophysics 6 0 33 33 0 1
Biology 6 17 33 17 0 0
Physics 7 0 71 14 0 0
Subtotal 19 6 46 21 0 1
Total/Average 68 1 36 15 3 6
Introduction 17
Conclusion
This is, in part, a story about the impact of a system motivated by good
intentions. A common thread in the findings is that faculty enter the ad-
missions process intending to hold firm on their ideals, but that they com-
promise again and again to get the job done. Faculty experience admissions
work as politically, cognitively, and procedurally difficult because it posi-
tions them between impulses, principles, and pragmatism. At the level of
process, they are caught between attractions to a collegial ideal of delib-
erative democracy and the efficiencies of bureaucratic decision making. At
the level of evaluative criteria, they feel that conventional achievements and
pedigree are critical, even as many feel obligated to and see opportunities
afforded by holistic review and a more inclusive notion of excellence. They
struggle with the prospect of rejecting African American, Native American,
and Latino students whose applications receive full committee review, but
they worry about considering diversity as one of their initial criteria. In the
end they exclude many who could be successful and admit some about
whom they feel ambivalent.
More fundamentally, faculty feel caught between satisfying their own
consciences, respecting their colleagues’ values and priorities, and the aims
of the program and discipline whose futures they are trying to shape. De-
termining who should be admitted often becomes an elaborate, ad hoc
compromise rather than an application of specific values and priorities.
In that compromise, good intentions and principles often fall prey to
pragmatic interests, and faculty frequently default to the safety of self-
Introduction 19
Biology 5 ~8 150–200/ 2–3 Research Male, domestic Short list, via 3 admissions processes used:
20–35/14 experience video conference standard, via interdisciplinary
program, & in rare cases direct
admit. Numbers reflect
standard admissions process.
Initial review of applications by a
subset of the committee; full
committee reads files on short
list.
2/3 of admitted are international
students.
Astrophysics 5 4 150/20/7 3 Physics GRE, Male, Short list, via Initial review of applications by
research international video conference full committee.
experience, All-male committee.
coursework/ 1 graduate student on committee.
grades Extensive consultation among
committee members via email.
Physics 10 1 450/90/26 1–4 Physics GRE, Male, Non-native Rolling review; initial review of
research international English speakers applications by committee
experience, on the short chair & 2 members.
coursework list, via video Number of rounds of review
conference depends on consistency of
initial ratings.
Committee members required to
provide narrative with their
ratings.
Subsets of committee may meet
to discuss a few specific cases.
Chair has strong managerial role.
Classics 5 1 80/9/4 2 Language Male, Very short list, Department administrator
training, grades, international, during recruit- conducts initial review of
Verbal GRE ment weekend applications, then full
committee reads files on short
list.
Committee includes department
chair.
Philosophy 5 3 200/7 + wait 2 Writing sample, Female, domestic No interviews Initial review of each application
1 list/7 letters of by two committee members;
recommenda- then, full committee reads files
tion, GRE on short list.
Wait list used extensively to ensure
the desired size of cohort.
Chair has strong facilitator role.
Committee appoints diversity
officer.
5-point rating scale used.
(continued)
Table 3 (Continued)
Number who
Number of Applied / Were Rounds Admissions
Committee Committee admitted/ of Key Evaluation Chair’s Gender & Interview (of
Department Size Meetings Enrolled Review Criteria Nativity whom & how) Notes
Philosophy 5 2 225/20/5 1–2 Writing sample, Male, domestic No interviews Initial review by admissions
2 letters of chair; any applicant accepted
recommendation or put on wait list will have
application read by at least 4
people.
4-point rating scale used.
Linguistics 6 5 105/8/4 4 Grades/ Male, Very short list, Initial review of each application
coursework, international via recruitment by 2 committee members; then,
college weekend full committee reads applica-
reputation, tions on short list.
alignment of 3 meetings of committee only;
research 2 meetings with full faculty
interests with deliberation of short list (~30) &
department very short list (~12).
vision Last round of review occurs after
the recruitment weekend.
2 graduate students on committee.
Committee includes department
chair.
Reviewers each give each
applicant a yes/no vote, then
number of yes/no votes used
as proxy for energy behind the
applicant.
Sociology 5 2 225/22/10 1–3 Committee Male, domestic No interviews Number of rounds of review
members free to determined by initial ratings.
use their own Initial review of each complete
criteria application by two committee
members.
Minimal deliberation about files.
Strong reliance on average
ratings.
Chair has a strong manager role.
Political 8 2 350/25/16 2–4 Committee Male, Rarely, usually 1 meeting to set process; 1 to
Science discouraged international intl. students via discuss files. Initial review by 2
from heavy video conference committee members; then full
reliance on committee reads all applica-
GRE tions on short list (~80).
3 graduate students on
committee.
Economics 6 2 800/65/25 3 or Quant GRE, Male, domestic No interviews Additional consultation occurs
more math outside of committee meetings.
coursework 10-point rating scale.
Program chair adjudicates final
decisions.
Admissions chair cuts 50% of
pool before committee review &
has a strong manager role.
28 I N S I D E G R A D U AT E A D M I S S I O N S
to cut the pool—still hundreds strong—in half. After this first screening,
in all but the two programs with the smallest pools each applicant’s file
would be assigned to two or three committee readers again, to reduce the
time commitment and encourage a close reading. Only if there was a large
discrepancy in reviewer ratings would other committee members review
the application or weigh in on whether it should be advanced to full com-
mittee review.
Interestingly, in the course of delegating admissions work, effort and ex-
pertise were often decoupled from decision-making authority. In all ten
programs, a member of the department’s administrative staff typically or-
ganized files for review, scheduled meetings, and provided institutional
memory. Often, he or she was familiar with all of the files, attended com-
mittee meetings, and was the only person in the room to have had personal
contact with an applicant. This individual was a professional who com-
mitted large numbers of hours to admissions work, yet was the only member
of the committee without a vote. By contrast, when committees included
graduate student members, they had full voting rights, regardless of prior
experience with application file review or decision making.
Perhaps in part because I was a graduate student myself at the time, I
was intrigued to observe differences in how graduate student committee
members handled their role and how often it reflected conventional status
hierarchies. Whereas a white male graduate student in political science con-
tributed with the outspoken self-assurance of tenured faculty on the com-
mittee, a white female graduate student spoke only when spoken to, and a
male student from an underrepresented ethnic background did not speak
at all. In linguistics, an international graduate student member worried
about senior faculty seeing and disagreeing with his ratings, whereas a white
male graduate student on the same committee actively challenged senior
professors’ interpretations of files. In this way, committees operated as mi-
crocosms, small worlds that reflected common department and academic
politics.
Sometimes, leaders involved outside reviewers with specialized research
expertise or knowledge of a country’s educational system. Eight of the ten
admissions chairs consulted with program faculty or doctoral students from
China, for example, in the hope that an additional set of eyes would clarify
ambiguities and ensure a fairer review of those applicants. As Chapter 6
will detail, efforts to improve the quality of review for international ap-
plicants were well warranted. Yet in several departments, the role of “China
expert” fell to one or two individuals year after year and appeared to
be neither voluntary nor accompanied by compensation, recognition of
service, or authority to make admissions recommendations. Similarly,
30 I N S I D E G R A D U AT E A D M I S S I O N S
We send it out to the experts and then we get the reports. But sometimes there
is disagreement with the experts too. The experts who read the paper haven’t
seen the whole pool, so there has to be some balance too . . . Unless the ex-
perts totally, you know, dismissed it and couldn’t find any value in the paper.
Quantifying Judgment
rate numbers into admissions began with the optimistic, democratic inten-
tion that standardized aptitude tests might ensure that talented college
applicants from less privileged backgrounds would be judged by the same
standard as their wealthy peers. Henry Chauncey, who founded the Educa-
tional Testing Service, reacted in amazement to the congruence between
his first aptitude test and student grades. Historian Nicholas Lemann wrote,
Chauncey was bowled over. It was magical . . . Testing touched upon the
deepest mythic themes: the ability to see the invisible (what was inside people’s
heads), the oracular ability to predict the future (what someone’s grades
would be in courses he hadn’t even chosen yet).17
Test score increments. Early in the review process, many faculty fixated on
small increments in test scores or grade point averages, treating them as
the equivalent of significant variance in intelligence, preparation, or gen-
eral admissibility.19 Describing the motivation for this practice to me, a so-
ciologist explained, “If you’ve got a stack from here to the ceiling, you’ve
got to try in a small amount of time to get them down to a small list. The
grades, the GREs, the letters do a big work {pause} in trying to decide who
is on the short list.” A biologist made a similar point on the clarity that GRE
scores provide. Individually composed aspects of the application like the
writing sample or personal statement are not only more time consuming
to review, he argued, but ultimately are incommensurable.20
It’s just too easy given quantitative data like that, it’s just too easy to just rank,
you know, to use that to differentiate . . . Not only is it obviously a time sav-
ings but . . . trying to judge and tease apart these factors and distinguish
applications—sometimes it’s not too bad but a lot of times it is, and so to be
32 I N S I D E G R A D U AT E A D M I S S I O N S
able to just say, “Okay, oh, this person clearly had a better GRE set of scores
than this person. We should rank them in.” . . . It’s something that common.
You know all applicants took the same test, presumably under the same con-
ditions, {Laughs} you know, they were watched over. But anyway it’s one thing
that we can standardize in the sea of variability in these applications.
As the applicant pool increases, so does the burden of holistic review, and
with it, the difficulty of sorting out who should have a place on the short
list. The GRE’s standardization thus becomes central to justifications about
its utility and appropriateness.
It’s really hard. Once you get down to the final forty, you could conceivably
admit all of these people . . . They probably would come here and do quite well.
It’s just you can’t admit everyone who is actually above a certain bar. You’ve
got to keep raising the bar just to accommodate the numbers that you want.
ceived some teasing from his colleagues for being a “softie,” I asked an-
other member of committee in a follow-up interview to explain the teasing:
If you put forward thirty out of the sixty that you want everybody else to
read—you’re not doing your job to whittle it down to the best of the best.
You’re just making more work for the four other people on the committee who
have to read your thirty—instead of them all having to read your twenty. I
think that’s really the only reason why being harsh would be valued. You’re
trying to pick out the best people. You want to cut the fat away.
The list needs to be cut down. We have 180 applications and we had to cut it
down to eighteen admissions or something like that. We had to make cuts. You
know so—you actually need to distinguish them between the merely good and
the very good, and being a harsh critic is helpful for making that distinction.
In some sense, the committee can’t function if we’re all softies. There needs to
be some who are more harsh and demanding. Otherwise it’s impossible to cut
it down.
The perceived need for some reviewers to be “harsh and demanding” was
not limited to the hard sciences. In one of the philosophy departments, for
example, the admissions chair apologized profusely for the number of 1’s
she had awarded, sparking a longer conversation about what constitutes
the “boundary between a 1 and 2” and how each of them had approached
the ratings. The chair exclaimed, “Sorry about all of my 1’s! My 1 might
be another person’s 2 . . . We are all intelligent, competent people trying to
do our best.” A senior colleague replied, “1’s are the crème de la crème. I was
very disciplined. I made a list of all the 1’s, and then I was ruthless to get
to ten 1’s.”
Still, rejecting a large majority of applicants can be a tough pill for new
reviewers to swallow. Many of those who are ultimately rejected could
probably succeed in these programs, and achievements of even rejected ap-
plicants may surpass reviewers’ own accomplishments at a similar stage of
their career. Everyone recognized the difficulty of cutting ostensibly quali-
fied students, and seasoned veterans of admissions review often adopted a
tough attitude to match the toughness of the task. Being “harsh,” “de-
manding,” “disciplined,” or even “ruthless” with one’s ratings was thought
to ultimately serve the committee’s best interests by moving the process
along more efficiently than a “soft,” “generous,” or “lenient” approach. A
sociologist clearly explained the importance of individual ratings, which
many faculty slipped into calling “rankings,” and their influence on admis-
sions outcomes:
34 I N S I D E G R A D U AT E A D M I S S I O N S
There was very much a sense that we all went off in our little corners and read
and submitted our rankings. That’s where the decision really got made.
for a long time. They know how to debate and they know how to engage all
these rhetorics . . . If we can keep debating about who is a better student
all morning, we still can’t convince each other . . .
In the end, it’s personal taste. Everyone has good scores on different aspects.
You know, “I like this person’s experience, that person’s background, this
person has better quantitative skills.”
Similarly, one philosopher who reflected on the process noted, “There was
always a consensus that way or another . . . but we didn’t have to agree on
why.” In essence, less time was required for discussion because less nego-
tiation was required. Given the small scale on which ratings were assigned,
average ratings disguised disagreements about individuals’ relative ratings
as minor differences of opinion about appropriate standards, criteria, and
applicant strengths and weaknesses.23
Some committees relied on the list more than did others. Some used it as
a jumping-off point for identifying and discussing borderline cases. In as-
trophysics, one member explained,
The first two-thirds of the list went immediately. There were some people it
was clear we were going to make offers to and some people it was clear we
weren’t going to make offers to, and I think two-thirds of the people fell into
that category. Those two-thirds took ten minutes and the rest of the time was,
“Let’s worry about the boundary cases.”
Other committees used the list to determine sets of applicants who should
be interviewed or whose files the committee should review more closely.
Still others simply admitted as many from the top of the list as their projected
enrollments and yield allowed. A sociologist explained to me that, with the
exception of one case,
there wasn’t a whole lot of discussion at the meetings about moving people
around . . . We kind of went with the rankings. We felt like we could discuss
all these people and certain cases but, you know, we had confidence that ev-
eryone had read everything pretty carefully. And we had thoughtful rankings.
I thought it went really well.
So, I’d rather have members of the committee not saying, “It’s GREs.” If
everybody went, “It’s GREs,” we’d have an easy process . . . and a deeply flawed
process. To me it would be very, very far away from that complicated truth.
So I want people coming to it, hopefully, from different angles.
Partly for reasons of expediency, we need some kind of scoring system. It’s easy.
I’ve been on lots of committees on campus this semester deciding award win-
ners. When the pool is twenty-five and you have time to think about your top
fifteen who should get this teaching award, the numbers and the myth of pre-
cision [are] readily acknowledged because you have time to talk about all of
this. But if you have a hundred good people, then . . . [we] say that the confi-
dence interval around these numbers [is] thirty spots plus or minus, but we
still have to go by them.
They were ranked, and some of the candidates were already on top of the rank-
ings, so that simplified a lot of the conversations. More disagreement was on
the edges. We cannot admit everybody. You need to put a line somewhere, and
it’s where do you put the line? And then, the people close to the line? That’s
where it starts. And so that’s where the disagreement emerges.
The hard truth for decision makers in programs such as these was that the
admissions process requires many more rejections than admissions. Drawing
a line to separate the two groups, even with a wait-listed set to buffer them,
felt uncomfortable both because it made the scope of the rejections so
plain to see and because it provoked the sort of disagreements that faculty
try to avoid.
I think on the whole there were relatively few, quote, disagreements. Nobody
was—that I could see—no one was particularly adamant that this person must
be admitted. I didn’t see any of that. I was expecting a little bit of that where
students might have contacted directly a professor to say, “I would very much
like to work in your group and your group exclusively” . . . But I didn’t see
any of that. I didn’t see anybody pushing internal candidates. I thought it was
all very congenial and, “Let’s talk this over. What did I miss?”
spreadsheet kind of format. There are some that light up. Basically, these
things are scores or numerical numbers like GPA, undergraduate institu-
tions, test scores. There are some that will stand out as being {Pause} that
look promising even without really looking at the application.”
Identifying applicants at the earliest stages of the process by standardized
categories such as test scores, institutional affiliations, or diversity contribu-
tions, rather than a review of their life stories or unique characteristics, had
two important consequences. First, it made the few criteria they did consider
more determinative of ratings and, ultimately, of students’ opportunities. It
also compelled an even greater need for committees to repersonalize ap-
plicants if reviewers submitted widely disparate ratings. They resolved
those differences in most cases not by debating the criteria used to award
a rating, but rather by developing narratives about the person behind the
numbers, achievements, and standard categories. Here the process re-
sembled what Heimer called biographical analysis, and what Mitchell
Stevens called “evaluative storytelling” in his analysis of undergraduate
admissions.29
Obscuring the basis for ratings and decisions. In addition to making pipe-
lines difficult to sustain and decontextualizing information about applicants,
perhaps the most fundamental cost of deliberative bureaucracy was that it
obscured the basis for ratings and, by extension, decisions. What really mat-
tered to faculty when they rated, admitted, and rejected applicants faded
into the background, and core questions of what counts as a “quality” ap-
plicant and which applicants met that definition received only marginal
attention. This tendency is closely related to a common critique of quanti-
fication, that in the course of facilitating decision making, it “simply evades
the deep and important issues.”30
By the standards of deliberative bureaucracy, utilizing numbers as proxies
for complex, debatable judgments had real advantages. Numbers concealed
underlying disagreements that faculty would rather not broach and buff-
ered them from charges of unfairness. I was struck to observe that in only
two of the ten programs were faculty even asked to compose notes that
explained their applicant ratings. Moreover, the very nature of deliberation
about borderline cases was so complex and holistic—rich with detail, im-
pressions, and simultaneous weighing of pros and cons—that it was rarely
possible to determine why, exactly, a given student was admitted, rejected, or
wait-listed. As the chair of the political science department aptly put it,
“Everything matters, and nothing matters the most.” Vague criteria, unjus-
tified ratings, and ad hoc policy all added to the veil of secrecy that pro-
tects these controversial decisions.31
Decision Making as Deliberative Bureaucracy 41
noting among other details that she had been homeschooled and that she
had scored at the 99th percentile for the Verbal section of the GRE and the
82nd percentile for the Quantitative section. Although the committee was
near the end of the short list that they were slated to discuss, her case was
the first in which they discussed GRE scores in more than passing detail.
Her educational background clearly had induced skepticism, and they sub-
jected her file to a more stringent review. Those seated on one side of the
table wanted to move her application forward into the next round of eval-
uation, while those on the other side were unconvinced.
“I feel like a jackass for saying this,” a male committee member said,
breaking a long pause, “but she doesn’t seem interested in research to me.”
Others marshaled evidence from her file to the contrary, and the committee
chair smiled and confessed, “I would like to beat that college out of her.”
“I think it already has been,” a senior member of the faculty suggested,
reading an excerpt from Maria’s personal statement that signaled indepen-
dence and critical thinking.
“You don’t think she’s a nutcase?” the department chair asked, to laughter
from most members of the committee. With the three most powerful people
around the table having joked about this case, no one tried to top them.
They agreed to move her forward to the next round but a few weeks later,
when making their final decisions, chose not to extend her an admissions
offer.
Driving home that evening after the meeting, I thought about how the
committee had discussed this case. I wondered what their meetings must
usually be like if this was how they spoke to each other with a researcher
in the room? It was a question I asked myself more than a few times during
the course of my fieldwork, in response to seemingly unfiltered discussions
of candidates with uncommon profiles. It had been an amusing conversa-
tion, but whether Maria had received a fair hearing was debatable, and the
tenor of their discussion was consistent with results of an experimental
study that found disclosing a religious background in one’s application to
psychology doctoral programs reduced the chances of admission.33 On the
one hand, it was frustrating to hear faculty describe any applicant as a pos-
sible “nutcase.” On the other hand, rude comments like this affirmed for
me that I really was seeing behind the curtain. Further, their exchange had
perfectly exemplified how individual and collective judgments could be re-
fined when a committee takes time to work through the details of a case,
especially an unconventional one that might otherwise fall through the cracks
of implicit, collective stereotypes.
On another level, this episode in linguistics showed that interactions of
committees characterized by vigorous but friendly debate were often less
Decision Making as Deliberative Bureaucracy 43
formal and used their deliberations to draw group boundaries. That is, they
used admissions deliberation not only to choose students, but also to send
messages to one another about who they were as a community and who
they were not. It was hardly the only time I observed committees ease ne-
gotiations over sensitive cases by introducing the entertainment and shock
value of humorous or rude comments. Such comments compromised norms
of professionalism, but served an important social function of cutting
through tension, encouraging camaraderie, and clarifying shared values.
Sometimes one committee member would tease another, but more often
jabs were outwardly focused—joking at the applicant’s or another disci-
pline’s expense.
The astrophysics committee was another whose meetings were charac-
terized by friendly debate and humor. In one case, they had reached a point
of deadlock over an applicant, and a junior professor noted that one of the
letters of recommendation in his file seemed “weird and brief.” Another shot
back, “That’s what happens when engineers write,” to cathartic laughter
all around. Whether it was astrophysicists distinguishing themselves from
engineers or members of a large research university distinguishing them-
selves from those in religious colleges, faculty used evaluative deliberations
to affirm their identities and organizational boundaries by admitting those
who were believed to fit and rejecting those who did not.
As my fieldwork progressed, I couldn’t help but note how unique the in-
teractions were in linguistics and astrophysics—how comfortable they
seemed to be with the each other and with the work of ruling out qualified
students. To understand this from a department member’s perspective, I
asked each committee’s admissions chair to reflect upon it in follow-up in-
terviews. The linguistics chair affirmed the value of their deliberation-rich
process,
I think the experience of doing this together is good for us even if we weren’t
admitting anybody. I mean just to read these applications and talk about them,
you find out, you know, about how your colleagues think or find out more
about how they think about the graduate students . . . Their perspective is often
useful and sometimes they know things about such-and-such an institution that
the rest of us wouldn’t know about.
Conclusion
Breaking the silence, Vivek acknowledged, “He’s the most amazing case
we’ve ever seen.”
Finally Harold, himself, spoke up. “He would bring some personality to
the department. I commit to look after him and fund him through the pre-
lims. He presents himself as quite intelligent.”
“Excellent idea to give him a chance,” the graduate student member of the
committee affirmed, and with that, Denpa’s case was closed. He was ulti-
mately admitted. He enrolled. He passed the “remedial” coursework, the
core courses, and his qualifying exam. And at the time this book went to
press, Denpa had submitted a paper for publication, was working on his
thesis, and was active in scientific outreach in both the United States and his
home country. Harold remained his advisor, and he collaborated with
William.
Debatable assumptions underlie judgments of quality, which underlie as-
sessments of merit and admissibility. I argued in Chapter 1 that running
admissions as a deliberative bureaucracy effectively prevents difficult con-
versations about those assumptions from dominating or extending the
review process. Yet regardless of whether the politics of quality remain
tacit—due to consensus or avoidance—or are made explicit because indi-
vidual judgments of applicants do not align, they are always present in ad-
missions. They are at the heart of committee and broader debates about
how opportunities should be distributed. Through cases like Denpa’s—in
which faculty debate judgments of unconventional, borderline applicants—
the politics of evaluating student quality and the multiple meanings of merit
are revealed.
I found that the standard used to assess merit during the initial screening
of applications varied substantially from the standard of merit used to judge
candidates who made the short list. The distinct notions of what made a
desirable applicant at each stage of review had distinct implications for the
equity and diversity of who might eventually enroll. Given the distributions
of GRE scores by race, ethnicity, and gender, for example, the extremely
high bar of conventional achievement with which faculty in these programs
initially assessed the pool adversely affected opportunities for Latino, black,
Native American, and female applicants.1 I found that meanings of merit
included diversity only when faculty worked to distinguish among those
on a short list of well-qualified applicants, at which point the ideal of merit
was rooted in envisioning the future of the discipline. Even then, however,
faculty conceived of diversity very broadly. Black, Latino, Native American,
or Southeast Asian applicants might stand out on the short list because they
rarely appeared there, but race/ethnicity was just one of many dimensions
of diversity they weighed in making judgments about quality. And as Denpa’s
48 I N S I D E G R A D U AT E A D M I S S I O N S
Reviewers could never be sure how much grade inflation had distorted a
given student’s GPA, and they doubted whether prestige of an undergrad-
uate institution actually predicted student success. Still, they continued to
read grades in light of college prestige because it effectively broadened the
range of grades and test scores. On one end would be a low GPA from an
unknown college or one whose training in the field was regarded as weak.15
On the other end of the spectrum was a high GPA from an Ivy League or
other institution with a reputation for strong undergraduate preparation
in the discipline. A “good” grade from a “good” college “carried more
weight” or could be awarded “higher marks.”
Rankings were only one way faculty gauged institutional quality, how-
ever. Seeing one’s alma mater on the application would stir participants on
52 I N S I D E G R A D U AT E A D M I S S I O N S
Risk aversion and predicting student success. One evaluative script empha-
sized risk aversion. Faculty believed that they had an institutional impera-
tive to avoid risky candidates. And because slots in their program were so
coveted, they had the luxury to reject those candidates whose test scores
and grades failed to reach a very high standard.
Worried about the possible financial and status consequences of student
attrition from their programs, faculty read applicant qualifications with
their own formal course requirements in mind. They sought students
whom they thought would work hard, but who would not struggle too
much with the curriculum. Often, this curriculum demanded prerequisite
skills not communicated to students and for which they offered few to no
opportunities to learn once on campus. Reflecting on their program’s ten-
dency to prefer students whom they felt “pretty confident can get through,”
a classicist explained,
Graduate admissions is one of the things I think you have to be very humble
about. And there’s always a tension here because we’re always under pressure
to have good numbers for completing a program, completing it in a reason-
able amount of time, and so on. The effect of that is to make you risk averse
because it’s not that hard just to go for the students you’re pretty confident
can get through.
Others discussed risk aversion in terms of the investments of time and en-
ergy that students require of faculty. During an interview with a physicist, I
commented, “You’ve mentioned a couple of times: ‘Can they be successful?’
Meanings of Merit and Diversity 53
and ‘Do I think they’ll be successful?’ It sounds like that’s a really key
question you’re asking.” He responded,
Yes, because it’s a big investment for the faculty member who takes on a stu-
dent. And so if you work with the student so closely and then he walks away
or doesn’t make it, then it’s a waste of his time. And in a way, I mean, it’s our
mission to teach, but I’d rather spend my time teaching somebody who actu-
ally can continue my mission and then teach other students than somebody
who realizes, “It’s just too difficult. I can’t do it.”
The tendency to avoid risk was ubiquitous, but it was especially potent in
programs with small cohorts and those that offered full financial support
to their students. Under these conditions, each student has a relatively large
effect on completion statistics and represents a significant financial invest-
ment. Perhaps it should come as no surprise that faculty repeatedly compared
admissions to “risk taking” and “gambling.”17
Participants in this study approached admissions as risk taking in a va-
riety of ways, but for most, the risk was entirely uncalculated. The vast
majority were unaware of research about what affects graduate student
outcomes, and only one program had analyzed their own applicant data.
Nevertheless, I heard a common refrain that a weaker record of upper-level
coursework on student transcripts could be assumed to represent weak
preparation and a good chance that the applicant “may not know what
they’re getting into.” Several participants admitted their tendency to “feel
spooked” when an applicant’s profile called to mind a past student who
had struggled or ultimately not completed. Still others, consistent with re-
search on decision making in elite organizations, preferred to eliminate per-
ceived risks rather than estimate or calculate the level of risk.18
Another approach to risk was born of the tendency toward credential
inflation at the undergraduate level. As more and more students report
higher grades and GRE scores, not to mention other skills, research expe-
riences, and honors, some faculty interpreted the absence of such distinc-
tion as a sign of risk. Finally, four admissions chairs—whose programs were
ranked in the top five for their disciplines—voluntarily discussed the “luxury
of risk aversion” that their large, highly qualified pools permitted. Some
preferred conventional overachievers in the first round of admissions simply
because they could.
in an academic community near the top of their fields.19 I asked each par-
ticipant in individual interviews what they thought GRE scores signaled,
and the first response from more than 50 percent of them included
comments like “innate ability,” “sheer intellectual horsepower,” and “native
intelligence.” These comments were reflected in admissions meetings, where
more than half of the comments about intelligence coincided with com-
ments about high grades and/or Graduate Record Exam (GRE) scores. In
linguistics, one professor commented, “Those are astronomical scores!”
with another responding, “And check out the stellar grades. There’s no ques-
tion she’s smart.” Following up with the department chair, he reiterated,
“Someone who does that well on the GRE is unlikely to be lame-brained.
They are likely to be smart.”
To the extent that faculty connect GRE scores to intelligence, these sup-
posedly objective, standardized criteria may take on a personal quality, for
intelligence is central to academic culture and faculty self-concept.20 I ex-
amine the nuances of how faculty conceive of intelligence in Chapter 5, but
for the sake of understanding conventional achievement as a standard of
merit early in the review process, the key point is that programs’ legitimacy
as elite intellectual communities in some ways hinges on the perceived in-
telligence of those whom they admit and hire. As the linguistics committee
chair put it, they used admissions to “reflect the view the department has
of itself” because the department’s character is “so determined by graduate
admissions.”
That faculty associated quantitative metrics with intelligence and be-
longing helps explain why faculty relied upon them so much when
making the first cut.21 Yet, a sense of the applicant’s belonging mattered
deeply in later phases of review as well. Explaining his committee’s deci-
sion not to admit a borderline applicant, a biologist commented, “[He
was] from a different planet and we were confident that this person was
not going to be one of us. He’s not going to be a full member of the sci-
entific community.” Committees often framed belonging in terms of “fit,”
which was a seemingly unassailable criterion and, in many cases, a bottom-
line consideration.
Convenience. Reading to this point, one might assume simple elitism and
outdated views of intelligence explained why faculty relied so much upon
GRE scores, grades, and institutional prestige. And, indeed, one sociologist
in the sample quipped,
This is an elite university and a lot of the people at the university are elitists.
{He laughs.} Simply said. So they make a lot of inferences about the quality of
someone’s work and their ability based on where they come from.
Meanings of Merit and Diversity 55
and doubt. In addition to the problem that this standard has only marginal
relevance for scholars’ long-term outcomes however, rigidly pursuing this
vision of academic excellence disproportionately prevents women and do-
mestic students of color from advancing beyond the first cut. As long as
systemic disparities in GRE scores and elite college enrollment persist, it
will be more difficult for programs to diversify if their initial standards of
quality rely heavily on these qualities.
Two pathways toward more equitable enrollments are available to fac-
ulty. One involves preserving the current admissions regime, waiting for
more equitable patterns in student scores and institutional affiliations, and
accepting that until that occurs, admission decisions may reproduce within
the academy the racial and gender inequalities present elsewhere in society.
Another pathway involves faculty stepping back from screening customs
and assumptions about student quality that are entirely taken for granted.
They could explicitly treat diversity as a dimension of quality from the be-
ginning of the review process, for example, or reevaluate how they think
about and weigh the GRE.22
Faculty revealed their preferences both in the initial criteria they used to
narrow the applicant pool and in the hairs they split to make final selec-
tions. Through holistic and individualized review, faculty adopted a much
broader view of merit in judging the short list. They opened their eyes to
the very minutiae in qualitative components of the application that initially
they wanted to avoid. Evidence of having mastered course material or a
bank of test items was insufficient to impress reviewers at this point, be-
cause the list was replete with such conventional achievers. Rather, they
looked for applicants who had a different relationship with knowledge.
Seeking potential for independent scholarship and innovation born of fresh
perspective, faculty combed through details to make a fundamental infer-
ence: Who might advance the future of the discipline?
Faculty from disciplines that were far afield intellectually shared the sen-
timent that such prediction was very difficult work. An astrophysicist
explained:
You’re really basing it on their potential to be great scientists. But it is much
harder—much harder. What you look at for a particular person varies from
person to person.
Meanings of Merit and Diversity 57
That’s so hard because at one level what you’re looking for is so easy. You’re
basically looking for people who are going to be first-rate researchers and
leaders in the field . . . who are going to be great economists. But figuring out
in a twenty-one-year-old what traits are predictive of becoming great intellec-
tual leaders is incredibly hard. You have to look for proxies at some level.
One of the proxies you look for is, is the person sufficiently quantitative and
mathematically sophisticated? . . . You want to find someone who is creative
and asks great questions. That is so hard to tell. You might look at their thesis
or maybe they worked as a research assistant or their recommendations. It’s
very hard to assess if someone is—{Pause} it takes a certain type of person to
be a researcher.
Respondents were divided, however, over whether the most reliable testi-
mony of a student’s research experience and potential came from letters of
recommendation or from students themselves. In four of the programs, re-
viewers wanted students to personally communicate their experience with
research (in the personal statement and/or interview), and in astrophysics
a majority of the committee discussed the importance of “sell[ing] your
ideas.” The admissions chair explained,
Here, we judge them about how well they can explain things. So the selling
component of being an astronomer and selling your ideas is very important.
In theory it’s actually even more important because we discuss ideas all the
time to get new ideas. It’s all about the discourse and why are you doing what
you’re doing. Challenging the fundamental, physical concepts behind it—a
student has to be well versed as to how to defend their own ideas and how to
express them.
The importance of intellectual fit applied across the disciplines. “We don’t
want clones,” one humanities professor laughed. “But on the other hand, we
do want people who really do match reasonably well to what we’re good at.”
I think the drive for broadening gender representation has been quite suc-
cessful, and not without its problems but we have {Pause} we have very strong
representation of women. You can see that in the profession now. {Laughs}
You look at university presidents for example. I think the highest paid presi-
dent in the United States is a woman PhD physicist, Shirley Jackson . . . Anyway,
we now see in our research groups a very strong representation of women and
they’re doing well. So whatever risk we took there, we haven’t had to worry
there. With African Americans, it’s often a different story.
two students that are, in my view, equal on intellectual merit, then I will
prefer a minority. And I think it is the same—at least from what I observed—
it probably was the same for my other colleagues on the committee. It’s some-
thing that everybody pays attention to—the minority race, gender—for good
reason.
Gender is an issue in that we get good—we get top-notch women as well top-
notch men. Black—we get fewer blacks. It’s true. But we do try—in the past
we’ve tried to attract them. But then they get the same attractive offers from
Columbia and Yale and Stanford and Berkeley and so forth. So it’s a small group
typically who get a lot of attention.
We all kind of admit the same pool of applicants—the top ten departments.
Harvard’s going to admit them, Princeton’s going to admit them, Stanford, Co-
lumbia, Michigan, Wisconsin, and Chicago. And so we’re all fighting for the
same applicants, and there’s a lot to compete with, and you know there are a
couple programs right now that are just kind of doing phenomenally well in
terms of placement and training—just dominating sociology.
I think roughly in whatever way the university will pay for. Our conceptual-
ization is the university’s conceptualization, and that’s putting it a little harsh.
But because the university’s commitment is quite good and there are lots of
incentives, we don’t need to add any interests . . . So we’ll just do whatever.
We define diversity as the university defines it.
I close this chapter with an extended episode that illustrates how faculty
negotiated ideals of merit and diversity in practice. It also is one in a
handful of cases I observed in which questions of preparation and risk re-
surfaced in the late stages of decision making. Two such cases occurred in
linguistics. Toward the end of their second meeting, Peter, the committee
chair, raised the need to discuss two “diversity fellowship students” who had
attended a local college from which the department was striving to develop
68 I N S I D E G R A D U AT E A D M I S S I O N S
We decided to interpret diversity broadly, not just race and gender and all those
things. We have very few students from local colleges so we contacted a local
college and told them that if they have good undergraduates to apply here be-
cause there’s this image that we are snobby so there is no point to apply here. So
we had several applications from the local college and two made the short list.
And, indeed, last year they did admit one student from the college. This
year, although a majority of the committee had voted them through to the
short list in their first meeting, a majority also raised concerns over whether
one student’s research interests were clear and whether the other posed too
much of an academic risk.
After reviewing some basic information about the first of these applicants,
whom I’ll name Amaya, the department chair, Nancy, commented, “If we’re
serious about diversity, these are the students we need to take seriously.”
Interrupting, Lin asked, “Can I please speak up? We want diversity, but we
want excellence in diversity. And when I read that statement, it was all over
the place.” Another member affirmed this view, comparing her to others
in the pool. “We need evidence of research skill, which we had with both
of the last two applicants we discussed.” A third added, “I tried to talk
with her when she visited campus and couldn’t get a line.”
Just as it seemed energy was building against Amaya’s case, Denise, an
associate professor, raised the diversity-risk relationship. “In most cases, di-
versity will involve some degree of risk on our part. We have to not be so
risk averse that we miss opportunities.”
“That’s true,” added one of the people who had expressed concern just
a moment earlier. Then, in the first and only mention of an applicant’s race
or ethnicity I heard in this program, she continued, “And students from her
ethnicity are very unlikely to apply to graduate school.” She did not for-
mally advocate for the student on this basis, but rather reminded the group
that the opportunity to enroll a student from this group—especially in
linguistics—was rare.
They tabled the decision on Amaya, and moved to discuss the other stu-
dent from the local college, Nikki. Peter began by reading an extended por-
tion of a letter of recommendation, which closed with the words “I hope you
get to meet her.” He followed this reading with, “And we will. She’s coming
to campus this Friday for a visit.” Like Amaya, it became clear as they dug
into Nikki’s application that no one felt strongly about moving her for-
ward in the process.
Peter in particular sounded unsure about her, but Nancy highlighted the
extreme personal struggles the student had faced, concluding, “She might
Meanings of Merit and Diversity 69
be a bet, but it could be a good bet.” She also reiterated an earlier point. “If
we are going to increase diversity, these are the students we need to take se-
riously.” This perspective reflected a view I heard frequently: that some
bets are safer than others, and improving diversity requires decision makers
to identify applicants who contribute to diversity and have acceptable risk
profiles.
Tentatively, Lin asked, “What’s the diversity?” Denise and Nancy, who
by now were unified in advocating for Nikki, responded with “family fi-
nancial hardship.” The committee agreed at that point to leave her on the
list, but discussion about her and about building diversity continued.
Nancy said, “It will be good for the whole faculty to take a look at her
file. It seems pretty clear that she’s a risk, but if we’re going to increase di-
versity, we have to take risks.” Concurring, Denise added, “And she seems
like a good bet. Increasing diversity will also require these pipelines.”
Two weeks later, after the next faculty meeting, both Nikki and Amaya
visited campus for the recruitment weekend. However, in the final selection
meeting following their visit, in which the goal was to cut four people, the
committee decided not to admit either of them. In Peter’s description,
the committee came to this decision “in the first five minutes, with very little
discussion.” He elaborated:
There was universal agreement . . . No one thought they were up to the bar.
So that got us down to ten. We liked them both [but] we thought they didn’t
have the intellectual capacity to excel in graduate school.
I probed, “What was it during the campus visit that gave you the sense of
that?” He responded,
In the end they just didn’t have the right preparation. They were just, there
were others from universities with great, active linguistics departments where
they probably had taken two years’ worth of graduate courses already, things
like that. The local students just didn’t have that preparation. So they might
have been perfectly capable, but in comparison . . . We felt horrible. We really
wanted them, but it just wasn’t going to happen . . . I’m still wondering what
necessarily the right thing to do is. Both of them may have had the intellectual
ability, but they didn’t have as much background as the other students. So
maybe if there were a way to guarantee them a sixth year of funding so that
they can take an extra year to catch up, but that’s not something we have.37
I followed up with another member of the committee as well, and his nar-
rative corroborated Peter’s:
They were applicants that we were hoping to be able to take a chance on, that
we invited to campus. Sadly, once they got here we decided it would not be a
good gamble. Um, and in fact, I mean we really were disappointed because
we did personally like the people involved and a lot about them but again you
70 I N S I D E G R A D U AT E A D M I S S I O N S
have to think about what you’re doing to their lives as well. {Pause} Some of
the sort of last stage of discussion was, which of the people . . . are likely to be
a good enough risk?
Conclusion
Disciplinary Logics
To be a Shakespearean scholar, to absorb oneself in black holes,
or to attempt to measure the effect of schooling on academic
achievement—is not just to take up a technical task, but to place
oneself inside a cultural frame that defines and even determines a
very great part of one’s life.
— Clifford Geertz
Economics
Stavros Ioannides and Klaus Nielsen argued that economics is “now widely
seen as the most advanced of the social sciences with its mathematical for-
malization, public prestige, and Nobel Prize awards.”6 Justin Wolfers, him-
self an economist, recently dubbed it “the queen.” Across macro and micro
levels of analysis, economics possesses a cultural coherence around numer-
ical evidence and algorithmic thinking that is stronger than any other so-
cial science discipline. In both the theoretical (mathematical modeling) and
empirical (statistical analysis) approaches to economics research, scholars
rely as much upon numbers as words to communicate their findings to one
another. One priority in economic scholarship, which is reflected in their
emphasis on mathematical reasoning, is precision. Economists have made
inroads into other disciplines by spotting topically related research whose
methodological or theoretical precision could be improved with economic
ideas, reasoning, or analytic approaches. Some argue that their doing so
has simultaneously weakened the intellectual consensus in target fields
and broadened the intellectual jurisdiction of neoclassical and Keynesian
economics. However, a sharp rise since the early 1990s in “heterodox eco-
nomics,” such as behavioral economics, and in membership in groups like
the International Confederation for Associations for Pluralism in Economics
suggests that the field’s orthodoxy may be weakening and/or that other dis-
ciplines shape economics, just as economics is shaping them.7
The viewpoints of economics faculty whom I interviewed epitomized how
common theories, methods, and practical priorities could combine to create
a common logic by which professors could legitimize admissions evalua-
tions and practices that others might question. Decision-making tactics and
priorities reflected foundations in theories of rational choice and human
capital, methods that are mainly quantitative, and a shared priority of main-
taining prestige in the social sciences. Like other disciplines, how econo-
mists represented their values in admissions revealed preferences that were
thought of as self-evidently preferable rather than the result of common
socialization and professional practice.
Relative risk aversion. In a discipline that prizes its status in the social sci-
ences and a department that prizes its standing in the discipline, the eco-
Disciplinary Logics 77
Philosophy
Interpreting the writing sample. Philosophers felt that the writing sample
evinced the substance, skill, and style of what an individual would bring to
the conversation of philosophy. They revealed the crucial role of the writing
sample in several ways. In our interviews, all members of the philosophy
committees I observed at both institutions volunteered to me that it was
“very important” or “the most important” component of the application.
In meetings, they referred to applicants not by name, but by the topic they
had chosen to explore in the writing sample. Philosophers also devoted
more time to discussing writing samples than any other component of the
application, and it became quickly clear to me that applicants needed to
receive a positive assessment of the writing sample to have a chance at an
admission offer. A senior professor explained his approach to evaluating
the writing sample:
80 I N S I D E G R A D U AT E A D M I S S I O N S
When you have eighty of these things to read and you come in in the evening,
you want to get home and watch TV and go to bed. So, you’re looking for a
reason to stop reading. And so I tell [students] what they have to do in their
writing sample especially—they have to try to counteract that tendency. They
have to give me something to make me keep reading.
Rhetoric is not a craft. It’s an empirical knack that enables you to please people.
But philosophy is [a craft], right? And I think Plato is right. There is such a
thing as learning to give good arguments for what you think. And it’s different
from the skill—such as it is—of just persuading people.
philosophers were the only ones to explicitly acknowledge it. Even one
committee member’s enthusiasm could determine an applicant’s chances
by shaping whether she advocated for the applicant, and this trend be-
came especially apparent in discussions of borderline applicants. When I
asked one philosophy professor what helped the committee decide among
relatively qualified applicants, he admitted:
Well it’s very hard. Let me try to answer your question in a way that may make
the whole process seem a little less credible—but that’s the way it is. What hap-
pens is that one or more members of an admissions committee will catch
some enthusiasm for some applicants but not others. If you go back over, if
you are forced—practically, they’d have to grab you by the scruff of the neck
and force you to look again at a recommendation that you have consigned to
oblivion. There probably are some of them where if you were to say, “Why
weren’t you enthusiastic about the person?,” I’m not sure I could answer. And
I’m sure every year there are . . . people who could easily have been among
the top ones but nobody picked up on them. They just didn’t light a fire under
anyone.
Certainly, graduate admissions is not the only type of elite selection in which
decisions can come down to feelings and gut responses. In an observational
analysis of hiring for investment firms, sociologist Lauren Rivera used Ran-
dall Collins’s theory of emotional energy to explain how “evaluators used
their own emotional responses to candidates as both metrics of merit and
mechanisms of candidate selection.” So influential is emotional “buzz” gener-
ated on behalf of a candidate that it can trump traditional metrics such as
achievement, performance, or ability.
He’s a brilliant guy. Also, his heart is in the right place, so when he hears evi-
dence from Yale, he believes it. This is just what he’s waiting to hear, and so
he believes it and he doesn’t approach it in a critical way. Roger, on the other
hand, has done this stuff. This is his bread and butter. He knows instantly that
this is a flawed study. Why did it even get published? Is it just because a lot of
people want to believe it?
His comments suggested skepticism not only about the research study dis-
cussed in the meeting, but also about the motives of those who marshal its
findings to downplay the importance of GRE scores. For his part, Thomas
recognized that others’ decades of experience with quantitative research
surely informed how they approached admissions and GRE scores. He ac-
knowledged to me privately that they had “a perfectly reasonable argu-
ment” about the Sternberg and Williams study, but that more discussion
Disciplinary Logics 89
should have taken place about the study’s nuances than had actually oc-
curred. Finally, Thomas felt that this was a moment in which worldview
and power dynamics in the group both became salient as some committee
members started taking their cues from Roger and David. Despite his posi-
tion as chair, Thomas was the only faculty member on the committee firmly
committed to deemphasizing GRE scores, and he felt that his minority view-
point had been essentially overruled. He was not the only person to see it
this way. In the course of reviewing this exchange with other members of
the committee, I learned that they too thought this was a situation in which
a minority viewpoint had been overruled through a combination of se-
niority and methodological majoritarianism.
Linda explained that she would not have voted for him if one of her
colleagues had not committed to serve as his mentor:
I think in the end I felt okay with it . . . If over five were in favor, I was at like
a 4.5 or slightly under. And I decided not to make sort of any problem with it
just because I was very respectful of the committee and I felt {Pause} the fact
that there was this professor here already who was willing to sort of work
with this student. I mean, if there hadn’t been that, it would have been like,
absolutely not. Because this person is likely to get lost and then somebody is
going to be, in some sense, stuck, on top of everything else we’re doing. Then
it takes our time away from our research, our other students, and all this kind
of stuff. But given that there was somebody who was really saying, “You know
I’m going to work with this person,” in the end I felt okay with the decision.
David and Linda both identified a role for mentoring students whose formal
credentials seem like outliers. Yet whereas David worried that mentoring
would be insufficient to offset Christian’s competitive disadvantage among
his peers and might recreate within their department the same inequalities
observed in society, Linda worried about how that mentoring would burden
faculty. Her comments suggest a posture of ambivalence—one that I heard
92 I N S I D E G R A D U AT E A D M I S S I O N S
We all voted for Obama. I doubt if there’s anyone in the department that did
not vote for Obama. And we want to believe sort of, “You can pick them at
random and they’ll all do well,” and it just isn’t true.
Conclusion
Mirror, Mirror
Mirror, mirror here I stand. Who is the fairest in the land?
— Wilhelm Grimm, Grimm’s Fairy Tales
T hat people connect through their similarities more than their differ-
ences is a fact of social life.1 We know this tendency affects undergrad-
uate admissions and professional hiring, for example, with decision makers
tending to prefer applicants who remind them of themselves or who fit with
the organization’s status quo. Sociologists call it homophily, and have
explained it in terms of simple attraction, reliance on segregated social
networks, and self-serving ideas about merit.2 Preferences for people like
oneself and for qualities like one’s own have significant implications for
equal opportunity, which is especially troubling because such preferences
can be difficult to avoid. Often they occur subconsciously. When those with
privilege look at others with privilege and instinctively see them as “the
fairest in the land,” it becomes difficult for those from more modest personal
backgrounds to break into the upper echelons of organizations. Sociologists
therefore usually discuss homophily as one in a handful of interpersonal
processes that reproduce broader patterns of inequality.
I did not set out to study the preference for self-similarity, but it was im-
possible to ignore in my data. Nothing short of pervasive, it brought to life
the tendency for organizational selection to operate as cultural matching.3
In some cases, reviewers’ personal identities and experiences shaped how
they emotionally responded to specific applicants’ life stories. More gener-
ally, self-similarity shaped reviewer responses to applicants by providing a
familiar frame of reference. Like previous research on elite selection, I found
96 I N S I D E G R A D U AT E A D M I S S I O N S
Astrophysics x x x
Biology x x
Classics x x
Linguistics x x
Political Science x x x
Sociology x x
Economics x
Physics x
Philosophy x
More often than disclosing their own preferences for students with quali-
ties like theirs, participants would volunteer how their colleagues responded
to self-similarities, although they could also point to specific applicants with
whom they personally felt a connection.
Philosophers not only were aware of and discussed with one another how
experiences, identities, and self-interest formed a basis for preferences; they
accepted this tendency as natural and joked about it. One reflected:
There are people who write original papers and they show that they’re . . .
interested in a topic you’re interested in. That has something to do with what
makes people catch fire about an applicant. If they write a good paper about
a topic I know something about and I’m interested in, I can then appreciate
the virtues of this paper. This person is on to a subject. They obviously show
they’re smart because they’re interested in the same thing that I am {He trails
off, laughing}.
tured the review process to ensure that each applicant’s writing sample
would be read by at least one person with expertise in the subject area. This
practice also addressed their concern that an applicant’s writing sample
might be discounted because a reviewer could not bracket their personal
biases or stylistic preferences.
Participants in other programs discussed the importance of constructing
committees that were diverse along several dimensions, including intellec-
tual focus, social identity, rank, and previous experience with admissions.
Ryan, an astrophysicist, elaborated, “It’s valuable for our committee to have
a diversity of backgrounds . . . I think that helps. People tend to view things
through their own experience.” This approach worked, in part, because ad-
missions committees tended to be relatively small, so adding just one or two
individuals from a particular background could easily broaden a group’s
common sense. On a committee of five, for example, a rating that might
have looked like an outlier from one individual would seem plausible from
two, and would become the majority viewpoint from three individuals.
One person might struggle to build enthusiasm for a borderline appli-
cant, but two or three who shared a particular perspective could shift the
entire tenor or direction of a discussion.
into elite undergraduate institutions (and the intelligence they had perceived
among their peers there) as evidence that today’s graduates from such in-
stitutions must truly be “better.” Brian is an astrophysicist who expressed
this perspective:
I was the best at math and physics in my high school, probably the best in five
or ten years. That may be a big fish in a very small pond. Then you get into a
bigger pond. I got to college and was an undergraduate at MIT. The guy sit-
ting next to me in my intro physics class had been on the American Physics
Olympiad Team and was clearly better than I was. I’m good but there’s al-
ways someone better . . . A letter that says, “This is the best person graduating
from Stanford or Princeton” means a lot more than, “This is the best person
graduating from Ohio State or University of Texas . . .” We certainly know the
caliber of people in there. There was one guy who we admitted that a pro-
fessor from Princeton said—“this is the best undergrad I’ve ever worked with.”
That means a whole lot more coming from MIT than coming from a lesser
school. MIT and Harvard are the places where, frankly, the real genius-type
people wind up.
Finally, a relatively small group offered the human capital argument for
pedigree as merit—that applicants who earned their college degrees from
peer institutions must be superior because they had received high-quality
training. Brian also mentioned, “Coming from the places that are our com-
petition, we know what kind of background they’ll be getting.” Across these
rationales, the common thread was an underlying preference for applicants
whose profiles resembled committee members’ own academically distin-
guished biographies.
Pedigree goes deeper than institutional affiliation, however, and every dis-
cipline has its own set of experiences and qualifications that are regarded
as distinctive. To illustrate how it played out in one field, I discuss pedigree
in classics—a small, tight-knit discipline marked by extended socialization
and study of the languages, literature, and art of ancient civilizations. Be-
fore asking questions about admissions, I began each of my interviews by
asking participants to describe how they had come to be professors in the
field, and in classics the responses had clear patterns. All came up through
the American or British academic establishment, all but one received an
early start learning ancient languages, and several felt that travel and study
in Athens, Rome, or England had an important socializing effect on them.
Sure enough, in their judgments of applicants, these very traits emerged as
Mirror, Mirror 101
salient. Not only did they weigh the undergraduate institutions that stu-
dents attended (very important), the honors or awards they earned (nice to
see), and the eminence of reference providers (expected in this small disci-
pline). They also considered years of Greek or Latin training as a yardstick
of preparation, looked for whether students had traveled to and studied in
the ancient world, and prized applicants who had connections to the British
universities that have been at the forefront of classics scholarship for cen-
turies. Given the discipline’s history and its geographic and educational loci
(including the relatively small set of elite preparatory schools and postsec-
ondary institutions that provide early training in Greek and Latin), these
priorities combined to encourage a system that disproportionately serves
the interests of wealthy students.8
The committee used the language of risk aversion to maintain that stu-
dents needed deep, formal training in both ancient and modern languages
to be successful at the graduate level. An associate professor of classics
explained:
We definitely want to know how many years have they studied the ancient
languages and how many modern languages do they have, because if they
don’t have that, they’re not going to be starting out at a certain level here. They
won’t be able to read any of the scholarship, the foreign language scholarship.
They’ll struggle in their classes.
Yet the tension between pedigree and potential was not lost on classi-
cists. Paula, an associate professor of classics who grew up with professors
in the family and whose institutional affiliations include the Sorbonne, Ivy
League schools, and public research universities, admitted that her depart-
ment was “torn” in how to think about students from less selective colleges.
She said, “I mean you can see how torn we are because, um, we want those
people. We want them encouraged. We would like to support them. {Pause}
On the other hand, they’re nearly always less of a sure thing.” Differenti-
ating herself from such applicants through language like “those people,”
Paula later made a point to deny “bias” in the department. Yet she also
admitted the benefits she personally experienced from her family and well-
resourced undergraduate institution. Paula expounded:
We don’t have any kind of bias. We’re not, you know, “We only take people . . .”
{Interviewee trails off}. We don’t say that, and we would never say that we
only take people from Ivy League schools or from universities as compared to
colleges. Because that’s not, you just never know who the exciting student is
going to be, and it’s in no way a guarantee of where they went to college. The
only thing that can help, that can be an issue, is students who’ve gone to re-
ally good . . . who have had certain advantages . . . either support from family
or support out of a department, have a kind of a confidence that I just myself
felt was needed to get through graduate school.
There may not have been an explicit bias against less renowned colleges
and universities, but there was a clear and consistent preference for the
sophistication of students who graduated from selective undergraduate
institutions.
Students self-taught in ancient languages and those who had attended
less prestigious institutions—including public flagship universities—often
need a postbaccalaureate or master’s degree to be competitive for doctoral
classics programs. The postbaccalaureate was started to help students from
fields like art history and archaeology who wanted to pursue a doctorate
in classics but lacked the language training. Over time, however, students
with bachelor’s degrees in classics have also begun pursuing these de-
grees to gain a competitive advantage over other applicants vis-à-vis lan-
guage skills. Such programs have become a means for current classics
students to preserve their competitive edge in admissions. Notably, these
programs come with high tuition, fees, and expenses for study abroad,
which may work against their original role of broadening access to the
discipline.
In short, it is rare in these programs to break into classics at the PhD
level without an undergraduate degree in the field from an elite institution.
Amy, a female junior faculty member, described the situation to me:
Mirror, Mirror 103
In this year’s pool, two individuals with self-taught Greek and Latin language
skills made it to the short list, but their lack of formal training remained a
major concern for the committee, and the committee opted not to send ei-
ther through to the interview stage. A senior scholar also noted it has been
“very rare not to have a senior thesis” among those recently admitted.
The implicit preference of elites for elites reproduces social hierarchies,
and in few places is that pattern more apparent than the upper echelons
of academia. In the case of classics, participants emphasized criteria in
which the lines between human and cultural capital were no doubt blurry.
Extended travel to the ancient world and formal training in prestigious
institutions had been personally formative for committee members, and
hold symbolic value in the field. From their personal and disciplinary frames
of reference, reliance on these criteria was understandable.
Yet when opportunities that are available to only a few pass as prerequi-
sites, it creates, as Amy described it, a “structure of privilege that is morally
uncomfortable.” Unlike fields such as biology or sociology, which have
multiple access points and in which nontraditional trajectories are acceptable
or even valued, this classics program was more like a typical mathematics
program, requiring an early start and years of experience in well-respected
programs to be perceived as a qualified applicant. Of course, the term
“qualified” is loaded. As recent controversies over hiring faculty and ad-
ministrators of color at the University of Pennsylvania have highlighted, to
be judged “qualified” is not only a judgment of skill and talent. It can also
be a function of whether an employer or decision maker feels comfortable
with the applicant due to common intellectual interests, social circles, or
institutional affiliations.11
Inside and outside of classics, participants were mindful of discipline-
specific prestige hierarchies, in addition to their awareness of a general
prestige hierarchy of colleges and universities. In philosophy, astrophysics,
and biology, for example, professors mentioned specific “underrated” uni-
versities whose reputations for strong training in the field surpassed their
104 I N S I D E G R A D U AT E A D M I S S I O N S
Astrophysics has become such a large field that you have to be broad in order
to understand what’s interesting—what areas you may move your research to
[in order to] follow or even impose a fashion . . . For example, if a new instru-
ment is going to be built—you know exactly that it’s going to revolutionize a
certain number of fields. What are the reasons for that? These projects are so
large. It’s not like someone can say, “I’m going to understand this question in
the lab. I’m going to set up my own lab to do this.” This is a billion-dollar
project that usually the whole U.S. or international community will use. Students
tend to understand where the landscape is—where they have to go—where
are the sexy questions are that people want answered.
Indeed, perhaps the only praise of research interests that trumped “cool”
was “sexy”—a word that participants reserved for research that was timely,
cutting-edge, and somewhat provocative.
By contrast, a committee member in classics audibly groaned as he read
from an applicant’s personal statement, then commented, “He’s really in-
terested in something that others have done and done and done.” A preppy
cool committee member defended his low rating of a student who had gen-
erated considerable discussion. “He was strong in a conventional way,” he
said. “He was everything you look for, and nothing you weren’t expecting,”
to which an ascetic cool professor added, with a chuckle, “Like a Ford.”
Neither applicant made their admit lists. To cool faculty, the novelty and
originality of one’s research interests and overall profile could make an in-
dividual more likable by enabling that student to stand out from the scores
or hundreds of strong, solid applicants.
Interestingly, not a single mention of a research interest being cool or sexy
came from participants in the higher-consensus disciplines of physics, phi-
losophy, and economics. This finding may relate to a trend in Lamont’s
study of peer review: that centralized, hierarchical disciplines are more in-
clined to believe that academic excellence inheres in the individuals who are
being evaluated rather than in the eye of the beholder.13 It may be that fac-
ulty in higher-consensus disciplines are more inclined to judge scholarship
on the basis of shared, well-established standards than on individual impres-
sions. Centralized disciplines possess more of an intellectual orthodoxy in
which novelty—one of the central meanings of coolness—may be of less
value than qualities like precision and methodological sophistication.
Eight of the ten committees included at least one member who advocated
for applicants from modest personal backgrounds. Some of these individ-
Mirror, Mirror 107
uals had been first-generation college students, and all had attended mod-
erately selective or public universities as undergraduates. In interviews with
me, they expressed mindfulness about how far they had come and how they
felt compelled by applicants whose paths reminded them of their own.
Having experienced social mobility, they saw admissions work as an op-
portunity to reach back and promote opportunity for others. Some from
this group also felt that their experience uniquely enabled them to inter-
pret applications from individuals from less privileged backgrounds, and
they offered alternative ways of thinking about institutional prestige and
academic preparation. Contrary to the risk aversion and prestige orientation
of these programs, those from less pedigreed backgrounds encouraged
their colleagues to take a chance on students who seemed to have potential,
apart from their achievements to date.
Narratives from Linda and Louis in the social sciences and from James
and Ryan in the natural sciences14 highlight the unique perspective shared
by faculty who did not attend elite undergraduate institutions. Louis, a so-
ciologist, went to a commuter-focused, moderately selective university
near his home before earning his PhD at an Ivy League university. The tran-
sition for him to graduate school had not been entirely smooth, but after
finding his footing, he had a positive experience. Discussing his current pro-
gram’s approach to thinking about college prestige, Louis remarked,
It’s not like we’re plucking people from only Princeton, Harvard, Yale, Co-
lumbia. But I think prestige is probably a little more important to my col-
leagues, and maybe they’ve internalized it more than I have . . . Some of my
colleagues, in fact people I know are on the committee, really care a lot more
about prestige and think of this university as a much more special place than
other institutions—probably more than I do.
Though he said the university was populated with many “elitists,” its intel-
lectual enterprise had earned his respect. Moreover, although he felt the
degree of coordination between the graduate school’s administration and
program faculty could be improved, the graduate college was “really put-
ting their money where their mouth is on diversity.”
Linda was a social scientist with an international reputation who had
grown up in an impoverished community and was one of the only people
in her high school class to go to college. She spoke to me at length about
her process for choosing a college as a teenager. To save money and stay
geographically close to her family, Linda had enrolled in a college that was
less selective than what she was academically qualified to attend. Higher
education researchers call this undermatching. I asked her whether she felt
her own experiences had affected how she read applications, and she re-
sponded, “Most definitely.”
108 I N S I D E G R A D U AT E A D M I S S I O N S
Linda felt she interpreted grades and institutional prestige more broadly
than the typical script of associating them with intelligence, likelihood
of success, and quality of training received. Her interpretation, she be-
lieved, represented a more “generous” and “gracious” approach than that of
her colleagues.
Linda also considered “distance traveled,” a noncognitive criterion that
many in undergraduate admissions are beginning to weigh. Based on her
firm belief in the role that effort plays in success as a doctoral student, she
assessed not only how accomplished a person seemed, but how far they had
come and how hard they had worked. When I asked her to share an
example of this, she spoke of her own experience as a first-generation col-
lege student, and how that informed her reading of a rural student’s
application:
So that one applicant, I don’t think it’s somebody we admitted, but he said
from his high school something like 50 percent wind up incarcerated . . . some
remote town in Montana. He had to Google how to apply to college. And so
somebody like that, I’m going to sort of look at the file and try to understand
if you started here and already got there {Using hands to show relative dis-
tance} versus somebody who started here and just got a little bit higher than
you. I’m very likely to look at, sort of, where did you start and where have
you been as a very good indicator of where you’ll be.
that’s impressive. It implies the person has strong motivation. And also there’s
a kind of sympathy factor. The spoiled brats who’ve always been rich and their
parents gave them everything, well, they can get in anywhere. We don’t need
to admit them.
Linda thus set her expectations of applicants not only in an absolute sense
and by comparing applicants with others in the pool, but relative to the
student’s own previous opportunities and what the person had made of the
chances they had been given.
James and Ryan, two junior scholars in a natural sciences department,
both of whom had attended midwestern land-grant universities, adopted a
similar approach when evaluating institutional affiliations. In their com-
mittee’s initial meeting to develop a short list, they discussed Wilson, a stu-
dent with a near-perfect GPA in the discipline and considerable under-
graduate research experience.
“He went to the University of Nebraska,” James commented. “He’s a lot
like me.”
“Defend your alma mater!” Matthew exuberantly responded, with a
swoop of his arm.
After a moment’s pause that appeared to me to be a pointed nonverbal
response, James calmly continued. “I trust Janine, his letter writer. If she
says he’s one of the best in forty years . . .” He trailed off, and there was
another pause in the conversation.
“I like him,” offered Ryan. “I think he’d be a good fit.”
“Let’s move him up and then do death match against the others,” Mat-
thew urged.
For context, Matthew earned his PhD from Columbia University, and
“death match” was a term he used multiple times to refer to comparing a
small group of applicants with one another in order to identify weak-
nesses.15 In a follow-up interview, James spoke at length with me about
how he felt Wilson and his alma mater had been evaluated.
There was the student from Nebraska who ended up getting in our top
thirty. There was an interview, and I couldn’t make the interview. Apparently the
interview didn’t go very well, and so he didn’t make the top twenty-two. But that
guy, personally, had a research record that looked very much like mine. He had
a very high GPA. If you want to stand out going to a big, state school, you have
to have a really high GPA. Someone from Columbia doesn’t have to have a 3.9
but if you’re from Nebraska you do. So anyway, we’re advocating for other
people. I try to generally take a second look at people from big, state universi-
ties. I know there are a lot of fantastic students there who for very good reasons
decided not to spend $50,000 a year on their undergraduate education.
110 I N S I D E G R A D U AT E A D M I S S I O N S
James continued, discussing how both his own judgment and that of his
colleagues were situated in personal experience:
The people on the committee who have an Ivy League background thought
about things a little differently. That’s why my colleague was trying to criti-
cize someone who went to Nebraska for going to Nebraska . . . I think people
understand what their [own] experience was, and maybe don’t think the others
on the committee may value the experience that they personally went through.
Recognizing that some of the distinctions that their colleagues valued were
also functions of class or wealth, socially mobile faculty made a special ef-
fort to disentangle potential from achievements. Looking back on their
own paths, some expressed skepticism about how well an elite pedigree
would predict long-term scholarly success. They rated unconventional ap-
plicants more highly than their colleagues did, and advocated for uncon-
ventional students in ways that both improved such students’ admissions
chances and, in a few cases, helped their colleagues think more broadly.
As things go on, the privileged get more privileges. One thing I like to do when
I can is to include in any class a kind of long shot. That is, a person from a
smaller college or something—someone who has written a writing sample that
really grabs you. Even though you don’t know the recommenders, so there-
fore you don’t really trust the recommendations. You don’t know what it
means that they got a high GPA at this school because it’s not much of a school.
But you know—it looks like this is the sort of person that needs to be plucked
out of mediocrity and given a chance. And I like to do that.
Such noblesse oblige seemed to give those faculty the sense that they had
fulfilled their responsibility to encourage opportunity and mobility in a
system fraught with obstacles. Yet it shifted opportunities for only a very
small minority of applicants, and is unlikely to shift the overall profile of
doctoral students away from the power of pedigree and wealth.
In a few cases a critical mass emerged through ally behavior—individuals
working across different social identities toward a common interest. In phi-
losophy, for example, there was the case of Gerald, who supported Liana’s
and Olivia’s argument that they should not prioritize high quantitative
GRE scores because it would systematically undermine women’s access. In
contrast to noblesse oblige, allies joined with individuals from historically
marginalized groups in questioning the usual review process or rethinking
common criteria with an eye to opening opportunities for categories of
112 I N S I D E G R A D U AT E A D M I S S I O N S
Conclusion
One thing is clear. The more that departments hold up a mirror and no-
tice in the reflection not only their collective fairness and beauty, but also
the flaws that stem from who is absent from the image that the mirror pres-
ents, the closer they may come, in time, to embodying the image of diver-
sity they aspire to project.
chapter five
intelligence tests, then the GRE and other graduate admissions exams are
“certainly cousins.” Designed to assess skills that are useful apart from dis-
ciplinary content, Zwick argues that the GRE General Test, along with the
SAT, LSAT, and GMAT, tends toward measuring aptitude, whereas the ACT
and MCAT assess specific subject matter learning.9 However, ACT and SAT
scores are highly correlated, and both are promoted as predictors of college
grades. The “IQ test versus achievement test debate is a tempest in a teapot,”
she writes, a minor distinction that has been blown out of proportion.
Zwick quotes sociologist Christopher Jencks:
Intellectual Intellectual
Novelty Rigor Insight Dispositions Virtues
Other respondents made direct links with love, such as “You’re supposed
to love truth” and that one should be “in love with research.”
The analogy with love is instructive in that it draws out the distinctly
personal, relational elements of intellectual life that scholars experience but
rarely discuss. In her book Professing to Learn, higher education scholar
Anna Neumann used vivid faculty narratives to illustrate affective and
aesthetic aspects of scholarship that contribute to ongoing scholarly learning.
She concludes that the “construction of subject matter knowledge is hardly
free of emotion and is intimately connected with themselves.”11 Neumann’s
participants relayed stories of rare, but powerful, “experiences of passionate
thought” wherein the beauties inherent in their work eclipsed the usual
struggles that accompanied research, their understanding intensified,
and they felt a sense of exhilaration or intimacy with the subject matter.
As fleeting as these experiences may be, their inspiration fuels everyday
academic life, she argues, and they matter deeply to what it means to be a
scholar.12 It may be that faculty were seeking in prospective students glim-
mers of the same passionate spirit that animates their own work and
careers.
In the unique relationship that scholars have with their work, however,
participants shared with me that intelligent scholars are not only “gripped
by whatever they’re working on.” They also stick with the research process
when the going gets tough. Respondents associated “intellectual grit” and
“tenacity” with intelligence, especially when considering the long haul of
the PhD and today’s competitive research climate. Determination and re-
solve were difficult qualities to infer from the records of these mostly young
students. For those applicants with more experience, however, “persistence
in a research area” could signal persistence through the dissertation. For
others, comments in letters of recommendation that an applicant was
“driven,” “hardworking,” “steady,” or “reliable” in research offered hints
that a student might have the intellectual determination that academic life
demands. To extrapolate from such evidence and become persuaded that
such hints were more signal than noise, reviewers might also look to pat-
terns of grades and courses within a student’s transcript.
Jack: One thing you’re very much looking for is a kind of intellectual
honesty that’s a real feature of quality-of-mind.
JP: What does that mean?
Jack: Above all, that means looking at reasons not to agree with what you’re
saying and treating them fairly. That means making nuanced arguments
instead of overstated ones . . . {Pause} It also involves a certain humility
about—you know, if you are arguing about what a certain expression
simply means at a semantic level. You know if important scholars have
taken views with which you disagree, you are looking for people who
have the courage to disagree but also are aware that . . . there are people
with whom one does not disagree, likely.
JP: That’s very helpful. I also heard intellectual courage mentioned a couple
of times.
Jack: Right. They go—they’re not at all the same. But, do they typically go
together? Yeah, I think so. A lack of profound intellectual honesty is often
a form of cowardice because the kind of intellectual honesty I’m thinking
about requires accepting that you can be wrong—that others’ views are
often entitled to quite a lot of respect. And to be able to be aware of that
and still say what you think is at least one important form of intellectual
courage.
In many cases, faculty folded specific qualities of thought and mind into
broader judgments of intelligence. In a handful of cases in the humanities,
however, they became bottom-line considerations in wrestling with bor-
derline candidates. For example, in the classics program, the committee
debated two applicants from the same, moderately selective public univer-
sity in New England, and ultimately made their decision on the basis of an
applicant’s failure to embody intellectual humility. Jack introduced the first
candidate to the committee by reminding them, “He got his degree in 2010
and has been a legal assistant since then. Has also been a volunteer editor
for a classics website.”
Bill noted, “His letters praise ‘diligence,’ and that he is ‘on the way to
originality.’ ”
“He’s bright and lively,” Linda, the department chair, followed. “Has been
to Athens. There are errors in his Greek, but he seems to have intellectual
courage. He’s curious and is an original character. He has studied with my
old student.”
124 I N S I D E G R A D U AT E A D M I S S I O N S
Jack reminded them that the applicant grew up in rural New England,
and commented, “The place is ideal in some ways for pursuit of classics.
Very pastoral.”
Moving on to the next applicant, Linda expressed amazement that the
student had checked the “some high school or less” box to describe his par-
ents’ education level. Jack said, “He seems bright enough. A little naive. Paper
seemed misguided but intelligent. It’s a good treatment of a new problem.”
Another noted that he “qualified as a diversity candidate,” and Sandy
admitted, “I’ve rated him lower than you all have. The letters stressed
drive and energy more than talent.”
“On general principle, it would be nice to have someone from that part
of New England, from a modest state university,” Linda added. “It’s im-
pressive that they can produce two reasonable applicants.”
Yet with an entering cohort of only four students, the committee agreed
that they should not admit both—that they needed to choose just one. As
they dug into the details of the applications, a committee member discov-
ered a line in one of the letters, describing the second applicant as insensi-
tive to what fellow students thought of his “academic zeal.” Worried that
this alleged lack of intellectual humility might encourage competitiveness
in their small graduate student community, they opted to admit the first
applicant. Qualities of mind, which in the humanities included intellectual
virtues, could thus build up or break down a committee’s enthusiasm and
trust in an applicant.
In the same way that successful economists bring a unique blend of tools,
knowledge, and perspective to their scholarly work, the intelligent applicant
was understood to be one whose combination of preparation, achievements,
skills, and qualities of thought signaled capability for producing excep-
tional research. For those students who demonstrated substantive research
experience in their application materials, the committee could more easily
recognize those qualities and, thus, associate them with intelligence.
As William noted, “in every field you want people who think super
clearly.” It was only in humanities, however, that applicants submitted re-
search that faculty could use to personally judge lucidity of thought.13 Fac-
ulty in the humanities scrutinized writing samples with a fine-toothed comb
for evidence of this quality and for evidence of fresh perspective on an issue
of importance to the field. Some social scientists I spoke with lamented the
lack of a writing sample from their applicants, while also acknowledging
that its absence came with positive trade-offs such as reducing the time re-
quired for each file’s review, eliminating ambiguity about how independent
the writing process had been, and obviating the need to debate whether co-
authored work merited the same consideration as a single-authored paper.
Moreover, in the social and natural sciences, an applicant could often
126 I N S I D E G R A D U AT E A D M I S S I O N S
Probably the most important criteria or variable that I look at is whether the
student has been engaged in research. Because that’s really what we’re trying
to figure out: whether the student can successfully finish a dissertation research
project . . . It’s not to say that I would automatically rule out a student who
had no research experience. But I think my point of view is probably fairly
common amongst most of the faculty.
The physics admissions chair used even stronger language. “If the person
hasn’t taken advantage of [research] opportunities, it’s effectively the kiss
of death, at least from my point of view. I think that probably speaks for
most of the people I’ve talked with about this process.”
With widening opportunities for undergraduate research, faculty increas-
ingly expect that at the point of admission students will already have had
some research experience, but they are not always sure how to accurately
draw meaning from the experience that students report. There were two
common refrains I heard on this topic, and both related to the broader chal-
lenge of incomplete information that plagues admissions decision making.
One interpretive challenge with respect to student research experience is
the question of how well a student’s past experience signals current skills
or future performance. A number of professors expressed to me that they
would ideally like to replicate in admissions their process for hiring faculty
or postdoctoral fellows, in which reviewers judge the quality of completed
manuscripts as a signal of future contributions. Unfortunately, forecasting
a student’s contributions from the admission application and prior research
experience was much more difficult. Substantial learning has yet to take
place, for one, and the nature of skills and dispositions a student may have
The Search for Intelligent Life 127
Conclusion
Scholars have argued that the informal mental models about intelligence
that each of us hold are at least as important as formal measures of intel-
ligence in how social goods and opportunities are distributed. By their very
nature implicit, these informal views often go unexamined. I found that
there were two dimensions to the implicit model common to many faculty
members in this study. They described intelligence both as something that
The Search for Intelligent Life 129
It is as if this test functions as a thermometer. And you give each person the
test as if you were taking their smartness temperature. And that, unfortunately,
is not how the test functions. Even the test makers do not claim it is a ther-
mometer of smartness. All they claim is that it correlates with first year college
grades.18
ETS has taken steps to revise the GRE away from the format of an IQ test.
Its most recent overhaul, which they have promoted as a more “friendly . . .
flexible test-taking experience,” reduced the amount of rote vocabulary re-
quired for high scores on the Verbal Reasoning section of the exam, among
other changes.19 Their revisions have the potential to reduce group dispari-
ties and better distinguish among test takers on the upper end of the score
range, but improvements to the instrument will not change how faculty in-
terpret the scores.
From professors’ hedging about what GRE scores mean, and from the
nuanced views of discipline-specific intelligence that they articulated, it is
clear that many of them possess a more sophisticated mental model than
the one implied in their discussions with one another. Most know that GRE
scores are only modestly correlated with measures of intelligence, and that
admission tests are not designed to measure it at all. Yet in contrast to some
thoughtful and measured discussions I observed about other topics, smart
talk in committee meetings was off the cuff, to the point of appearing perfor-
mative. Why? I have spent some time trying to make sense of this, because
faculty falling back, in practice, on a more simplistic view of intelligence than
the one they actually hold could be seen as a significant flaw for the integ-
rity and legitimacy of admissions evaluations.
The Search for Intelligent Life 131
International Total +9 +9 +9 +9
Country of Origin
China +21 +20 +5 0
India +2 0 +27 +25
South Korea −2 0 −10 −9
Taiwan — −4 −3 −6
Canada — +9 −1 +4
Mexico — +6 0 −1
Brazil — +6 +46 +98
Region of Origin
Africa — +10 +7 +3
Europe — +2 0 +2
Middle East +16 +17 +12 +9
Note: Prior to 2011, data were not collected for Taiwan, Canada, Mexico, Brazil, Africa,
and Europe.
Source: Council of Graduate Schools, 2013.
intelligence, belonging, and likelihood of success. However, they did not al-
ways see scores this way for international students, whose formal training
in basic skills and test preparation might be different than American stu-
dents’. “The educational infrastructure leading up to this test is not the same
across countries,” one physical scientist put it, “so we set the bar at different
places depending on the country and gender.” A social scientist born in
Italy commented more specifically on the relative quality of test prepara-
tion that he believed to characterize different regions:
European students tend to be pretty bad in performing in the standardized
tests . . . They don’t get exposed to this kind of test in their regular curriculum.
For example, I’d never done a test in my life until I had to face the GRE . . .
[So] we tend to underweigh the scores of students from South Asia for the very
simple reason that we know that some of them actually go to school to do the
GRE for months. There’s not a lot of signal in the scores from South Asian
students, especially students from China.
His perspective was hardly unique. A philosopher also shared, “There cer-
tainly is a kind of stereotypical {Pauses, apparently catching himself} Chi-
nese student who will have astronomical test scores.”
With a large pool of East and South Asian applicants who have high
quantitative reasoning scores, many participants came to set higher GRE
score expectations of Chinese, Korean, and Indian applicants than of Amer-
ican and European applicants. “If a kid from the PRC has not essentially . . .
perfect scores on GRE exams,” one linguist admitted, “they’re regarded as
probably brain dead.” In a few fields, however, faculty read Chinese students’
higher mean scores as a sign that the test was less useful for comparing
them, to the point that some dismissed the scores entirely. Describing ap-
plicants from China, Japan, and Vietnam, a midcareer scientist who led his
program’s admissions effort noted:
The scores on the standardized tests are just out-of-sight, just off the charts.
So you can basically throw that out as a discriminator. They’re all doing 90th
percentile and above. The domestic students were all over the place so there
was actually some spread, some dispersion . . . so you could use that more as
one of the quantifiers.
Another, who had been born outside of the United States himself, said,
To evaluate them [Chinese students] relative to Americans and Europeans is
not so easy. The Americans will not push to take the prep on the GREs and
sometimes do very poorly on them . . . If you had to admit them strictly on
the basis of the GRE, we’d basically have . . . all the kids would be Chinese.
There’s no doubt about it.
International Students and Ambiguities of Holistic Review 139
families exorbitant prices to take the TOEFL exam or, in some cases, to pro-
vide answers in advance.15 And in 2001 the Educational Testing Service,
which administers both the TOEFL and the GRE, filed a lawsuit against
China’s largest and most profitable test preparation company for illegally
publishing ETS materials. Official correspondence from ETS notified grad-
uate school deans across the United States of the situation.16 The effect of
these scandals and others, he argued, has been to call into question all test
scores from Chinese applicants. In a system as competitive as this, when
“you’re not 100 percent sure whether they are the person who took it,”
doubts about the trustworthiness of a test score could be used to discredit
the applicant in general.
Others distrusted the signaling value of the GRE for Asian applicants be-
cause it does not capture the work that they worry Asian students will
struggle with in graduate school: open-ended, creative scholarship. This pat-
tern was exemplified in physics and astrophysics, two programs in which
most or all faculty expected strong performance on the GRE, especially the
Physics Subject test. William explained:
If we let in all of the top GRE scores automatically, then we’d have all Chinese
students, which aren’t bad. But historically what’s been found is that students
from China tend to not succeed as well as their GRE scores would indicate
since they’ve learned over the years to learn towards the test. This is a general-
ization, but they generally don’t perform as well as graduate students when it’s
more open-ended because they’ve learned—they’ve been trying to work towards
a particular task their whole time in undergraduate. It’s something that we look
at, but we do a lot of talking about how it is an imperfect measure.
It is incredibly rare for any American undergrad to score more than seventies
or eighties in terms of percentile. Like 99th-percentile scores, invariably, are
from China or India or something like that. But often the students aren’t as
successful, because what that proves is that they’re really, really good at mem-
orizing formulas and solving problems based on them. And the way physics is
taught in—as I understand it from talking to people who went through that
system in India and China—is, it is very rote . . . You will solve problems until
you can solve them in your sleep . . . But if that’s what you’ve been trained to
do and you haven’t been trained to think about things that aren’t reducible to
simple formulas, you’ll have a lot of trouble in grad school.
and interested,” she said, “but their English is just not good enough to
keep up.” As with their evaluations of domestic students, admissions com-
mittees hoped for students who would work hard, but not struggle too
much, because struggling slows students down and drains faculty time
and resources.
And like their interpretations of scores from the quantitative section of
the GRE, some faculty admitted suspicions that Asian students’ English
skills were weaker than implied in the application because applicants had
gamed or cheated the system, or had forged personal statements. One
frankly put it, “I think there’s something notorious out there. The TOEFL
scores somehow can get jacked up.” Like many of the assumptions I picked
up on in our interviews, I probed respondents about what led them to be-
lieve this. Typically, they cited vague memories of publicity from the cheating
scandals or memories of isolated instances in which students arrived on
campus with subpar English skills. Several also discussed rumors of stu-
dents contributing illegally to banks of GRE items after completing the
exam or of hiring someone to stand in for them on the TOEFL or phone
interviews. Recalling his experience at another university, a sociologist
recounted:
There were people applying from China who were getting 100 percent perfect
scores on the verbal part. These are people for whom English is not only not
their native language, but they don’t live in an English-speaking country. And
we found out later there apparently was all kinds of cheating going on.
Perfect TOEFL or GRE Verbal scores are simply not expected of Chinese
students because of the context in which those students are growing up.
Although the economics and physics committees liked to see extremely high
or perfect Quantitative scores, none expected perfect Verbal or Writing GRE
scores—even of American students. Therefore, when such scores showed
up in the application of a U.S.-born student, it was a remarkable surprise,
and when they appeared in a non-native English speaker’s file, it was con-
sidered suspect. And, indeed, uncertainty about whether their GRE Verbal
or TOEFL scores might be ethically tainted often cast doubt upon Chinese
applicants’ fluency, generally.
Those faculty who discussed efforts to gauge fluency from the applica-
tion alone described it as an almost impossible task. In the sociology pro-
gram, several faculty stated the perception that the best evidence for
applicants from China was having studied in the United States, for having
American transcripts and taken the GRE in the United States provided
“a U.S. basis to judge them. They’ve done work in English.” Some programs
conducted video interviews with prospective international applicants to
International Students and Ambiguities of Holistic Review 143
“deal with the paranoia” of admitting students with poor English fluency
or inadequate research experience (see Table 8).
I sat a few feet behind the committee members during the interview, and
each time I looked up from the field notes I was taking, I could see she was
wearing a wide grin. It appeared that she did not stop smiling from the mo-
ment the interview started until the time they disconnected from the video
conference. I was reminded in the moment of William Tierney and Estela
Bensimon’s idea of “smile work,” an impression management strategy that
women sometimes employ to “fit into departments with a tradition of male
dominance.” Knowingly or unknowingly, women may present themselves
as “pleasing and agreeable” in order to avoid being stereotyped as overly
aggressive.17 Her smiles were not lost on the committee. After finishing the
interview and disconnecting, they leaned back to debrief. They discussed
her “very nice personality,” with one remarking that she was “glowing.” One
admitted he hoped that “she would go into greater detail” about her re-
search, and in the only comment about language, another commented that
she was “not the most articulate person we’ve interviewed.”
“Good but not great . . . Maybe not as serious about us as some,” the
committee chair concluded, to nods from the others. My read of the de-
briefing was that they wanted to like Chun because she seemed so very lik-
able, but that they did not see her as sufficiently professional, at least when
compared with others whom they had interviewed. Interestingly, none of
their comments related to her English skills, which they previously shared
with me was a primary motivation for the video interviews, or other issues
specific to her status as an international applicant.
Finishing up their conversation in the minutes before the next interview,
two of the committee members commented on gender dynamics they had
observed in interviews over the years. Victor said he felt women tended to
give concise responses and “speak only when they know what they are
talking about” whereas men will “just keep talking to convince you that
they know what they’re talking about.” It was not clear whether they
made these comments because I was in the room or because questions about
the depth of Chun’s responses hung in the air after her interview, but it
was clear that the pattern they noted with women had been true of Chun.
Similarly, the pattern they attributed to men was evident in the next inter-
view, with Bradley, a male in his thirties.
The two other committee members joined the huddle to participate in
Bradley’s interview. They may have judged Chun “good, but not great” after
her interview, but that was the general impression of Bradley held by two
of the five before his interview began, largely because of an unconventional
trajectory into the discipline (he had worked for several years in the arts)
and his undergraduate education at a moderately selective public univer-
sity. He had just barely made the short list, and they wanted to video in-
International Students and Ambiguities of Holistic Review 145
terview him to gather more information about his background. The two
skeptics wanted to be present to take a closer look, and the three who were
already impressed wanted to attend out of curiosity—and to make sure the
skeptics did not grill Bradley too harshly. By the end of the interview,
however, he had completely won them all over with the story behind his
unusual background (a triple major, including astrophysics and art), his
obvious ease discussing his research in detail, and by the incisive questions
he asked the committee. For example, whereas Chun’s first question for
the committee was “What is it like to live in your town?,” Bradley’s first
question for the committee was, “It seems from the website like you distin-
guish your department in specific ways. Could you talk about your current
priorities as a department?” He even went so far as to directly inquire
about the committee’s thoughts on a personal and legally protected char-
acteristic that he disclosed in the personal statement, and which, indeed, one
member of the committee had raised as a red flag in their last meeting. “We
think it is worth something,” one of them assured him. Victor added, “It’s
worth a lot.”
In the closing back-and-forth comments between Bradley and the com-
mittee, the chair’s tone and comments seemed to presume admission and
enrollment, and in debriefing his interview after it finished, the committee
displayed none of the ambivalence or equivocation that I heard after Chun’s
interview. Instead, discussion repeatedly included such words as “superb.” It
was clear that they wanted badly to attract him to their program, and indeed,
at the end of the process he was one of the first to be added to their “admit”
list. In the end, however, Bradley chose to enroll elsewhere.
I do not mean to imply that Chun’s and Bradley’s interviews represent
how the committee judged women versus men or Chinese versus American
students. This committee was thoughtful in their deliberations, and the con-
clusion to my field notes from that day includes the line, “If I could admit
two of the four people interviewed today, I would select the two men.”
However, these interviews did draw out just how much more evaluation
may take place in interviews than is formally communicated to students.
As a professor in another department admitted to me, “That’s what you’re
going to tell them, that you’re going to screen them for language. But frankly,
we think a little broader.”
As with GRE scores, suspicions of fraud surfaced in respondents’ stories
to me about their interviews with students from China, South Korea, and
Japan. Some faculty admitted that they would continue to be skeptical of
international students’ English skills until they arrived on campus. A member
of the committee described above recalled the case of a recent South Korean
applicant:
146 I N S I D E G R A D U AT E A D M I S S I O N S
They interviewed him on the telephone. His English was fine, and he was very,
you know, his credentials were good. We admitted him. But he couldn’t talk
English. I mean he couldn’t understand what you said to him. He couldn’t
speak English. The only thing we could think was that he’d gotten a ringer to
do the interview.
The most common concern faculty named about reading letters was how
to interpret a less-than-exuberant tone. Could they safely use tone as a clue to
the letter writer’s feelings about the applicant? Or was it a function of cul-
tural norms or the letter writer’s personality? After tone, faculty struggled
with how to make sense of content, especially in letters from scholars in
China. Letters from China often emphasized applicant morality, when what
faculty primarily wanted were hints about fit and the quality of their research
experience. Also, what would the applicant be like as a junior colleague for
five or more years? How did she or he compare to other students?20 The
chair of the economics committee described their general understanding
of the situation: “Internationally, they [the committee] know the programs
they trust, and there are some institutions producing very good econo-
mists, but their faculty don’t know how to craft the kind of recommenda-
tion that at U.S. reader will find persuasive.” Recognizing this tendency, he
has made it a point to explain these norms to scholars he meets at interna-
tional meetings and collaborations.
Like differences in the cultures of test preparation, cultural differences
in letter-writing norms complicated faculty members’ efforts to get to know
individual applicants and their skills. Ultimately, that ambiguity prevented
most Chinese applicants from receiving the same boost that a well-received
letter could give students with nontraditional backgrounds.
Table 9 Descriptors Used by Faculty in Profiles of “Easy to Admit” Students from China,
South Korea, and Japan
Note: Descriptors that faculty used in the other three profiles of “easy to admit” students from East
Asian countries were “thoughtful,” “knowledgeable,” “really good,” “very strong,” “imaginative,” and
“independent.”
for their uniqueness. In sum, stereotypes associated with the model minority
paradigm informed faculty judgment, but when it came to reviewing the stack
of outwardly “indistinguishable” Chinese applicants, those with the best
chances of being admitted contradicted those stereotypes.
Conclusion
A natural question is: To what extent is there evidence for the types of
assumptions that faculty held? On the question of whether TOEFL and
GRE Verbal scores are valid indicators of English proficiency and student
success, more than forty years of research have yielded few clear trends
about the TOEFL’s utility in predicting international students’ academic per-
formance. A recent study, which sampled 1,733 international students en-
rolled in U.S. graduate programs between 2005 and 2009 (22 percent of
whom were Chinese), found that TOEFL scores did not predict graduate
school academic performance. Other studies suggest that the TOEFL is a
more useful metric in the humanities and social sciences than in the natural
sciences and more effective in predicting academic performance of students
with lower English proficiency. An interesting study of international grad-
uate teaching assistants found that those who received negative teaching
evaluations from students were also likely to have lower TOEFL and
Verbal GRE scores. These mixed findings suggest that faculty should not
count on the TOEFL alone to gauge students’ fluency. When doubts are
present, seeking additional information to assess applicant English profi-
ciency appears to be a reasonable step.31
It is true that, on average, international students have higher GRE Quan-
titative scores than U.S. citizens, by 6 points in 2012. Chinese students
have the highest mean GRE Quantitative scores in the world (162.9 points),
more than 13 points higher than the mean for U.S. test takers.32 However, Fu
found that, among international students, GRE Verbal, GRE Quantitative,
and undergraduate GPA together explained only 3.1 percent in the vari-
ance of first-year graduate school grade point average, less than half of
that explained in an identical model with domestic students. She also found
that GRE scores did not on their own significantly predict international stu-
dents’ graduate school GPA,33 suggesting that reviewers had a point in not
taking international students’ scores too seriously. If the test’s weakness for
some U.S.-born African American and Latino students is that scores are
susceptible to noise from stereotype threat, then for many Asian-born stu-
dents, the weakness may be scores’ sensitivity to large amounts of practice
and preparation. Rather than reducing students to their performance on
tests, faculty should weigh TOEFL and GRE scores as part of a holistic set
of considerations about students.
Reliable evidence on the presence, nature, and extent of academic cheating
is difficult to obtain, and to my knowledge there is no academic research
on the topic of cheating in graduate school admissions.34 Incidents of fraud-
ulent TOEFL and GRE test taking in China seem to have reinforced the
fundamental distrust with which many faculty regard applicants from that
country, even though the incidents were thought to involve only a small
International Students and Ambiguities of Holistic Review 153
Summary
We know this much about how faculty evaluate prospective graduate stu-
dents: Test scores, college grade point average, and college reputation play
a formative role in the initial review of applications, which explains their
relationship with the probability of admission, generally. From the current
study, I learned that faculty conceive of “merit” at this point in review prin-
cipally as a matter of conventional achievement, although scholars across
the disciplines may vary in the sections of the GRE they weigh and in con-
sidering overall GPA versus grades earned within one’s major. They do not
interpret every student’s scores the same way. Due to China’s deep-rooted
culture of test preparation and history of admissions fraud, for example,
many faculty believe that students should have very high GRE and TOEFL
scores but that those scores cannot be trusted to reliably predict student
skills. Intriguingly, although it is standard practice to contextualize test scores
by national origin, and grades by institutional prestige, most faculty do
not contextualize test scores in light of their distributions by race, gender, and
socioeconomic status. Just two respondents, an economist and a philoso-
pher, actively encouraged consideration of diversity and/or students’ social
identities in the initial round of review.
Why the double standard? The most common explanation I heard was
that such an interpretation would introduce diversity into the conversation
too soon. As a sociologist in the study put it: “First you have to be above a
bar, then we can ask the diversity question.” Setting extremely high bars on
GRE scores and college prestige, however, disproportionately excludes the
very populations whom university websites and mission statements claim
they wish to attract—and who are already underrepresented in many fields
at the levels of doctoral education and the professoriate. For example,
16 percent of Asian American high school graduates enrolled in highly se-
lective colleges and universities in 2004 compared to 2 percent of African
American high school graduates. In the physical sciences, 82 percent of
Asian and white students earned a 700 or above on the Quantitative sec-
tion of the GRE, compared to 5.2 percent of underrepresented minority stu-
dents.3 The informal admission standards that elite doctoral programs
have established in many fields therefore make it extremely difficult for
people of color to gain access.
As a matter of procedure, committees commonly maximize efficiency and
minimize conflict by discussing only the cases in which initial ratings di-
verge from each other. As long as committee members rate an applicant
similarly, the average rating can serve as a proxy for “the collective assess-
ment of the committee.” Through this process, they can quickly eliminate
156 I N S I D E G R A D U AT E A D M I S S I O N S
a large share of the pool using common, academic criteria. But deliberations
about borderline applicants are handled quite differently; these decisions often
come down to hair splitting or making subtle distinctions between appli-
cants based on novel criteria that were not considered relevant to the assess-
ments of other candidates.
Academic preparation is just the tip of the iceberg when it comes to
“merit,” because faculty judge many more students smart and competent
than their doctoral programs have capacity to accommodate. For the small
number whose applications survive to receive full review, judgments are
thus holistic, complex, and unpredictable. When comparing generally qual-
ified students, seemingly small matters may matter very much to an appli-
cant’s chances because of the layers of inference involved. In the words of
one tenured philosopher, “We are in the business of making fine distinc-
tions.” A single, ambiguous line in a letter of recommendation; the appeal
of a writing sample’s introduction; the poor reputation of a letter writer
for speaking too highly of too many students; an applicant’s weekend hobby
or hometown—reviewers may read meanings and value judgments into
each of these, in ways that can spell the difference between a candidate’s
admission or rejection. With few cases discussed and evaluations subject to
a myriad of considerations, pinning down what counts as merit late in the
process is more difficult than it is earlier in review, when a few key criteria
go a long way in shaping ratings. “Everything matters, and nothing matters
most,” as one faculty member commented.
In this type of situation, any basis for comparing applicants can have the
effect of a “preference.” The individualistic analyses that are inherent to ho-
listic review can elevate opportunities for one student in spite of reducing
chances of another with different, albeit also desirable, qualities. When a
small program like classics admitted one of two applicants from rural New
England because a committee member envisioned it as a “pastoral” place
for early socialization in classics, it impinged on opportunities for many
applicants whose geographic origins were not perceived as salient. In po-
litical science, when a student with mediocre grades was admitted in part
because a committee member thought it was “cool” that she wrote for an
online magazine, it came at the cost of another borderline applicant who
had written a book. Committees in several disciplines admitted applicants
from China who disclosed creative hobbies over dozens of their fellow Chi-
nese nationals who did not. What counts as merit when comparing bor-
derline cases sometimes comes down to details that appear idiosyncratic
and far afield from conventional achievement.4
Many of the grounds for judgment late in the review process are spe-
cific to one or two applicants rather than applied to the entire pool, but
Conclusion 157
those evaluations are all part of an effort to shape the future of their pro-
grams and disciplines. Leaving behind the focus on conventional achieve-
ment in most cases, deliberations revolved around how applicants “fit” with
the program in the present and their idealized academic communities of the
future. They sought students who offered fresh perspectives and strong
grounding in discipline-specific research dispositions and skills. Diversity,
broadly defined, was integral to the fresh perspectives they sought, and a
majority strived to construct “balanced” cohorts of students. Rarely, how-
ever, did they discuss race, gender, or socioeconomic status in explicit or
substantive ways. In contrast to the state of affairs that some worry about,
in which race considerations drive admissions in ways that compromise
the fairness of the entire process and its outcomes, I was more taken
aback by the almost complete silence on these topics in the meetings that
I observed.
in the political environment, university efforts since the 1970s have been
to protect the legitimacy of race-conscious admissions by elevating the ra-
tionale with the widest public support.
Institutions have also focused on diversity’s educational benefits because
the courts have established narrow parameters for the constitutionality of
race-conscious admissions. In 1978 in Regents of the University of California
v. Bakke the U.S. Supreme Court ruled racial quotas unconstitutional, and
in 2003 in Gratz v. Bollinger it also struck down the awarding of “auto-
matic, predetermined point allocations” to underrepresented students.12
Justice Lewis Powell’s controlling opinion in Bakke ruled consideration of
race permissible as a “plus factor” in admissions and financial aid decisions,
but this consideration requires narrow tailoring to a compelling state
interest.13 What counts as a compelling state interest? In Bakke, whose
precedent has been upheld in such recent decisions as Fisher v. University
of Texas, the Court rejected three of the four interests in affirmative action
asserted by the University of California–Davis Medical School. However,
Powell’s opinion affirmed the educational benefits of diversity, broadly de-
fined, citing promotion of diversity in higher education as a “compelling
governmental interest.” Powell also upheld educational institutions’ discre-
tion to determine the selection procedures that best suit their needs, asso-
ciating it with academic freedom and the First Amendment.14 In the years
since Bakke, voters have banned affirmative action through ballot initia-
tives in Arizona, California, Michigan, Nebraska, Oklahoma, and Wash-
ington, and the legislature and governor passed anti-affirmative policies in
New Hampshire and Florida. These bans are responsible for declining
racial/ethnic diversity in selective undergraduate institutions and in many
graduate fields of study, amid increasing racial and ethnic diversity in the
population.15 For academic institutions in the other forty-two states, how-
ever, principles from Powell’s opinion are still the law of the land, and are
important for those engaged in admissions to know. A brief from the Civil
Rights Project at UCLA summarizes them:
Risk aversion. There is also abundant evidence that faculty in these presti-
gious programs engaged with admissions work from a posture of risk aver-
sion. This tendency, paired with the specific assumptions about risk that
they frequently made help clarify why they favored criteria that undermine
increased racial diversity. Many respondents associated less selective under-
graduate institutions and lower test scores and grades with less prepara-
Conclusion 163
tion and intelligence, and they associated less preparation and intelligence
with a higher risk of academic struggle or failure. This risk aversion script
pervaded ratings and deliberations at all stages of review. Risk aversion also
provided a bottom-line basis for rejecting well-pedigreed individuals who
had personality red flags, research interests that aligned only marginally
with faculty expertise, or letters of recommendation that raised eyebrows.
Organizational theorist James March has found that a propensity to risk
aversion is common in high-status organizations’ decision-making pro-
cesses.20 In this case, faculty rationalized risk aversion as an organizational
luxury, a matter of financial prudence, and a foundation of responsible de-
cision making. They knew they could afford to be risk averse because their
highly ranked programs attracted so many qualified candidates. Further,
they convinced themselves they should be risk averse in light of the finan-
cial investment involved and what admitted students represent—namely, the
program, discipline, and university’s quality, status, and future.21
High-status organizations are also more prone to fundamental attribu-
tion error—the tendency to attribute the outcomes of their members to
intention and skill rather than to the conditions in the environment. Under
these conditions, high-status organizations often simply exclude prospects
perceived as risky rather than measuring the risk and making a decision on
that basis.22 This point highlights a critical detail about the risk aversion I
observed—that it was almost always grounded in perceptions of risk rather
than generalizable evidence or calculations of it.
Availability bias offers a third way of understanding risk aversion in
terms of cognitive biases. Trusting the reliability and validity of the limited
information that is currently available to decision makers can lead them to
overestimate the likelihood of rare but memorable events. Availability bias
facilitates group-based stereotyping, and I observed it to be a process by
which racism was subtly institutionalized in the admissions process. For
example, a number of faculty regarded African American, Latino, or Na-
tive American applicants from less selective colleges or non-native English
speakers from East Asian countries as admissions risks because their pro-
grams did not enroll many of these students and recollections of one or two
students who had enrolled and struggled were hard to shake from their
memories. Several participants admitted that they felt “spooked”—three
using this particular word—when reading applications from students whose
profiles reminded them of individuals who did not graduate.
Availability bias is especially dangerous when combined with fundamental
attribution error. The combination of these two biases locks in faulty as-
sumptions about who is successful and why, and then uses those faulty
assumptions as a basis for distributing future opportunities. First, attribution
164 I N S I D E G R A D U AT E A D M I S S I O N S
errors blind academic departments to how the climate and culture that
they create may contribute to students’ successes and struggles. Then,
availability bias encourages extrapolation of a few students’ struggles
(which resulted in part from organizational conditions the department
could change) to a larger category of students as a basis for evaluating their
future potential, and thus their deservingness for opportunities. Taking steps
to actively check the natural tendency toward these biases can prevent the
experiences of a few individuals from becoming the basis for judging whole
categories of future applicants as risks. It also highlights the importance of
encouraging faculty mindfulness about their own role in shaping student
success.23
It’s uncomfortable to be reminded that I’m part of the problem. What I don’t
want are things that will feel unnatural, take 300 percent more time, or that my
colleagues will fight. I want to keep my sanity as a professional, and I don’t want
admissions work to consume me. What I want are straightforward ideas that
help me be part of the solution.
With this idea and Jonathan’s quote in mind, I turn now to discuss the im-
plications of this research for graduate admissions practice. “Admissions
decisions are actionable choices,” as higher education scholars Rachelle
Winkle-Wagner and Angela Locks wrote, and although professors may in-
herit their colleagues’ approach to admissions, they also have autonomy in
most universities to change the way things are done. My research was not
designed to encourage policy prescription, but integrating its findings with
those of other recent research studies is useful for sketching a framework for
structural changes needed in many fields and programs. Within this frame-
work, graduate programs can craft and evaluate practices that suit their
own unique needs.
are easily assessed in the context of their individual trajectories and oppor-
tunities. Open-ended review can lack transparency, however, putting the
applicant in the position of playing a game whose rules are unknowable.
This opacity maximizes institutional discretion, but it can also allow un-
seemly preferences and biases to enter the review process.
More structured approaches to review define in advance the criteria on
which every application will be assessed. The National Science Foundation’s
ADVANCE program has developed rubrics and other evaluation tools that
codify and define selection criteria and ask reviewers to provide a rationale
for their ratings. Table 10 presents a very basic skeleton of a rubric that
departments could customize. Rubric-based evaluation raises transparency
and does not preclude reviewers from contextualizing applicant charac-
teristics or attending to underlying rationales. Rubrics can also be de-
signed to note desirable qualities that come along so rarely that it makes
little sense to include them in evaluations of everyone.27 Using a rubric in-
creases equity, by comparing all applicants using the same criteria, and ef-
ficiency, by focusing reviewer attention on key information. Rubrics do
raise the stakes associated with each criterion, so they need to be chosen
with care.28
Table 11 Top 30 Institutions Producing African American, Latina/o, and Asian / Pacific
Islander PhDs
Sources: Lundy-Wagner, Vultaggio, and Gasman 2013, 158, citing Survey of Earned Doctorates 2009.
and diversity. Diversity was one dimension of merit when faculty assessed
applicants on the short list, but many spoke about “diversity with excel-
lence” as well—as if these are independent entities accompanying one an-
other. The Association of American Colleges and Universities recommends
educational institutions work toward a culture of inclusive excellence,
which
integrate[s] diversity, equity, and educational quality efforts into their missions
and institutional operations . . . The action of making excellence inclusive re-
quires that we uncover inequities in student success, identify effective educa-
tional practices, and build such practices organically for sustained institutional
change.33
the GRE measures skills. It advises that raw scores and percentiles should
not be used as sole or primary admissions considerations, and that score
thresholds should not be applied.38 However, decision makers in these pro-
grams routinely used scores as a primary consideration in the first round
of review. About half thought of scores as signaling intelligence, and it was
common practice to assess applicants against formal or informal score or
percentile thresholds. Simply put, they misused the GRE.
The appeal of simple metrics is undeniable. Indeed, anything that makes
this complicated review process more convenient is hard to ignore. How-
ever, the patterns I observed both run contrary to the psychometric
properties of the test and put already underrepresented populations at a
disadvantage. By failing to read scores in context, reviewers made overly
simplistic comparisons about students’ relative potential. Many had a gen-
eral awareness that GRE scores have patterns associated with race, gender,
and first-year graduate school GPA. Fewer knew that research studies have
come to very different conclusions about the strength of the correlation
between test scores and longer-term academic outcomes, or that stereotype
threat helps explain group-level disparities.39 Professors thus need better
knowledge of ETS guidelines, of research about the full scope of factors
that test performance can reflect, as well as its validity for different groups
of students and for short- versus long-term outcomes. With this knowledge,
admissions leaders can come to more thoughtful decisions about whether to
require the test and, if they choose to do so, how to appropriately use and
interpret its results.40
Awareness of the many problems with standardized test scores—that they
are more complicated than they appear, that reliance on them can under-
mine equity efforts, that they do not reliably predict students’ long-term
success—has led some higher education institutions to reduce their reliance
on these measures or eliminate their requirement entirely. As of summer
2014, the National Center for Fair and Open Testing reported that 103 se-
lective colleges and universities had implemented test-optional admissions
processes. At the graduate level, doctoral programs in at least thirty-two
different fields have eliminated their GRE requirement, including ones at
Columbia University, University of Pennsylvania, Johns Hopkins Univer-
sity, and the University of Michigan.41 Research is needed about the effects
of going test optional, both at the undergraduate and graduate levels. In
one study, results indicated that making standardized test scores optional
resulted in an increase in the enrollment of women, students of color, and
international students, without changing the institution’s mean GPA or gradu-
ation rate. But in another study, researchers found that going test-optional did
not on its own increase diversity, but instead increased selectivity because only
174 I N S I D E G R A D U AT E A D M I S S I O N S
the applicants with higher scores submitted theirs.42 If increasing the enroll-
ment of students of color is specifically a goal, making GRE scores optional or
declining to review them are options that should be on the table. However,
they will be more successful as part of a coordinated set of efforts.43
Conclusion
I have argued that judgments of the “best” graduate programs in the country
and the “best” applicants in the pool come about only by negotiating across
priorities associated with specific social contexts. Thus, there is wisdom in
my colleague Paul Courant’s admonition to “beware the tyranny of best
practices.” The best practices for admission to a department’s doctoral
program may be different from those used to admit master’s-level students,
who may have different professional goals. What is best for recruiting
176 I N S I D E G R A D U AT E A D M I S S I O N S
graduate students to New York or Los Angeles may be different from what
it takes to draw students to Madison or Boulder. From this perspective, a
final implication of this study is not the need for a specific set of practices,
but rather for faculty to approach their gatekeeping work with a different
state of mind. Instead of proceeding by default or adopting a specific check-
list of procedures developed for some other program’s needs or goals, ad-
missions decision makers need to approach gatekeeping with mindfulness
of their own situation and needs. When evaluation and selection happen
by default rather than intention, the social consequences of decision
making may be misrecognized as the normal course of events—the way
things should be rather than the way things ended up. And over time those
outcomes can be thought of as natural rather than deliberate, for the more
deeply held a belief is, the more likely it is to keep a person from seeing
things any other way.
Today’s faculty choose students on the basis of an array of perceptions
that only sometimes have a strong evidentiary basis. In a process so com-
petitive that the mere presence of doubt can seal an applicant’s fate, per-
ceptions often carry the weight of truth. They drive decision makers to
act—to rate and advocate, to admit and reject—as if perception were
reality. As the theorem made famous by sociologists William and Dorothy
Thomas puts it: “If men define situations as real, they are real in their
consequences.”
Context and circumstance will always establish broad parameters within
which we make choices. Yet social constructionism teaches us that the so-
cial world is as we perceive it to be because we act upon our perceptions.48
Admissions judgments are socially situated; they result from inference upon
inference, and from filters associated with organizational contexts and
goals. The benefit of research like this study, which puts participant inter-
pretations at the center of analysis, is in uncovering these taken-for-granted
filters, for it is only by stepping outside of and analyzing them that we can
understand their power. Like the prisoners in Plato’s cave, misled to believe
that shadows on the wall were reality, scholars may not even realize that
the way they have been conditioned to see excellence in themselves and
others is not natural, but constructed to serve specific ends. Yet unlike the
prisoners, scholars can shape the social contexts in which their judgment is
situated. In doing so, they refine the lenses through which their own un-
derstanding—and that of their colleagues and students—will be filtered.
Indeed, one of the great values of understanding an organization’s gate-
keeping systems is that it lays bare cultural values that drive policy, which
are often so engrained as to be taken for granted. Too often our preferences
and aversions go unspoken—even unrealized at a conscious level—so that
Conclusion 177
misguided assumptions and implicit biases are never challenged and con-
tinue to shape the outcomes of review. Honest dialogue about the values and
norms that shape interpretations of scholars’ records is therefore needed,
not only in admissions, but across the disciplines and the range of gate-
keeping processes the academy employs. These conversations are relevant
to how we admit students; how we hire postdoctoral researchers and fac-
ulty; how we select individuals for awards, grants, and fellowships; how
we advance students to candidacy; and how we assess faculty scholarship
for tenure and promotion. Each of these evaluation processes is fundamen-
tally an activity of defining and monitoring organizational boundaries, of
determining the grounds for membership, belonging, and recognition.
The faculty I spoke with want their students to succeed, and they like
the idea of increasing diversity of many sorts. They carry out gatekeeping
activities consistent with field-level norms and with those of their own
training. Yet having mostly graduated from selective doctoral programs
themselves, and with limited exposure to other models, their inclination
may be to so strongly associate their own training with “quality” training
that they recreate its selection process and the educational gauntlet in the
interest of preserving what they see to be the purity of the discipline and
excellence of the program.
However, society is changing. The labor market for PhDs is changing.
And higher education is changing, too, both intellectually and demograph-
ically. If doctoral education and our means of identifying talent do not
change with them, it will be doctoral education and the professoriate that
fail by falling behind, not our students. Re-creating academic programs and
disciplines in our own image may be the natural tendency, but in a changing
world—one that is more diverse, more collaborative, more interdisciplinary—
stewardship of our disciplines’ futures means being flexible to recognize
what the world needs from our fields of study and adapting our ideals of
excellence accordingly.
Methodological Appendix
Research design follows from one’s research questions, and the two questions that
guided my design were straightforward: How do faculty members individually judge
and collectively select prospective doctoral students? How do disciplines shape judg-
ments of admissibility? I could have answered these questions through a number of
methods but opted to design an ethnographic comparative case study after weighing
several options. I could have statistically inferred faculty priorities from the char-
acteristics of students that they admitted, but I wanted to explore reasons for the
apparent contradiction between diversity as an institutionalized value and con-
tinuing inequalities in higher education. I also wanted to see how admissions nego-
tiations unfolded over multiple rounds of review—knowing from previous research
that there were likely to be differences between how reviewers approached the pool
as a whole compared to how they approached the short list.1 Third, quantitative
research only picks up patterns present across many people, and many of the rea-
sons that individuals are selected for graduate programs may be idiosyncratic to
committees, programs, disciplines, or specific applicant pools. Thus, the benefits of
greater generalizability that might have come from findings of a quantitative study
would have come at the cost of capturing the very complexities that make it a so-
cially important, and intriguing, phenomenon.
My own conceptualization of faculty evaluation also suggested the need for nat-
uralistic research. I think of evaluation as an activity situated in, and thus shaped
by, social forces associated with multiple organizational contexts, whose priorities
may or may not align. I therefore sought to be closely engaged with the phenom-
enon as it was happening, where it was happening. Observations would also help
triangulate what the evaluative scripts in use were, per methods used in Goffman’s
180 Methodological Appendix
not lost. Small matters—the lighting in a conference room, the order in which
applicants are reviewed, the topics of side conversations preceding the “real”
conversation—may matter much as cultural insights, and through describing
such details I have tried to capture the social and organizational complexity of
faculty evaluation.
Case study methodology does not prescribe specific analytic methods, but weaving
together a case narrative that both accounts for details and sorts out participants’
signification structures is empirical, interpretive work.7 To make sense of the volu-
minous data typically collected for case studies, the researcher’s meaning-making is
a key intellectual activity of analysis.
The final element in Merriam’s definition is the case itself—the object of study—
as a bounded system. The case can be an instance of a population or of a concep-
tual class, but either way it may be thought of as the phenomenon in context.8 I
strove to capture individual and collective faculty judgment in situ, so my case
boundaries were organizational (highly selective PhD-granting programs) and tem-
poral (the admissions cycle from application to yield). Case selection often takes
place by selecting on the dependent variable (identifying a case or cases that maxi-
mize the phenomenon of interest). In a regression this sampling approach is under-
stood to produce selection bias, but comparative case study researchers make no
assumptions about broad generalizability from the case. Instead, their goal and in-
tellectual contribution is deep understanding, including capturing necessary (versus
sufficient) conditions.9 For case study researchers, it is more important to gain a
rich picture of a phenomenon in a meaningful context.
Sampling
Rather than generalizing from their small n’s to broader populations, case study
scholars hope that the theoretical leverage obtained through thick description and
in-depth analysis generates understanding that can illuminate similar cases. Case
study sampling involves selection decisions at two levels: (1) the case, which serves
as the primary unit of analysis, and (2) subjects within the case, whose perspectives
help the researcher craft a holistic depiction.10 At both levels I used criterion sam-
pling, in which the researcher chooses cases that meet a predetermined criterion or
set of criteria.11
Because the majority of doctoral degrees are awarded in research-focused uni-
versities, I focused on programs within three universities that have the Carnegie clas-
sification Research Universities–Very high research activity (RU/VH). Two are
public and one is private, and they are located in two regions of the United States.
Both for participant and program confidentiality and because institutional details
are less salient to my analysis than details of the departments, programs, and disci-
plines, I do not discuss in the results the names or other identifying details of the
universities in which data were collected. Initially I was disappointed by the Insti-
tutional Review Board’s constraint on discussing the details of the universities in
which I collected data. However, as my time in the field went on, I came to see that
the universities varied more in their yield—the ability to draw admitted students—
than in their selection processes, which was my focus.
182 Methodological Appendix
Table 12 summarizes the sampling design. Within each university, I sampled PhD-
granting programs representing disciplines in humanities, social sciences, and
physical/natural sciences. I expected that such programs would evince disciplinary
influences more clearly than applied or interdisciplinary programs. I also narrowed
my choice of institutions to those in which the fields of interest maintain programs
ranked in the top fifteen in their field.12 In these contexts, many qualified individuals
apply; therefore, the competing demands of selection come into sharper focus.
Although I initially hoped to study the same departments at multiple universities,
there was only one instance in which I could gain access from a second department
that was also ranked in the top fifteen in the discipline. The exception to this is phi-
losophy, in which I collected data at two of the three universities. However, within
the humanities, social sciences, and natural/physical sciences, I sampled at least one
higher-consensus discipline (such as classics, economics, or physics) and one lower-
consensus discipline (such as linguistics, political science, or biology), which has lent
structure and intellectual focus to my cross-case comparison.
My sample in each of the ten programs consisted of the chair of the department
and/or admissions, members on the admissions committee, and one emeritus pro-
fessor. Where this group totaled fewer than six people due to a small committee
size or a small proportion of the committee who consented to be interviewed, I in-
terviewed additional faculty members. The astrophysics, linguistics, and political
science departments each included one to three graduate students on the admissions
committee as well, for a total of six graduate student participants. I wanted to create
a picture of admissions as it is currently practiced in these departments, and there-
fore I did not oversample by race/ethnicity or gender. As a result, my sample re-
flects the same problems of underrepresentation by female and domestic faculty of
color that the U.S. professoriate does.
Recruitment
Sensitive to the ethical and reputational implications of this research for the pro-
grams and individuals who participated, I tried to design and write it in ways that
protected them, and to make it as easy as possible for prospective participants to
feel comfortable in our early interactions. In the initial contact, I framed my study
as a matter of decision making and the challenge of balancing multiple interests.
Although I probed for issues around diversity throughout data collection, I saved
the protocol questions about diversity for the end of interviews, after some rapport
and the beginnings of trust had been established. Also, I outlined in both the initial
email and the informed consent document the measures I took to ensure confiden-
tiality. In summary, although the nature of the research undoubtedly deterred some
from participating, I made a concerted effort to minimize the risks to participants
and maximize their anonymity.
With a target sample of four to six programs per year, I initiated contact via email
with seventeen programs in the first year of data collection and eighteen programs
in the second year. My first contact with each was an email message in September
to the department chair or program director in qualifying programs at prospective
universities. I requested a thirty-minute informational interview to discuss their pro-
Methodological Appendix 183
Data Collection
To achieve deep and holistic understanding of a case, leaders in case study research
advise using all three of the common qualitative data collection techniques—
interviews, observation, and artifact analysis.13 In this study, data collection consisted
of observations, interviews, and collection and analysis of department websites
and participants’ curricula vitae. In the first year, I collected data from one pro-
gram at one university and three more at another university. Then, in the second
year, I collected data from six programs at one university.
History, place, and thick description. Understanding contemporary social and ed-
ucational phenomena requires us to consider how they are situated spatially and
temporally.22 Present events and prevailing logics constitute “the signature of his-
tory.”23 Details of space and setting similarly shape social phenomena. What may
appear to be background details are more than local color, for the dimensions of time
and space create dependencies and contingencies that help explain how and why a
case plays out as it does under our analysis. Howard Becker describes such detail
as “the environing conditions under which the things we stud[y]—the relationships
we uncover, the general social processes whose discovery we want to brag about—
exist.”24 While rigorously adhering to the standards of confidentiality that human
subjects policy and informed consent agreements demanded, my analysis involved
careful observation, investigation, chronicling, and sifting of details about the set-
tings and histories of the programs, disciplines, and universities to draw out
context-specific variation and provide rich case descriptions.
Data Management
Case studies are notorious for the amount of data they generate, and I knew that
my ability to craft a meaningful narrative would depend partly on its overall orga-
nization and the accessibility of individual bits of data. My first step in managing
the data was creating an inventory, for which I maintained a comprehensive Excel
workbook. To organize the field notes, interview transcripts, documents, and memos,
I utilized NVivo 9.2. NVivo was also a critical tool for me in data analysis.
Methodological Appendix 187
Data Analysis
The aims of case study—to “uncover patterns, determine meanings, construct con-
clusions, and build theory”—provided a guide to selecting appropriate analytic
methods.25 Techniques from the grounded theory tradition provided a systematic
means of capturing patterns and meanings and of developing conclusions and
theoretical contributions. Grounded theory’s constant comparative method is prev-
alent across various qualitative research traditions, including case studies.26 I drew,
in particular, from Strauss and Corbin’s approach, which involves three stages of
coding (that is, seeking patterns in the data).27 Data collection and analysis occurred
simultaneously to facilitate ongoing reflection on the data and adjustments to my
interviewing and observations. However, analysis continued long after data collec-
tion concluded. I initially analyzed the data one department at a time and used those
analyses to write cases of each department. Then I conducted a cross-case analysis
in which I compiled all of the cases into a new NVivo project and interpreted case
similarities and differences by disciplinary type and paradigm strength using the
same micro-level analytic steps described below. Analysis was iterative, alternating
between aggregated data from specific cases, cases themselves, and the sample as a
whole.
Analysis at the micro level proceeded according to the three stages of coding rec-
ommended in grounded theory: open, axial, and selective. During the initial open
coding phase, I stayed close to my original research questions, looking for themes
in faculty members’ decision making processes, the meanings they associated with
common criteria, and evidence of disciplinary cultures. However, the second round
of open coding was more inductive, and through this I developed a variety of ad-
ditional codes including homophily, bureaucracy, aversions, intelligence, and many
more. For the purposes of an ethnographic case study, I think of axial coding as
data-driven theory generation and of selective coding as an opportunity that case
study presents to intersect theory generation with thick description. It was through
selective coding that I developed a narrative that accounts for the relationship of
the codes to one another and to critical details of the case. By interrelating the data
and themes across levels of analysis and abstraction, my findings include a combi-
nation of description and interpretation at both the individual level and the case
level.
Limitations
The principal limitations of this study concern data imbalances across departments
and demographic groups. Female, African American, or Latino faculty are under-
represented in the highly ranked departments I partnered with and on the commit-
tees I studied; their voices are therefore underrepresented in my sample. Although
this means that my results capture prevailing viewpoints in these departments
(and thus, I hope, cultural dynamics that help sustain structural inequality), the
results do downplay the alternative viewpoints that individuals from these back-
grounds may contribute.
Another limitation is that I have interview data from all ten programs, but ob-
servational data from only seven. Seven of the ten permitted observation, and one
of these (physics) does not convene for traditional admissions committee meetings.
Though I observed two Skype interviews of applicants in physics, I am unable to pro-
vide concrete examples from deliberations in four departments: biology, economics,
physics, and sociology.
Also, the committee sizes and response rates for consent to be interviewed varied
widely across departments. In an extreme case, although the admissions chair was
eager for my involvement with his committee, only one other member consented to
be interviewed; therefore, I withdrew this case from the set of cases (for a final total
of ten). On the other end, in astrophysics, each member of the five-person committee
was willing to be interviewed multiple times. In several departments the committee
consisted of fewer than six individuals or not every member of the committee con-
sented to be interviewed; in these departments, I recruited faculty to interview from
outside the committee, using snowball sampling starting with the admissions chair.
a two-day seminar. Then, each fall, I worked one-on-one with students as they se-
lected prospective graduate programs, initiated contact with prospective advisors,
wrote their personal statements, solicited letters of recommendation, and managed
the myriad of details, deadlines, and emotions that the process requires and creates.
Through this work, I became interested in several aspects of graduate admissions.
As mentioned in the Preface, I struggled to find cross-disciplinary, empirical studies
that could inform my advising work, and thought this absence of research was
curious considering how much has been published on undergraduate admissions.
The similarities between doctoral admissions and faculty hiring processes also
became striking to me, including the role that research potential and establishing in-
stitutional fit play in perceived merit. When I decided to pursue a PhD myself, it
was with an interest in building knowledge about the current structure of access to
graduate education.
Positionality and building rapport. I began the research as an outsider to these de-
partments, disciplines, and the professoriate itself. According to Jorgensen, a major
strength of the ethnographic approach is that long-term involvement allows time for
the building of insider perspective and, with it, trust in the researchers.32 Conversely,
where trust is low, the risks are higher that participants will withhold or distort in-
formation, act out their roles differently than usual, or provide socially desirable
answers to interview questions.33 Thus, it came as no surprise that I encountered a
wide range of comfort and candor levels from participants. Five participants of the
eighty-six who consented to be interviewed projected a clear sense of guardedness
throughout the interviews. These interviews were also relatively short. The other re-
spondents thawed over the first fifteen minutes of the interview or displayed ease
from the beginning and an interest in co-constructing bridges of rapport.
Rapport was demonstrated in ways including but not limited to: socially unde-
sirable and politically incorrect responses (which I probed), an offer to provide me
with an office within the department for my work (which never panned out due
to space limits), an invitation to have our families meet for a playdate (which I
declined), requests for additional conversations about the department’s admissions
reform efforts (which I agreed to), and expressions of emotion such as tears, excla-
mations, and laughter (which I noted with gratitude).
Although it was impossible to know how forthcoming any research participant
was being, the faculty I interviewed seemed to be especially direct with me when
interviews took place after I had already observed an admissions meeting in that
department. Having seen them involved in this difficult work, they spoke with the
honesty that one has when there is nothing left to hide. Interviews with emeritus
faculty were also rich, and often entertaining as they passionately recounted to me
the tides of change and currents of stability in their careers and the lives of their
departments and disciplines. Faculty emeriti, I learned, have not only a wealth of
knowledge about the politics and “dirty laundry” of their departments and disci-
plines. Unlike graduate students and untenured professors, they have little to lose
in disclosing it. I also learned they have a deep, emotional appreciation for their
work and the academic communities who have supported them.
Methodological Appendix 191
Conclusion
Each experience one has for research is an opportunity for continued learning, both
about one’s subject matter and the research process. Although I am unable to share
the original data from this study with others due to my agreements with partici-
pants and the Institutional Review Board, I would be pleased to discuss further de-
tails of the research methodology or findings with readers who are interested.
Notes
Introduction
1. All faculty, applicant, and university names, as well as other personally iden-
tifiable information, have been changed or masked to protect participant
confidentiality.
2. My first thought when I scoped out the room was that I must be in the wrong
place. “Come to the conference room off of the copier room,” my email instruc-
tions from the committee chair had read. The only such room I could find, how-
ever, was about 10 feet by 10 feet, with walls on three sides covered with storage
units and filing cabinets. In the middle was a table for four—but which could
seat six if you were willing to get cozy. I walked the hallways to see if there
might be another copier room for the department. By the time I made my way
back I found three of the committee members seated at the table, and concluded
that this tiny space must be it after all.
3. These numbers refer specifically to admission/rejection in doctoral programs in
research universities with very high research activity. For this and other statistics
about admission rates in master’s and doctoral programs in universities with
additional Carnegie classifications, see Allum, Bell, and Sowell 2012, 5.
4. Other correlates of admission include college curriculum and grade point av-
erage, stated religion, and perceptions of professional competency and interper-
sonal and intrapersonal problems (Campbell 2009; Brear, Dorrian, and Luscri
2008; Attiyeh and Attiyeh 1997; Gartner 1986).
5. For a few of the explanations behind rising graduate degree pursuit, see Collins
2002, Labaree 1997, Pappano 2011, Walker et al. 2008, and Wulff et al. 2004.
194 Notes to Pages 2–6
6. Schmidt 2010; Schofer and Meyer 2005. For detailed trend data about U.S. doc-
torates in the twentieth century, see Thurgood, Golladay, and Hill 2006. Find-
ings from the Council of Graduate Schools’ annual International Graduate
Admissions Survey offer useful information about trends in application, admis-
sion, and enrollment across countries, regions of origin, and fields of study.
For example, Chinese nationals comprised 34 percent of international students
enrolled in American graduate programs in 2014. See J. Allum et al. 2014.
7. Torche 2011.
8. U.S. Department of Education, National Center for Education Statistics 2012.
9. Gonzales, Allum, and Sowell 2013. Note that across racial/ethnic groups,
women comprised the majority attaining doctoral degrees in 2010 if first pro-
fessional doctoral degrees (e.g., MD, JD, DDS) are included in the calculation
(U.S. Department of Education, National Center for Education Statistics 2012).
10. Bell 2010. In 2012, U.S. universities awarded just 102 new PhDs to Native
Americans (Patel 2014).
11. Leslie et al. 2015; Attiyeh and Attiyeh 1997.
12. National Science Foundation 2010.
13. Gonzales et al. 2013.
14. On rising pursuit of the PhD, see Jones 2003, Gibney 2012, and Cyranoski et al.
2011.
15. Nettles and Millett 2006, 101.
16. Schillebeeckx, Maricque, and Lewis 2013;Cassuto 2015. Recent attention in
the popular press to the academic job market in the humanities includes a forum
in the New York Times (“Room for Debate” 2013) and an article by Michael
Bérubé (2013) in the Chronicle of Higher Education.
17. Cassuto 2015; Kezar and Sam 2010.
18. James 1903.
19. To maintain a clear focus, this research excluded from analysis professional doc-
toral degree programs (e.g., MD, JD) because processes of admissions to such
programs are unique in several ways. Professional staff often review applica-
tions, and criteria emphasize experience with and potential for practice. Not-
withstanding the range of careers those with a PhD may pursue, PhD programs
continue to emphasize research training over (or in addition to) training for
professional practice. Different standardized tests are also used for professional
admissions, and scores on those tests are more heavily weighted in admissions
decisions than in most PhD programs.
20. APA-accredited clinical psychology programs—arguably among the most elite
in the discipline—offered admission to only 10.5 percent of the nearly 19,000
applicants in 2002 (Landrum and Clump 2004). Within and across the disci-
plines, admissions selectivity and overall doctoral program enrollment explain
large proportions of reputational scores used to calculate the 1995 National
Research Council rankings (Grunig 1997) and the 2008 U.S. News and World
Report rankings (Sweitzer and Volkwein 2009). The exception to this trend is
in education, where average admissions test scores for graduate programs are
not significantly associated with program reputation (Sweitzer and Volkwein
2009). Nevertheless, Vanderbilt University’s Peabody College of Education, the
Notes to Pages 6–8 195
highly ranked universities and graduate programs within them tend to receive
applications from many students who fall in the “right tail of the distribution
of talent” (Klitgaard 1985, 12).
33. A few scholars have noted how environmental characteristics shape the rela-
tionship between academic admissions criteria and student outcomes, such as
Walters, Lee, and Trapani, 2004. Organization-level characteristics, such
as those of the test center (e.g., ethnic match between test proctor and test-
taker), graduate program (e.g., number of same-gender peers in a graduate pro-
gram), or university (e.g., perceptions of climate) may also explain the relationship
between applicant criteria and later outcomes. Regression analyses that fail to
control for organizational-level factors will produce upwardly biased estimates
about the strength of the relationship between an admissions criterion and later
measures of success.
34. For examples of research on higher education that examines the use of hiring
and admission to encourage broader organizational goals, see Birnbaum 1988,
Klitgaard 1985, Killgore 2009, Nivet 2011.
35. Stevens 2007.
36. Lamont 2012.
37. The organizational perspective on merit that I propose draws upon ideas from
the sociology of evaluation and sociocultural research on undergraduate ad-
missions and the professoriate. See, for example, Karabel 2005, Kahlenberg
1996, and Karen 1990. In higher education research, specifically, sociocultural
scholars approach selection and promotion in higher education as contextual-
ized and socially constructed. See Tierney 1988, and Peterson and Spencer 1990,
13. Beginning with Burton Clark (1960) sociocultural paradigms have been
used to study process-based phenomena such as socialization and tenure (Tierney
and Bensimon 1996) and the institutionalization of interdisciplinarity (Lattuca
2001). Stevens 2007, Birnbaum 1988, Twombly 1992, and Lamont 2009 all
bring sociocultural sensibilities to bear on selection in higher education. I also
thank Janet Weiss and Andrew Kinney for their insights into this angle on merit.
38. Cassuto 2015; Guinier 2015.
39. Wechsler 1977, 244. See also Stevens 2007 and Stampnitzky 2006 for institu-
tional accounts about the production of preferences in undergraduate
admissions.
40. A narrow definition of diversity is heterogeneity based on individual character-
istics such ethnicity, race, gender, gender identity, sexual orientation, class, reli-
gion, geography, experience, and viewpoint. Beyond this narrow framing, which
Daryl Smith calls “the laundry list approach,” the pursuit of diversity through
graduate admissions may encompass a wide range of important considerations
about the nature of the knowledge produced, the unique strengths and weak-
nesses that prospective cohort members hold, the representation of historically
marginalized groups in an increasingly multiethnic society, and the place of
justice and opportunity among an organization’s aims (National Center for In-
stitutional Diversity 2011).
41. Attiyeh and Attiyeh 1997; Karabel 2005; Grodsky 2007; Stevens 2007; Lamont
2009. Inequalities in graduate education condition the equity in the labor
Notes to Pages 12–21 197
market, and indeed, women and people of color are underrepresented in many
corners of academia, especially tenured faculty positions and selective colleges
and universities. For example, women constitute just 21 percent of the popula-
tion of employed philosophers (Crasnow 2007).
42. Attiyeh and Attiyeh 1997; Klitgaard 1985; Grodsky, Warren, and Felts 2008;
Campbell 2009.
43. According to Educational Testing Service (2013a), among U.S. citizens who
took the GRE in 2012, men had higher scores than women on both the verbal
and the quantitative reasoning sections. Including international students, men
had higher scores only on the quantitative section of the test. Among the racial/
ethnic classifications that ETS uses, whites and Asians earned the highest scores
on the verbal and quantitative sections of the test, respectively. There are just
three studies that point to how faculty actually use test scores or other criteria
in graduate admissions decisions. In a 1984 ETS-sponsored study of 333 fac-
ulty members, participants claimed that their most important admissions crite-
rion is grade point average, followed by letters of recommendation, and then
GRE scores. However, as the authors admit, “We are dealing with self-reports
and not observed actions” (Oltman and Hartnett 1984, 7). A decade later,
Landrum, Jeglum, and Cashin (1994) found that GRE scores were the second
most important criterion in psychology admissions outcomes, and Attiyeh and
Attiyeh (1997) found GRE scores the strongest predictor of admission.
44. Moss-Racusin et al. 2012.
45. Milkman, Akinola, and Chugh 2014.
46. That I did not find evidence of discrimination does not mean it does not occur,
but I designed the research as an open-ended inquiry into possible explanations
for inequality rather than as a specific test for prejudicial behavior.
47. See Roithmayr 2014 for a description of the ways in which white privilege is
reproduced through everyday choices, including in college admissions.
48. Tilly 1998.
49. See Bonilla-Silva 2010, 8, on colorblind racism and how contemporary social
scientists may unwittingly reinforce racial hierarchy by describing racial in-
equalities without explaining the processes that create those inequalities.
50. DiMaggio and Powell 1983; Stevens 2007.
51. Findings from research like these cannot be used to directly prescribe policy, but
they can be used to inform a more thoughtful approach to policy formation.
52. Sociologists such as Lyn Spillman call the uncovering of mechanisms and con-
cepts through thick description “theoretical generalization.” See her excellent
2014 paper in Qualitative Sociology for an example.
21. In linguistics, the only program that does not assign numerical ratings, indi-
vidual faculty members commensurate their judgment into a yes/no vote for
each applicant.
22. Porter 1996, 6.
23. Judgment is quantified in other ways as well, but not as consistently across pro-
grams. For example, in biology the faculty developed a system for rating along
several dimensions the applicants whom they interview. Summary scores from
those evaluations are averaged and tabulated to develop a rank-ordered list that
drives the final round of decision making.
24. Only in political science and physics were faculty formally asked to provide
written comments to justify their ratings.
25. I thank Michael Bastedo for this insight.
26. Indeed, their discussion did not only reveal differences in interpretation about
what a rating of 1, 2, or 3 means. It turned out that one committee member
had used the three-point scale as three categories and others on the committee
had regarded the numbers as ordinals.
27. Griffin and Muñiz 2011.
28. Heimer 2001.
29. Ibid.; Stevens 2007.
30. Porter 1996, 5.
31. Klitgaard 1985, 13.
32. Fisher v. University of Texas, 570 U.S. 11-345 (2013).
33. Gartner 1986.
34. Wilson 1989.
35. Thucydides (trans. Crawley) 1951, 105–106.
36. Birnbaum 1988; Twombly 1992.
7. Lamont 2009. Note that evaluative scripts are distinct from interaction scripts
qua Barley: “outlines of recurrent patterns of interaction that define in observ-
able and behavioral terms, the essence of actors’ roles” (Barley 1986, 83).
8. Birnbaum 1988, 498.
9. Birnbaum 1988; Brink 1999; Klitgaard 1985; Twombly 1992.
10. Chapter 3 examines how these trends play out in specific disciplines.
11. March 1994; Karen 1990.
12. Espeland and Sauder 2007; Bourdieu 1984; Attiyeh and Attiyeh 1997;
Hersch 2014.
13. When I reviewed my findings with the chair of economics (i.e., what qualita-
tive research methodologists call member-checking), he mentioned that he now
pulls applications from black and Latino students to ensure a diverse pool in
later rounds of review. He reported that they have relaxed the GRE score
threshold since the test’s 2011 revision, which he believes “nicely distinguishes
among highly qualified people.”
14. Klitgaard 1985, 32.
15. Their devaluing of unknown institutions is consistent with previous research
on status judgments of organizations, such as that by Bitekine (2011).
16. Zimmerman and Zeitz 2002, 416.
17. Bowen, Rudenstine, and Sosa’s (1992, 11) study of doctoral education in ten
institutions found that graduate programs with small cohorts had higher com-
pletion rates and shorter time to degree that those with larger entering cohorts.
18. March 1994, 38. Just two programs among the ten in this study had been col-
lecting data on applicant characteristics in relation to students’ academic and
professional outcomes. Neither used the data to inform current admissions
practice.
19. ETS does not claim that the GRE measures intelligence. For guidance on inter-
preting scores on tests taken after August 2011, see ETS 2014a.
20. Bourdieu 1988; Lamont 2009.
21. Mitchell Stevens (2007) called this phase “coarse sorting” in his study of un-
dergraduate admissions.
22. Although my study was not designed to assess alternative approaches to using
the GRE, there are a number of possibilities, including interpreting scores in
light of known disparities, waiting to consider GRE scores until the rest of the
application has been reviewed, or cutting the GRE from their considerations
entirely.
23. Walker et al. 2008, 11.
24. For a thoughtful discussion of drawbacks to a “laundry list” approach to di-
versity in higher education, see Smith 2009.
25. For a few of the many studies on the benefits of educational diversity for un-
dergraduates, see, for example, Bowen and Bok 1998; Chang, Astin, and Kim
2004; Gurin et al. 2002; and Jayakumar 2008. Some studies have found that
educational experiences with diversity can strengthen professional preparation
and research innovation; these include Page 2008 and Harvey and Allard 2012.
26. For studies that examine how colleges and universities strive to present them-
selves as diverse, see Osei-Kofi, Torres, and Lui 2013; regarding admissions
Notes to Pages 60–72 201
viewbooks, see Stevens and Roksa 2011; regarding mission statements, see
Morphew and Hartley 2006. Stevens and Roksa argue for a “metrical” under-
standing of diversity as an indicator of organizational excellence in higher ed-
ucation today.
27. Two respondents in philosophy noted that women have better representation
in ethics and the history of philosophy than they do in other subdisciplines.
28. In an interesting example of how one’s own identity may frame conceptualiza-
tions of diversity, I found that the majority of people who counted national
origin among salient dimensions of diversity had, themselves, been born out-
side of the United States. Similarly, individuals in two programs who had grown
up in Appalachian states defended the importance of regional diversity.
29. Garces 2012.
30. Smith et al. 1996.
31. Beutel and Nelson 2005; Kulis, Chong, and Shaw 1999; Olivas 1994; Smith
et al. 1996; Trower and Chait 2002.
32. Smith 2009, 149.
33. Haro 1995, 196; Danowitz Sagaria 2002, 689.
34. Garces 2014; Marichal 2009; Smith, 2009.
35. Brief for Columbia University, Harvard University, Stanford University, and the
University of Pennsylvania as Amici Curiae at 3, Regents of the University of
California v. Bakke, 438 U.S. 265 (1978) (No. 76–811).
36. Smith 2009; Garces 2014.
37. It was unclear from these comments whether the faculty assumed that the
courses the students had taken signaled their “intellectual capacity,” whether
some committee members were concerned about preparation and others about
capacity, or whether Peter was just uncomfortable describing their rationale for
eliminating these two individuals and so spoke in apparent contradictions.
38. Kahneman 2011.
39. Bastedo and Jaquette 2011; Bielby et al. 2014; Posselt et al. 2012; Rojstaczer
and Healy 2012.
40. For data on group differences in GRE scores and ETS recommendations for
the appropriate use of GRE scores in the review process, see ETS 2013a
and 2014a; Fischer, Schult, and Hell 2013; and Miller 2013.
41. See, for example, Fischer, Schult, and Bell 2013; Young and Kobrin 2001. In the
most recent study of differential predictive validity on college admissions exams
by gender, meta-analysis by Fischer, Schult, and Bell (2013) found that the
problem of performance underprediction is worse for undergraduate admissions
tests than for the GRE. Like all meta-analyses, however, the findings are only
as generalizable as the data from which the studies’ findings are drawn. Often in
the research on graduate admissions, studies disproportionately examine stu-
dent scores in psychology, which may not generalize to other disciplines.
42. ETS, 2014a.
43. Berrey 2015, 3.
44. Dowd and Bensimon 2014, 58.
45. Stevens (2007) noted that diversity has become an informal “index of prestige”
(182) among selective liberal arts colleges.
202 Notes to Pages 72–82
46. Park (2013) highlighted the power of intentionality for meaningful diversity in
her analysis of the racial reconciliation efforts of a religious student organiza-
tion at a California university affected by Proposition 209, the state’s ban on
affirmative action.
3. Disciplinary Logics
1. Walker et al. 2008, xi.
2. The findings of the Carnegie Initiative on the Doctorate, described in full in
Walker et al., The Formation of Scholars (2008), borrowed imagery and ideas
from the training of clergy to promote an ideal of doctoral education that in-
cludes developing “stewards” of the discipline. See also Abbott 2001, Austin 2002,
Thelin 2004, and Wulff et al. 2004 on doctoral education as credentialing and
socialization for the professoriate.
3. Becher 1981; Clark 1987; Hermanowicz 2005.
4. Johnson (2008) discussed increasing divergence in the approaches to scholar-
ship used by linguists.
5. It would have been convenient to defer to the disciplinary classification schemes
developed through Hagstrom’s (1964) or Biglan’s (1973) analyses of disciplinary
consensus or that of Lodahl and Gordon (1972) based on paradigm develop-
ment. However, their classifications are forty or more years old, and disciplinary
changes during this time period make adoption of previous scholars’ assessments
of paradigm strength a spurious task (Pfeffer 1993). Therefore, I adopted a his-
torical approach to categorizing each discipline as high-, moderate-, or low- con-
sensus relative to others within their respective subject area of humanities, social
sciences, or natural sciences. To do so, I used (a) surveys of the history of the
disciplines from secondary sources, (b) interviews with emeritus members of
each department, and (c) member-checking with admissions committee chairs.
Given what we know about the dynamics of change in disciplines, these clas-
sifications should be interpreted, not as static, enduring, or absolute, but rather
as reflections of assessment in the context of the fields’ historical trajectories.
6. Ioannides and Nielsen 2007, 1; Wolfers 2015.
7. For brief overviews of economics as a discipline, see Becker 1978, Skousen
2009, and Harvey and Garnett 2006.
8. March 1994.
9. Under the GRE’s previous scoring rubric, the mean quantitative reasoning score
of students enrolled in the top six economics programs in 2002 was 785,
and 765 in the programs ranked 15–30 (Stock, Finnegan, and Siegfried 2006).
10. Russell 1972; Durant 2012.
11. Biglan 1973.
12. Durant 2012.
13. In classics, the department chair said that ratings were a “guide to the feelings
that people have about candidates,” but this was not established as the norm
for the entire committee.
14. Knorr-Cetina 1999; Lamont 2009.
15. See, for example, Clark 1987 and Hermanowicz 2005.
Notes to Pages 84–96 203
4. Mirror, Mirror
1. McPherson, Smith-Lovin, and Cook 2001, 416.
2. Kanter 1977; Karabel 2005; Rivera 2012b.
3. DiMaggio 1992.
4. This tendency would be defensible if faculty were selecting students to be ap-
prentices of their own, since it would be hard for a professor to advise a stu-
dent in areas of research far afield from one’s own. However, in the committees
I observed, the committee members’ task was to select a cohort of students for
the department as a whole.
5. I began to notice it in the course of analyzing how disciplinary context shapes
personal preferences, and how personal preferences affect admissions outcomes.
I noted that preferences for self-similarity seemed especially prevalent in low-
consensus disciplines, the very fields in which personal tastes often played an
especially important role in evaluation, generally. Realizing that individual level
preferences for particular types of students could not, in many cases, be divorced
from reviewer backgrounds, the four types of homophily that I observed most
frequently were by and for pedigreed, cool, socially mobile, and international
scholars. This chapter focuses on the first three.
204 Notes to Pages 96–117
6. This finding could be due to the absence of individuals from these backgrounds
in high-consensus disciplines (i.e., a selection effect) or the absence of a common
disciplinary logic, making personal tastes more salient (i.e., a disciplinary
effect).
7. Rivera 2011b.
8. What I observed is a perfect example of Pierre Bourdieu’s description of elite
reproduction through education. He noted that selection processes in elite
French educational institutions treat elite social connections and cultural knowl-
edge as forms of capital on par with financial resources. Social and cultural
capital operate as arbitrary, and ultimately exclusionary, bases for selection that
reproduce existing structures of privilege.
9. Given the small range in grades typically assigned for graduate courses, small
increments carry greater meaning—both to the faculty to assign the grades and
to the students who receive them.
10. Bourdieu 1984; Khan 2011; Lamont and Lareau 1988.
11. Patton 2013.
12. Professors may not be cool by society’s standards, but signature frames may be
a way some scholars try to express style while owning their intellectual status.
13. Lamont, 2009.
14. In this case, I do not mention disciplines to protect anonymity.
15. “Death match” can be thought of as the opposite of an undergraduate admis-
sions model of “building” (Bastedo 2012), in which reviewers assess and col-
lect applicants’ strengths as grounds for moving an individual forward in the
process.
16. Kanter 1977, 965.
17. McPherson et al. 2001.
18. Rivera 2012b.
19. Rivera 2011b.
20. Correll, Benard, and Paik 2007; Benard and Correll 2010. Benard and Correll
argue that the judgments of likeability have to do as much with the importance
of likeability on the job as the perception that professionally successful women
have betrayed their proper gender role. The perceptions of mothers that Cor-
rell and colleagues have found can skew how opportunities and rewards are
allocated. They also risk pigeonholing women—or other groups about whom
there are strong moral overtones to their social roles—into persistently second-
class status by nudging them to self-select out of careers and fields where their
success may be negatively judged.
21. Sellers et al. 1998.
22. Martin 1992, 9–10. Such complexity might help explain trends that statistical
research has represented as either weak or broad preferences (i.e., what soci-
ologists have dubbed cultural omnivorism).
8. ETS 2014a.
9. Zwick 2002. The ACT’s core areas are English, Science, Math, and Reading,
for example, and the MCAT focuses on knowledge of Chemistry, Physics, and
Biology.
10. Ibid., 32–33.
11. Neumann 2009, 54–55.
12. Ibid., 54–55.
13. Comments from Bruce Cole, former chair of the National Endowment for the
Humanities, suggest that writing quality and cognitive clarity are inseparable
in the humanities. He said, “Writing is thinking. To write well is to think clearly”
(National Endowment for the Humanities 2002).
14. Gumport 1993, 226.
15. Walker et al. 2008.
16. My thanks to Elizabeth Knoll for this insight.
17. Leslie, Cimpian, Meyer, and Freeland 2015.
206 Notes to Pages 130–133
18. Mindful of higher education’s democratic mission, Guinier (2003) urges ad-
missions policymakers and decision makers to ask themselves whether test scores,
intelligence, or first-year grades are robust conceptions of excellence for a
democratic society.
19. For details of the revised general test, see ETS 2014b.
20. Goffman, 1959.
21. Wendler and Bridgeman 2014. ETS has released a compendium of research
about the GRE that will be worthwhile for readers interested in learning
more about the details of the test’s validity. Most of the research was con-
ducted before implementation of the revised GRE General Test.
22. Steele and Aronson 1995. For an excellent narrative about the results of ste-
reotype threat research and the development of this line of scholarship, also
see Claude Steele’s accessible 2010 volume, Whistling Vivaldi: How Stereo-
types Affect Us and What We Can Do about It.
23. See Logel et al. 2012 pp. 46–49 for additional recommendations about making
college learning environments stereotype-safe. The 2008 field experiment by
Catherine Good, Joshua Aronson, and Jayne Ann Harder revealed that stereo-
type threat can shape outcomes in a common STEM gatekeeping course, but that
highlighting a test’s fairness could eliminate performance gaps. They manipu-
lated the instructions that students in a college calculus class received on a test
with items similar to those on the GRE. To half of the class, the researchers
described the test as diagnostic of mathematical ability; instructions to the
other half stated, “This mathematics test has not shown any gender differences
in performance or mathematics ability.” The researchers found no significant
gender differences in either group’s final course grades and or in the test scores
of students in the stereotype-inducing condition. However, women’s perfor-
mance in the stereotype-safe condition exceeded that of men’s, implying that
stereotype-neutralizing test instructions make a difference (Good, Aronson,
and Harder 2008).
24. Gregory Walton and Geoffery Cohen’s 2002 meta-analysis estimated that ste-
reotype lift gives white males a bump of about 50 points on the SAT (Walton
and Cohen 2003, 456).
25. Like the call to preserve democratic deliberation, this recommendation may
seem to some a stumbling block on the already rocky path to decision making.
But, hopefully, it will compel those with gatekeeping roles to growing in the
definition of intelligence that literary critic Barbara Christian (1987) articu-
lated: “a tuned sensitivity to that which is alive and therefore cannot be known
until it is known.”
share of adults on the top end of the wealth distribution with graduate degrees,
see Thompson 2013.
3. Applications from Chinese students dipped 3 percent in 2012 and 1 percent in
2013, after increasing by 21 percent in 2010 and 19 percent in 2011 (Allum
et al. 2014, 7).
4. For the proportion of the adult population, by gender, with graduate degrees,
see Torche 2011. See Gonzales, Allum, and Sowell 2013 for statistics on inter-
national students in U.S. graduate education. Tracing the pathways from
students’ countries of origin to U.S. doctoral programs, as well as growth of
foreign enrollments in U.S. doctoral programs and trends by educational devel-
opment in the country of origin, Blanchard, Bound, and Turner (2009) found that
students from countries with well-developed higher education systems typically
come to the United States for doctoral degrees only when highly ranked programs
admit them, in contrast to countries with fewer doctoral programs, which send
students to lower-ranked U.S. doctoral programs as well. Their findings sup-
port a broader pattern of international students’ strong preference for highly
ranked universities. Fischer 2013 cites a study by IDP Education, a firm that
facilitates study abroad opportunities, that found that no fewer than 85 percent
of international students reported prestige to be an important consideration in
their college choice process, and one-third said it was their top priority.
5. On trade-offs among enrollment management goals, see Cheslock and Kroc
2012. For the use of admissions and student body composition to signal pri-
orities to stakeholders, see, for example Karen 1990 and Karabel 2005.
6. For rates of growth in first-time graduate school enrollment, see Gonzales,
Allum, and Sowell 2013. For national economic benefits of international
student enrollment, see National Foundation for American Policy (NFAP) 2013,
Roach 2013, and Institute of International Education 2013.
7. See David 2012, Jaquette and Curs 2015, Rizzo and Ehrenberg 2004, for the
role of nonresident student tuition in offsetting state appropriations. See Redden
2013 for the role of international students in sustaining STEM faculty research.
See NFAP 2013 for the role of international students in filling gaps.
8. Olivas 2009.
9. Allum et al. 2014; Allum, Bell, and Sowell 2012.
10. Interestingly, they worried less about their ability to judge across American ap-
plicants’ diverse institutional, geographic, and personal contexts.
11. In 1961, economist Daniel Ellsberg classically defined ambiguity as a type of
uncertainty present “in situations where available information is scant or obvi-
ously unreliable or highly conflicting; or where expressed expectations of dif-
ferent individuals vary widely; or where expressed confidence in estimates
tends to be low” (Ellsberg 1961, 660–661).
12. See Epley and Krueger 2005 for an example of research into how ambiguities
create conditions for stereotyping.
13. Gonzales, Remington, and Allum 2013.
14. For the quotation about the Civil Service Exam, see Suen and Yu 2006, 48. For
more about China’s test preparation apparatus, see Golden 2011, Magnier
2006, Özturgut 2011, Xueqin 2011, and Zhao 2001.
208 Notes to Pages 140–153
Conclusion
1. See Clauset, Arbesman, and Larremore 2015; Fowler, Grofman, and Masuoka
2007.
2. See Rivera 2011b and 2012a on professional investment firms’ consideration
of elite college status for entry-level hiring. It’s important to note that sorting
out which colleges deserve “elite” status has become a national preoccupation,
and simply gaining admission to the ones so deemed is now a veritable status
symbol for both the young adults who attend them and their families. A growing
share of families organize their children’s time and very lives to put them on a
trajectory toward one of these selective institutions. They do so because, to
many, admission to elite colleges not only symbolizes status achieved. It also
represents a gateway to status and a hope for inoculation from the financial
stresses that plague so many Americans today. Graduate school is among the
subsequent opportunities that may follow from attending an elite college, and
attending graduate school is on the minds of young people from as early as
tenth grade. A recent study I conducted with Matthew Holsapple found that U.S.
tenth-graders who aspired to a graduate degree or who thought a college’s grad-
uate school placement rate was “very important” had higher odds of enrolling
at one of U.S. News and World Report’s top 100 colleges and universities (Hol-
sapple and Posselt 2010).
3. For racial inequalities in selective college enrollment from 1972 to 2004, see
Posselt et al. 2012, p. 1091. For percentage of women, men, underrepresented
minority, and other ethnic groups earning scores of 700 or above, see Miller
and Stassun 2014.
4. For an excellent analysis of trade-offs and opportunity costs in admissions, see
Espenshade and Chung 2005. An important and related point is this: When a
program fixes the number of students they will admit, they create a zero-sum
game. Trade-offs for access and opportunity are inherent to these kinds of com-
petitions, so the question is not whether there will be trade-offs, but what they
will be, how they will be determined, and what their implications are. As we
saw in affirmative action lawsuits by Abigail Fisher and Jennifer Gratz, con-
troversy can erupt when a student denied admission assumes that she would
have been admitted next if some preference or another had not been in play.
Like other external sources of student financial support, institutional diversity
fellowships for graduate students may therefore be most powerful as an incen-
tive for increasing diversity when they increase program capacity, because it
changes the very nature of the admissions competition.
5. Boltanski and Thévenot 2000.
6. Bourdieu 1984; Bourdieu 1988.
7. For details of the methodology behind the National Research Council’s as-
sessment of research doctoral programs, see http://www.nap.edu/catalog
.php?record_id=12676#toc. For details of the U.S. News Best Graduate
School Rankings, see http://www.usnews.com/education/best-graduate-schools
/articles/2014/03/10/how-us-news-calculated-the-2015-best-graduate-schools
-rankings.
210 Notes to Pages 158–166
27. Neglecting context is what Kahneman (2011) calls narrow framing, and it
causes reviewers to misread the justifiable reasons some applicants might be
weaker or stronger than expected on a desired criterion.
28. An extreme version of structured review is “policy capturing,” which a small
group of scholars recommended in the 1970s (Dawes 1971). Using the charac-
teristics of recent cohorts to reveal a department’s preferences, policy capturing
would replace human judgment in admissions with regression models that mea-
sure an applicant’s admissibility.
29. Lundy-Wagner, Vultaggio, and Gasman 2013.
30. See Fisk-Vanderbilt (2014) for a full description of the Fisk-Vanderbilt Masters-
to-PhD Bridge Program. A similar bridge program links Spelman and Georgia
Tech. Others using the bridge label offer the master’s degree at a research uni-
versity as a bridge to doctoral program admission, but do not recruit solely
from an MSI.
31. Eagan et al. 2013.
32. Nagda et al. 1998; Posselt and Black 2012. Through the National Science Foun-
dation’s Research Experiences for Undergraduates program and the Department
of Education’s Ronald E. McNair Postbaccalaureate Achievement Program,
the federal government has financially invested in student research as a means
of diversifying graduate education and the professoriate. There are institution-
specific programs, such as the successful Meyerhoff Scholars Program at the
University of Maryland–Baltimore County, as well as multi-university efforts
such as the Summer Research Opportunities Program, administered through a
cooperative effort of Big Ten universities and the University of Chicago. The
mission of programs like these is to develop professional interest in and com-
mitment to research among underrepresented populations, but their partici-
pants may also be attractive recruits for graduate programs.
33. Association of American Colleges and Universities 2014.
34. Hersch 2014. See Rogers and Molina 2006 for research into the qualities of
psychology doctoral programs that have been especially successful in recruiting
and retaining students of color.
35. Rather than assume risk associated with metrics like college grades, TOEFL,
or GRE scores, some leaders may want to start by measuring the probability
of specific outcomes for students in their program relative to specific student
characteristics. To do this well, though, there are a few measurement issues to
take into account. For programs that have historically enrolled few people from
a specific group (e.g., women, international students with lower TOEFL scores,
students from less selective colleges), the validity of analyses may be hampered by
small sample sizes. Also, measures concentrated in a small range, like enrolled
students’ college GPA, may produce downwardly biased estimates of correla-
tions with the outcome (researchers call this attenuation bias). Finally, because
student success is the product of a complex interplay of student inputs and the
learning environments faculty create, such analyses would need to account not
only for characteristics of students, but also for characteristics of the environ-
ment that shape student performance (e.g., perceptions of climate and/or ste-
reotypes, proportion of same-identity individuals in one’s cohort). Hierarchical
212 Notes to Pages 172–174
linear modeling is well suited to analyses of this sort. See Walters, Lee, and
Trapani 2004 for a fine example.
36. Among the noncognitive characteristics that scholars have proposed for grad-
uate admissions, Sedlacek (2004) has developed measures for the following: Pos-
itive self-concept, Realistic self-appraisal, Successfully handling the system,
Preference for long-term goals, Availability of a strong support person, Leader-
ship experience, Community involvement, Knowledge acquired in a field. The
ETS Personal Potential Index provides opportunity for those writing letters of
recommendation to assess the following qualities of applicants: Knowledge,
Creativity, Communication skills, Teamwork, Resilience, Planning and organi-
zation, Ethics and integrity (Kyllonen 2008).
37. Powell 2013; Miller and Stassun 2014.
38. ETS 2014a.
39. For analyses of white and African American students’ scores in relation to back-
ground characteristics, ethnic match with test proctors, and characteristics of
the GRE test center, see Walters, Lee, and Trapani 2004. An interesting finding
of this study, one that the authors argue contradicts a trend toward stereotype
threat, is that a match between student ethnicity and proctor ethnicity is sig-
nificantly associated with test scores for white students, but not for African
American or Hispanic students.
40. ETS (2013b) promoted the most recent GRE overhaul as a “friendlier, more flex-
ible test-taking experience.” Among other changes, they have reduced the amount
of rote vocabulary knowledge required for high scores on the Verbal section.
41. For the list of colleges and universities that have test-optional policies, see Na-
tional Center for Fair and Open Testing 2014. For a list of PhD programs that
do not require the GRE see http://ainsleydiduca.com/phd-programs-no-gre
-required/.
42. For findings about the effects of going test-optional at the undergraduate level,
see Hiss and Neupane 2004; Belasco, Rosinger, and Hearn 2015.
43. About test-optional undergraduate admissions, Belasco et al. (2015) wrote, “Ar-
guably, institutions that fail to reach a majority of underrepresented students
through recruitment or other outreach initiatives, will find it difficult to im-
prove diversity in meaningful and significant ways, regardless of their admis-
sions criteria” (219).
44. Weick 1984, 40. There are physiological explanations for freezing up in the face
of significant challenges, such as overarousal in the limbic system, with observ-
able physiological effects such as an inability to concentrate.
45. For doctoral programs that choose to require GRE scores, for example, another
small win would be more nuanced classification of “high” and “low” scores. If,
when reviewers sit down with files, they are provided with some discipline- or
institution-specific data about the current distributions of GRE scores by na-
tional origin, race/ethnicity, and gender, they might interpret scores differently.
One of the three graduate schools with which I worked already shares similar
information in their admissions workshop for faculty, providing institutional
data about the wide racial disparities in the number of students who score
above 700 on each section of the test.
Notes to Pages 174–191 213
Methodological Appendix
1. Stevens 2007.
2. Goffman 1959; Garfinkel 1967; Lamont 2009.
3. Vaughan 1992; Eisenhardt 1989.
4. Merriam 2009, 39.
5. Stake 2005, 448.
6. Geertz 1973.
7. Charmaz, Denzin, and Lincoln 2000; Stake 2005; Yin 1994; Cronbach 1975;
Geertz 1973.
8. Abbott 1992; Miles and Huberman 1994; Merriam 2009; Smith 1978.
9. Dion 1998.
10. Merriam 2009.
11. Patton 2002.
12. National Research Council 2010; “Best Graduate School Rankings” 2010.
13. Merriam 2009; Yin 1994.
14. Merriam 2009.
15. Gold 1958.
16. Weiss 1995; Rubin and Rubin 2009.
17. Rubin and Rubin 2009, 152–153.
18. Tierney and Bensimon 1996; Barley 1990, 1996; Lamont 1992, 2009.
19. Lamont 2009; Barley 1996.
20. Green, Franquiz, and Dixon 1997; Scheurich 1995.
21. Lincoln and Guba 2000.
22. Gieryn 2000; Clark 1987.
23. Gould 1990, 283.
24. Becker 2008, 54, emphasis in original.
25. Patton and Appelbaum 2003, 67.
26. Glaser and Strauss 1967, 22, 25, 101–116.
27. Strauss and Corbin 1998.
28. Rubin and Rubin 2009, 201.
29. Curtin and Fossey 2007, 92.
30. Popper 1959.
31. Lareau 2010.
32. Jorgensen 1989.
33. LeCompte and Schensul 1999.
34. Michéle Lamont, personal communication, 2010.
References
Abbott, A. 1992. What do cases do? Some notes on activity in sociological anal-
ysis. In C. C. Ragin and H. S. Becker, eds., What is a case? Exploring the foun-
dations of social inquiry. New York: Cambridge University Press.
———. 2001. Chaos of disciplines. Chicago: University of Chicago Press.
Ahmed, S. 2012. On being included: Racism and diversity in institutional life.
Durham, NC: Duke University Press.
Allum, J., et al. 2014. Findings from the 2014 CGS International Graduate Admis-
sions Survey: Phase II: Final applications and initial offers of admission. Wash-
ington, DC: Council of Graduate Schools.
Allum, J. R., N. E. Bell, and R. S. Sowell. 2012. Graduate enrollment and degrees:
2001–2011. Washington, DC: Council of Graduate Schools. http://www.cgsnet
.org/graduate-enrollment-and-degrees-2001-2011.
Association of American Colleges and Universities. 2014. Making excellence inclu-
sive. http://www.aacu.org/compass/inclusive_excellence.cfm.
Attiyeh, G., and R. Attiyeh. 1997. Testing for bias in graduate school admissions.
Journal of Human Resources 32 (3): 524–548.
Aud, S., M. A. Fox, and A. Kewal-Ramani. 2010. Status and trends in the educa-
tion of racial and ethnic groups (NCES 2010-015). U.S. Department of Edu-
cation, National Center for Education Statistics. http://nces.ed.gov/pubs2010
/2010015.pdf.
Austin, A. E. 2002. Preparing the next generation of faculty: Graduate school as
socialization to the academic career. Journal of Higher Education 73 (1):
94–122.
Austin, A. E., and M. McDaniels. 2006. Preparing the professoriate of the future:
Graduate student socialization for faculty roles. In J. C. Smart, ed., Higher
216 References
David, J. 2012. Michigan colleges welcome Chinese students. Detroit Free Press,
March 6.
Dawes, R. M. 1971. A case study of graduate admissions: Application of three prin-
ciples of human decision making. American Psychologist 26 (2): 180–188.
———. 1975. Graduate admission variables and future success. Science 187 (4178):
721–723.
Deo, M. 2011. The promise of Grutter: Diverse interactions at the University of
Michigan Law School. Michigan Journal of Race & Law 17 (1): 63.
DiMaggio, P. 1987. Classification in art. American Sociological Review 52 (4):
440–455.
———. 1992. Nadel’s paradox revisited: Relational and cultural aspects of social
structure. In N. Nohria and R. Eccles, eds., Networks and organizations: Struc-
ture, form and action, 118–142. Boston: Harvard Business School Press.
———. 1997. Culture and cognition. Annual Review of Sociology 23 (1): 263–287.
DiMaggio, P. J., and W. W. Powell. 1983. The iron cage revisited: Institutional iso-
morphism and collective rationality in organizational fields. American Socio-
logical Review 48 (2): 147–160.
———, eds. 1991. New institutionalism in organizational analysis. Chicago: Uni-
versity of Chicago Press.
Dion, D. 1998. Evidence and inference in the comparative case study. Comparative
Politics 30 (2): 127–145.
Dowd, A. C. and E. M. Bensimon. 2014. Engaging the “race question”: Account-
ability and equity in US higher education. New York: Teachers College Press.
Duguid, M. M., D. L. Loyd, and P. S. Tolbert. 2012. The impact of categorical
status, numeric representation, and work group prestige on preference for de-
mographically similar others: A value threat approach. Organization Science
23 (2): 386–401.
Durant, W. 2012. The story of philosophy. New York: Pocket Books.
Eagan, M. K., S. Hurtado, M. J. Chang, G. A. Garcia, F. A. Herrera, and J. C.
Garibay. 2013. Making a difference in science education: The impact of
undergraduate research programs. American Educational Research Journal 50
(4): 683–713.
Educational Testing Service (ETS). 2013a. A snapshot of the individuals who took
the GRE Revised General Test. http://www.ets.org/s/gre/pdf/snapshot_test
_taker_data.pdf.
———. 2013b. Test content and structure. https://www.ets.org/gre/revised_general
/about/content/.
———. 2014a. GRE: Guide to the use of scores. http://www.ets.org/s/gre/pdf/gre
_guide.pdf.
———. 2014b. Test content and structure. https://www.ets.org/gre/revised_general
/about/content/.
Eide, E., D. Brewer, and R. Ehrenberg. 1998. Does it pay to attend an elite private
college? Evidence on the effects of undergraduate college quality on graduate
school attendance. Economics of Education Review 17 (4): 371–376.
Eisenhardt, K. M. 1989. Building theories from case study research. Academy of
Management Review 14 (4): 532–550.
References 221
Ellsberg, D. 1961. Risk, ambiguity, and the Savage axioms. Quarterly Journal of
Economics 75 (4): 643–669.
Epley, N., and J. Kruger. 2005. When what you type isn’t what they read: The per-
severance of stereotypes and expectancies over e-mail. Journal of Experimental
Social Psychology 41 (4): 414–422.
Espeland, W. N., and M. Sauder. 2007. Rankings and reactivity: How public mea-
sures recreate social worlds. American Journal of Sociology 113 (1): 1–40.
Espeland, W. N., and M. L. Stevens. 1998. Commensuration as a social process.
Annual Review of Sociology 24 (1): 313–343.
———. 2009. A sociology of quantification. European Journal of Sociology 49 (3):
401–436.
Espenshade, T. J., and C. Y. Chung. 2005. The opportunity cost of admission pref-
erences at elite universities. Social Science Quarterly 86 (2): 293–305.
Feldman, M. S., and B. T. Pentland. 2003. Reconceptualizing organizational rou-
tines as a source of flexibility and change. Administrative Science Quarterly
48 (1): 94–118.
Fischer, F. T., J. Schult, and B. Hell. 2013. Sex-specific differential prediction of col-
lege admission tests: A meta-analysis. Journal of Educational Psychology 105
(2): 478.
Fischer, K. 2013. American universities yawn at global rankings. Chronicle of
Higher Education. http://chronicle.com/article/American-Universities-Yawn-at
/141947.
Fish, I. S. 2013. Why do so many Chinese people share the same names? Foreign
Policy, April 26. http://blog.foreignpolicy.com/posts/2013/04/26/why_do_so
_many_chinese_people_share_the_same_name.
Fisher v. University of Texas at Austin. 2013. 570 U.S. 11–345.
Fishkin, J. 2009. When the people speak: Deliberative democracy and public con-
sultation. Oxford: Oxford University Press.
Fisk-Vanderbilt. 2014. Fisk-Vanderbilt Masters-to-PhD Bridge Program. http://www
.vanderbilt.edu/gradschool/bridge/descript.htm.
Fowler, J. H., B. Grofman, and N. Masuoka. 2007. Social networks in political sci-
ence: Hiring and placement of PhDs, 1960–2002. PS: Political Science & Poli-
tics 40 (4): 729–739.
Fox, C. R., and A. Tversky. 1995. Ambiguity aversion and comparative ignorance.
Quarterly Journal of Economics 110 (3): 585–603.
Frank, R. H., and P. J. Cook. 1995. The winner-take-all society. New York: Free
Press.
Freeman, R. B., and W. Huang. 2014. Collaborating with people like me: Ethnic
co-authorship within the US. National Bureau of Economic Research. NBER
Working Paper No. 19905. http://www.nber.org/papers/w19905.
Friedland, R., and R. R. Alford. 1991. Bringing society back in: Symbols, practices,
and institutional contradictions. In P. J. DiMaggio and W. W. Powell, eds., The
new institutionalism in organizational analysis, 232–263. Chicago: University
of Chicago Press.
Fu, Y. 2012. The effectiveness of traditional admissions criteria in predicting col-
lege and graduate success for American and international students. Unpublished
222 References
Kezar, A., and C. Sam. 2010. Special Issue: Understanding the New Majority of
Non-Tenure-Track Faculty in Higher Education—Demographics, Experiences,
and Plans of Action. ASHE Higher Education Report 36(4): 1–133.
Khan, S. R. 2011. Privilege: The making of an adolescent elite at St. Paul’s school.
Princeton, NJ: Princeton University Press.
Killgore, L. 2009. Merit and competition in selective college admissions. Review of
Higher Education 32 (4): 469–488.
Klitgaard, R. 1985. Choosing elites: Selecting the” best and brightest” at top uni-
versities and elsewhere. New York: Basic Books.
Knorr-Cetina, K. 1999. Epistemic cultures: How the sciences make knowledge.
Cambridge, MA: Harvard University Press.
Konrad, A. M., and J. Pfeffer. 1991. Understanding the hiring of women and mi-
norities in educational institutions. Sociology of Education 64 (3): 141–157.
Kuhn, T. S. 1970. The structure of scientific revolutions, 2nd ed. Chicago: Univer-
sity of Chicago Press.
Kulis, S., Y. Chong, and H. Shaw. 1999. Discriminatory organizational contexts and
black scientists on postsecondary faculties. Research in Higher Education 40
(2): 115–148.
Kuncel, N. R., and S. A. Hezlett. 2007. Standardized tests predict graduate students’
performance. Science 315:1080–1081.
Kuncel, N. R., S. A. Hezlett, and D. S. Ones. 2001. A comprehensive meta-analysis
of the predictive validity of the Graduate Record Examinations: Implications
for graduate student selection and performance. Psychological Bulletin 127 (1):
162–181.
Kyllonen, P. C. 2008. The research behind the ETS® Personal Potential Index (PPI).
Princeton, NJ: Educational Testing Service. http://www.ets.org/Media/Products
/PPI/10411_PPI_bkgrd_report_RD4.pdf.
Labaree, D. F. 1997. How to succeed in school without really learning: The creden-
tials race in American education. New Haven, CT: Yale University Press.
Lamont, M. 1992. Money, morals, and manners: The culture of the French and
American upper-middle class. Chicago: University of Chicago Press.
———. 2009. How professors think: Inside the curious world of academic judg-
ment. Cambridge, MA: Harvard University Press.
———. 2012. Toward a comparative sociology of valuation and evaluation. An-
nual Review of Sociology 38 (1): 201.
Lamont, M., and A. Lareau. 1988. Cultural capital: Allusions, gaps and glissandos
in recent theoretical developments. Sociological Theory 6 (2): 153–168.
Lamont, M., and V. Molnar. 2002. The study of boundaries in the social sciences.
Annual Review of Sociology 28 (1): 167–195.
Landrum, R. E., and M. A. Clump. 2004. Departmental search committees and the
evaluation of faculty applicants. Teaching of Psychology 31 (1): 12–17.
Landrum, R. E., E. B. Jeglum, and J. R. Cashin. 1994. The decision-making pro-
cesses of graduate admissions committees in psychology. Journal of Social Be-
havior and Personality 9:239–239.
Lannholm, G. V. 1968. Cooperative studies of predicting graduate school success.
Graduate Record Examinations Special Report Number 68–3.
References 227
Magnier, M. 2006. The world: The academic equation in China is making college
a long shot. Los Angeles Times, June 18.
Maloney, P. 2014. Gaming or cheating? How teachers and administrators in low-
income schools adapt to high stakes standardized tests. Paper presented at the
2014 Sociology of Education Association Conference, Pacific Grove, CA,
February.
March, J. G. 1994. A primer on decision making: How decisions happen. New York:
Free Press.
March, J. G., H. A. Simon, and H. Guetzkow. 1958. Organizations. Cambridge,
MA: Blackwell.
Marichal, J. 2009. Frame evolution: A new approach to understanding changes in
diversity reforms at public universities in the United States. Social Science
Journal 46 (1): 171–191.
Marston, A. R. 1971. It is time to reconsider the Graduate Record Examination.
American Psychologist 26 (7): 653–655.
Martin, J. 1992. Cultures in organizations: Three perspectives. Oxford: Oxford Uni-
versity Press.
Mason, M. A., M. Goulden, and K. Frasch. 2009. Why graduate students reject the
fast track. Academe 95 (1): 11–16.
Maton, K. I., J. L. Kohout, M. Wicherski, G. E. Leary, and A. Vinokurov. 2006.
Minority students of color and the psychology graduate pipeline: Disquieting
and encouraging trends, 1989–2003. American Psychologist 61 (2): 117.
Mayhew, M. J., H. E. Grunwald, and E. L. Dey. 2005. Curriculum matters: Cre-
ating a positive climate for diversity from the student perspective. Research in
Higher Education 46 (4): 389–412.
McAdam, D., S. G. Tarrow, and C. Tilly. 2001. Dynamics of contention. Cambridge:
Cambridge University Press.
McDonough, P. M. 1997. Choosing colleges: How social class and schools struc-
ture opportunity. Albany: SUNY Press.
McPherson, M., L. Smith-Lovin, and J. M. Cook. 2001. Birds of a feather: Ho-
mophily in social networks. Annual Review of Sociology 27:415–444.
Melamed, D., and S. V. Savage. 2013. Status, numbers and influence. Social Forces
91 (3): 1085–1104.
Melcher, T. 2010. Busted: The top 5 ways that Chinese students cheat on their un-
dergraduate applications to American schools (and what schools can do about
it). In The China conundrum: Insights for US schools. White Paper No. 4,
Zinch, Inc. http://www.aplu.org/document.doc?id=4004.
Merriam, S. B. 2009. Qualitative research: A guide to design and implementation.
San Francisco: Jossey-Bass.
Meyer, H. D., and B. Rowan. 2006. The new institutionalism in education. Albany:
SUNY Press.
Meyer, J., and B. Rowan. 1977. Institutionalized organizations: Formal structure
as myth and ceremony. American Journal of Sociology 83 (2): 340–363.
Milem, J. F., M. J. Chang, and A. L. Antonio. 2005. Making diversity work on
campus: A research-based perspective. Washington, DC: Association of Amer-
ican Colleges and Universities.
References 229
Oltman, P. K., and R. T. Hartnett. 1984. The role of GRE General and Subject test
scores in graduate school admission. GRE Board Research Report GREB.
http://origin-www.ets.org/Media/Research/pdf/RR-84–14-Oltman.pdf.
Orfield, Gary, ed. 2001. Diversity challenged: Legal crisis and new evidence. Cam-
bridge, MA: Harvard Education Publishing Group.
Ortiz, A. 2003. The ethnographic interview. In F. K. Stage and K. Manning, eds.,
Research in the college context: Approaches and methods, 35–48. New York:
Brunner-Routledge.
Osajima, K. 2005. Asian Americans as the model minority: An analysis of the pop-
ular press image in the 1960s and 1980s. In K. Ono, ed., A companion to Asian
American studies, 215–225. Malden, MA: Blackwell.
Osei-Kofi, N., L. E. Torres, and J. Lui. 2013. Practices of whiteness: Racialization
in college admissions viewbooks. Race Ethnicity and Education 16 (3):
386–405.
Oyserman, D., K. Elmore, and G. Smith. 2012. Self, self-concept, and identity.
In M. R. Leary and J. P. Tangney, eds., Handbook of self and identity, 2nd
ed., 69–104. New York: Guilford Press.
Özturgut, O. 2011. Standardized testing in the case of China and the lessons to be
learned for the U.S. Journal of International Education Research 7 (2).
Page, S. E. 2008. The difference: How the power of diversity creates better groups,
firms, schools, and societies. Princeton, NJ: Princeton University Press.
Pallas, A. M. 2001. Preparing education doctoral students for epistemological di-
versity. Educational Researcher 30 (5): 6–11.
Pappano, L. 2011. The master’s as the new bachelor’s. New York Times, July 22.
Park, J. J. 2013. When diversity drops: Race, religion, and affirmative action in
higher education. Newark, NJ: Rutgers University Press.
Patel, V. 2014. Why so few American Indians earn Ph.D.’s, and what can be done
about it. Chronicle of Higher Education, May 27. http://chronicle.com/article
/Why-So-Few-American-Indians/146715/.
Patton, E. and S. H. Appelbaum, S. H. 2003. The case for case studies in manage-
ment research. Management Research News 26(5): 60–71.
Patton, M. Q. 2002. Qualitative research and evaluation methods. Thousand Oaks,
CA: Sage.
Patton, S. 2013. At the Ivies, it’s still white at the top. Chronicle of Higher Educa-
tion, June 9.
Pennock-Roman, M. 1986. Fairness in the use of tests for selective admissions of
Hispanics. In M. A. Olivas (Ed.), Latino College Students (pp. 246–280). NY:
Teachers College Press.
Peterson, M. W., and M. G. Spencer. 1990. Assessing academic climates and cul-
tures. New Directions for Institutional Research, no. 68: 3–18.
Pfeffer, J. 1993. Barriers to the advance of organizational science: Paradigm devel-
opment as a dependent variable. Academy of Management Review 18 (4):
599–620.
Pfeffer, J., and G. R. Salancik. 1978. The external control of organizations: A re-
source dependency perspective. New York: Harper and Row.
232 References
Pfeifer Jr., C. M., and W. E. Sedlacek. 1971. The validity of academic predictors for
black and white students at a predominantly white university. Journal of Edu-
cational Measurement 8 (4): 253–261.
Popper, S. K. 1959. The logic of scientific discovery. Fayetteville, AR: Hutchinson.
Porter, T. 1996. Trust in numbers: Pursuit of objectivity in science and public life.
Princeton, NJ: Princeton University Press.
Portes, A. 2003. Social capital: Its origins and applications in modern sociology.
Annual Review of Sociology 24:1–24.
Posselt, J. R. 2014. Toward inclusive excellence in graduate education: Constructing
merit and diversity in Ph.D. admissions. American Journal of Education 120
(4): 481–514.
Posselt, J. R., and K. Black. 2012. Developing the research identities and aspi-
rations of first generation college students: Evidence from the McNair
Scholars Program. International Journal of Researcher Development 3 (1):
26–48.
Posselt, J. R., O. Jaquette, R. Bielby, and M. N. Bastedo. 2012. Access without eq-
uity: Longitudinal analyses of institutional stratification by race and ethnicity,
1972–2004. American Educational Research Journal 49 (6): 1074–1111.
Powell, K. 2013. Higher education: On the lookout for true grit. Nature, no. 504:
471–473. http://www.nature.com/naturejobs/science/articles/10.1038/nj7480
–471a.
Powell, W. W. 1985. Getting into print: The decision-making process in scholarly
publishing. Chicago: University of Chicago Press.
Powers, D. E., and S. S. Swinton. 1981. Extending the measurement of graduate
admission abilities beyond the verbal and quantitative domains. Applied Psy-
chological Measurement 5 (2): 141–158.
Poyrazli, S., and M. D. Lopez. 2007. An exploratory study of perceived discrimina-
tion and homesickness: A comparison of international students and American
students. Journal of Psychology 141 (3): 263–280.
Rao, H., and S. Giorgi. 2006. Code breaking: How entrepreneurs exploit cultural
logics to generate institutional change. Research in Organizational Behavior:
An Annual Series of Analytical Essays and Critical Reviews 27:269–304.
Rao, H., P. Monin, and R. Durand. 2005. Border crossing: Bricolage and the ero-
sion of categorical boundaries in French gastronomy. American Sociological
Review 70 (6): 968–991.
Redden, E. (2013, July 12). New report shows dependence of U.S. graduate pro-
grams on foreign students. Inside Higher Ed. http://www.insidehighered.com
/news/2013/07/12/new-report-shows-dependence-us-graduate-programs-forei
gn-students.
Regents of the University of California v. Bakke. 1978. 438 U.S. 265.
Rivera, L. A. 2011a. Go with your gut: A theory of emotion and inequality in hiring.
In Academy of Management Proceedings, 1–2. http://proceedings.aom.org
/content/2011/1/1.262.short.
———. 2011b. Ivies, extracurriculars, and exclusion: Elite employers’ use of edu-
cational credentials. Research in Social Stratification and Mobility 29 (1):
71–90.
References 233
———. 2012a. Diversity within reach: Recruitment versus hiring in elite firms. An-
nals of the American Academy of Political and Social Science 639 (1): 71–90.
———. 2012b. Hiring as cultural matching: The case of elite professional service
firms. American Sociological Review 77 (6): 999–1022.
Rizzo, M., and R. G. Ehrenberg. 2004. Resident and nonresident tuition and
enrollment at flagship state universities. In C. M. Hoxby, ed., College choices:
The economics of where to go, when to go, and how to pay for it, 303–354.
Chicago: University of Chicago Press.
Roach, R. 2005. Affirmative action fallout. Black Issues in Higher Education 22
(11): 24–27.
———. 2013. U.S. international education enrollment reaches all-time high. Diverse
Issues in Higher Education, November 11. http://diverseeducation.com/article
/57394/#.
Robins, R. H. 1997. A short history of linguistics, 3rd ed. Harlow, UK: Longman.
Rogers, M. R., and L. E. Molina. 2006. Exemplary efforts in psychology to recruit
and retain graduate students of color. American Psychologist 61 (2): 143.
Roithmayr, D. 2014. Reproducing racism: How everyday choices lock in white ad-
vantage. New York: NYU Press.
Rojas, F. 2007. From black power to black studies: How a radical social movement
became an academic discipline. Baltimore: Johns Hopkins University Press.
Rojstaczer, S., and C. Healy. 2012. Where A is ordinary: The evolution of American
college and university grading, 1940–2009. Teachers College Record 114 (7).
Room for debate: The fate of the humanities. 2013. New York Times, November 4,
http:// www. nytimes . com / roomfordebate / 2013 / 11 / 04 / the - fate - of - the
-humanities.
Rubin, H. J., and I. Rubin. 2009. Qualitative interviewing: The art of hearing data,
2nd ed. Thousand Oaks, CA: Sage.
Ruscingno, G. 2006. Admission variables and academic success in a doctor of physical
therapy program. Unpublished doctoral dissertation, Seton Hall University.
Russell, B. 1972. The history of Western philosophy. New York: Simon and Schuster.
Russell, S., M. Hancock, and J. McCullough. 2007. Benefits of undergraduate re-
search experiences. Science 316:548–549.
Ryfe, D. M. 2002. The practice of deliberative democracy: A study of 16 delibera-
tive organizations. Political Communication 19 (3): 359–377.
Salthouse, T., W. McKeachie, and Y. Lin. 1978. An experimental investigation of
factors affecting university promotion decision: A brief report. Journal of
Higher Education 49 (2): 177–183.
Sauder, M., F. Lynn, and J. M. Podolny. 2012. Status: Insights from organizational
sociology. Annual Review of Sociology 38:267–283.
Scheurich, J. J. 1995. A postmodernist critique of research interviewing. Interna-
tional Journal of Qualitative Studies in Education 8 (3): 239–252.
Schillebeeckx, M., Maricque, B., & Lewis, C. 2013. The missing piece to changing
the university culture. Nature biotechnology 31(10): 938–941.
Schmidt, F. L., and J. Hunter. 2004. General mental ability in the world of work:
Occupational attainment and job performance. Journal of Personality and So-
cial Psychology 86 (1): 162.
234 References
Steele, C. M. 2010. Whistling Vivaldi: How stereotypes affect us and what we can
do about it. New York: Norton.
Steele, C. M., and J. Aronson. 1995. Stereotype threat and the intellectual test per-
formance of African Americans. Journal of Personality and Social Psychology
69 (5): 797.
Stephens, N. M., S. A. Fryberg, H. R. Markus, C. S. Johnson, and R. Covarrubias.
2012. Unseen disadvantage: How American universities’ focus on independence
undermines the academic performance of first-generation college students.
Journal of Personality and Social Psychology 102 (6): 1178.
Sternberg, R. J. 2003. Wisdom, intelligence, and creativity synthesized. Cambridge:
Cambridge University Press.
Sternberg, R. J., and W. M. Williams. 1997. Does the Graduate Record Examina-
tion predict meaningful success in the graduate training of psychologists? A
case study. American Psychologist 52 (6): 630–641.
Stevens, M. 2007. Creating a class: College admissions and the education of elites.
Cambridge, MA: Harvard University Press.
Stevens, M. L., and J. Roksa. 2011. The diversity imperative in elite admissions.
In L. M. Stulberg and S. L. Weinburg, eds., Diversity in American higher
education: Toward a more comprehensive approach, 63–73. New York:
Routledge.
Stock, W. A., A. T. Finnegan, and J. J. Siegfried. 2006. Attrition in economics Ph.D.
programs. American Economic Review 96 (2): 458–466.
Strauss, A., and J. Corbin. 2008. Basics of qualitative research: Techniques and pro-
cedures for developing grounded theory. Thousand Oaks, CA: Sage.
Studley, R. E. 2004. Inequality, student achievement, and college admissions: A
remedy for underrepresentation. In R. Zwick, ed., Rethinking the SAT: The fu-
ture of standardized testing in college admissions, 321–344. New York:
Routledge.
Suen, H. K., and L. Yu. 2006. Chronic consequences of high stakes testing? Les-
sons from the Chinese civil service exam. Comparative Education Review 50
(1): 46–65.
Suzuki, B. H. 2002. Revisiting the model minority stereotype: Implications for stu-
dent affairs practice and higher education. New Directions for Student Services,
no. 97: 21–32.
Swales, J. 2004. Research genres: Explorations and applications. Stuttgart: Ernst
Klett Sprachen.
Sweitzer, K., and J. F. Volkwein. 2009. Prestige among graduate and professional
schools: Comparing the US News’ graduate school reputation ratings between
disciplines. Research in Higher Education 50 (8): 812–836.
Swidler, A. 1986. Culture in action: Symbols and strategies. American Sociological
Review 51 (2): 273–286.
Swidler, A., and J. Arditi. 1994. The new sociology of knowledge. Annual Review
of Sociology 20 (1): 305–329.
Tajfel, H., ed. 2010. Social identity and intergroup relations, vol. 7. Cambridge:
Cambridge University Press.
236 References
Tajfel, H., and J. Turner. 1986. The social identity theory of intergroup behavior.
In J. T. Jest and J. Sidanius, eds., Psychology of intergroup relations, 7–24. Chi-
cago: Nelson Hall.
Taylor, C. R., and B. B. Stern. 1997. Asian-Americans: Television advertising and
the “model minority” stereotype. Journal of Advertising 26 (2): 47–61.
Temp, G. 1971. Validity of the SAT for blacks and whites in thirteen integrated in-
stitutions. Journal of Educational Measurement 8 (4): 245–251.
Teranishi, R. T., L. B. Behringer, E. A. Grey, and T. L. Parker. 2009. Critical race theory
and research on Asian Americans and Pacific Islanders in higher education. New
Directions for Institutional Research, no. 142: 57–68.
Thelin, J. R. 2004. A history of American higher education. Baltimore: Johns Hop-
kins University Press.
Thompson, J. 2013. The changing demography of wealth: Demographics by wealth
and wealth by demographics in the SCF. Washington, DC: Federal Reserve
Board of Governors.
Thorndike, R. L. 1949. Personnel selection: Test and measurement techniques. New
York: Wiley.
Thornton, P. H. 2004. Markets from culture: Institutional logics and organizational
decisions in higher education publishing. Stanford, CA: Stanford Business Books.
Thornton, P. H., and W. Ocasio. 1999. Institutional logics and the historical contin-
gency of power in organizations. American Journal of Sociology 105 (3):
801–843.
———. 2008. Institutional logics. In R. Greenwood, C. Oliver, R. Suddaby, and
K. Sahlin-Anderson, eds., The Sage handbook of organizational institution-
alism, 99–129. Thousand Oaks, CA: Sage.
Thucydides. 1951. The history of the Peloponnesian War. Translated by R. Crawley.
New York: Random House.
Thurgood, L., M. J. Golladay, and S. T. Hill. 2006. U.S. doctorates in the 20th cen-
tury: Special report. NSF 06-319. http://www.nsf.gov/statistics/nsf06319/pdf
/nsf06319.pdf.
Tienda, M. 2013. Diversity ≠ inclusion: Promoting integration in higher education.
Educational Researcher 42 (9): 467–475.
Tierney, W. G. 1988. Organizational culture in higher education: Defining the es-
sentials. Journal of Higher Education 59 (1): 2–21.
Tierney, W. G., and E. M. Bensimon. 1996. Promotion and tenure: Culture and so-
cialization in academe. Albany: SUNY Press.
Tilly, C. 1998. Durable inequality. Berkeley: University of California Press.
———. 2005. Social movements, 1768–2004. Boulder: Paradigm.
Torche, F. 2011. Is a college degree still the great equalizer? Intergenerational mo-
bility across levels of schooling in the United States. American Journal of Soci-
ology 117 (3): 763–807.
Tough, P. 2012. How children succeed: Grit, curiosity, and the hidden power of char-
acter. New York: Houghton Mifflin.
Trice, A. G. 2004. Mixing it up: International graduate students’ social interactions
with American students. Journal of College Student Development 45 (6):
671–687.
References 237
Trower, C. A. 2009. Toward a greater understanding of the tenure track for mi-
norities. Change 41 (5): 38–45.
Trower, C. A., and R. P. Chait. 2002. Faculty diversity: Too little for too long. Har-
vard Magazine, March/April.
Tumminia, D. 1992. Hard work, luck, and uncontrollable variables: A guide to get-
ting into graduate school. Sociological Practice Review 3 (1): 37–41.
Twombly, S. 1992. The process of choosing a dean. Journal of Higher Education
63 (6): 653–683.
Urrieta, L. 2007. Orchestrating habitus and figured worlds: Chicana/o educational
mobility and social class. In J. A. VanGalen and G. W. Noblit, eds., Late to
class: Social class and schooling in the new economy, 113–140. Albany: SUNY
Press.
U.S. Census Bureau. 2008. 2008 American Community Survey 1-year estimates.
Washington, DC: U.S. Census Bureau.
U.S. Department of Education, National Center for Education Statistics. 2012. The
condition of education 2012. NCES 2012-045. Indicator 47. http://nces.ed.gov
/fastfacts/display.asp?id=72.
Vaughan, D. 1992. Theory elaboration: The heuristics of case analysis. In C. C.
Ragin and H. S. Becker, eds., What is a case? Exploring the foundations of so-
cial inquiry, 173–203. Cambridge: Cambridge University Press.
Wadsworth, B. C., M. L. Hecht, and E. Jung. 2008. The role of identity gaps, dis-
crimination, and acculturation in international students’ educational satisfac-
tion in American classrooms. Communication Education 57 (1): 64–87.
Wait, I. W., and J. W. Gressel. 2009. Relationship between TOEFL score and aca-
demic success for international engineering students. Journal of Engineering
Education 98 (4): 389–398.
Walker, G. E., C. M. Golde, L. Jones, A. C. Bueschel, and P. Hutchings. 2008. The
formation of scholars: Rethinking doctoral education for the twenty-first cen-
tury. San Francisco: Jossey-Bass.
Walters, A. M., S. Lee, and C. Trapani. 2004. Stereotype threat, the test-center en-
vironment, and performance on the GRE General Test. Princeton, NJ: Educa-
tional Testing Service.
Walton, G. M., and G. L. Cohen. 2003. Stereotype lift. Journal of Experimental
Social Psychology 39 (5): 456–467.
Weber, M. 1978a. Economy and society, vol. 1. Berkeley: University of California
Press.
———. 1978b. Economy and society, vol. 2. Berkeley: University of California Press.
Wechsler, H. S. 1977. The qualified student. New York: Wiley.
Wei, M., T. Y. Ku, D. W. Russell, B. Mallinckrodt, and K. Y. H. Liao. 2008.
Moderating effects of three coping strategies and self-esteem on perceived dis-
crimination and depressive symptoms: A minority stress model for Asian in-
ternational students. Journal of Counseling Psychology 55 (4): 451.
Weick, K. E. 1979. Cognitive processes in organizations. Research in Organizational
Behavior 1 (1): 41–74.
———. 1984. Small wins: Redefining the scale of social problems. American Psy-
chologist 39 (1): 40.
238 References
with witty remarks. After she transitioned out of HUP, Andrew’s editorial skill and
eye for detail also contributed to the strength of the manuscript, and I’m grateful for
his steady support through the publication process. I would be remiss not to acknowl-
edge my appreciation to the two anonymous external reviewers, both of whom of-
fered constructive and thoughtful advice that helped me improve the manuscript.
Chapter 4 develops ideas originally treated in “Disciplinary Logics in Doctoral Ad-
missions,” published in the Journal of Higher Education.
Outstanding research and editorial assistance from University of Michigan doc-
toral students Kimberly Reyes, Kelly Slay, and Aurora Kamimura also supported the
production of the book. I am particularly appreciative of Kim’s dedicated editorial
support with early chapter drafts. I also want to acknowledge my transcriptionist,
Mary Ann Spitale, whose efficient, accurate work increases my research capacity.
I have been graced with several wise mentors whose counsel and support have
been instrumental as I worked on this project. This book would not exist without
Mike Bastedo’s generous mentoring through the research and publication processes.
I am deeply grateful to Deborah Carter for her wisdom, wit, and for all that I learned
from her about qualitative research. Janet Lawrence and Janet Weiss offered astute
interpretations of my early findings, and they helped me think about my data in
new ways. I am also indebted to Annemarie Palincsar, Lisa Lattuca, Diana Hess,
Chris Golde, Liliana Garces, and Tabbye Chavous for professional guidance and
review of specific chapters.
For conversations and insights that strengthened the design, findings, and/or mes-
sage of this work, I extend my sincere thanks to Elizabeth Armstrong, Ann Austin,
Deborah Ball, Estela Bensimon, John Bound, Phil Bowman, Bryan Brayboy, Lenny
Cassuto, Steve DesJardins, Kimberly Griffin, Eric Grodsky, Patti Gumport, Ozan
Jaquette, Michèle Lamont, Anna Neumann, Gary Rhoades, Ed St. John, Mitchell
Stevens, Barrett Taylor, and Rebecca Zwick.
Through the years I have conducted research on graduate admissions—the long
haul of design, recruitment, fieldwork, analysis, writing, and revising—scholarly
friendships with others who study higher education have been a great source of sus-
tenance. I especially want to acknowledge Cassie Barnhardt, Nick Bowman, Julio
Cardona Raya, Gloryvee Fonseca, Leslie Gonzales, Nathan Harris, Matt Holsapple,
Ignacio Hernandez, Susana Hernandez, Marc Johnston, Anat Levtov, Chris Linder,
Angela Locks, Johanna Masse, Matt Mayhew, Carmen McCallum, Genevieve
Negron-Gonzales, Penny Pasque, Rosie Perez, Awilda Rodriguez, Shelley Strickland,
and Kerri Wakefield.
Finally, my family. Blessings to each and every one of you. Special thanks to my
parents, Janet and Gary Schmidt, and to Derek and Daniel Posselt, my dear hus-
band and son. Thank you for being my foundation, and for your strong support of
my work and its demands. Derek and Danny boy: I absolutely love our life together,
and I dedicate this book to you.
Index
Abbott, Andrew, 203n19 Asians, 149, 153, 155, 163, 170, 197, 108,
Academic preparation, 67–70, 78, 156, 162 197, 208n22; Asian international
Access, 2, 6, 7, 11, 15, 20, 67, 102–103, students, 17, 61, 112, 137, 139, 140, 141,
111, 127, 134, 155–159, 170, 210n14 142, 148–150, 152, 163, 208; East
Accountability, 41 Asians, 112, 137, 138, 148, 150–151,
ACT, 205n9 163; South Asians, 138; Southeast Asians,
Administrative staff, 1, 29, 44 47
Affirmative action. See Race-conscious Association of American Colleges and
admissions Universities, 48, 172
African Americans, 3, 4, 159, 189, 200n13, Astrophysics, 2; admissions committee
212n39; baccalaureate origins of, dynamics observed in, 32–33, 35, 41, 43,
169–170; and compositional diversity, 18, 44; and admissions interviews, 143–146;
61, 135; evidence of bias against, 12, 66, assessments of merit in, 46–47, 50, 51,
163; and GRE scores, 47, 132, 141, 152, 56, 58, 147; description of departments
155, 212n39; and stereotype threat, 132, included in study, 16, 28, 180, 182, 184,
152; and undergraduate research 189; discussion of gender, 65; evaluation
programs, 171; views regarding of GRE scores in, 140; evidence of
underrepresentation of, 60, 63–64, 72 homophily in, 97, 98, 99, 100, 105–106;
Ally behavior. See Solidarity and risk aversion, 101, 103–104, 128,
Ambiguity, 55, 114, 125, 133–153, 156, 165
207nn11–12
Ambiguity aversion, 162 Bastedo, Michael, 199n25, 204n15
American Philosophical Association, 175 Becher, Tony, 117
American Psychological Association, 194n20 Belonging, 53–54, 161
Aronson, Joshua, 132, 206nn22–23 Benard, Stephen, 204n20
Asian Americans, 3, 4, 12, 148–149, 155, Bensimon, Estela, 72, 144, 186, 196,
208n23, 208n27; baccalaureate origins 208n17
of, 169–170 Berrey, Ellen, 72
244 Index
180, 182, 187; nature of, 20–22, 39, interest, 67, 160; and conceptions of
44–45; as part of the admissions process, merit, 47–48, 50, 71; definition of, 59–60,
18, 22–23, 29, 195n23, 198n11; through 62, 67, 157, 196n40, 200n24; as a
quantification, 31, 38, 40, 55, 71, dimension of quality and merit, 56, 172;
195n29, 199n23; relationship to and enrollment management, 23, 39, 171,
disciplinary logics, 75–77, 87–88, 93; and 212n43; faculty commitment to, 92, 164,
risk taking, 53, 67, 162–163; through 177; fellowships, 66, 67, 89, 136, 209n4;
serial impressions, 84–86 geographic, 61, 135–136, 201n28;
Decision theory, 162–164 graduate diversity officers, 39, 169;
Delegation, 21–23, 28–30, 37–38, 44 intellectual, 49, 203n19; as obligation,
Deliberation, 39–43, 68–70, 143–146, 156, 62–63; as opportunity, 63–65; as
161–162; about borderline cases, 40, 111; organizational interest, 9, 114–115,
disciplinary logics reflected in, 84–94; 159–161, 200–201n26; as part of
discussions of intelligence during, 199, admissions review, 18, 22, 55, 72, 155,
123–124, 128, 130; nature of, 37, 41, 43, 157–158; on research teams, 210n18, 40,
79, 112–113, 131; value of, 37, 39, 45 47, 72; and risk aversion, 67–70; as a
Deliberative democracy, 18, 20, 40, 44, 47, value, 92, 157–158
162, 164, 197n2, 206n25 Doctoral education, 3–9, 14, 200n17,
Democracy, 206n18 202n2, 210n8; and academic depart-
Department, 8, 11, 54, 115, 145, 150; ments, 23, 198n8; diversity consider-
description of departments in study, ations for, 155, 161, 170–172, 177;
24–27; political dynamics within, 47–48; relationship to disciplines, 74; and risk
relationship to admissions committees, aversion, 70; and student research
23, 28–30 experience, 58, 127, 171
Disagreement, 21, 29–30, 34–38, 117, 150; Dowd, Alicia, 72
caused by homophily, 98; disguised
through ratings of applicants, 34–35, Economics, 2, 4, 32, 57, 200n13, 202n7;
40–41; over diversity considerations, 59, admissions practices and priorities in,
62; as part of academic life, 43–45; 75–78, 82–84, 93; beliefs about diversity
relationship to disciplinary consensus, 75, in, 60–61, 64, 135; description of
82, 86–91, 93; and status hierarchies, 29, departments included in study, 14, 16, 27;
93; over use of GRE scores, 89–91, 93 evaluation of GRE scores in, 50, 142,
Disciplines, 7–9, 13, 101, 157–158, 177, 195n30; evidence of homophily in, 97,
212n45; classification, 202n5; construc- 106; interpretations of intelligence, 125,
tions of merit in, 50–52, 56–59; 129
disciplinary cultures, 117–118, 135, Educational Testing Service, 71, 130–131,
203n20; disciplinary logics, 17, 74–94, 141, 173, 195n31, 197n43, 198n19,
205n6; intellectual consensus in, 74–76, 200n19, 201n40, 206nn19–20, 212n36,
84–94, 96, 106, 203n5, 203n19, 204n6; 212n40
and interpretations of diversity, 60, 62, Efficiency, 9, 28, 37, 44
65, 72; judgments of intelligence in, 118, Elitism, 54, 103, 107
120, 121, 124, 126, 129; prestige Ellsberg, Daniel, 207n11
hierarchies within, 103–104, 113, 114; Emotions, 70, 80–81, 112, 122, 202n13
rationale for disciplines included in study, Engineering, 43
14, 19, 182; relationship to university English, 137, 141–146, 151, 163, 205n7,
departments, 23, 28, 45 205n9
Discrimination, 12, 13, 67, 149, 159, 166, Enrollment management, 23, 134–136,
175, 197n46, 199n1, 210n14 207n5
Disparate impact, 199n1 Enthusiasm, 80–81, 86; of applicants, 57,
Diversity, 11–12, 13, 72; on admissions 121; and homophily, 96, 99, 121; of
committees, 28, 41, 198n12; ambivalence reviewers, 32, 96, 124
about, 164–166; benefits of, 159–160, Environmental conditions, 196n33, 206n23,
200n25; as compelling governmental 210n24, 211n35
246 Index
Equity, 3, 12, 13, 22, 47, 161, 165–166, scores, 47, 155; international students’
169, 172, 175, 196n41 scores, 137–141, 141–142, 151–152;
Espeland, Wendy, 198n20 interpretation of, 53, 55, 71, 87–93,
Ethical considerations, 137–142 118–120, 174, 200n19; meanings
Ethnicity, 47, 113, 210n18 associated with, 49, 50, 53–54, 118–120,
Evaluation, 17, 18, 204n15. See also Rating 130, 139, 158, 161, 211n35; misuse of,
Evaluative culture, 9 37, 172–174, 198n19, 201n40; practice
Excellence, 5, 132, 176, 177; inclusive increases scores, 205n6; revisions to test,
excellence, 18, 48, 171–172; and 130, 132, 200n13, 202n9, 212n40; score
intellectual consensus, 106; in organiza- disparities in, 12, 56, 71, 131, 197n43,
tions, 48–49; in relation to diversity, 56, 201n40, 206n23, 209n3, 212n39,
59, 64, 72, 161, 165 212n45; as a tool for efficiency and
clarity, 28, 31–32, 55, 78, 162; validity
Faculty hiring, 51, 64, 126, 154 of, 7–8, 71, 131, 195nn29–30, 201n41,
Fairness, 45, 195n24, 206n23 203n21, 206n21, 211n35, 152–153;
Fellowships. See Financial aid value attributed to, 49, 55, 111, 155
Financial aid, 22, 23, 60, 66, 101, 135, 167. Grant, 23
See also Diversity: fellowships Gratz v. Bollinger, 160, 209n4, 210n12
First-generation college students, 107–108, Griffin, Kimberly, 39
124 Guinier, Lani, 11, 48, 130, 206n18
Fisher v. University of Texas, 41, 160, Gumport, Patricia, 126, 198n10
109n4 Gutmann, Amy, 20, 197n1
Fisk University, 170, 172, 211n30
Fit, 13, 49, 54, 59, 109, 112, 118, 158 Haro, Roberto, 65
France: education, 204n8, 210n8; philos- Harvard University, 50, 60, 120
ophy, 208n20 Hatt, Beth, 117
Fraud in applications. See Cheating Heimer, Carol, 39–40
Friendly debate, 41–43 Heterarchy, 10, 157
Hiring, 209n2
Garces, Liliana, 61 Hispanic Americans. See Latinos
Gatekeeping, 5, 19, 70; and assessments of Holistic review, 32, 40, 56, 71, 136, 153,
merit and diversity, 48, 64; faculty 156, 167
gatekeeping, 22, 45, 72, 93, 176; Homophily, 17, 80, 84, 95–116, 204n5
gatekeeping course, 206n23; organiza- Human capital, 100
tional, 176–177 Humanities, 3, 52; admissions committee
Geertz, Clifford, 74 dynamics observed in, 28, 30, 162; and
Gender, 3, 4, 48, 113, 131, 144–145, 155, the academic labor market, 5, 11,
157, 194n9, 204n20, 206nn23–24, 194n16; description of departments
207n4; and GRE, 47, 173; consideration included in study, 14, 16, 75, 180, 182;
in admissions, 65; inequality, 210n24, evaluation of GRE scores in, 50, 119;
212n45; on research teams, 210n18 evaluation of writing samples in, 125,
Georgia Tech University, 211n30 127, 129, 205n13; intellectual consensus
Ginsburg, Ruth Bader, 41, 48 and disciplinary logics within, 75, 79, 84,
Goffman, Erving, 48, 131, 179 93, 202n5; and international students’
Grades, in college, 53, 122, 197n43, English skills, 141, 152; judgments of
211n35; as evaluation criterion, 50–51, intelligence in, 119, 120–121, 122–125
54–55, 71; grade point average, 31, 40, Humor, among reviewers, 42–43
50–51, 109, 111, 155; in graduate school,
131, 195, 204n9; meanings of, 49, 53–54 Identity, 47–48, 96, 99, 111–114, 119, 158
Graduate Record Examination (GRE), 2, IDP Education, 207n4
11, 12, 197n43, 200n22, 212n41; Implicit bias, 41–42, 153. See also
ambivalence about, 36–37; and decision Discrimination
making, 42, 44–45; distributions of Inclusive excellence, 48
Index 247
Inequality, 3, 12, 15, 174, 209n3; in the disposition, 121–122; organizational, 45,
academy, 64, 157, 196–197n41; and 112; student, 48, 101, 108, 120, 126,
diversity efforts, 61, 62, 72, 136, 161; 132, 159; subject matter, 120, 122
institutionalized, 13; maintained by Legitimacy, 52–54, 132, 164, 198n16; of
decision making preferences, 20, 45, 166; admissions practices, 9, 41, 45, 52, 76,
and postracial discourse, 165–166, 197n49; 82; through disciplinary logics, 75, 93;
in relation to beliefs about intelligence, and diversity, 62, 63; and norms of
129, 132; reproduced by homophily, 95 academic work, 21; and perceived
Innovation, 56, 57, 59, 66, 200 intelligence, 54, 130; of race-conscious
Institutional affiliations. See Pedigree admissions, 159–160
Institutional theory, 159 Lemann, Nicholas, 31, 205n7
Intelligence, 17, 18, 116–132, 200n19, Lesbian, gay, bisexual, transgender, and
201n37, 205n2, 206n18; and admissions queer (LGBTQ) students, 153
tests, 53–55, 118–120, 124, 130–131, Letters of recommendation, 55, 58, 68, 111,
161, 205n7; context-specific definitions, 128, 137, 156, 163; cultural variation in,
117, 205n4; as disciplinary cultural 147–148, 197n43
practice, 118, 124–130; as general Linguistics, 2, 199n21, 202n4; admissions
impression, 118–120, 128–132; committee dynamics observed in, 28,
intellectual dispositions, 121–122; 29, 41–44, 67; and admissions inter-
intellectual virtues, 121–4; judgments of, views, 143; description of departments
47, 53–55, 69–70 included in study, 14, 16, 26, 180, 182;
Interdisciplinarity, 177, 196n37 diversity considerations in, 67–70;
International students, 17, 46–47, 133–153, evidence of homophily in, 97; intellec-
204n5, 206n2, 207n4, 211n35; distin- tual consensus in, 75, 85; judgments of
guishing among, 146–148; organizational intelligence in, 54
interests in, 134–136, 207nn6–7; Locks, Angela, 167
preference for, 96–97
Interviews, for admissions, 118, 143–146 March, James, 163
Ivy League, 52, 102, 107, 110, 113 Master’s degrees, 3, 198n8, 211n30
Mathematics, 206n23
James, William, 5, 13, 116 MCAT, 205n9
Johns Hopkins University, 173 McNair Postbaccalaureate Achievement
Johnson, Lyndon, 159 Program, 211n32
Member checking, 200n13
Kahneman, Daniel, 70, 211n27 Menand, Louis, 165
Kiang, Peter, 149 Mentoring, 90–92, 165–166
Klitgaard, Robert, 50, 195n32 Merit, 7, 8, 9, 10, 11, 12, 46–49, 62, 67,
Kroc, Rick, 134 92–93, 99, 110, 153; ambiguity of, 132,
Kuncel, Nathan, 8n30 156; assumptions about, 171–172; as
conventional achievement, 50–56,
Labor market, 2, 11, 177; for professoriate, 155–157; democratic, 48; as future of
3, 5, 195n23, 196n41 discipline, 56–58, 113, 118, 126,
Lamont, Michele, 48, 106, 117, 158, 186, 128–129, 156–157; meritocracy, 30, 149,
200n7 205n7; organizational perspective on,
Latinos, 3, 12, 18, 47, 63–64, 135, 152, 161, 196n37
159, 163, 171, 200, 212n39; baccalau- Meyer, John, 28
reate origins of, 169–170 Meyerhoff Scholars Program, 211n32
Leaders, 28, 171; admissions committee Milkman, Katherine, 12
chair, 29, 30, 68, 97–89, 128, 165, Minority-serving institutions, 169
198n15, 202n13 Moss-Kanter, Rosabeth, 110
Learning: contexts for learning, 153; curves, Moss-Racusin, Corrine, 12
101, 108; environments, 9, 66, 206n23, Muñiz, Marcela, 39
210nn23–24, 211n35; and intellectual Museus, Samuel, 149
248 Index
Narrow framing, 45, 211n27 62, 63, 201n27; rating and ranking of
National Center for Fair and Open Testing, applicants in, 32–34, 35, 37
212n41 Physics, 2, 4, 117, 158, 199n24, 205n9; and
National Endowment for the Humanities, admissions interviews, 143; description of
205n13 departments included in study, 14, 16, 24,
National origin, 60, 212n45 180, 182; disciplinary logics of, 75, 82,
National Research Council, 6, 194, 209n7 83; evaluation of GRE scores in, 50, 55,
National Science Foundation, 169–170, 140, 142; evidence of homophily in, 97,
211n32 104, 106; faculty perspectives on diversity
Native Americans, 3, 18, 135, 163, 171; and and equity, 60, 135; faculty views on risk
GRE scores, 47 aversion, 52; and international students,
Natural sciences, 52, 107, 129, 152, 202n5; 140, 142, 146
description of departments included in Plato, 176
study, 14, 16, 180, 182; judgments of Policy capturing, 211n28
intelligence in, 125, 127 Political science, 2, 165, 199n24; and
Neumann, Anna, 122 admissions interviews, 143; decision-
Nixon, Richard, 159 making dynamics observed in, 40, 41, 43;
Noblesse oblige, 92, 97, 111, 114 description of departments included in
Noncognitive admissions criteria, 57, 172, study, 14, 16, 27, 28, 180, 182; disci-
212n36 plinary logics in, 75, 85, 87–94; evidence
Nonresident students, 207n7 of homophily in, 97, 105
Norms, 36, 39, 43, 44, 202 Postracial discourse, 165, 210n25
Novelty, 105–106 Potential, 7, 9, 10, 45, 56, 58, 96, 101–102,
126, 129, 132, 153, 164, 174
Oakes, Jeannie, 116, 205 Powell, Lewis, 160
Obama, Barack, 92, 203n23 Preferences, 44–45, 98, 102, 113–114, 156,
Organizational change, 164–166, 171, 158, 176, 196n39, 204n5, 205n6,
174–175 205n22, 211n28; revealed, 56
Organizational culture, 114, 164, Prestige, 2, 8, 78, 201n45, 207n4; of
174–175 graduate program, 49, 135; as organiza-
Organizational learning, 45, 112 tional interest, 9, 13–14, 157–159, 161;
Outreach, 23, 169 of institutional affiliations, 51, 54, 77,
99–104, 107–113, 155, 175, 209n2
Park, Julie, 202n46 Privilege, 111, 166, 171, 204n8
Passion, 121–122 Professional doctorate, 194n9, 194n19
Pedigree, 67–71, 84, 95–97, 99–104, Psychology, 42, 201n41, 211n34
107–113, 154, 158–159, 163, 204n5
Peer review, 21 Quality, 2, 5–11, 158; of academic research,
Pennock-Roman, Maria, 7 78, 161, 203n21; of applicant, 39–40,
Pericles, 45 54–56, 63, 82, 132, 153; challenges in
Personal statement, 42, 50, 55, 118, 127, assessing, 29–31; of dissertation, 203n21;
141–142, 145 of graduate program, 49, 134, 177,
PhD, 2, 3, 5; completion, 200n17; rising 210n23; judgments of, 47, 56, 195n23;
pursuit of, 193n5, 194n6; time to degree, personal and intellectual qualities of
200n17 applicants, 116, 118, 123, 125, 185;
Philosophy, 1, 165, 174–175, 196–197n41, politics of, 47–48, 73; quantification of,
208n20; and admissions interviews, 143; 31, 35, 37, 55; slight differences in
description of departments included in student quality, 6, 39; of test preparation
study, 14, 16, 25–26, 180; disciplinary for international students, 138; of
logics of, 78–84; evaluation of writing undergraduate institution, 51–52, 100,
samples in, 30, 127, 132; evidence of 108; of undergraduate research experi-
homophily in, 97–98, 103, 110; faculty ence, 126–127, 129, 148; university, 163,
perspectives on diversity and equity, 60, 171–172
Index 249
Quantification, 30–32, 34–37, 40, 44, 55, Smith, Daryl, 64, 196
77–78, 81–82, 162, 164, 199n23 Smith vs. City of Jackson, 199n1
Social capital, 147
Race, 47–48, 72, 113, 149, 155, 158, 173 Socialization, 126, 128, 156; disciplinary,
Race-conscious admissions, 23, 59, 61, 67, 74–76; experiences formative to, 100,
157, 159–160, 209n4, 210n14 112; in low-consensus disciplines, 93
Racial inequality, 210n24, 212n45 Social mobility, 204n5; homophily based
Racial isolation, 210n23 on, 96–97, 106–110
Racism, 12, 13, 92–93, 149, 163, 197n49 Social reproduction, 74, 95, 103–104, 113,
Rankings, 135 158
Rating, 1, 29, 31–37, 40–41, 131, 155, Social sciences, 3, 34, 105, 107; description
199n21; use of rubrics, 168–169 of departments included in study, 14, 16,
Recruitment, 5, 22, 69–172, 175, 212n43; 28, 57–58, 180, 182; intellectual
challenges in student, 21, 135, 165, 171; consensus and disciplinary logics within,
diversity, 23, 39, 68; events, 14, 69; in 75–76, 82, 93, 202n5; and international
industry, 154; practices, 22, 25–26, 121, students, 141, 152; prestige hierarchies
167, 211n34; recruitment networks and within, 78, 83
relationships, 39, 170, 172, 211n30; of Socioeconomic status, 50, 60, 99, 135, 155,
study participants, 182–184, 189; 157
through undergraduate research Sociology, 2, 36; assessments of merit in,
experiences, 170–171, 211n32; of 33–35, 51, 54–55, 101, 103; description
underrepresented students, 11, 63, 68–69, of departments included in study, 16, 27;
72, 135 evidence of homophily in, 97; views of
Reed College, 52 admissions exams in, 119, 142; sociolog-
Regents of the University of California v. ical research informing the study, 48,
Bakke, 67, 160–161, 210n12 72–74, 81, 95, 113, 133; views on
Religion, 41–42, 158, 193n4 diversity in, 60, 62, 64, 66
Research experience, 124–130, 211n32; as Solidarity, 97, 111, 174
admissions criteria, 55, 109, 158, 171; Spelman College, 211n30
evaluation of, 57–58, 66, 118; in Spillman, Lyn, 197n52
master’s-PhD bridge program, 170; of Statement of purpose. See Personal
international students, 143, 148; statement
Research universities, 23, 102, 113, 129, Status, 72, 76, 159, 204n20, 105, 110–111,
193, 211n30 150
Risk, 112, 211n35; aversion to, 52, 68–72, Steele, Claude, 90, 131, 206n22
76–78, 89–90, 101, 111, 162–163 Stereotypes, 42, 131, 144, 146; model
Rivera, Lauren, 81, 99, 112–113, 154, minority, 137, 148–150, 166, 208n27;
209n2 stereotype lift, 131, 206n24; stereotype
Rowan, Brian, 28 threat, 90, 131, 173, 203n22, 206n22,
212n39; and availability bias, 163
SAT, 205n7 Sternberg, Robert, 88, 205n3
Science, technology, engineering, and math Stevens, Mitchell, 40, 195n32, 198n20,
(STEM), 3, 127, 135, 170, 172, 206n23 200n21, 201n45
Scripts, 48–49, 52–53, 61, 71–72, 161, 163, Subjectivity, 80
200n7; counterscripts, 96, 110–112, 131, Summer Research Opportunities Program,
174 211n32
Selectivity, of colleges, 14, 22, 209nn2–3 Survey of Earned Doctorates, 3, 4
Self-concept, 4, 116–117, 132, 205n2
Self-esteem. See Self-concept Taste, 35, 80, 94, 112
Self-similarity. See Homophily Technology, 34, 105
Sexism, 12–13 Test of English as a Foreign Language
Shared governance, 21 (TOEFL), 7, 28, 37, 141–142, 152,
Smart. See Intelligence 211n35
250 Index