3 Newman FORUM 50 2 Web
3 Newman FORUM 50 2 Web
3 Newman FORUM 50 2 Web
ABSTRACT The relationship between the size of a school and various education
outcomes continues to interest parents, campaigners and politicians. This article
summarises some of the arguments made in relation to the importance of school size
and explores the results of a systematic review of 31 research studies on the effects of
secondary school size. Overall, the review found that directions and patterns of effect
vary for different outcomes. The results of the review suggested that there was little
empirical evidence to justify policies aimed at changing or mandating particular school
sizes. However, given the continuing interest in the issue and indications that more
research is becoming available, the author suggests that continuing rigorous systematic
evaluation is needed to explore the association between school size and outcomes.
Introduction
An article in the Sunday Times in January 2008 reported that the optimal size of
secondary schools was about 800 children. The overall thrust of the article was
that secondary schools in England are becoming too big. The article included
the Sunday Times own data and the opinion of a ‘professor of education’ to
support the newspaper’s claim (Sian Griffiths, Sunday Times, 6 January, 2008).
Issues raised in the article reflect a long-standing public and media interest in
the issue of school size. One of the attractions of ‘size’ is that, in theory at least,
the issue is amenable to relatively simple controls. Decisions about the size of
any new school are made in consultation with local authorities, and size is often
cited as a justification for closing a particular school. In England, government
policy on school admissions has been gradually moving towards a model
whereby individual schools have more freedom to choose the size of their
intake. This could be viewed as a reduction in the country’s collective capacity
to control school size or, more benignly, as transferring the power over the
decision from politicians (local or national), to parents and schools themselves.
167
Mark Newman
Whatever view is taken, it is useful to know whether, and under what
circumstances, school size is in fact an important determinant of outcomes.
168
DOES THE SIZE OF A SECONDARY SCHOOL MATTER?
between the size of a school and any outcomes that we may think indicate
something about the quality of educational provision in that school. We might
do this by referring to theoretical arguments about the relationship between size
and outcomes, as in the examples above. But given that different, and sometimes
opposing, arguments are made we would also want to explore the relationship
empirically i.e. through research.
Systematic Review
Before conducting any new primary research to answer a question it is useful to
consider the evidence provided by existing studies. There are numerous
‘reviews’ of research on school size (for example, Cotton, 1996; McGuire,
1989; Muir, 2000; Spielhofer et al, 2002; Tasker, 2003). These reviews all
have limitations of one kind or another. One thing they have in common is that
they do not provide a clear explanation of how the author identified, selected,
or synthesised the evidence they use; that is they were not reported in a way
that made it possible to assess their relative strengths and weaknesses as reviews.
Not surprisingly, the reviews come to different conclusions, but it is not clear to
the reader why they did so.
In 2003 the EPPI-Centre was commissioned by the (then) Department for
Education and Skills (DfES) to conduct a systematic review of the relationship
between school size (expressed as the number of students) and ‘outcomes’.[1] A
systematic review differs from the traditional literature review in that it is
169
Mark Newman
undertaken as a piece of research and thus uses a transparent and explicit
process or method. Specifically:
• it answers a research question;
• it is protocol driven;
• an explicit search strategy is used to identify all possible research evidence;
• an explicit set of criteria are used to select studies for inclusion in the review;
• a coding tool is used to obtain the same information about all the studies
included in the review;
• this information is used to make a judgement about the quality and relevance
of a particular study to the review question;
• the results of the individual studies are synthesised in a systematic and
transparent manner to generate a ‘new’ and/or summary answer to the
review question.[2]
The remainder of this article provides a summary of the findings of this review.
170
DOES THE SIZE OF A SECONDARY SCHOOL MATTER?
Overall the results suggest a quadratic association between school size and
student absence. That is, absence decreases as school size increases up to a
certain point but then appears to increase. None of the studies examined
variation on this outcome (or any of the subsequent outcomes reported below)
by age or SES.
The summary of directions of effect for school size and student behaviour
in Figure 1 illustrates the inconsistency of results in the included studies. In
some studies there was increased ‘ violence’ in larger schools; for other studies
the association was in the opposite direction, i.e. there was more ‘violence’ in
smaller schools. Different studies use different definitions of violent or anti-
social behaviour and different methods of data collection, either of which may
explain the different directions of effect reported.
171
Mark Newman
Studies measuring what students and teachers thought about their school
found a negative association between school size and this outcome, despite
different conceptualisations, outcome measures and instruments used. Such a
pattern of results suggests that we can be fairly confident that teachers and
students in smaller schools have more positive perceptions of the school climate
than their counterparts in larger schools.
In all studies measuring the association between school size and costs, the
‘costs’ measured were limited to public expenditure on schools. The pattern of
results here suggests that as school size increases the school’s cost per pupil
decreases. The size of the association between average secondary school size
and costs differs slightly between studies. An increase in school size of 10 per
cent is estimated to reduce costs per student by between one per cent and four
per cent depending on the definition of cost used.
Discussion
When considering the implications of the results provided by the systematic
review it is important to take into account its limitations. The remit of this
review extended only to a consideration of studies that investigated empirically
the association between an outcome variable and school size. It is also important
to note that studies from the USA about the division of larger schools into much
smaller schools (so called ‘schools-within-schools’) were excluded from the
review because they did not meet the criteria for inclusion.
The review process itself had a number of limitations. Comparatively
limited searches were undertaken and we were not able to obtain all of the
papers identified. It is difficult to estimate the impact of this. A simple
preliminary analysis of the sensitivity of the bibliographic database search found
that between 60 and 70 per cent of papers cited in the included studies had
been identified. The design of studies included in the in-depth review allowed
for sophisticated analysis of the degree of association between the dependent
variable (for example, attainment) and school size. However, the studies did not
assign students or teachers at random to different size schools (i.e. they did not
use an experimental design), and therefore may be affected by selection bias.
Conclusions about causality must therefore be considered tentative.
Different studies use different analytical models, different methods of
analysis and different methods of constructing both the dependent and
independent variables. Making comparisons across studies is therefore difficult,
even when they use the same dependent variable. There are also differences in
the socio-economic and cultural contexts of schooling in different countries.
Taken together, these differences may limit the generalisability of conclusions
about the ‘effects’ of school size on school outcomes.
Another important limitation of the findings is that the individual studies
in the review only measure a limited range of outcomes. Attainment, for
example, is measured only in terms of performance in tests and examinations,
which is only one aspect of attainment. Similarly, the costs of schooling are
172
DOES THE SIZE OF A SECONDARY SCHOOL MATTER?
measured only in terms of the financial costs to government. School size impacts
on a much wider range of costs and benefits than those included in existing
studies.
Conclusions
The systematic review was concerned with the overall relationship between
secondary school size and outcomes. In terms of the overall relationship, i.e.
across all outcomes, the association with school size would appear to be
inconsistent. In practical terms this suggests that for some types of outcomes
larger schools do better than smaller schools and for others smaller schools do
better.
Three key issues require further consideration. First, to be of practical
value we would need to know at what school size attainment is likely to be
maximised and absence (or student drop-out) is minimised. Being confident that
the relationship is quadratic does not tell us very much. For example, a
quadratic relationship with an optimal size range of about 400 students may
have quite different implications to one where the optimal range is about 2,000
students. As we have seen earlier, an optimum size range of 2,000 would
include just about all secondary schools in England and so would not be
particularly useful. The studies included in this review do not provide a clear
answer to this question. Second, we need to know whether the directions of
‘effect’ based on the ‘average’ secondary school apply to all types of secondary
school and/or subgroups of particular students. Third, we need to know the
‘effect’ on outcomes of changing the size of individual schools. Such an analysis
would need to include not only the effects on the school that had changed size
but also effects on neighbouring schools. Only two studies in the systematic
review attempted this. Bradley & Taylor (1998, 2004) provide empirical
evidence that schools which perform well (according to GCSE point scores)
relative to neighbouring schools grow more quickly in size than schools that
perform badly. What these studies do not tell us, however, is how changes in
school size within localities affected the overall performance of students in those
localities, nor was it clear in these studies whether higher GCSE performance
led to increased enrolment or higher enrolment led to increased GCSE
performance.
The findings of the systematic review would seem to refute some of the
more prevalent myths regarding the advantages and disadvantages of smaller
and larger schools. For example, the view that student attainment is universally
higher in smaller schools and that student behaviour is universally worse in
larger schools is inconsistent with the evidence in the systematic review. These
relationships appear to be much more complex than such simple arguments
suggest.
The EPPI-Centre review on secondary school size does not provide strong
evidence to support policy initiatives that aim to either increase or decrease the
size of schools and/or to close or change the structure of schools below or
173
Mark Newman
above a certain size. The review findings suggest that for some outcomes, there
may be advantages for smaller schools whilst for other outcomes larger schools
may be more advantageous. There are also a number of qualifications that need
to be taken into account when considering the practical application of these
results. Firstly, the ‘effects’ of changing school size within a single school and
the upheaval associated with this are not identified or investigated in this
review. Secondly, many of the associations (even if they are statistically
significant) are comparatively weak, and other factors are shown to be as
important or more important in predicting the outcome variable. In particular,
whilst many studies found a statistically significant association between school
size and attainment, this was found to be considerably weaker than the
association between SES and attainment across all the studies in the review.
The issue of school size continues to excite interest amongst policy
makers, campaigners, researchers and parents. This is not surprising given
continuous changes in demographic profiles, continuing concern over
inequalities in educational attainment and continued emphasis on economic
efficiency. Further work is need in this area, both quantitative and qualitative.
Since the systematic review was published, economists at OECD have analysed
data from the PISA study and suggested that larger schools are more ‘efficient’
(Sutherland & Price, 2007). Economists at the Centre for the Economics of
Education have analysed a new combination of large-scale, individual-level
administrative datasets linked by the Department for Children, Schools and
Families and the Department for Innovation, Universities and Skills including
data from the National Pupil Database and Pupil Level Annual School Census.
They argue the results of their analysis suggest that larger schools are more
effective at getting their pupils to University (Chowdry et al, 2008).
However ‘efficiency’ at obtaining exam grades, or getting to university,
are not the only things we might take note of when considering how big or
small we want our secondary schools to be. We might also be interested in
wider aspects of children’s education and want to know about non-
governmental ‘costs’ such as costs to families and communities of changes in
school size. Consolidation of any kind may lead to more travel for students
and/or loss of school buildings for community use for example. It is therefore
important that any claims made about the association between school size and
outcomes continue to be critically and systematically investigated using a range
of different perspectives.
Notes
[1] The Department for Education and Skills (DfES) and HM Treasury (the UK
government department responsible for much economic and financial policy) in
England funded the review, set the initial scope, and were involved in refining
the research questions in collaboration with the research team.
[2] Interested readers can find out more about how to conduct systematic reviews
on the methods pages of the EPPI-Centre website
174
DOES THE SIZE OF A SECONDARY SCHOOL MATTER?
Acknowledgements
The systematic review referred to in this article was completed by the author
with colleagues: Zoe Garrett, Diana Elbourne (EPPI-Centre), Ann West, Philip
Noden (London School of Economics), Steve Bradley & Jim Taylor (University
of Lancaster). The review was funded by the DfES (now DCSF) and HM
Treasury.
References
Bradley, S. & Taylor, J. (1998) The Effect of School Size on Exam Performance in
Secondary Schools, Oxford Bulletin of Economics and Statistics, 60(3), 291-324.
http://dx.doi.org/10.1111/1468-0084.00102
Bradley, S. & Taylor, J. (2004) The Economics of Secondary Schooling, in G. Johnes &
J. Johnes (Eds) International Handbook of Education Economics. Cheltenham: Edward
Elgar.
Chowdry, H., Crawford, C. & Vignoles, A. (2008) Widening Participation in Higher
Education: a quantitative analysis, Building Research Capacity, 13, 8-11.
Cotton, K. (1996) School Size, School Climate and Student Performance. North West Regional
Educational Laboratory. http://www.nwrel.org/scpd/sirs/10/c020.html (accessed
10 March 2008).
Darling-Hammond, L., Ancess, J. & Ort, S. W. (2002) Reinventing High School:
outcomes of the coalition campus schools project, American Educational Research
Journal, 39(3), 639-673. http://dx.doi.org/10.3102/00028312039003639
Department for Children, Schools and Families (DCSF) (2007) Schools and Pupils in
England, January (Final)
http://www.dcsf.gov.uk/rsgateway/DB/SFR/s000744/index.shtml (accessed 14
April 2008).
Garrett, Z., Newman, M., Elbourne, D., Bradley, S., Noden, P., Taylor, J. & West, A.
(2004) Secondary School Size: a systematic review.
http://eppi.ioe.ac.uk/cms/Default.aspx?tabid=320 (accessed 13 May 2008).
McGuire, K. (1989) School Size: the continuing controversy, Education and Urban Society,
21(2), 164-174. http://dx.doi.org/10.1177/0013124589021002005
McKenzie, P. (1995) Scale Economies in Australian Secondary Schools, Australian
Journal of Education, 39(2), 109-125.
175
Mark Newman
Muir, E. (2000) Smaller Schools: how much more than a fad?, American Educator,
Winter, 40-46.
Newman, M., Garrett, Z., Elbourne, D., Bradley, S., Noden, P., Taylor, J. & West, A.
(2006) Does Secondary School Size Make a Difference? A Systematic Review,
Educational Research Review, 1(1), 41-61.
http://dx.doi.org/10.1016/j.edurev.2006.03.001
Spielhofer, T., O’Donnell, L., Benton, T., Schagen, S., & Schagen, I. (2002) The Impact
of School Size and Single-Sex Education on Performance. Slough: National Foundation for
Educational Research.
Sutherland, D. & Price, R. (2007) Linkages between Performance and Institutions in the
Primary and Secondary Sector. Economics Department working papers No. 558
ECO/WKP(2007)18.
http://www.olis.oecd.org/olis/2007doc.nsf/ENGDIRCORPLOOK/NT00002C
0A/$FILE/JT03228886.PDF (accessed 10 March 2008).
Tasker, M. (2003) Smaller Structures in Secondary Education: a research digest. Bristol: Human
Scale Education.
176