Understanding and Job Quality: Measuring
Understanding and Job Quality: Measuring
Understanding and Job Quality: Measuring
Understanding
measuring
and
job quality
The CIPD is the professional body for HR and people
development. The not-for-profit organisation champions
better work and working lives and has been setting the
benchmark for excellence in people and organisation
development for more than 100 years. It has more than
145,000 members across the world, provides thought
leadership through independent research on the world of
work, and offers professional training and accreditation for
those working in HR and learning and development.
Understanding and measuring job quality
Research report
Part 2 – Indicators of Job Quality
Contents
Foreword 2
Executive summary 3
Introduction 5
1 Data sources 6
2 Methodological issues 14
3 International indexes to measure job quality comparatively 18
4 Indicators mapped to key dimensions of job quality 20
Concluding remarks 23
References 26
Websites for data sources 30
Acknowledgements
This report was written by Sally Wright, Chris Warhurst, Clare Lyonette and Sudipa Sarkar,
from the Institute for Employment Research, the University of Warwick.
Introduction
This report maps indicators which,
Methodological issues
Additionally, there are at least six
‘There have been a
alongside other measures, might methodological issues to consider number of efforts
be used to inform an index of when aiming to operationalise a
job quality. Current and potential conceptually sound measure of to measure job
future measures and indicators of job quality: (1) focusing on what
job quality are investigated and is to be measured; (2) deciding
quality at the
evaluated. The report identifies a
number of appropriate international
on the approach to take; (3)
choosing whether to develop a set
international
and UK datasets which might of indicators or a composite index; level and using
help to map trends in job quality (4) deciding whether to construct
longitudinally, assesses the quality a measure of job quality at either a indicators that,
and availability of this data for macro or micro level; (5) deciding
comparative purposes and makes whether any set of indicators in principle,
suggestions for the development of
an index of job quality.
or index of job quality needs to
include a dynamic dimension;
could allow
and (6) choosing whether, and if cross-national
Development of an index of so, how, to assign weights to the
job quality raises a number of dimensions and indicators. comparisons.’
challenges. At a practical level, the
development of indexes tends to International indexes
be driven by pragmatism, most to measure job quality
notably the availability of data. comparatively
What is conceived as job quality There have been a number of
is therefore based on what can efforts to measure job quality at
be feasibly measured, and any the international level and using
measure of job quality is limited indicators that, in principle, could
to operationalisation via the set of allow cross-national comparisons.
available indicators. Most of the existing indexes tend
to rely on numerous indicators
Data sources of a different nature. There is an
Eight cross-national data sources issue about the comparability of
and four UK-specific data sources these indicators across countries,
are reviewed. For each data socio-demographic groups and
source, a brief outline is provided, time, as well as their adequacy for
indicating their origin, purpose, policy purposes.
periodicity, access/availability,
country coverage, contents, level Two job quality indexes are
or unit of analysis, and respective of particular relevance, both
strengths and weaknesses. None created using European data but
of the data sources were solely or differing in terms of the data and
specifically designed to measure weightings used, the number
job quality and none alone cover of dimensions captured, and
the full range of aspects of work whether a single index or set of
and employment that comprise sub-indexes were constructed. The
jobs which would enable the first is Leschke et al’s ETUI-REHS
construction of a desirable Job Quality Index; the second
measure of job quality. is Muñoz de Bustillo et al’s Job
Concluding remarks
There is no dataset dedicated
to measuring job quality, either
in the UK or internationally.
Nonetheless, there are a number
of data sources which can be
drawn upon to create an index
(or set of indicators). Efforts to
operationalise indexes of job
quality have all, to a greater or
lesser degree, been hampered
by the availability and content
of suitable data. Important
methodological insights are
The CIPD is committed to help map trends in job quality existing datasets. From the scope
supporting better working lives. longitudinally. It also assesses of the contents of those datasets,
Work and employment can be the quality and availability of this indicators are selected and
transformative for individuals, data for comparative purposes. information pertaining to those
their families, their employers and Drawing on this information, indicators input into the model
for society as a whole. A number the report makes suggestions for through the dimensions.
of recent changes to work and the development of an index of
employment, and concerns about job quality. This report follows this logic.
sustainable economic growth in The next section identifies and
the UK, have triggered debate Development of an index of job evaluates appropriate sources
about job quality in the UK and quality raises both conceptual of international and UK datasets
possible interventions to improve and practical challenges. Part 1 which could be used to map
it. Indeed, in signing the Ankara (ibid) outlined the conceptual trends in job quality and related
Declaration in 2015, the UK is now dynamism and outlined the factors in the UK. The following
formally committed to improving family of concepts associated section sets out a number
job quality (see Warhurst 2017). with job quality. Given that the of methodological issues in
UK and other leading economies developing an index. The third
As yet, however, there is no have committed to improving provides examples of international
consensus amongst academics job quality while no concept indexes that attempt to measure
or policy-makers about the agreement exists, it is hard to job quality comparatively.
definition, operationalisation and then develop indexes with models Evaluating the key available
measurement of job quality either of measurement. There is a need datasets, the final section maps
in the UK or internationally (Wright to address this problem. indicators to the six dimensions
2015). The aim of the CIPD’s of job quality recommended in
feasibility study on job quality is A useful step would be the Part 1 of this review (Warhurst et
twofold: first, and undertaken in organisation of a national or al 2017). The concluding section
Part 1 of this review (Warhurst et international workshop or even outlines a number of options for
al 2017), to increase understanding summit of policy-makers, the CIPD in its deliberations about
and inform the CIPD’s position practitioners and academics further work on developing an
about what good job quality committed to developing index of job quality.
looks like; in turn, to inform media agreement of the definition,
discussion, policy-making, research operationalisation and
and actual people management in measurement of job quality. This
organisations; and second, to map task is one for the future. In the
indicators which, alongside other meantime, on a practical level, the
measures, can be used to inform development of indexes that
an index of job quality. involve the definition,
operationalisation and
This report furthers the CIPD’s measurement of job quality tend
second aim and builds on the to be driven by pragmatism, most
dimensions of job quality outlined notably the availability of data
in Part 1 (ibid). It investigates (Muñoz de Bustillo et al 2011).
measures or indicators of job What is conceived as job quality is
quality, evaluating current therefore based on what can be
indicators and considering future feasibly measured. The logic
potential indicators. It also driving the modelling and
identifies appropriate UK and measurement of job quality is first
international datasets which might determined by the contents of
Origin Conducted by the European Foundation for the Improvement of Living and Working Conditions
(Eurofound), an agency of the European Commission.
Purpose A cross-sectional survey which focuses on working conditions and the quality of work of employees and the
self-employed.
Periodicity Administered every five years; the sixth and latest wave conducted in 2015 (with 5th in 2010; 4th in 2005;
3rd in 2000; 2nd in 1995/96; and 1st in 1990/91).
Country Number and type of countries covered has expanded with each wave. Latest survey covers workers in the
coverage EU28, Norway, Switzerland, Albania, the former Yugoslav Republic of Macedonia, Montenegro, Serbia and
Turkey.
Contents Scope of the questionnaire has widened substantially since its first edition. Themes now include
employment status, working time duration and organisation, work organisation, learning and training,
physical and psychosocial risk factors, health and safety, work–life balance, worker participation, earnings
and financial security, as well as work and health.
Level or unit of Micro-level (that is, individual worker) which can be aggregated to national level and disaggregated by
analysis groups of workers (that is, gender, industry, and so on).
Strengths/ The strength of the EWCS is that it offers detailed indicators to measure job quality at the micro level.
weaknesses Its main weaknesses are that it is only conducted every five years, some questions are not held constant
in successive surveys, there are small sample sizes for individual countries, and there are incomplete
indicators for some dimensions (that is, voice and representation). In addition, wages are not adequately
covered (data are missing for many countries or the sample counts are too small for meaningful analysis).
Importantly, it is not clear at this time if ongoing UK participation will occur post-Brexit.
Origin Conducted by the European Foundation for the Improvement of Living and Working Conditions
(Eurofound), an agency of the European Commission.
Purpose Aims to examine both the objective and subjective circumstances of European citizens’ lives and how they
feel about those circumstances and their lives in general.
Periodicity Every four years, 2003, 2007, 2011–12, 2017 (forthcoming). In addition, a number of questions from 2nd
EQLS were asked as part of Eurobarometer survey in 2009 (study of trends in quality of life in the EU:
2003–09).
Access/ Questionnaires and datasets freely available to the public. Survey datasets are made available not later than
availability two years after fieldwork completion. Online and available through UK Data Service.
Country 28 EU member countries plus all five candidate countries (that is, Albania, former Yugoslav Republic of
coverage Macedonia, Montenegro, Serbia and Turkey).
Contents The survey examines a range of issues including employment, income, education, housing, family, health,
work–life balance. It also looks at subjective topics such as people’s levels of happiness, how satisfied
they are with their lives, and how they perceive the quality of their societies. Includes sets of indicators to
complement traditional indicators of economic growth and living standards, such as GDP and income.
Strengths/ High-quality cross-national comparative data for European countries, multiple waves enabling trend
weaknesses analysis, online data visualisation tools. Importantly, it is not clear at this time if ongoing UK participation
will occur post-Brexit.
Origin Run by a self-funded association established in 1984. Institutional members, each representing one nation,
consist of academic organisations, universities or survey agencies. The National Centre for Social Research
(NatCen) is a founding member of the ISSP and the UK’s investigator. The UK survey that feeds into the
ISSP is the British Social Attitudes Survey.
Purpose An annual programme of cross-national collaboration on surveys with rotating thematic modules on a
range of topics related to social sciences. The topics covered are: role of government, social networks, social
inequality, family and changing gender roles, religion, environment, national identity, citizenship, health care
and work orientations.
Periodicity Established in 1984. Since 1985, an ISSP module has been included in the British Social Attitudes Survey. The
Work Orientation Module is only conducted every ten years (I- 1989, II- 1997, III- 2005 (BSA 33), IV- 2015, due for
release in July 2017). In 2012, Family, Work and Gender Roles (BSA 30, Qs 1a–33) was chosen as an ad hoc topic.
Access/ Archived in the Leibniz Institute for the Social Sciences (GEISS) data archive. GEISS provides the data, its
availability documentation and support for external users. Datasets are also available at various national archives. The
UK Data Service holds data for the UK.
Country Currently 47 countries are members of the ISSP, including the UK.
coverage
Contents The work orientations module has four topic areas: working conditions, labour relations/conflict,
unemployment and employment.
Level or unit of Micro-level (that is, individual worker) which can be aggregated to national level and disaggregated by
analysis groups of workers (that is, gender, industry, and so on).
Strengths/ Work Orientation Module is only conducted every 10 years (I- 1989, II- 1997, III- 2005, IV- 2015).
weaknesses
Origin Quality of Jobs and Innovation Generated Employment Outcomes (QuInnE) is a pan-European project funded
by the EU’s Horizon 2020 programme. Six countries are represented: Germany, Hungary, the Netherlands, Spain,
Sweden and the UK. The UK team is led by the Institute for Employment Research at Warwick University.
Purpose Using EWCS and EU LFS data, with additional data from the EU Structure of Earnings Survey and the
European Statistics on Accidents at Work, QuInnE has produced an online map of job quality (as well as
innovation and employment outcomes) for 22 EU countries.
Periodicity The QuInnE map draws on various data sources (EWCS 2010; Structure of Earnings Survey 2012; EU LFS 2012,
2013; OECD 2012; European Statistics on Accidents at Work 2012). No plan yet for regular updating of data.
Contents Brings together data from various sources into a synthetic index of job quality. Nested structure of 19 indicators of job
quality across 6 dimensions: wages, employment quality, education and training, working conditions, work–life balance
and gender equality, and collective interest representation. Job quality is measured through objective and subjective
indicators (relying on workers’ perceptions). Wages are expressed in euros for cross-national comparability. Three
classifications (or clusters) of job quality have been developed and applied to data for the 22 countries.
Level or unit Macro-level. Possible to graphically chart individual indicators for a selected country and visually compare them
of analysis with other EU countries as well as EU maxima/minima/averages.
Strengths/ Underpinned by new data analysis, the online mapping tool allows classification of job quality (as well as innovation
weaknesses and employment outcomes) into ‘job quality clusters’ based on a country’s relative position in their cluster. Useful
data source with analysis based on a definition of job quality aligning with existing literature and with job quality
measured through objective as well as subjective indicators. Easy-to-use mixture of online visual and textual data.
Sample limited to 22 EU countries for two reasons: first, missing data within country datasets; and, second, to aid
comparability. It is also aggregate-level data so not possible to compare job quality among different groups of
workers. It is also a static, single snapshot analysis, with no plan yet for regular updating of data.
Origin Directed by a Core Scientific Team led by City University, London, alongside six other partner institutions.
Purpose A cross-national survey measuring a wide range of attitudes, beliefs and behaviours consisting of a collection
of questions that can be classified into two main parts: a core section and a rotating section.
Access/ NSD (Norwegian Centre for Research Data, Norway) manages the data archive and distribution of ESS data.
availability The data are available without restrictions for not-for-profit purposes.
Contents Measures a wide range of attitudes, beliefs and behaviours of respondents. Of particular relevance to job
quality is rotating module on Family, work and well-being (ESS2 in 2004 & ESS5 in 2010). This module aims to
contribute to measurement of both the quality of jobs and social inclusion. It includes objective indicators for
measuring job characteristics, family structure and welfare with indicators of attitudes and life satisfaction in
order to measure how European citizens experience their jobs, families, and lives in the context of their values
and preferences.
Strengths/ High-quality cross-national comparative data for European countries; separate study of working life and
weaknesses family and how these areas interact (that is, work–life balance). Includes indicators for atypical work and skill
upgrading. The main weakness is infrequency of data collection.
Origin Eurostat
Purpose The EU-SILC is the main source for the EU statistics on income, social inclusion and living conditions. It also
collects micro data on income, poverty, social exclusion, housing, labour market, education and training, and
health.
Periodicity Annual harmonised cross-sectional micro-data from 2004 – latest release 2014. Harmonised longitudinal
datasets released 2013. Special module on well-being in 2013.
Access/ Access to Eurostat microdata (including EU-SILC) is restricted and granted for scientific purposes only to
availability recognised research entities such as universities, research institutions or research departments in a public
administration, bank or statistical institute. Cross-sectional data for the UK is available.
Country EU countries plus Norway, Iceland, Bulgaria, Romania, Switzerland and Turkey.
coverage
Contents Cross-sectional data for variables on income, poverty, social inclusion and other living conditions, and
longitudinal data on individual-level changes observed over a four-year period.
Level or unit of Micro data where the sampling design varies, depending on the participating countries (dwelling, address,
analysis household or individuals used as sampling units).
Strengths/ Contains data for monthly earnings for men and women. Contains cross-sectional and longitudinal micro
weaknesses data. Sampling unit varies between countries. Not as timely as EU-LFS data and currently a number of EU
countries only provide net (not gross) figures on monthly earnings.
Origin LFS surveys collected by national statistics institutes across Europe, centrally processed by Eurostat.
Purpose The EU LFS is a large household sample survey that is the main source for statistics on employment and
unemployment.
Periodicity Quarterly with yearly data for many indicators, 1983 onwards.
Access/ Access to Eurostat micro data (including EU-SILC) is restricted and granted for scientific purposes only to
availability recognised research entities such as universities, research institutions or research departments in a public
administration, bank or statistical institute.
Country 33 countries including EU 28 countries (plus 3 EFTA countries of Iceland, Norway and Switzerland, and 2 EU
coverage candidate countries of the Former Yugloslav Republic of Macedonia and Turkey).
Contents Includes data on population, employment, working time, permanency of the job, professional status, and
the data is broken down by age, sex, education level, economic activity and occupation (where applicable).
Strengths/ Timely release; results are harmonised, making comparability between EU countries easier; data are
weaknesses disaggregated by gender, covers all industries and occupations.
Origin Eurostat
Purpose To provide accurate and harmonised data on earnings in EU member states, candidate countries and EFTA
countries for policy-making and research purposes.
Periodicity Four-yearly (2002, 2006 and 2010; 1995 micro data for 6 countries, not including the UK).
Access/ Access to Eurostat micro data is restricted and granted for scientific purposes only to recognised research
availability entities such as universities, research institutions or research departments in a public administration, bank
or statistical institute.
Country 33 countries including EU 28 countries (plus 3 EFTA countries of Iceland, Norway and Switzerland, and 2 EU
coverage candidate countries of the Former Yugloslav Republic of Macedonia and Turkey).
Contents Indicators for occupation, type of pay agreement, tenure, working time arrangements, type of employment
contract, earnings, overtime, bonus arrangements, payment-in-kind, shift penalties, social contribution by
employer, taxes and average gross earnings.
Level or unit of Micro data at establishment level for enterprises with at least 10 employees. Excludes public administration.
analysis
Strengths/ Timely release; results are harmonised, making comparability between EU countries easier; data are
weaknesses disaggregated by gender, covers all industries and occupations. Excludes enterprises with fewer than 10
employees and public administration.
Origin Jointly run by Department for Business, Innovation and Skills (BIS), the Economic and Social Research
Council (ESRC), the Advisory, Conciliation and Arbitration Service (Acas) and the UK Commission for
Employment and Skills (UKCES).
Purpose Nationally representative survey of British workplaces with at least 5 employees. Aims to map workplace
employment relations in Britain and examine changes over time for a broad range of employment
practices across most sectors of the UK economy; inform policy development and practice and provide a
comprehensive dataset on British workplace employment relations.
Periodicity No set periodicity. Frequent but not regular starting from 1980 (1980, 1984, 1990, 1998, 2004 and 2011).
Cross-section data (1990–98), panel data (1990–98) and time series data (1980–2011). High-involvement
management, employee well-being and organisational performance data (2004).
Access/ Data have been made publicly available. Six rounds of datasets available: 1980, 1984, 1990, 1998, 2004 and 2011.
availability
Country Britain
coverage
Contents Includes an employer survey but of most interest is the Survey of Employees Questionnaire (SEQ) which
is administered to up to 25 staff at each workplace on topics including intrinsic characteristics, terms of
employment, work–life balance and voice/representation. The Employee Profile Questionnaire (EPQ) contains
a total of 16 questions which collect key information about the size and structure of the workforce. The Worker
Representative Questionnaire (WRQ) covers representation at the workplace and employee involvement.
Level or unit of Linked employer–employee representative–employee micro data. Up to 25 randomly selected employees
analysis are administered the SEQ at each workplace.
Strengths/ Data are available for several years from 1980 in cross-sectional, panel and linked formats but sampling
weaknesses does not include workplaces with fewer than 5 employees and excludes agriculture, the hunting and fishing
industry, and mining and quarrying industries. Regardless of organisation’s size, a maximum of up to 25
employees are surveyed at each establishment. Number of other countries emulated variant of survey but
WERS only covers Britain. Given its single-country focus, cross-national comparisons are limited. There
is no set periodicity. Moreover, responsibility for skills has now shifted from BIS into the Department for
Education, and UKCES closed in March 2017. At this time, it is not clear if (and if so, when) there will be
further waves of the survey.
Purpose The primary objective is to provide information on skills and measure 10 generic skills in addition to
computing skills along with issues such as quality of work, training and skills development, and terms and
conditions of employment.
Periodicity Every 4–6 years (1986, 1992, 1997, 2001, 2006 and 2012).
Access/ The six surveys are all available separately from the UK Data Archive. A special licence access version of the
availability study may become available in the future.
Contents The main topics include skills at work, quality of work, training and skills development, and terms and
conditions of employment.
Strengths/ Good coverage of indicators for several key dimensions of job quality. Although not originally planned as
weaknesses part of a series and had different funding sources, continuity in questionnaire design has meant the surveys
provide a nationally representative picture of change in British workplaces as reported by individual job-
holders. Whether, and if so when, the next wave of the survey might be run is not known.
Origin Closure of the UK Commission for Employment and Skills (UKCES) in March 2017 saw responsibility for
running the survey shift to the Department for Education (DfE).
Purpose To provide a comprehensive picture of skills needs and training investment including vacancies and skill
shortages, employee skill gaps and the recruitment of education leavers and young people.
Periodicity Every two years since 2011 (1st ESS 2011; 2nd ESS 2013; 3rd ESS 2015; 4th 2017 – due for release in 2018).
Access/ Data available with special licence access under the Open Government Licence via the UK Data Service.
availability
Country UK (prior to 2010, each nation in the UK gathered their own labour market intelligence; now aligned into
coverage one UK-wide survey).
Contents Topics covered include establishment characteristics; recruitment vacancies; demand for skills and skills
gaps; hard-to-fill vacancies; workforce development and training; skills utilisation and high-performance
working; and business strategy and structure.
Strengths/ Provides an employer perspective on several aspects of job quality and includes indicators aimed at
weaknesses measuring high-performance working by sector, size and geography and related to training activity, skill
deficiencies and product market strategies. Does not include establishments with fewer than 2 employees.
Origin Conducted by the Institute for Social and Economic Research (ISER), Essex University.
Purpose Multi-topic panel study of UK households aimed at understanding twenty-first-century UK life and how it
is changing at the individual and household level. Primarily, data collected are used to produce research to
inform social, economic and health policy and practice in the UK and abroad.
Periodicity Annual, beginning 1991 (in 2009 it replaced British Household Panel Study).
Country UK
coverage
Contents The survey covers a wide range of themes including employment status, income, job satisfaction,
employment history, health, well-being, family, education and finance.
Strengths/ Timely annual survey, although not specifically designed to measure job quality. Britain’s ethnic and
weaknesses immigrant groups are fully represented in the study.
Putting aside practical constraints job quality indicators has proven 2 The second is described as ‘an
with the existing datasets, there to be extremely detrimental to intermediate option’ in which
are, in addition, a number of the relevance and usefulness of workers are asked what they
methodological issues to consider indicators,’ they state. consider as being important
when aiming to operationalise a for job quality, and then using
conceptually sound measure of job To this end, Muñoz de Bustillo et their answers to model job
quality. These include: al (2011) argue strongly for strictly quality. An advantage to this
limiting indicators to those aspects approach is that most surveys
1 focusing on what is to be of the job that have a clear and include questions about the
measured direct impact on the well-being desirability of specific job
2 deciding on the approach to take of workers. Their concept of job attributes. As a consequence,
3 the use of objective or subjective quality includes the characteristics there is a significant volume of
indicators of the work performed and its data drawn from workers that
4 whether to use a set of indicators environment (which they call the is available for analysis. While
or a composite index ‘work’ dimension, including among this approach gives workers a
5 deciding whether to construct a other things the level of autonomy voice in the definition of what
measure of job quality at either a at work, as well as its social and makes a good job, it requires
macro or micro level physical environment). It also presenting workers with a
6 deciding whether any set of includes the characteristics of the predefined set of options
indicators or index of job quality contractual conditions under which (attributes to be ranked).
needs to include a dynamic the work is undertaken (which they However, the identification of
dimension call the ‘employment’ dimension, the elements to be included in
7 whether, and if so how, to assign and includes pay, contractual the list is almost as tricky as the
weights to the dimensions and stability and development model of job quality itself, and
indicators. opportunities, among other things). leaving out important elements
can have a ‘disastrous effect
Each of these issues is briefly Approaches on the modelling of job quality’
discussed in turn below. There are three main approaches (Muñoz de Bustillo et al 2009,
to measuring job quality. p13).
Focus
As we noted in Part 1 of this 1 The first is described by Muñoz 3 The third approach, and the
review (Warhurst et al 2017), the de Bustillo et al (2009) as a one advocated by Muñoz de
measurement of job quality by ‘shortcut’ approach that focuses Bustillo et al, draws on the
some researchers has included on an overall indicator of job many different perspectives
dimensions and indicators that are quality. Instead of focusing on and approaches in the social
not strictly properties of the job. the characteristics of the job to sciences’ literature on how
For example, certain dimensions assess job quality, attention is work and employment affects
are concerned with labour market paid to measuring the output – the well-being of workers. This
conditions, organisational context the well-being of the worker in literature is then used as the
and with outcomes at the individual the job. With this approach, job initial driver for developing the
level (for example job satisfaction, satisfaction is used as an overall model, with this model then
engagement, life satisfaction) and indicator or proxy for job quality. being used as the background
at the organisational level (for While it is a simple approach, for any indicator/s of job quality
example economic performance, job satisfaction serves as a ‘very (p13). In other words, it is an
productivity). Muñoz de Bustillo et unsatisfactory indicator of job evidence- and conceptually-
al (2009, p25) call for a ‘purging’ quality’ (p12) because there are based approach. Because it
of variables that do not directly many other variables not related offers evidential and conceptual
affect job quality: ‘the practice of to job quality that can affect the legitimacy, it is this approach
“anything goes” in constructing level of job satisfaction. that we recommend.
There have been a number of and sometimes over time. At the and collective interest
efforts to measure job quality international level, macro-level representation and participation
at the international level and to indexes have been produced (for (Leschke and Watt 2008).
collect indicators that, in principle, example Standing 2002, Bonnet
could allow cross-national et al 2003, Ghai 2003). Similarly, It was developed for the 27 EU
comparisons (Cazes et al 2015). there are indexes that have used countries and was operationalised
However, further efforts are still data from EU27 countries (for using 2005 and 2006 data from
needed to design an operational example Curatarelli et al 2014, multiple sources. This method of
framework to assess and monitor Hurley et al 2012, Leschke and coupling together various sources
job quality which is flexible enough Watt 2008, Leschke et al 2008, of data is known as a synthetic
to be applied in various contexts, Erhel et al 2012). In addition, index. The index is compiled on the
while maintaining the fundamental indexes have been developed basis of six sub-indices. In terms
principles and key dimensions using data from one country (for of weights, Leschke et al (2008)
and allow disaggregation to take example Berglund 2014, Gallie assigned their own normative
account of distributional issues, as 2013, Vidal 2013, Osterman and weights to items with equal
many of the existing international Shulman 2011, Kalleberg 2011, weighting applied to each of the
efforts only provide aggregate Holzer et al 2011) or several six dimensions when aggregated
measures (for example ILO, countries (for example Cloutier- into an overall index of job quality.
UNECE, ETUI and so on). Villeneuve 2012, Olsen et al 2010, The ETUI-REHS JQI was updated
Gallie 2007, Clark 2005). in 2010, allowing for a comparison
In addition, most of the existing of job quality before and after
indexes tend to rely on numerous Two job quality indexes are of the global financial crisis (GFC)
indicators of different nature particular relevance. Both are (Leskhke et al 2012).
(for example Leschke and Watt created using European data but
2008). A question then arises they differ in terms of the data While separate results are produced
about the comparability of these used (that is, macro- or micro-level for women, men and overall,
indicators across countries, socio- data), the number of dimensions because this index uses macro-level
demographic groups and time, captured, the use of a single index data, it does not allow for a detailed
as well as their adequacy for or set of sub-indexes and the analysis of the distribution of job
policy purposes. In the case of importance placed on the different quality within each country (Muñoz
the ILO and UNECE frameworks, dimensions (that is, weights). The de Bustillo et al 2009).
both have very wide scope construction and merits of each
and combine measures of both index are discussed below. Muñoz de Bustillo et al’s Job
outcomes of job quality (such Quality Index
as earnings) and drivers of job The European Trade Union Stating that none of the existing
quality (such as characteristics of Institute for Research, indexes had been accepted as
the industrial relations system). At Education and Health and standard measures of job quality,
the same time, some important Safety (ETUI-REHS) Job Muñoz de Bustillo et al (2011)
attributes of job quality, such as Quality Index used the EWCS to construct
lack of autonomy at work and The ETUI-REHS Job Quality Index their Job Quality Index. The
representation/voice, are either is a macro-level index created construction of the index is based
not covered or not fully covered, to compare job quality between on selecting dimensions according
often because of a lack of data countries. The underlying model to a theoretical model based on
availability or a lack of comparative captures six dimensions of job empirical research. The model is
information (Cazes et al 2015). quality: wages, non-standard restricted to information about
forms of employment, work–life the attributes of jobs, not of the
A number of job quality indexes balance and working time, working workers who hold these jobs, and
have been developed that enable conditions and job security, access it does not include any contextual
comparisons between countries to training and career advancement, information. The dimensions
Orientation (2015)
Society (UKHLS)
Earnings Survey
Understanding
UK SES (2015)
EWCS (2015,
WERS (2011)
EES5 (2010)
EQLS (2016,
Structure of
ISSP Work
4th wave)
6th wave)
EU-SILC
EU-LFS
QuInnE
Dimensions
Objective ()
Subjective (for example pay
satisfaction)
Non-wage rewards
Intrinsic characteristics of work
Contract stability
Opportunities for training and
development, progression ()
Perception of job security
Health and safety
Scheduling ()
Working time arrangements ()
()
2004,
Flexibility 2010 and
forthcoming
Representation ()
Involvement in decision-making
Key 1: EWCS: European Working Conditions Surveys; EQWL: European Quality of Working Life Surveys; ISSP: International Social Survey Programme; QuInnE:
Quality of Jobs and Innovation Generated Employment Outcomes; EU ESS: European Social Survey; EU-SILC: European Union Statistics on Income and Living
Conditions; EU LFS: European Union Labour Force Survey; WERS: Workplace Employment Relations Survey; UK SES: Survey of Employment & Skills; UKHLS: UK
Household Longitudinal Study (Understanding Society).
Key 2: = relevant indicator/s; = no indicators; () = some indicators/partial coverage of dimension.
Note 1: Most recent version of survey questionnaire mapped above. Certain indicators may be available in one country but not in another or may only be available
in particular waves of the respective survey.
Note 2: The UK ESS (Employer Skills Survey) is not included in this table because it is an employer survey. It does have some indicators for high-performance
work systems that could be reworded for employees.
Table 3: Overview of the feasibility of using the key existing data sources
Orientation (2015)
Society (UKHLS)
Earnings Survey
Understanding
UK SES (2015)
EWCS (2015,
WERS (2011)
EES5 (2010)
EQLS (2016,
Structure of
ISSP Work
4th wave)
6th wave)
EU-SILC
EU-LFS
QuInnE
Dimensions
Micro or macro data micro micro micro micro micro micro micro micro micro micro micro
individual individual individual national household individual household firm individual individual household
Sample unit of worker worker worker and worker worker and worker worker worker and
analysis individual
worker
5 years 5 years every n/a 2 years 1 year quarterly annual 4–5 years 2 years annual
10 years after and but Funding
Periodicity survey annual unknown ends soon.
year if Unknown
ongoing if ongoing
Adequate coverage
of set of indicators
for all dimensions
partial partial partial partial
Trend analysis over
time ? ? ?
International
comparability
Overall rating of Suitable for macro synthetic index
8/10 6/10 7/10 7/10 Feasible only – index only if combine data 6/10 7/10 3/10
feasibility from multiple sources
ANAND, S. and SEN, A. (1997) BOOTH, A. and SNOWER, D. (1996) CRESPO, N., SIMÕES, N. and
Concepts of human development The low-skill, bad-job trap. In: PINTO, J.C. (2013) Determinant
and poverty: a multidimensional SNOWER, D.J. and BOOTH, A. factors of job quality in Europe.
perspective. Human Development (eds) Acquiring skills. Cambridge: Lisbon, Portugal, Working Paper
Papers 1997. New York: Human Cambridge University Press. 13-01, Business Research Unit,
Development Report Office. Instituto Universitário de Lisboa.
CARRÉ, F., FINDLAY, P., TILLY, C.
ANKER, R., CHERNYSHEV, I., and WARHURST, C. (2012) Job CROMPTON, R. and LYONETTE, C.
EGGER, P., MEHRAN, F. and quality: scenarios, analysis and (2006) Some issues in cross-
RITTER, J. (2003) Measuring interventions. In: WARHURST, C., national comparative research on
decent work with indicators. FINDLAY, P., TILLY, C. and CARRÉ, women’s employment: a
International Labour Review. F. (eds) Are bad jobs inevitable? comparison of Britain and
Vol 142, No 2. pp147–77. Trends, determinants and Portugal. Work, Employment and
responses to job quality in the Society. Vol 20, No 2. pp389–400.
ANTÓN, J., FERNÁNDEZ-MACÍAS, twenty-first century. London:
E. and MUÑOZ DE BUSTILLO, R. Palgrave Macmillan. CURTARELLI, M., FRIC, K., VARGAS,
(2012) Identifying bad jobs across O. and WELZ, C. (2014) Job
Europe. In: WARHURST, C., CARRÉ, CAZES, S., HIJZEN, A. and SAINT- quality, industrial relations and the
F., FINDLAY, P. and TILLY, C. (eds) MARTIN, A. (2015) Measuring and crisis in Europe. International
Are bad jobs inevitable? Trends, assessing job quality: the OECD job Review of Sociology. Vol 24, No 2.
determinants and responses to job quality framework. OECD Social, pp225–40.
quality in the twenty-first century. Employment and Migration
London: Palgrave Macmillan. Working Papers No 174. Paris: DAVOINE, L., ERHEL, C. and
OECD. GUERGOAT-LARIVIÈRE, M. (2008)
BERGLUND, T. (2014) Crisis and Monitoring quality in work:
quality of work in the Nordic CLARK, A.E. (2005) Your money or European employment strategy
employment regime. International your life: changing job quality in indicators and beyond.
Review of Sociology. Vol 24, No 2. OECD countries. British Journal of International Labour Review.
pp259–69. Industrial Relations. Vol 43, No 3. Vol 147, No 2–3. pp163–98.
pp377–400.
BESCOND, D., CHÂTAIGNIER, A. DECANCQ, K. and LUGO. M. (2010)
and FARHAD MEHRAN, F. (2003) CLOUTIER-VILLENEUVE, L. (2012) Weights in multidimensional indices
Seven indicators to measure Job quality in Quebec and the of well-being: an overview. OPHI
decent work: an international United Kingdom: trends by sex and Working Paper No 18. Oxford:
comparison. International Labour family status, 1998–2008. Oxford Poverty & Human
Review. Vol 142, No 2. pp179–211. International Labour Review. Vol Development Initiative (OPHI),
151, No 1–2. pp61–84. Oxford Department of International
BILLAUT, J.C., BOUYSSOU, D. and Development, University of Oxford.
VINCKE, P. (2010) Should you COIN – Composite Indicators Available at: www.ophi.org.uk/
believe in the Shanghai ranking? Research Group, Joint Research wp-content/uploads/OPHI-wp18.
Scientometrics. Vol 84. pp237–63. Group (JRG) of the European pdf
Commission, online forum. Found
BONNET, F., FIGUEIREDO, J.B. and at: https://composite-indicators.jrc.
STANDING, G. (2003) A family of ec.europa.eu/
decent work indexes. International
Labour Review. Vol 142, No 2.
pp213–38.
LESCHKE, J. and WATT, A. (2008) OLSEN, K., KALLEBERG, A. and STANDING, G. (2011) The precariat.
Job quality in Europe. ETUI-REHS NESHEIM, T. (2010) Perceived job London: Bloomsbury Academic.
Research Department Working quality in the United States, Great
Paper 2008.07. Brussels: European Britain, Norway and West Germany, TAYLOR, M. (2017) Good work: the
Trade Union Institute. 1989–2005. European Journal of Taylor review of modern working
Industrial Relations. Vol 16, No 3. practices. London: Department for
LESCHKE, J., WATT, A. and FINN, M. pp221–40. Business, Energy and Industrial
(2008) Putting a number on job Strategy. Available at: www.gov.uk/
quality? Constructing a European OSTERMAN, P. and SHULMAN, B. government/uploads/system/
job quality index. ETUI-REHS (2011) Good jobs in America: making uploads/attachment_data/
Working Paper No 2008/03. work better for everyone. New York: file/626772/good-work-taylor-
Brussels: European Trade Union Russell Sage Foundation. review-modern-working-practices.
Institute. pdf
PARK, A., CLERY, E., CURTICE, J.,
LESCHKE, J., WATT, A. and FINN, M. PHILLIPS, M. and UTTING, D. (eds) TOYNBEE, P. (2003) Hard work.
(2012) Job quality in the crisis – an (2012) British social attitudes: the London: Bloomsbury.
update of the job quality index 29th report. London: NatCen Social
(JQI). ETUI-REHS Research Research. UK COMMISSION FOR
Department Working Paper No EMPLOYMENT AND SKILLS. (2017)
2012.07. Brussels: European Trade PARUOLO, P., SAISANA, M. and Employer skills survey, 2015: special
Union Institute. SALTELLI, A. (2013) Ratings and licence access. [data collection].
rankings: voodoo or science? 2nd edition. Colchester: UK Data
MUNDA, G. and NARDO, M. (2009) Journal of the Royal Statistical Service. SN: 7997. http://doi.
Non-compensatory/non-linear Society A. Vol 176, No 3. pp603–34. org/10.5255/UKDA-SN-7997-2
composite indicators for ranking
countries: a defensible setting. POLLERT, A. (1988) The ‘flexible UNECE. (2015) Handbook on
Applied Economics. Vol 41. pp1513– firm’: fixation or fact? Work, measuring quality of employment:
23. Employment and Society. Vol 2, a statistical framework. Prepared
No 3. pp281–316. by the Expert Group on Measuring
MUÑOZ DE BUSTILLO, R., Quality of Employment. New York
FERNÁNDEZ-MACÍAS, E., ANTÓN, J. QUALITY OF JOBS AND and Geneva: United Nations.
and ESTEVE, F. (2009) Indicators of INNOVATION GENERATED
job quality in the European Union. EMPLOYMENT OUTCOMES UNIVERSITY OF ESSEX, INSTITUTE
Study prepared for the European (QuInnE). (n.d.) Available at: http:// FOR SOCIAL AND ECONOMIC
Parliament. Brussels: Department of tools.quinne.eu/quinnemap/ RESEARCH, NATCEN SOCIAL
Employment and Social Affairs. RESEARCH and KANTAR PUBLIC.
RAFFERTY, M. AND BRYAN, D. (2016) Understanding society:
MUÑOZ DE BUSTILLO, R., (2015) Beyond the necessary, waves 1–6, 2009–2015. [data
FERNÁNDEZ-MACÍAS, E., ESTEVE, (utilitarian) and mundane? The collection]. 8th edition. Colchester:
F. and ANTÓN, J (2011) Measuring economics of job quality. In: KNOX, UK Data Service. SN: 6614. http://
more than money: the social A. and WARHURST, C. (eds) Job doi.org/10.5255/UKDA-SN-6614-9
economics of job quality. quality in Australia: perspectives,
Cheltenham: Edward Elgar. problems and proposals. VALLAS, S. and PRENER, C. (2012)
Annandale: Federation Press. Dualism, polarization, and the
OECD. (2016) How good is your job? social construction of precarious
Measuring and assessing job quality. work. Work and Occupations.
Paris: OECD Vol 39, No 4. pp339–53.