5952-MentalHealth - Imp - 5 - 2676 - 12008
5952-MentalHealth - Imp - 5 - 2676 - 12008
5952-MentalHealth - Imp - 5 - 2676 - 12008
22
Guide 5: Selecting scales to assess mental wellbeing in adults is based upon a review
commissioned and funded by Health Scotland. This work was developed by Dr Jane
Speight and Dr Carolyn McMillan (AHP Research Ltd), with Dr Mark Barrington (St
Bartholomews Hospital, London) and Professor Christina Victor (University of Reading).
Health Scotland would like to thank all those who participated in the consultation
process during the development of this Guide:
Dr Derek McLeod-Petrie,
NHS Grampian Public Health
Contents
Page no
1 Introduction
12
18
25
28
30
8 Concluding comments
55
9 References
56
Appendices
Appendix A Glossary
61
65
67
68
Introduction
1.1 What is the purpose of this guide?
This is the fifth in a series of Evaluation Guides2, which aim to encourage, support
and improve standards in the evaluation of mental health improvement initiatives.
This guide is based upon a Review of Scales of Positive Mental Health Validated for
Use with Adults in the UK: Technical Report. Parkinson, J (ed) (in press).
The guides are intended to help colleagues design evaluations that build on what
is known about what works to improve mental health and that take account
of the challenges of assessing the effectiveness of mental health improvement
interventions.
The first five guides in the series are:
Guide 1: Evidence-based practice. How can we use what we currently know
to inform the design and delivery of interventions? This guide explores current
debates about evidence of effectiveness and why they matter for mental
health improvement. It also considers how the evidence-base on mental health
improvement can be used to inform the design of interventions and their
evaluation.
Guide 2: Measuring success. How can we develop indicators to gauge progress
and access the effectiveness of mental health improvement interventions?
This guide covers the use of consultation to develop robust, valid and reliable
indicators, examines the differences between mental illness indicators and
mental health indicators and provides a useful source of indicators.
Guide 3: Getting results. How can we plan and implement an evaluation. This
guide gives an overview of the stages involved in planning and implementing
an evaluation, and outlines the key issues for consideration. It also indicates
sources of further, more detailed information on evaluation.
Guide 4: Making an impact. How do we analyse and interpret the results
from an evaluation and communicate the findings to key audiences. This
guide discusses how to use the data gathered. It explores how evaluation can
be used to inform practice and how the publication of results can add to the
evidence-base for mental health and improvement.
Introduction
Introduction
For further details on these scales see Review of Scales of Positive Mental Health Validated for Use with Adults in the UK: Technical
Introduction
For full details of the methods used in the review, see Review of Scales of Positive Mental Health Validated for Use
This guide considers how to go about selecting a scale for the purposes of evaluating
the impact of interventions on mental wellbeing in adults. It is organised into two
main sections:
How to select a scale: general principles to guide your choice of scale (see Sections
3, 4 and 5)
The recommended scales: information about specific scales that have been
developed to measure various aspects of MWB in adults and that meet our
inclusion criteria (see Sections 6 and 7).
This guide is intended to be of use to practitioners and those responsible for
delivering and/or evaluating interventions in terms of their impact on adult MWB.
Using the results of evaluation to inform policy and practice development is critical in
strengthening the two-way link between evidence and practice, as indicated in Guide
1: Evidence-based practice.
Introduction
Developing Indicators to
Measure Success
Developing individual and
community indicators that suit your
intervention
Using risk and protective factors
to select indicators (See Guide 2:
Measuring success)
Selecting a scale to measure
the impact of your intervention
on mental wellbeing in adults
(See Guide 5: Selecting scales to
assess mental wellbeing in adults)
The term positive mental health is used as an alternative to mental wellbeing in the technical report which
supports this practical guide; Review of Scales of Positive Mental Health Validated for Use with Adults in the UK:
Technical report (http://www.healthscotland,com/understanding/population/mental-health-indicators.aspx)
8
Aspects of mental
wellbeing used in this
guide
Emotional wellbeing
Life satisfaction
Self-esteem
10
Aspects of mental
wellbeing used in this
guide
Spirituality
Social functioning
Emotional intelligence
11
12
13
[known as categorical]
10 9 8 7 6 5 4
Very much
[known as continuous]
Very much
2 1
Not at all
X
Not at all
[known as continuous]
The type of response used in the scale will influence the level of sensitivity of the
data. Using the example shown above, you can see that the continuous responses
provide far more information than the categorical yes/no response. Moreover, the
greater the number of points in the response scale, the more sensitive the question
is likely to be at measuring changes (e.g. post- versus pre-intervention). The VAS
has advantages where participants may have literacy difficulties that would distort
their interpretation of questions. The disadvantage is that the researcher needs to
interpret what the cross (marked at a particular point on the line) means for the
participant. Moreover, a scoring grid is needed to place over the line to convert the
cross into a number for analysis purposes.
14
3.3 Pros and cons of scales versus other methods of data collection
As there are several limitations to using scales (see below), it is often useful to use a combined
approach when evaluating interventions in terms of mental wellbeing This is especially important
when considering the main shortcoming of scales: that they do not give participants the
opportunity to raise new important issues that the researcher did not expect to be relevant.
Advantages of using a scale
Standardisation of questions
allows comparisons to be made
(e.g. between groups, or before
and after an intervention),
because everyone receives the
same questions, in the same
format, with the same response
options.
15
By supplementing the use of scales with other methods, such as interviews, the
practitioner is more likely to obtain a clearer picture of the ways in which an
intervention has affected the community it attempted to serve. For more information,
see Guide 3: Getting results.
3.4 Reasons not to design your own scale
Many people believe that designing a scale is easy, but it is a challenging, time
consuming and complicated task. Almost any newspaper or magazine that you care
to look in will include a questionnaire, supposedly designed to measure some aspect
of your personality or life e.g. What does your home say about you? Are you a party
bore? What kind of shopper are you?9
However, developing10 scales that yield worthwhile data that are insightful, reliable
and comparable, is more difficult. In particular, developing questions to measure
abstract concepts, such as optimism or self-esteem, is a complex process (see box).
Most well-known scales have been developed over several years with many revisions,
when flaws in the earlier versions became apparent. This ensures they have been
extensively tested and are valid and reliable. Thus, it is almost always better to use
scales that have been thoroughly tried and tested. It is also very important not to use
single questions or parts of a scale (unless the developer advises that this is possible)
because this may invalidate the scale.
Some of the processes involved in developing a new scale
A comprehensive literature review to understand the themes and issues
relating to your subject of interest.
A qualitative study (e.g. long interviews and focus groups) to investigate the
important issues among your participants.
Development of hypotheses about what you are measuring.
Design (and refining) of the items and responses.
A small pilot study (see box on p20) to test the clarity and practicality of your
scale, followed by revision of items/responses to improve as needed.
A large-scale quantitative survey using your new scale.
Statistical analyses to check if your scale is working as expected (known as
psychometric validation).
10
16
If you have compelling reasons to believe that existing scales do not suit your
purpose, then you could be justified in developing your own scale. Just bear in mind
that perhaps the greatest disadvantage in doing so would be the lost opportunity to
make comparisons with the results of other studies i.e. it could be more difficult to
prove your intervention was a success compared with other interventions. If you were
to develop your own scale, it is important to include one or more existing scales in
your data collection so that you can investigate how your new scale compares with
other widely used scales. More information on the characteristics of good scales is
provided in Section 4.3.
Points for reflection
When planning your intervention, consider the pros and cons of using scales
versus other methods of data collection:
scales provide information about the quantity of impact of your intervention
i.e. they allow you to measure differences in scores between groups or before
and after an intervention. Scales provide very limited information about the
quality of impact of your intervention. Consider whether interviews and/or
focus groups would be useful to explore the participants experiences
consider collecting objective data as well as subjective data
be aware of the sensitivity of different types of response
be aware of the advantages (e.g. comparable responses, low-cost) and
disadvantages (e.g. missing data, misunderstandings due to poorly worded
questions, low response rates) of using scales
Finally, be aware of the pitfalls of designing your own scale. It is much better to
use a scale that has been well developed and tested elsewhere, as this adds to
the validity of your results. There are many scales available to assess the impact
of your intervention (see Section 7).
17
General mental
wellbeing
Emotional wellbeing
Self-esteem
Social functioning
Life satisfaction
Resilience & coping
Emotional intelligence
Select an appropriate
general mental
wellbeing scale
(pages 30-54)
Life satisfaction
Self-esteem
Spirituality
Social functioning
Emotional intelligence
(page 30)
(page 39)
(page 47)
(page 35)
(page 41)
(page 37)
(page 44)
(page 52)
12
20
Readability is rarely assessed formally or documented. It is highly likely that your target
population will include some people who have difficulty reading written English (either
because of low literacy levels or because English is not their first language). Some scales
are more difficult to read than others, with long words and complex sentence structures.
The only way to make sure that the scale you select is appropriate for your target
population is for you to assess the readability/suitability of the scale (see below). If you
find problems with the scale you have chosen, e.g. some questions are poorly worded
and/or irrelevant, you would be well-advised to consider choosing another scale.
If there are no other more suitable scales, then you may want to contact the scale
developer to discuss the possibility of modifying some of the items. It is important to
contact the developer at this point because they will know how and why the questions
have been worded in that particular way. It is likely that the scale developer will be able
to advise you what to do in this situation.
22
Desirable properties
Construct validity
Does the scale relate to other variables in a meaningful way? This is usually
assessed by including additional scales in your study that you expect either to
relate well to your scale because they are intended to measure similar constructs
(e.g. two scales designed to measure optimism) or to be completely unrelated to
your scale (e.g. optimism and IQ).
Responsiveness14
Does the scale detect changes following an intervention? This can be assessed in
a number of ways, though it is typically (if not ideally) reported as a statistically
significant difference between pre- and post-intervention scores, thus indicating
that some change has occurred.
Normative data
How does the general population score on this scale? In practice, this information
is available for very few scales of MWB because it requires very large sample sizes
(which unfortunately are rare in the social sciences). However, if available, this
information can be useful in determining the extent to which your sample is similar
to the general population.
Practical properties
How many items are included in the scale? It would be counter-productive to
administer a scale that includes 40 items if you know that your participants have
short attention spans or if you are also including several other scales in your
evaluation. Participant fatigue or boredom will probably result in ill-considered
answers, missing data and/or low response rates.
How much time do participants take to complete the scale? In addition to the
number of items, the complexity and wording of items can greatly influence how
long it takes a participant to complete the scale, or even whether or not he/she
completes it at all.
How easy is it to access a copy of the scale? While many scales are freely available
on the internet or directly from the scale developer/copyright holder, there are
many others that require the user to sign an agreement relating to its use. There
are several benefits to accessing a legitimate copy directly from the copyright
holder (see overleaf), but it is worth finding out early on how long the process of
setting up an agreement will take.
How much does the scale cost? While many scales are free of charge (and many
more are free to those working on non-commercially funded projects), there are
some that require a fee to be paid. This can be as a one-time payment for use in
a given study or programme of research or it can be a cost per participant, which
may limit the number of people you can afford to include in your evaluation.
14
23
Responsiveness is often used interchangeable with sensitivity to change, but the latter term does not imply the
change is clinically meaningful
24
25
26
Have you considered respondent burden (i.e. the difficulty and number of
questions you are expecting the participant to complete)? Are you planning
on including additional scales or other questions (such as age, race, gender,
education, employment and physical health history), which may add to the
respondent burden?
Does the scale developer provide any guidance about scoring the items? This
should include what to do about missing data.
Will you need to repeat your data collection (e.g. before and after the
intervention)? If so, what would be an appropriate follow-up period (e.g. three,
six or 12 months)?
Will participants complete the scale while you are present or some time
later, perhaps at home, returning it by post? What implications could such
arrangements have for the quality of the data you get back?
Have you considered whether the scale, and/or the setting for completing it,
may have any potential adverse effects? Is it possible that some questions might
upset some participants (e.g. questions about the number of people they are
emotionally close to). If so, is an appropriately qualified professional going to be
available to deal with any distress caused?
27
16
28
are suitable for use with the general adult population. This review excludes scales
designed specifically for other age groups (e.g. children, adolescents), sub-sections
of the adult population (e.g. elderly people) or target populations (e.g. specific
diseases or conditions, health-related behaviours, hospital or occupational settings)
have been validated for use in the UK. This review excludes many scales that have
been used widely in other countries (most frequently the USA), but for which no
evidence could be found of UK validation
do not require the user to undergo specialist training or have qualifications in
psychometric testing. This was a practical issue taking account of the fact that
practitioners would be unlikely to be qualified in psychometric testing or have the
resources available to facilitate specialist training
have been psychometrically validated. The scales have undergone statistical
testing to demonstrate the properties described in Section 3. In the course of this
review, some newly designed scales were identified that have not yet undergone
this level of validation.
To exclude those scales that did not meet our inclusion criteria entirely would be to do
a disservice both to the scales (many of which have been used widely outside the UK
and/or for purposes other than assessing MWB) and to future researchers, who may be
interested in conducting the necessary validation. Therefore, further details about the
excluded scales is included in the Technical report18 (including copies where permission
to reproduce was obtained).
With these caveats in mind, it is hoped that you will find the description and appraisal
of scales (see Section 7) useful when planning your evaluation.
6.3 How will you know if overall mental wellbeing has improved?
This guide has been structured to provide advice on measuring specific aspects of
MWB e.g. life satisfaction, social functioning, and spirituality (see Section 7). Whilst
scales measuring specific aspects of MWB may well be useful for evaluating specific
interventions, they will not be able to indicate whether or not overall MWB has
improved (see Section 4.1). If you want to find out whether overall MWB has improved
as a result of your intervention, you are most likely to find a suitable scale in Section 7.1.
In particular the Affectometer 2 (Kammann & Flett, 1983; Stewart-Brown, 2006) has
been highlighted as a useful scale for this purpose19.
29
Emotional wellbeing
20
30
various emotional states. Please note that the psychological term affect means
emotional feeling or emotional experience. Timeframe is perhaps the most
important feature of these scales. With shorter timeframes (e.g. referring to
right now, today, at the current time), the scale is more likely to capture an
emotional response, whilst with longer timeframes (e.g. the past week, past few
weeks, past month), the scale is more likely to capture mood or personality traits.
Practitioners are advised to consider which aspect of emotional wellbeing they
wish to evaluate, and to select a scale that fits their needs.
The following scales of emotional wellbeing are recommended:
Affect Balance Scale (ABS) (Bradburn, 1969) measures the concept of
emotional wellbeing, seen as a function of two independent dimensions
positive and negative affect meaning pleasurable and unpleasurable
experience
Affectometer 2 (Affect 2) (Kammann and Flett, 1983) measures MWB using a
balance of positive and negative feelings and thoughts
Depression-Happiness Scale (DHS) (McGreal and Joseph, 1993) measures
positive and negative affect, in terms of positive and negative thoughts,
feelings and bodily experiences. Note that the DHS remains unique in its
dual measurement of depression and happiness as opposite ends of a single
continuum
Oxford Happiness Questionnaire (OHQ) (Hills and Argyle, 2002) provides a
broad measure of happiness in three domains (life satisfaction, positive affect
and negative affect)
Oxford Happiness Questionnaire - Short-Form (OHQ-SF) (Hills and Argyle,
2002) is a brief (8-item) version of the above OHQ
Positive And Negative Affect Schedule (PANAS) (Watson et al, 1988)
measures positive and negative affect, identified in research as the dominant
dimensions of emotional experience. Consists of single word items describing
various feelings and emotions
Psychological General Wellbeing Index (PGWBI) (Dupuy, 1984) provides a
detailed assessment of positive wellbeing, self-control and vitality as well as
aspects of mental health problems
Short Depression-Happiness Scale (SDHS) (Joseph et al, 2004) is a brief
(6-item) version of the above DHS
Wellbeing Questionnaire 12 (WBQ12) (Bradley, 1994; 2000) provides a
brief (12-item) measure of positive wellbeing, energy and negative wellbeing
(avoiding the use of somatic items, so as to be particularly suitable for use in
patient populations).
31
Most scales included here measure positive affect (with or without a measure
of negative affect). They typically include several statements (or single words)
to describe a range of emotional states. There appears to be little attempt with
the current instruments to measure in detail the different types of positive affect
i.e. happiness, elation, calmness, momentary satisfaction. Rather, it is the case
that items can generally be summed (or otherwise aggregated) to form a scale
that measures positive affect or positive wellbeing rather than more specific
elements of the construct.
The Affectometer 2 take a much broader perspective of MWB, including not
only hedonic (i.e. pleasure) but also eudaimonic (i.e. function) dimensions. The
Wellbeing Questionnaire (W-BQ12) and the Psychological General Wellbeing
Index (PGWBI) both provide measures of positive wellbeing but they also include
measures of energy/vitality.
32
A short and substantially revised form of the Affectometer 2 (the Warwick-Edinburgh Mental Wellbeing
Scale (WEMWBS)) is currently under development. Validation on WEMWBS to date is favourable see http://
www.healthscotland.com/understanding/population/mental-health-indicators.aspx for information
21
33
34
(510 mins)
29 items
(Unknown)
8 items
(5 mins)
20 items
(510 mins)
(1015 mins)
6 items
(<5 mins)
**
*** (*)
****
** (*)
*
*
** (*)
***
*
*
**
*
** (*)
*** (*)
*
* (*)
** (*)
* (*)
*
*
* (*)
**
****
****
*** (*)
*
*** (*)
***
**
***
***
** (*)
** (*)
*
** (*)
***
*
*
** (*)
**
*** (*)
*** (*)
***
****
****
*** (*)
*** (*)
*
*** (*)
DepressionHappiness Scale
Oxford Happiness
Questionnaire
Oxford Happiness
Questionnaire
Short form
Psychological
General Wellbeing
Index
Wellbeing
Questionnaire-12
Yes
No
Yes
Yes
Unknown
Unknown
No
No
Yes
Permission
needed
No fee
No fee
No fee
No fee
Unknown
Unknown
No fee
No fee
Fee
Fee to use
scale
Overall rating = mean score of the essential and desirable properties (e.g. 24 stars / 6 properties = *****).
Scales are given a maximum 5-star rating for each of the six psychometric properties reflecting both quantity and quality of evidence, where: ***** = excellent evidence, **** = very good evidence, *** = good evidence, ** = moderate evidence, * = lack of evidence.
Further information about obtaining permission to use scales and details of license fees are provided in the summary reports for each scale, which can be found in the Review of Scales of Positive Mental Health Validated for Use with Adults in the UK: Technical report .
Where information is unknown, contact the developer and/or copyright holder (contact information provided in the Technical report). It should be noted, however, that the authors of this guide have made every effort to obtain as much information as possible.
Summaries of each scale as well as copies (and details of how to obtain permission to use, where necessary) can be found in the Review of Scales of Positive Mental Health Validated for Use with Adults in the UK: Technical report (http://www.healthscotland.com/
understanding/population/mental-health-indicators.aspx for information) which accompanies this guide.
12 items
(510 mins)
22 items
25 items
40 items
(5 mins)
***
****
****
***
*
*
***
10 items
(5 mins)
Items (time)
Practicalities
Affectometer 2
Normative
data
Overall rating
*
**
*
* (*)
*
*
*
Responsiveness
Construct
validity
Reliability
Content
validity
Structure
Desirable properties
Essential properties
Scale
7.2
Life satisfaction
36
Normative
data
26 items
(1520 mins)
(5 mins)
5 items
1 items
(< 5 mins)
1 items
(< 5 mins)
Items (time)
Practicalities
Yes
No
No
Yes
Permission
needed
No feec
No fee
No fee
Unknown
Fee to use
scale
Overall rating = mean score of the essential and desirable properties (e.g. 24 stars / 6 properties = *****).
Scales are given a maximum 5-star rating for each of the six psychometric properties reflecting both quantity and quality of evidence, where: ***** = excellent evidence, **** = very good evidence, *** = good evidence, ** = moderate evidence, * = lack of evidence.
Further information about obtaining permission to use scales and details of license fees are provided in the summary reports for each scale, which can be found in the Review of Scales of Positive Mental Health Validated for Use with Adults in the UK: Technical report.
Where information is unknown, contact the developer and/or copyright holder (contact information provided in the Technical report). It should be noted, however, that the authors of this guide have made every effort to obtain as much information as possible.
a
Summaries of each scale as well as copies (and details of how to obtain permission to use, where necessary) can be found in the Review of Scales of Positive Mental Health Validated for Use with Adults in the UK: Technical report (http://www.healthscotland.com/
understanding/population/mental-health-indicators.aspx for information) which accompanies this guide.
***
***
*****
*****
***
***
****
****
***
***
*
***
*****
*****
**
N/A
*
**
**
*
**
World Health
Organisation Quality
of Life BREF
**
N/A
**
Overall rating
**
*
*
**
Responsiveness
Construct
validity
Reliability
Content
validity
Structure
Desirable properties
Essential properties
Delighted-Terrible
Scale
Scale
36
7.3
37
38
**
**
****
***
**
*
** (*)
**
***
****
***
*
*
** (*)
(12 items)
(<5 mins)
48 items
(510 mins)
(5 mins)
10 items
***
****
****
*** (*)
*
*
***
12 items
(510 mins)
*
* (*)
** (*)
*** (*)
*
*
**
Items (time)
25 items
(510 mins)
Normative
data
**
*
****
** (*)
*
*
**
Responsiveness
Construct
validity
Reliability
Content
validity
Structure
Desirable properties
Essential properties
No
Yes
Yes
Yes
Yes
Permission
needed
No fee
NZ$1
No feec
No fee
No fee
Fee to use
scale
Overall rating = mean score of the essential and desirable properties (e.g. 24 stars / 6 properties = *****).
Scales are given a maximum 5-star rating for each of the six psychometric properties reflecting both quantity and quality of evidence, where: ***** = excellent evidence, **** = very good evidence, *** = good evidence, ** = moderate evidence, * = lack of evidence.
Further information about obtaining permission to use scales and details of license fees are provided in the summary reports for each scale, which can be found in the Review of Scales of Positive Mental Health Validated for Use with Adults in the UK: Technical report.
Where information is unknown, contact the developer and/or copyright holder (contact information provided in the Technical report). It should be noted, however, that the authors of this guide have made every effort to obtain as much information as possible.
Summaries of each scale as well as copies (and details of how to obtain permission to use, where necessary) can be found in the Review of Scales of Positive Mental Health Validated for Use with Adults in the UK: Technical report (http://www.healthscotland.com/
understanding/population/mental-health-indicators.aspx for information) which accompanies this guide.
Trait (Dispositional)
Hope Scale
Positive and
Negative Expectancy
Questionnaire
Life Orientation
TestRevised
Generalised
Expectancy Scale for
Success
Scale
38
7.4
Scales of Self-esteem
39
40
***
** (*)
*
*
**
**
**
*
** (*)
**
***
****
****
*
** (*)
* (*)
**
**
* (*)
**
* (*)
****
****
***
***
****
*** (*)
**
*
***
Robson Self-Concept
Questionnaire
Normative
data
Basic Self-Esteem
Scale
****
****
**
****
****
(10 items)
(Unknown)
(5 mins)
10 items
(510 mins)
30 items
25 items
(510 mins)
20 items
(unknown)
Items (time)
Unknown
No
No
Yes
Unknown
Permission
needed
Unknown
No fee
No fee
Fee
Unknown
Fee to use
scale
Overall rating = mean score of the essential and desirable properties (e.g. 24 stars / 6 properties = *****).
Scales are given a maximum 5-star rating for each of the six psychometric properties reflecting both quantity and quality of evidence, where: ***** = excellent evidence, **** = very good evidence, *** = good evidence, ** = moderate evidence, * = lack of
evidence.
Further information about obtaining permission to use scales and details of license fees are provided in the summary reports for each scale, which can be found in the Review of Scales of Positive Mental Health Validated for Use with Adults in the UK: Technical
report. Where information is unknown, contact the developer and/or copyright holder (contact information provided in the Technical report). It should be noted, however, that the authors of this guide have made every effort to obtain as much information as
possible.
Summaries of each scale as well as copies (and details of how to obtain permission to use, where necessary) can be found in the Review of Scales of Positive Mental Health Validated for Use with Adults in the UK: Technical report (http://www.healthscotland.com/
understanding/population/mental-health-indicators.aspx for information) which accompanies this guide.
Scale
Responsiveness
Construct
validity
Reliability
Structure
Content
validity
Desirable properties
Essential properties
40
7.5
41
42
43
Reliability
Responsiveness
Desirable properties
Construct
validity
Normative
data
Structure
Essential properties
Scale
Content
validity
Permission
needed
$20 US
Fee to use
scale
Items (time)
Yes
12 items
(20 mins)
* (*)
* (*)
**
**
*
*
* (*)
No fee
Attributional Style
Questionnaire
No
28 items
(Unknown)
**
** (*)
*
*
**
**
**
(Unknown)
Yes
No fee
** (*)
** (*)
*
*
**
48 items
(Unknown)
No
No
**
**
**
*
*
**
*** (*)
16 items
(Unknown)
No fee
60 items
COPE Scale
***
** (*)
*** (*)
***
*
*
**
No
No fee
$1NZ
Coping Styles
Questionnaire
** (*)
** (*)
10 items
(<5 mins)
No fee
Functional Dimensions
of Coping
****
***
*
***
***
No
** (*)
****
General Self-Efficacy
Scale
Unknown
66 items
(Unknown)
(1015 mins)
Yes
*** (*)
** (*)
29 items
Sense of Coherence
Scale
*** (*)
***
*
* (*)
** (*)
Ways of Coping
** (*)
*
*
**
** (*)
**
**
a
Summaries of each scale as well as copies (and details of how to obtain permission to use, where necessary) can be found in the Review of Scales of Positive Mental Health Validated for Use with Adults in the UK: Technical report (http://www.healthscotland.com/
understanding/population/mental-health-indicators.aspx
for information) which accompanies this guide.
b
Further information about obtaining permission to use scales and details of license fees are provided in the summary reports for each scale, which can be found in the Review of Scales of Positive Mental Health Validated for Use with Adults in the UK: Technical report.
Where information is unknown, contact the developer and/or copyright holder (contact information provided in the Technical report). It should be noted, however, that the authors of this guide have made every effort to obtain as much information as possible.
c
Scales are given a maximum 5-star rating for each of the six psychometric properties reflecting both quantity and quality of evidence, where: ***** = excellent evidence, **** = very good evidence, *** = good evidence, ** = moderate evidence, * = lack of evidence.
Overall rating = mean score of the essential and desirable properties (e.g. 24 stars / 6 properties = *****).
43
7.6
Spirituality
44
the response scale, so it takes a little more time to complete and may be more
confusing to participants than a similar measure that uses the same response
scale throughout. A further concern with the PIL is that its content is somewhat
confounded with depression (e.g. If I could choose, I would: prefer never to
have been born live nine more lives just like this one). This is likely to artificially
increase correlations with other aspects of mental health.
The SWBS is a relatively brief measure of spirituality, which focuses on spiritual
wellbeing, both religious (i.e. relationship with God) and existential (i.e. ones
sense of life purpose and life satisfaction). Thus, it offers a slightly different focus
from other scales reviewed here. The SWBS has been reported to be prone to
ceiling effects in some religious samples, which may limit its usefulness for some
purposes. However, for use in the general population, this criticism may not be
relevant and the scale has been found to be particularly useful for identifying
those experiencing spiritual distress or lack of wellbeing.
With only 10 items (five of which concern the presence of purpose and five of
which concern the search for purpose), the Meaning in Life Questionnaire (MLQ)
offers the most concise measure of spirituality. As it takes less than 10 minutes to
complete and is available free of charge for non-commercial use, the MLQ offers
distinct practical advantages over the other scales included here. The MLQ also
offers good content validity, as well as superior evidence for its scale structure
and reliability. As the MLQ has been developed very recently, the lack of evidence
regarding responsiveness and normative data is not a major concern.
45
Normative
data
***
Spiritual Wellbeing
Scale
20 items
(1015 mins)
Yes
Unknown
Yes
Yes
Permission
needed
Overall rating = mean score of the essential and desirable properties (e.g. 24 stars / 6 properties = *****).
Scales are given a maximum 5-star rating for each of the six psychometric properties reflecting both quantity and quality of evidence, where: ***** = excellent evidence, **** = very good evidence, *** = good evidence, ** = moderate evidence, * = lack of evidence.
Further information about obtaining permission to use scales and details of license fees are provided in the summary reports for each scale, which can be found in the Review of Scales of Positive Mental Health Validated for Use with Adults in the UK: Technical report.
Where information is unknown, contact the developer and/or copyright holder (contact information provided in the Technical report). It should be noted, however, that the authors of this guide have made every effort to obtain as much information as possible.
46
$20 US
Unknown
No fee
$40 US
Fee to use
scale
Summaries of each scale as well as copies (and details of how to obtain permission to use, where necessary) can be found in the Review of Scales of Positive Mental Health Validated for Use with Adults in the UK: Technical report (http://www.healthscotland.com/
understanding/population/mental-health-indicators.aspx for information) which accompanies this guide.
***
*
**
** (*)
** (*)
*** (*)
20 items
* (*)
***
** (*)
*
** (*)
**
(15 mins)
10 items
(510 mins)
****
****
***
*
*
***
***
48 items
(15 mins)
Items (time)
Practicalities
Meaning in Life
Questionnaire
**
Overall rating
**
**
***
***
*
*
Responsiveness
Construct
validity
Reliability
Content
validity
Structure
Desirable properties
Essential properties
Scale
46
7.7
Social functioning
47
Perceived Social Support from Family and Friends (PSSFF) (Procidano and Heller,
1983) measures the extent to which an individual perceives that his/her needs for
support, information and feedback are fulfilled by friends (PSS-Fr) and by family (PSSFa)
Social Support Questionnaire (SSQ) (Sarason et al, 1983) measures the perceived
availability of social support, i.e. the number of people likely to provide support
(number) and satisfaction with the support received (satisfaction)
Social Support Questionnaire Brief (SSQ-B) (Sarason et al, 1987) a brief measure
of perceived availability of (Number) and Satisfaction with social support.
The scales can be categorised (broadly) into four approaches to the measurement
of social functioning:
Interpersonal trust Scales in this category (i.e. ITQ, ITS) focus on the capacity or
willingness of the individual to engage in social interaction, e.g. the expectancy
held by an individual or a group that the word, promise, verbal or written statement
of another individual or group can be relied upon (Rotter, 1967, pp 651) or the
ability to self-disclose and express emotion in an adaptive manner in the context of
social support (Forbes and Roger, 1999, pp168)
Perceived sources of social support Scales in this category include the MSPSS
and the PSSFF. Like the scales of functional social support (below), they focus
on perceptions of the availability of social support (rather than objective
assessment). Where they differ from functional measures is in their emphasis on
the importance of the source of social support, e.g. friends, family or significant
other. The importance of this focus is based on the notion that different
populations may rely on or benefit from friend or family support to different
extents (and at different times in their lives)
Functional social support Scales in this category include the DUFSS, ISEL, ISSB,
MOS-SSS and 03SS. They include subscales that measure the degree to which
interpersonal relationships serve particular functions (Sherbourne and Stewart,
1991, pp705) (e.g. emotion/information sharing for problem-solving, practical
assistance, companionship)
Social networks i.e. the number of people an individual can turn to for help
(sometimes referred to as objective measurement of social support). Scales
that include some objective measurement include: 03SS, SSQ, SSQ-B. The SSQ
and SSQ-B also include an assessment of the individuals satisfaction with the
support received. It should be noted, however, that most researchers have found
functional or perceived social support and satisfaction with social support to be
a better predictor of mental health than objectively measured social support
(Barrera Jr et al, 1981; Cohen et al, 1985; Sarason et al, 1987; Sarason et al, 1983;
Zimet et al, 1988).
48
49
Social networks
The SSQ and its short-form (SSQ-B) both provide objective measures of
the availability of social support (in terms of numbers of people) as well as
satisfaction with that support. Thus, if a scale is required that includes both
objective and subjective assessment of social support, then the long-form
can be recommended for a detailed assessment and the brief-form can be
recommended if respondent burden or time is an issue.
Finally, if a particularly brief measure of social functioning is required, the O3SS
includes just three items, which are designed to provide an objective measure
of the number of people the respondent feels close to, as well as interest and
concern shown by others and ease of obtaining practical help. Unfortunately,
the structure and reliability of the O3SS have not been well-documented despite
widespread use in several European countries. The O3SS is the only scale for
which normative data (i.e. scores from the general population) from several
countries are available. In future, the brevity of this scale and the availability of
normative data with may well be influential in decisions regarding which scale of
social functioning to choose.
50
** (*)
48 items
** (*)
*
** (*)
**
*
*
* (*)
****
***
***
*** (*)
*
*
** (*)
Perceived Social
Support from Family
and Friends
Social Support
Questionnaire
*** (*)
*
*
** (*)
****
** (*)
(10-12 mins)
12 items
(15-20 mins)
(<1 mins)
3 items
No
No
Yes
No
No
No
No
Yes
Yes
No
Unknown
Permission
needed
No fee
No fee
No fee
No fee
No Fee
No fee
No fee
No fee
No fee
No fee
Unknown
Fee to use
scale
Overall rating = mean score of the essential and desirable properties (e.g. 24 stars / 6 properties = *****).
Scales are given a maximum 5-star rating for each of the six psychometric properties reflecting both quantity and quality of evidence, where: ***** = excellent evidence, **** = very good evidence, *** = good evidence, ** = moderate evidence, * = lack of evidence.
Further information about obtaining permission to use scales and details of license fees are provided in the summary reports for each scale, which can be found in the Review of Scales of Positive Mental Health Validated for Use with Adults in the UK: Technical report.
Where information is unknown, contact the developer and/or copyright holder (contact information provided in the Technical report). It should be noted, however, that the authors of this guide have made every effort to obtain as much information as possible.
Summaries of each scale as well as copies (and details of how to obtain permission to use, where necessary) can be found in the Review of Scales of Positive Mental Health Validated for Use with Adults in the UK: Technical report (http://www.healthscotland.com/
understanding/population/mental-health-indicators.aspx for information) which accompanies this guide.
****
27 items
* (*)
Social Support
Questionnaire - Brief
40 items
(Unknown)
**** (*)
** (*)
**** (*)
** (*)
*(*)
*
***
Multidimensional
Scale of Perceived
Social Support
*
* (*)
*
*** (*)
* (*)
12 items
**** (*)
**** (*)
** (*)
***
*
*
***
19 items
(57 mins)
**
*
** (*)
**
*
*
* (*)
Inventory of
Socially Supportive
Behaviours
(<5 mins)
40 items
(10 mins)
**
40 items
(1520mins)
** (*)
** (*)
*
*
* (*)
*
** (*)
*** (*)
(15 mins)
****
***
40 items
(Unknown)
8 items
(Unknown)
Items (time)
Interpersonal Trust
Scale
Interpersonal Trust
Questionnaire
***
** (*)
*** (*)
***
*
*
** (*)
Interpersonal
Support Evaluation
List
Normative
data
***
**
**
** (*)
*
*
**
Responsiveness
Construct
validity
Reliability
Content
validity
Structure
Desirable properties
Essential properties
Duke-UNC Functional
Social Support
Scale
51
7.8
Emotional intelligence
52
53
*(*)
**
**
** (*)
** (*)
*
*
**
Normative
data
** (*)
**
*
**
*
*
* (*)
*
** (*)
* (*)
*
*
* (*)
Responsiveness
Construct
validity
Reliability
Structure
Content
validity
Overall rating
Desirable properties
Essential properties
(510 mins)
30 items
114 items v1
153 items v1.5
(1520 mins)
33 items
(Unknown)
Items (time)
Practicalities
No fee
No feec
Nod
Overall rating = mean score of the essential and desirable properties (e.g. 24 stars / 6 properties = *****).
Scales are given a maximum 5-star rating for each of the six psychometric properties reflecting both quantity and quality of evidence, where: ***** = excellent evidence, **** = very good evidence, *** = good evidence, ** = moderate evidence, * = lack of evidence.
Further information about obtaining permission to use scales and details of license fees are provided in the summary reports for each scale, which can be found in the Review of Scales of Positive Mental Health Validated for Use with Adults in the UK: Technical report.
Where information is unknown, contact the developer and/or copyright holder (contact information provided in the Technical report). It should be noted, however, that the authors of this guide have made every effort to obtain as much information as possible.
No fee
Fee to use
scale
No
No
Permission
needed
Summaries of each scale as well as copies (and details of how to obtain permission to use, where necessary) can be found in the Review of Scales of Positive Mental Health Validated for Use with Adults in the UK: Technical report (http://www.healthscotland.com/
understanding/population/mental-health-indicators.aspx for information) which accompanies this guide.
Trait Emotional
Intelligence
Questionnaire
Short Form
Trait Emotional
Intelligence
Questionnaire
Emotional
Intelligence Scale
Scale
54
54
Concluding comments
We hope that this guide to selecting scales for evaluating the mental health of
adults in the UK will encourage you to do so in your day-to-day work, whether in
a community project, an inpatient or outpatient clinic or a whole range of other
settings.
Although we have tried to make our explanations straightforward, we appreciate
that this can be a difficult area for practitioners who are not familiar with
research and/or the concept of mental wellbeing. Many of the issues covered
in this guide are discussed in greater detail in other guides in the series or
in the accompanying technical report: Review of Scales of Positive Mental
Health Validated for Use with Adults in the UK: Technical report (http://www.
healthscotland.com/understanding/population/mental-health-indicators aspx).
Our intention has been to create a guide that will be a useful resource, enabling
you to make informed decisions about which scales of mental wellbeing to use to
demonstrate:
the needs of the adults you are working with, and
the effectiveness of your activities, by collecting data about mental wellbeing
both before and after your service or other intervention has been provided.
55
References
Andrews, FM and Withey, SB (1976). The Measurement of Affective Evaluations. In
Social Indicators of Wellbeing: Americans Perception of Life Quality (pp 1820,
120121, 203212, 223, 226229, 351, 426428). Plenum Press, London.
Antonovsky, A (1987a). Measuring the Concept: A New Scale. In Unraveling the
Mystery of Health: How People Manage Stress and Stay Well (pp 6388).
JosseyBass Publishers, London.
Antonovsky, A (1987b). The Sense of Coherence Concept. In Unraveling the
Mystery of Health: How People Manage Stress and Stay Well (pp 1532).
JosseyBass Publishers, London.
Barrera Jr, M, Sandler, IN and Ramsay, TB (1981). Preliminary Development of a
Scale of Social Support: Studies on College Students. The American Journal of
Community Psychology, 9, 435447.
Bowling, A (2005) Measuring Health: A Review of Quality of Life Measurement
Scales. (3 Edition). Open University Press, New York.
Bradburn, NM (1969). Two Dimensions of Psychological Wellbeing: Positive and
Negative Affect. In The Structure of Psychological Wellbeing (pp 5370). Aldine
Publishing Company, Chicago.
Bradley, C (1994). The wellbeing questionnaire. In Bradley, C (ed) Handbook of
Psychology and Diabetes (pp. 89109). Chur, Switzerland: Harwood Academic
Publishers.
Bradley, C (2000). The 12Item Wellbeing Questionnaire: Origins, Current Stage of
Development and Availability. Diabetes Care, 23, 875.
Broadhead, WE, Gehlbach, SH, de Gruy, FV and Kaplan, BH (1988). The DukeUNC
Functional Social Support Questionnaire. Measurement of Social Support in
Family Medicine Patients. Med Care, 26, 709723.
Brumfitt, SM and Sheeran, P (1999). The Development and Validation of the Visual
Analogue SelfEsteem Scale (VASES). British Journal of Clinical Psychology, 38,
387400.
Carver, CS (1997). You want to Measure Coping But Your Protocols Too Long:
Consider the Brief COPE. International Journal of Behavioural Medicine, 4,
92100.
Carver, CS, Scheier, MF and Weintraub, JK (1989). Assessing Coping Strategies: A
Theoretically Based Approach. Journal of Personality and Social Psychology, 56,
267283.
56
57
References
Expectancy for Success Scale: A Validity and Reliability Study. Journal of Clinical
Psychology, 48, 517521.
Hills, P and Argyle, M (2002). The Oxford Happiness Questionnaire: A Compact
Scale for the Measurement of Psychological Wellbeing. Personality and
Individual Differences, 33, 10731082.
Hyland, ME and Sodergren, SC (1996). Development of a New Type of Global
Quality of Life Scale, and the Comparison of Performance and Preference for 12
Global Scales. Quality of Life Research, 5, 469480.
Joseph, S, Linley, PA, Harwood, J, Lewis, CA and McCollam, P (2004). Rapid
Assessment of Wellbeing: The Short DepressionHappiness Scale (SDHS).
Psychol.Psychother., 77, 463478.
Kammann, R and Flett, R (1983). Affectometer 2: A Scale to Measure Current Level
of General Happiness. Australian Journal of Psychology, 35, 259265.
Keyes, CL (2005). Mental Illness and/or Mental Health? Investigating Axioms of the
Complete State Model of Health. Journal of Consulting and Clinical Psychology,
73, 539548.
McGreal, R and Joseph, S (1993). The DepressionHappiness Scale. Psychological
Reports, 73, 12791282.
Olason, DT and Roger, D (2001). Optimism, Pessimism and Fighting Spirit: A New
Approach to Assessing Expectancy and Adaptation. Personality and Individual
Differences, 31, 755768.
Paloutzian, RF and Ellison, CW (1982). Loneliness, Spiritual Wellbeing and the
Quality of Life. In LA Peplau and D Perlman (eds), Loneliness: A Sourcebook of
Current Theory, Research and Therapy (pp 224237). Wiley, New York.
Parkinson, J (ed) (in press). Review of Scales of Positive Mental Health Validated
for Use with Adults in the UK: Technical Report. Health Scotland, Edinburgh.
Peterson, C, Semmel, A, von Baeyer, C, Abramson, LY, Metalsky, GI and Seligman,
ME (1982). The Attributional Style Questionnaire. Cognitive Therapy and
Research, 6, 287300.
Petrides, KV and Furnham, A (2006). The Role of Trait Emotional Intelligence
in a GenderSpecific Model of Organizational Variables. Journal of Applied
Psychology, 36, 552569.
Petrides, KV and Furnham, A (2000). On the Dimensional Structure of Emotional
Intelligence. Personality and Individual Differences, 29, 313320.
58
References
60
Appendix A Glossary
61
Affect
Aspect of mental
wellbeing
Categorical data
Ceiling effect
Construct
Construct validity
Content validity
Continuous data
Correlation
Eudaimonic
Factor analysis
Floor effect
Appendices
Hedonic
Hypothesis
Indicator
Internal consistency
Item
Linguistic validation
Mental wellbeing
Normative data
Objective
Psychometric
validation
62
63
Qualitative data
Quantitative data
Rating scale
Reliability
Response options
Responsiveness
Scale
Self-report
Somatic
Structure
Appendices
Subjective
Test-retest reliability
Validity
Variable
64
65
ABS
Affect-2
Affectometer 2
ASQ
BCOPE
Brief COPE
BSES
COPE
COPE Scale
CSEI
CSQ
DHS
DepressionHappiness Scale
D-T Scale
DelightedTerrible Scale
DUFFS
EIS
FDC
GESS-R
GQOL
GSE
ISEL
ISSB
ITQ
ITS
LAP-R
LOT
LOT-R
MLQ
MOS-SSS
MSPSS
Appendices
O3SS
OHQ
OHQ-SF
PANAS
PANEQ
PGWBI
PIL Test
PSSFF
RSCQ
RSES
SDHS
SOC
SSQ
SSQ-B
SWB
SWLS
T(D)HS
TEIQue
TEIQue-SF
VASES
WAYS
Ways of Coping
W-BQ12
Wellbeing Questionnaire 12
WHOQoL-BREF
66
22
67
Appendices
68
Self-esteem
Carr A (2004) Chapter 7: Positive self.*
Hewitt JP (2005). The Social Construction of Self-Esteem. In Snyder CR, Lopez SJ
(eds), Handbook of Positive Psychology (pp 231243). Oxford University Press,
New York.
Resilience and coping
Carr A (2004). Chapter 7: Positive Self.*
Schwarzer R, Knoll N (2003). Positive Coping: Mastering Demands and Searching
for Meaning. In Lopez SJ, Snyder CR (eds). Positive Psychological Assessment: A
Handbook of Models and Measures (pp 393409). APA, Washington, DC.
Spirituality
Joseph S, Linley PA, Maltby J (2006). Positive Psychology, Religion and Spirituality.
Mental Health, Religion and Culture, 9, 209212.
Social functioning
Carr A (2004). Chapter 8: Positive relationships.*
Emotional Intelligence
Carr A (2004). Chapter 4: Emotional Intelligence. *
69
2676 1/2008
22