Making Quality Sense PDF
Making Quality Sense PDF
Making Quality Sense PDF
Jane Owen
raising quality
and achievement
programme
Jane Owen
Further information
For further information about the issues discussed
in this publication please contact :
Jane Owen
Development Adviser
Learning and Skills Development Agency.
Tel 020 7297 9083
jowen@LSDA .org.uk
This publication was funded by the Learning and Skills Council
as part of a contracted support and development programme.
Contents
Introduction
The basics
11
17
37
Quality gurus
45
51
Next steps
53
Further information
55
57
Introduction
The basics
Quality
There are many definitions of quality, including :
conforming to requirements
Processes
Processes are the building blocks of every organisation. It is
important that each organisation understands its processes,
how they work, what internal and external influences there are
on them, their inputs and outputs.
Processes are often confused with documented procedures and
can be seen as bureaucratic additions to already paper-laden work.
The related documentation that many object to can hide the fact
that everything we do, in work or out of it, is a process.
One technical definition of a process is an activity or a series
of activities that changes an input into an output. In the learning
and skills sector, inputs can include requests for information,
letters of complaint or books. Outputs can include qualifications,
learning or data.
Simply put, a process is something we do to add value to a product,
an idea or a service. In its simplest form it can be illustrated
as shown in Figure 1.
Input
Process
Output
Customer
Customers
Customer is a term that has been increasingly used and abused
in all sectors over the past years. It is easy to get hung up on
the terminology of customer service instead of looking at service
improvement. Most of us have experienced being called a customer
while clearly not being treated as one. For example, announcements
that tell overheated, delayed train passengers to make room for
other customers do not make them feel like valued customers.
In fact, such announcements can make them feel annoyed or
patronised, especially when the service or the attitude of staff
does not match the words.
There is emerging evidence that overusing the term customer can
alienate the very people you are trying to serve. A recent NHS survey,
for example, showed that people being treated wanted to be called
patients. It is not what term is used by an organisation that is
important, it is the way people are treated.
Customers are simply people to whom we give a service, be they
learners, employers or funders and regardless of whether they
pay directly or indirectly for the service. Each group will have its
own needs and expectations and the service we provide to them
has to reflect this. It is our responsibility to ensure that the service
is provided for each group and individual to a quality that would
satisfy us if we were the customer.
The basics 5
Internal customers
We all have customers though not everyone deals with
external customers. A good indicator of how well an organisation
will treat its external customers is how well its staff treat their
internal customers.
Internal customers are your colleagues. They are anyone to
whom you provide a service. It is important to ensure that they
are satisfied with the service you provide for them.
Customer complaints
A complaint could be described as any expression of dissatisfaction
from a customer. Generally, if a customer believes he or she
is making a complaint then it is a complaint.
For every person who makes a complaint around 20 will say nothing
to you but will either stop using your service or will stay unsatisfied
with you. So, if they have gone to the trouble of making a complaint
they usually feel genuinely disgruntled.
Again, it is important that we do not become tied up in the technicality
of language. Some organisations can over-complicate their
complaints procedure by stratifying complaints using categories
such as minor, formal, informal, verbal, written, major, etc.
This does not mean that complaints should not be coded to assist
analysis. Coding is an important means of identifying root causes of
problems, but it is not something that customers need to know about.
How an organisation recovers from service failure is one of the
most important aspects of its service delivery. Research has shown
that customers who complain and have their problems resolved
quickly are more likely to repeat purchase than customers who
had no problems with the service or organisation.
Though it is best to get things right first time, a well-handled complaint
can leave customers more satisfied with an organisation than if
the service had not failed at all.
There are times when you cannot do what your customer wants
you to do. If this happens you should always be willing and able to
explain why you cannot do it. There is nothing more likely to infuriate
a customer who is making a complaint than a jobs worth attitude.
Responses such as its not our policy or its not my job are
more likely to antagonise the situation than explaining why
something cannot be done and making a useful suggestion
about an alternative service or action.
There are some basic principles that are common to organisations
that make good use of customer complaint feedback.
Access and information How easy is it for your customers to tell you
when something goes wrong ? An organisation that boasts of very
low complaint rates may in fact just be inaccessible. Make it easy
for your customer to let you know that something has gone wrong
and consider how your customers prefer to communicate with you.
Staff knowledge and access Publicity about the complaints
procedure should not be confined to customers. Some organisations
give each staff member a full copy of the complaints procedure
or make it available on the organisations intranet. Alternatively,
some organisations produce leaflets for staff that explain the
reasons why complaints procedures are needed and what
the processes are that should be followed.
Reporting Both what is reported and who it is reported to send
out strong messages about the importance given to successful
complaint handling.
Organisations should beware of using the number of complaints
received as a performance indicator. If staff feel they will be
penalised for reporting complaints made about themselves or their
services it becomes easier simply not to report them. Remember
a low number of logged complaints is as likely to be caused by the
inaccessibility of the complaints process as by high satisfaction levels.
Some alternative performance indicators are :
complaint type
The basics 7
Benchmarking
Benchmarking, at its simplest, is a way of comparing something,
whether it is a product, service, process or output, to establish
the relative level of performance.
There are three distinct types of benchmarking.
Metric benchmarking This involves the comparison of statistical
data. Usually the data compared is a performance indicator,
for example customer satisfaction levels, costs or staff turnover.
The results are often compiled in a league table. It is a relatively
low-cost method. It shows how an organisations results compare
with other organisations but does not explain why there is a difference.
Diagnostic benchmarking This involves examining how an organisation operates and comparing this with how other organisations
operate. It is a method of identifying what processes might be
causing particularly good or poor results. It helps to identify areas
of comparative strength and weakness within an organisation and
pinpoints where to focus effort when making improvements.
Process benchmarking This is a systematic method of comparing
specific processes with other processes within the organisation
or within other organisations. It is quite resource intensive but has
the potential to give impressive results. It is explained in more detail
in the following chapter.
of benchmarking
Increasing
knowledge
and benefits
process
benchmarking
diagnostic
benchmarking
metric
benchmarking
The basics 9
Processes, processes,
processes
11
This constant review will help to ensure that the process, and
hence the product or service it produces, continues to meet
customer needs over time.
The key steps of continuous improvement are :
identify problems
implement changes
review changes
start again.
Process re-engineering
Process re-engineering is a technique employed to make major step
changes in quality. In many cases a re-engineering project starts
( in theory ) from the concept of the blank sheet of paper or thinking
the unthinkable. In practice, it is rare that there will be a genuine start
from scratch as the costs involved would be prohibitive.
Unlike continuous improvement, there is more of a top-down feel
to process re-engineering. This does not mean that staff are not
involved at all. They will eventually have to implement the new process
and so it is usually beneficial to involve them to some extent.
The main steps of re-engineering are :
assemble a team
resistance to change
unrealistic expectations
cost implications.
Some of these barriers can be overcome by using a
more incremental approach to the project.
Re-engineering
Involvement
All staff
Project group
Type of change
Gradual, incremental
Sudden, major
Time-scale
Ongoing
Sudden, one-off
Personnel focus
Bottom-up with
management support
Top-down with
some staff input
Process benchmarking
Process benchmarking is a systematic method of improvement that
uses others good practice and learning to improve your own processes.
It is a method of identifying what must be improved in an organisation,
finding ways of making those improvements, and then implementing
the improvements.
It requires an organisation to fully understand its processes
and its customers and stakeholders needs. From that point
it is possible to identify gaps between needs and performance.
Support for the staff taking part in the project, including training
and resources. Training in quality tools is particularly useful.
Agreed time off from their normal duties for those staff taking part
and arrangements in place to cover staff when they are working
on the project.
Any process can be benchmarked. However, one of the most
common reasons for failure in a benchmarking project is that the
subject area was too wide and nebulous. Once people realise
the benefits of benchmarking it is easy to become enthusiastic
and to over-stretch. A common area identified for benchmarking is
communication. This issue, seemingly raised by every staff survey
ever conducted, is so large that few organisations really understand
how it works. As a result, any attempts to improve it, especially as
a first project, through benchmarking tend to be problematic.
Before deciding to benchmark sizeable chunks of processes, it is
necessary to consider the resources available, the experience of
staff involved, the size of the problem ( if known ) and the importance
of the process.
Quality tools
and techniques
affinity diagrams
brainstorming
flowcharts
Gantt charts
histograms
moments of truth
Pareto analysis
scatter diagrams
SWOT analysis.
They can be used with minimal training by staff at all levels and
help to provide a more focused examination of quality issues.
Affinity diagrams
Affinity diagrams ( Figure 3 ) are a way of sorting a variety of ideas,
problems or issues into related groups or under specific headings.
Affinity diagrams are usually constructed by a team of people.
17
The team begins to group each of the cards or notes, moving those
that they do not agree with until everyone is happy with the grouping.
Environment
No staff
empowerment
Cramped office
conditions
Staff feedback
not acted on
Location
Not visible
Old buildings
Decoration
Managers
seem aloof
No staff-room
Equipment
Workload
Staff
Failing IT
Excessive workload
Office gossip
Machinery
breakdown
Staff shortages
No socialising
Unequal work
distribution
Untrained staff
Unpaid overtime
Shortage of
photocopiers
Management style
Unhelpful
colleagues
Brainstorming
Brainstorming is a simple way to generate a large number of
ideas from a group of people in a relatively short period of time.
The idea is that a group of people bounce ideas off each other.
Even really impractical ideas are seen as useful as they can
generate new ideas that are more practical.
Steps in brainstorming
Members of the team call out ideas for solving the problem.
This can either be done in rotation or people can call out
as they get ideas.
Brainstorming rules
All ideas must be recorded, no matter how off the wall they seem.
Plant
Equipment
breakdown
Skills
Training
Ingredients
Badly
cooked food
Product
specification
Staff numbers
Cooking time
Policies
Procedures
Maintenance rota
machinery
manpower
method
material
maintenance.
In non-manufacturing organisations the 4P method ( see Figure 4 )
is often used :
people
policies
procedures.
Of course, each situation is different and it may be better to use
your own headings.
The contributory causes of each of these main causes are
then identified, usually using brainstorming.
The diagram is generally drawn up by a group of people who are
involved in the process being examined. As with brainstorming,
the method is guided by a facilitator who ensures that everyone
can contribute to the discussion.
Most important
issue raised
Other
issue raised
Management
IT
Salary
Workload
Other
Flowcharts
Flowcharts are diagrammatic representations of processes. They can
be constructed using a very small number of symbols ( Figure 6 ) .
Figure 6 Flowchart symbols
Start of
process
End of
process
Process
Decision
Member of staff
contacts
department
about possible
publication
Publications
administrator helps
proposer to
complete form
Has proposal
form been
completed ?
No
Yes
Form
checked by
publications
manager
Discuss timetable
with author and
negotiate a
new timetable
No
Is
timetable
achievable ?
Yes
Does
publication
have appropriate
budget and
approval ?
No
Yes
Publications
manager signs form
with comments
and passes to
coordinator
Publication put on
schedule with job
number
End
The people who should develop the flowchart are those people
involved in the process area.
Use a facilitator who is not involved in the process to ask the obvious
questions that people involved in the process are often not free
to ask why do this ?, who is responsible ? and what is this for ?.
Positive force
Negative force
Staff
resistance
Management
commitment
Resources
Lack of
funding
Quality
culture
Possible
job losses
Need to
improve
Drivers
Barriers
Gantt charts
A Gantt chart ( Figure 9 ) is a useful method of planning and monitoring
a project. It shows the progress of each element of a project on
a separate line, plotted against the estimated or actual time for
each element. The elements can run consecutively, or in parallel.
Gantt charts show the likely overall timescale for projects and,
by updating them regularly, it is possible to highlight any
potential problems that could alter the completion date.
Though there are specific software packages available for
constructing Gantt charts, they can be drawn by hand or by using
a basic spreadsheet package.
List the elements down one side of the sheet in time order
of them starting.
Draw in a block on each line showing the timescale for each element.
The chart should be updated regularly, using different colours
or shading to show completed, current and pending elements
of the project and altering timescales where appropriate.
8 Sep
15 Sep
22 Sep
29 Sep
6 Oct
13 Oct
20 Oct
27 Oct
3 Nov
10 Nov
17 Nov
24 Nov
1 Dec
8 Dec
15 Dec
22 Dec
Histograms
A histogram ( Figure 10 ) is a bar chart that is used to demonstrate
the variation in a set of data. It shows the frequency with which
particular values occur and is a good method of illustrating
the shape of the distribution.
Figure 10 An example of a histogram
Learners on a course
9
8
Number of learners
7
6
5
4
3
2
1
Age range
42 45
38 41
34 37
30 33
26 29
22 25
18 21
Moments of truth
Moments of truth (M o T ) are the times when a customer comes
into contact with a member of staff.
Organisations are often not aware of how many of these moments of
truth there are. There is a tendency to concentrate on more obvious
examples such as when a customer is greeted at reception or when a
call is made to the service department. This can lead to less obvious
moments of truth, such as when a customer makes a telephone call to
the finance department or asks a cleaner for directions in a corridor,
being ignored. It is often these less obvious moments of truth that
are the make or break points for customers when they are deciding
whether they are satisfied.
It is a good idea for organisations to map moments of truth to
establish what areas and processes they should review and
what staff may need additional training.
Pareto analysis
Pareto was an Italian economist who realised that 85% of the
countrys wealth was in the hands of 15% of the people. This basic
principle, sometimes called the 80 /20 rule, appeared to be
applicable to vast numbers of numerical facts.
Using this theory, we can assume that 80% of problems result from
20% of causes. In factories, for example, 80% of the value of the
stock in storerooms is likely to be held by 20% of the items in stock.
In surgeries, 80% of visits to GP s are likely to be made by 20% of
registered patients.
A simple way to use this tool is to analyse the root cause of complaints
and comments made over the past year. These root causes could
then be categorised into groups and ranked according to how much
they cost, how often they occur or how much time is spent solving
the problems. By using the Pareto method to analyse the root cause
of complaints you can focus on processes whose improvement
will make the biggest difference to service delivery.
It is usual to portray the results as a Pareto diagram ( Figure 11 ),
a type of bar chart with the most frequently occurring or most
costly area to the left of the diagram and the least to the right.
Complaint type
he
r
Ot
li t
ci
Fa
Tr
an
sp
or
t
Bu
ild
in
gs
Ca
te
r in
g
ie
s
ce
vi
Ad
Te
ac
hi
ng
Scatter diagrams
A scatter diagram is a chart that shows data by displaying the
relationship between two variables. It is a way of finding out whether
one variable ( eg the number of hours a learner revises for an exam )
is affected by another variable ( eg the exam results ) and whether
the effect is positive or negative.
Figure 12 An example of a scatter diagram with positive correlation
90
80
..
. .
..
70
Exam mark
60
50
40
.. .
.
30
20
10
0
0
10
Hours studied
Figure 12 shows that for this mocked-up group of learners,
the more they studied the better their exam results. This suggests
that studying had a positive effect on exam results.
Other diagrams ( Figure 13 ) might show a negative correlation.
.. .
.. .
. . ..
80
70
60
50
40
. .
30
20
10
0
0
10
. ..
..
.
.
. ......
.
3
2.75
2.5
2.25
..
..
2
3
3.25
3.5
3.75
4.25
4.5
4.75
3.5
..
... . .
. .. . .
.. . .. . .
3.25
3
2.75
2.5
2.25
2
3
3.25
3.5
3.75
4.25
4.5
4.75
SWOT analysis
SWOT ( strengths, weaknesses, opportunities, threats ) analysis
what do we do well ?
what do we do badly ?
social changes
new technology
new funding
additional customers.
competition
funding cuts
Models, awards
and assessment
Charter Mark
Investors in People
ISO 9000
Charter Mark
The Charter Mark scheme is a customer service standard and an
award promoted by the government. All public sector organisations
that deal directly or indirectly with the public can apply to be awarded
a Charter Mark.
Charter Marks are given to organisations by a panel of independent
judges on the basis of the recommendations of a team of assessors.
37
Results
People
People results
Policy and
strategy
Partnerships
and resources
Customer
results
Society
results
Enablers
Processes
Leadership
Investors in People
Investors in People (I i P ) is an award that is given to organisations
that meet criteria laid down for the training and development of
people. It was developed in 1990 by the National Training Task Force,
in collaboration with a number of well-respected organisations
including the CBI ( Confederation of British Industry ), Trades Union
Congress (TUC ) and Institute of Personnel and Development (IPD ) .
Indicators
Commitment
An Investor in People is fully
committed to developing its
people in order to achieve
its aims and objectives
Planning
An Investor in People is clear
about its aims and its objectives
and what its people need to do
to achieve them
Action
An Investor in People develops
its people effectively in order
to improve its performance
Evaluation
An Investor in People understands
the impact of its investment
in people on its performance
ISO 9000
ISO is the International Organisation for Standardisation. It is made up
PROBE
PROBE ( Promoting Business Excellence ) is a questionnaire-based
business leadership
service processes
people
performance management
results.
Each of these areas is examined in detail to establish
the organisations current practices.
PROBE steps
The PROBE benchmarking process is team-based and consists
of the steps outlined below.
Team selection Individuals are chosen from across the organisation
and from different management levels. They are people who are able
and prepared to contribute to the discussion.
Initial communication The team leader acts as the point of
communication to team members. Leaders distribute the team
member procedures, guidelines and questionnaires to the team.
Questionnaire The individuals on the team complete the questionnaire
before meeting ( consulting with colleagues where appropriate ) .
First meeting The team leader arranges the first team meeting,
which lasts a half day ( maximum recommended time 3 to 4 hours )
to enable discussion and reflection of the individual scores,
reaching a team consensus score where possible.
Learning PROBE
The Learning and Skills Development Agency (LSDA ) has developed
a version of the tool that is designed specifically for the learning
and skills sector Learning PROBE . The tool is readily applicable
to colleges and training providers throughout the sector but at the
same time ensures full compatibility with the non-education-based
version Service PROBE .
Quality gurus
Crosby
Philip R Crosby was born in 1926 . The Crosby philosophy is that
quality is free and that the goal of any system should be zero defects.
It is based on four absolutes of quality :
Deming
W Edwards Deming was born in 1900 . He is most famous for his
work on quality in Japan. He began teaching in Japan in 1950 at the
request of the Japanese Union of Scientists and Engineers (JUSE ) ;
the Deming Prize for Quality began the following year, 1951 .
Demings philosophy, summarised in his 14 points, is that quality
can only be achieved by adopting an organisation-wide commitment
to continuous improvement and training, and by ensuring that
all people work together, removing barriers between departments
and between staff and management. There is an emphasis
on the psychology of motivation for both staff and managers
in Demings philosophy.
Demings 14 points are :
1 create constancy of purpose towards improvement
of product and service
2 adopt the new philosophy
3 cease dependence on mass inspection
4 end the practice of awarding business on the basis of price
5 constantly improve the system of production and service
6 institute training
7 institute leadership
8 drive out fear
9 break down barriers between departments and staff
10 eliminate slogans for staff
11 eliminate numerical goals and management by objective
12 remove barriers that stop staff having pride in their work,
such as annual ratings and merit payments
13 institute a vigorous programme of education and training for all staff
14 take action to accomplish the transformation.
Ishikawa
Kaoru Ishikawa was born in 1915 . His theories are based on
the belief that quality improvement is a continuous process.
He developed a system of seven basic quality tools that can be
used to support this continuous improvement. The tools are
designed so that staff at all levels can use them without having
to undergo excessive training.
Ishikawas seven basic tools are :
check sheets
control charts
flowcharts
histograms
Pareto diagrams
scatter diagrams.
His philosophy promotes the use of quality circles and the
involvement of staff at all levels in the quality process. It also
stresses the importance of management support to ensure
the quality of an organisations products or services.
Juran
Joseph M Juran was born in 1904 . He defined quality as fitness
for purpose and stated that the customers needs should inform
process, product and service design. Like Deming, he believed
that staff are not the main cause of poor quality, and that less
than 20% of problems are caused by an organisations staff.
His philosophy is based around three specific areas ;
his quality trilogy :
quality planning
quality control
quality improvement.
Quality gurus 47
Other gurus
Feigenbaum
Arman V Feigenbaums philosophy promotes the use of
organisation-wide systematic quality methods that involve
all staff and areas of an organisation.
Moller
Claus Moller asserted that the cornerstone of quality within an
organisation is the personal development of its staff. Many of his
ideas are based around identifying the ideal performance (IP ) and
actual performance (AP ) levels of staff and how to improve the AP .
Peters
Tom Peters stated that leadership is key to an organisation.
His theories promotes the concept of MBWA management by
walking about. They also place great emphasis on the customer focus
of an organisation. His more recent work focused on the need
for innovation, summarised as distinct or extinct, and the
need for organisations to make the most of women as customers
and employees.
Shingo
Shigeo Shingo is best known for his concept of Poka-Yoke, a method
of foolproofing that prevents mistakes being made. His theories
emphasise the need to set up systems that will, by their design,
always produce quality products or services.
Taguchi
Genichi Taguchis ideas place the emphasis of quality in the
pre-production of products or services. His theory is that quality
and reliability are the result of the design of services and products
rather than inspection.
Quality gurus 49
51
( see page 36 )
TQM total quality management TQM is a management model that
Next steps
53
Further information
Books
Dale BG . Managing quality ( 3rd edn ) . Blackwell Publishers,
Malden Massachusetts, 1999 .
DTI . Statistical process control : an introduction to
quality improvement. URN 95 /656 DTI Publications, 1995 .
DTI . From quality to excellence. URN 00 /1226 DTI Publications, 2000 .
Websites
Charter Mark www.chartermark.gov.uk
This site gives details of Charter Mark criteria and has background
information on some organisations that have gone for the award.
DTI (Department of Trade and Industry) www.dti.gov.uk
the Quality Model, and explains how to apply for the award.
IQA (Institute of Quality Assurance) www.iqa.org
The site gives details of the Institute and the services it offers.
LSDA (Learning and Skills Development Agency) www.LSDA .org.uk
The site shows all of the support available from the Agency. There is
also access to a considerable number of downloadable publications.
RQA (Raising Quality and Achievement) www.rqa.org.uk
The RQA site lists details of the support available to the sector
from the Benchmarking and Information strand and from each of
the other strands within the programme.
55
Appendix
Contact
Respect the culture of partner organisations and work
within mutually agreed procedures.
Use the preferred contact( s ) designated by the partner organisation.
Agree how far communication or responsibility is to be
delegated in the course of the benchmarking exercise.
Check mutual understanding.
Obtain an individuals permission before providing their name
in response to a contact request.
Exchange
Be willing to provide the same type and level of information that you
request from your benchmarking partner to your benchmarking partner.
Clarify expectations and avoid misunderstanding by establishing
the scope of the project as early as possible.
Be honest.
57
Confidentiality
Treat benchmarking findings as confidential to the individuals and
organisations involved. Such information must not be communicated
to third parties without prior consent ; make sure that you specify
clearly what information is to be shared, and with whom.
An organisations participation in a study is confidential and
should not be communicated externally without their prior permission.
Use of information
Use information obtained through benchmarking only for purposes
stated and agreed with the benchmarking partner.
The use or communication of a benchmarking partners name
with the data obtained or the practices observed requires
the prior permission of that partner.
Contact lists or other contact information provided by benchmarking
networks or databases will only be used for benchmarking.
Legality
If there is any potential question on the legality of an activity,
you should take legal advice.
Avoid discussions or actions that could lead to or imply
anti-competitive practices. Dont discuss your pricing policy
with competitors.
Do not obtain information by any means that could be interpreted
as improper.
Do not disclose or use any confidential information that may have
been obtained through improper means, or that was disclosed
by another in violation of duty of confidentiality.
Do not pass on benchmarking findings to another organisation
without first getting the permission of your benchmarking partner
and without first ensuring that the data is appropriately anonymous
so that the participants identities are protected.
Completion
Follow through each commitment made to your
benchmarking partner in a timely manner.
Try to complete each benchmarking project to the satisfaction
of all benchmarking partners.
Appendix 59
raising quality
and achievement
programme