The Contribution of Quality Management To The UK Economy
The Contribution of Quality Management To The UK Economy
The Contribution of Quality Management To The UK Economy
The contribution of
quality management
to the UK economy
This report was written and researched by the
Centre for Economics and Business Research (Cebr)
June 2012
This report was written and researched by Daniel
Solomon and Oliver Hogan from the Centre for
Economics and Business Research (Cebr)
EXECUTIVE SUMMARY 02
Brief introduction
Key conclusions of the report
Synopsis of the findings
Estimated quantitative impacts on the economy 03
Overview of the report
1 INTRODUCTION AND METHODOLOGICAL OVERVIEW
1.1 Overview and aims of the report
1.2 A history of quality management
1.3 Structure of the report and overview of study methods
2 LITERATURE REVIEW: THE EFFECTS OF QUALITY MANAGEMENT ON BUSINESS OUTCOMES AND GDP 12
2.1 Literature review introduction
2.2 QM definition and preliminary discussion
2.3 Stock prices
2.4 Customer and user retention and satisfaction, and employee and volunteer satisfaction
2.5 Costs 14
2.6 Financial performance and profits
2.7 Organisational culture 17
2.8 Conclusions from the literature review 18
6 CONCLUSION 56
6.1 Aims and structural overview of the report
6.2 Summary of the report’s findings
7 BIBLIOGRAPHY 58
Brief introduction study respondent’s data yielded a Profit RoI of 3:1, implying
This study by the Centre for Economics and Business Research that for every £1 spent on QM, profits increased by £3.
(Cebr) concludes that, not only has the effective application of Finally, one interview respondent, a quality excellence body,
quality management (QM) procedures already contributed to past reported that across 830 business services firms, investing
UK business and economic successes and that it will continue in QM programmes had reduced costs by £18 for every £1
to do so in the future, but that it could well provide an important spent. These impressive RoI findings indicate that if QM
foundation on which future business and institutional success programmes were instituted more widely, businesses would
could be built. Such success is vital to the task of returning the stand to benefit from net reductions in costs and net increases
UK to positive economic growth. in revenues and profits.
At the request of the Chartered Quality Institute (CQI) the Cebr These three conclusions are the final product of the combination
has investigated the economic impact of QM programmes, of primary and secondary data inputs provided through
through its effects on the productivity and success of organisations case studies (based on in-depth interviews), a survey of 120
in the private, public and voluntary sectors. organisations, and a review of the literature on business and
economic effects of QM.
The fruits of our lengthy investigation are contained within the
pages of this report, and summarised in this preamble. Our These three sources were generally coherent with each other.
investigations were carried out in accordance with the study’s Also, because they were independent their coherency indicates
twin research aims to, firstly, demonstrate and quantify the extent that the information they yielded is correct. That is, it is unlikely
to which more effective, intensive and longer-term use of QM that three independent data sources would all be incorrect in
systems and techniques create more productive and successful similar ways. This means that Cebr has every confidence in the
organisations and secondly, to show how this translates into three broad conclusions stated above.
positive effects on headline economic indicators.
Synopsis of the findings
Key conclusions of the report The literature review evidence suggests that effective QM
Overall, Cebr’s investigations of QM in the UK economy point to programmes can contribute to increases in share price, profit,
three broad conclusions: revenue and customer retention, as well as employee, customer
i. 5 Insofar as they have been implemented by organisations in the and user satisfaction. There was also a significant body of
different sectors of the economy, QM systems have already evidence indicating that QM programmes, particularly Lean
contributed substantially to the success of those organisations, programmes, reduce costs. This is especially relevant to public
judged against a wide array of metrics. Return on investment sector organisations1.
(RoI) data support this conclusion, indicating that businesses
can typically expect to make more from their QM systems The evidence reveals that QM mechanisms mitigate the cost of
than they spend implementing them. identifying and rectifying problems during or after production,
ii. 5 Via their impact on organisations’ outcomes, QM systems while raising those expenditures that are focussed on stopping
have, in aggregate, proven themselves important contributors problems before they occur. This cost rebalancing was found to
to the health of the UK macroeconomy. In other words, QM be associated with a reduction in overall costs.
programmes have already improved UK macroeconomic
outcomes significantly. The evidence also supports the contention that QM programmes
iii. 5If QM programmes were instituted more widely by often become effective with a lag, in that their most substantial
organisations in all sectors of the economy, these desirable impacts on an organisation’s economic outcomes can come
effects would become even more pronounced, to the several years after implementation2.
benefit of both the organisations individually and to the UK
economy as a whole. RoI data, estimated from a series of We also find, from the literature review evidence under scrutiny,
in-depth interviews, support this conclusion. Across a number that a precondition of a QM programme’s success is senior
interview respondents, the data indicated an average Revenue management’s active commitment to the programme in the first
RoI of 6:1, i.e. for every £1 spent on a QM programme, place.
revenues were increased by £6. They also indicated an
average Cost RoI of 16:1. This implies that for every £1 spent Responses to the survey questionnaire indicate that QM
on a QM programme, costs were reduced by £16. One case mechanisms were utilised primarily by businesses to control
The case studies also tend to cohere with the literature when The cause-and-effect assumption upon which the model was
examining QM’s effects on outcomes for organisations in given predicated – that QM can improve the efficiency of individual
sectors. For instance, case study respondents from all sectors often organisations’ productive processes and that this can improve
identified that their organisation’s QM programme had helped to headline UK economic indicators – was, in turn, premised upon
control costs and/or raise customer retention or satisfaction. widespread conclusions derived from the literature review. As
However, the literature and case studies do not always agree. such, Cebr is satisfied that this assumption is sufficiently robust for
For example, responses to the case study questions in the legal the purposes of this investigation.
services industry suggest that QM mechanisms become effective
comparatively quickly in that sector, more rapidly in fact than in Overview of the report
other types of commerce or industry. In order to garner the research materials needed for such a report,
Cebr gathered primary evidence from three main sources. They
Estimated quantitative impacts on the economy were: (i) an exhaustive global and academic literature review;
Using inputs drawn from the aforementioned sources, Cebr’s (ii) an extensive survey of 120 pertinent organisations; and (iii)
bespoke economic model fulfils the second aim of the report by a quantity of relevant original high-level case studies attained
formulating estimates of QM’s impacts on headline UK economic through interviews.
indicators.
A working definition of quality management (which accords
The model formulates estimates for each year of the 2009-13 with the CQI’s most up-to-date interpretation) is adopted at the
study period, and for an average or typical year of that period. beginning of the literature review. This working definition then
As the completed year with the timeliest data, the model’s applies thematically throughout the report as a whole.
headlined estimates focus, consequently, on 2011. They are:
The study begins with an overview of the historical development
i. 5 GDP of QM. The historical overview itself commences with the
In 2011, Cebr estimates QM procedures contributed £86bn beginnings of modern quality management in armaments’
to Gross Domestic Product (GDP) in real terms (based on production during the First World War, when specialised quality
2009 pounds sterling).3 In other words, we estimate UK GDP managers first began to intercept defective items and had
would have been 6.02% lower than it really was in 2011, had them scrapped or reworked post-production. The subsequent
no QM procedures been in place in the economy. development of QM is then discussed through the prism of
the theorists contributing most to its systems and practice
Furthermore, if QM programmes had been rolled out as fully development, notably Shewhart, Deming and Juran. The
as possible throughout the UK economy then 2011 GDP discussion focuses on their application of statistical methods
might have been £46bn higher (in terms of real 2009 pounds). to quality, and the broader management and organisational
This estimate implies that, in 2011, had QM systems been principles they developed and refined.
implemented throughout the economy, GDP would have been
3.37% higher. Then, in light of US and British concerns over their international
competitiveness in the 1970s and 1980s, and building on growing
ii.5 EMPLOYMENT industrial and political opinion that the promotion of QM could
In 2011, Cebr estimates that QM procedures caused UK supply a desirable additional competitiveness, the introduction
economy-wide employment to be 1.43 million higher than it discusses the wholesale adoption of new QM techniques, such as
would otherwise have been. This means our economic model Kansei Engineering, Continuous Improvement and Lean.
estimates that UK employment would have been 4.94% lower The historical overview finishes by discussing the development
than it actually was in 2011, had no organisation in any sector of QM certificates – such as ISO 9001 and PQASSO – and the
of the economy had any QM procedures in place that year. benefit that organisations derive from them.
Moreover, if QM programmes had been instituted as fully The second part of the introduction explains that the report adopts a
as possible in all sectors of the UK economy, employment diverse set of methodologies: (i) a literature review; (ii) case studies;
in 2011 could have been higher than it actually was by (iii) a survey of 120 organisations; and (iv)the formulation of a new
455,000 jobs. This represents a forgone potential increase in bespoke economic model by Cebr, the purpose of which is to estimate
employment of 1.57%. the impacts of QM on headline UK macroeconomic indicators.
iii. 5TAX RECEIPTS TO THE EXCHEQUER The first three methodological stages are primarily focussed on
In 2011, QM procedures are estimated to have contributed achieving the report’s first aim, and constitute primary sources of
a minimum of £8.4bn (in terms of real 2009 pounds) to the data in their own right for use in the fourth stage.
Exchequer4.
The final methodology, Cebr’s new economic model of the impact
What is more, if QM programmes had been rolled out as fully of QM, uses the primary data inputs provided by the first three
as possible, in 2011 the Exchequer’s net tax takings would methodology stages to estimate the impact of QM mechanisms
have been nearly double that and might have been £8bn (in on headline UK macroeconomic indicators, thus achieving the
terms of real 2009 pounds) higher than they actually were. report’s second aim.
References
1. See Cohen and Brand (1993) and the Scottish Executive
(2006) for discussions on Lean programmes’ particular
effectiveness in reducing public sector organisations’ costs.
2. Empirical investigations tend to agree that QM programmes
become effective with a lag, but disagree as to the length of this
lag. For example, Hannah (2011) finds that ISO 9001-certified
businesses’ asset returns become noticeably higher than those
of comparable businesses about two years after certification.
By contrast, Hendricks and Singhal (2001) find that QM
programmes tend to become effective with a lag of up to five
years.
3. The model yields’ estimates for each year from 2009-13 and all
other estimates are given in terms of real 2009 pounds; 2009
is the first year of the model. Presenting the estimates in this
manner strips out the effects of inflation, which reduces the real
buying-power of a pound in each subsequent year. Giving the
model’s annual estimates in terms of 2009 pounds makes the
estimates for each year directly comparable. Achieving direct
comparability in this manner – ie by presenting estimates in
terms of currency in the first year of the model – is standard
practice in multi-year empirical models.
4. Taxes on incomes are not included in these estimates.
5. Only one respondent provided data which enabled Cebr
to estimate a Profit RoI. Hence, no average Profit RoI was
estimated across different businesses. The Profit RoI was found
to be 3:1, implying that for every £1 spent on QM, profits
increased by £3.
1.1 Overview and aims of the report These new mechanisms were dependent on a statistical analysis
This report, commissioned by the Chartered Quality Institute of processes, but QM has since evolved to include a holistic
(CQI), details Cebr’s analysis of quality management’s (QM) toolkit that is applied in all sectors of the economy. Modern-day
contribution to the UK economy. This introduction provides QM mechanisms typically employ statistical process control
context for the rest of the report by summarising the evolution mechanisms, and emphasise management leadership and
of QM since its inception during the First World War. It then employee commitment to quality improvements.
describes the investigative methods used and the report’s
structure. The structure is such that the analysis of each section Noticing that poor-quality military equipment was contributing to
builds logically on the preceding sections. casualties, the belligerent governments instituted QM procedures
in their armaments factories. While these procedures were
The dual objectives of the research were to demonstrate and rudimentary by today’s standards, it is accepted that modern QM
quantify the extent to which more effective, intensive and systems materialised during the First World War. The procedures
longer-term use of QM systems and techniques: (i) creates created a number of quality inspectors who focussed on selecting
more productive and successful organisations by delivering which armaments did not meet required standards after they
demonstrable RoI value; and (ii) affects headline UK economic had been produced. These armaments were then reworked or
indicators. These aims are complementary but distinct, as are the scrapped.6 QM processes during the First World War were simpler
methods used to achieve them. The three investigative methods than those which came after because they focussed primarily on
used in the report - a literature review, case studies and a survey managing quality after production, as opposed to during it.
of 120 organisations – have focussed on achieving the first aim.
We then used a bespoke economic model to gather the evidence More advanced QM mechanisms came about in the mid-1920s
from the three investigative streams as inputs for the purpose when a statistician, Dr Walter Shewhart, formulated the first-ever
of estimating the effects of QM on headline UK economic statistical ‘control chart’ while working in manufacturing at the
indicators. Western Electric Company’s Bell Laboratories in the US. The
contribution of these charts was to quantify the extent to which
This report adopts the CQI’s definition of QM as its own working variation in the outputs of a productive process was caused by the
definition of QM. A short version of the definition is now given to production process itself, as opposed to being caused by factors
contextualise the discussion in this introduction. The full version outside the specified parameters of the process.
of the definition is given and discussed at the start of sub-section
2.2. Under the working definition, QM techniques: (i) are applied This gave the charts two principal functions: (i) they could be
across entire organisations and focus on meeting customer used to reduce variation in output quality which resulted from
requirements; (ii) facilitate the planning of product lifecycles and factors outside the productive process; and (ii) they could inform
delivery; and (iii) quantify all elements of productive processes to changes to productive processes in order to alter the quality of
drive continual improvements in quality. This working definition outputs. This innovation was the first attempt to determine how
of QM ensures that only those organisational practices that have a productive processes affected the quality of outputs, and to tie
prima facie right to be called QM are discussed in this report. the quality of outputs closely to productive processes. Previous
attempts to control output quality (during the First World War)
1.2 A history of quality management focussed largely on rejecting units post-production. Shewhart’s
The development of modern QM has been driven by the unique innovation was to use statistics to analyse and alter
innovations and ideas of notable individuals. These have altered productive processes with the aim of stopping defects before they
the way in which entire businesses manage quality, and have occurred in the first place.
led to radical changes in the business culture and practices
of entire countries. In particular, they have promoted the role During the inter-war and Second World War periods, Shewhart’s
of management and the active involvement of staff in driving ideas were built on by Deming, Dodge and Roming. While all
quality improvements. Modern QM began modestly during the of their contributions were important, we focus on Deming’s
First World War, when armaments were sent back for fixing or pre-eminent role. Deming realised that Shewhart’s methods could
discarded if they did not meet quality standards after they had be applied outside of manufacturing and provided four principal
been produced. By the mid-1920s, QM systems had shifted their innovations:
focus to analysing and altering productive processes, to stop
defects before they became apparent in finished products. This 1. He explained that statistical sampling methods could be
reduced the need for post-production reworking or scrapping. used to inform QM processes and regulate the quality of
The literature review adopts a working definition of QM (which The following are details of the construction of Cebr’s bespoke
applies to the literature review and to the report as a whole) economic model, which seeks to analyse QM’s effect on four
before discussing the findings of the literature review as to how key UK economic indicators: GDP; the efficiency of sectors’
QM has affected different outcomes. These outcomes cover: (i) productive technology; employment; and the Exchequer’s net
stock prices, (ii) customer and user retention and satisfaction, tax receipts.27 Detail of the model’s construction is reserved until
and employee and volunteer satisfaction; (iii) costs; (iv) financial nearer the end of the report, because it builds on the evidence
performance and profits; and (v) organisational culture. Using this base provided by the literature review, case studies and survey
outcomes-based structure, the literature review discusses how results. For now, five points should be noted:
the application of QM techniques has affected these outcomes in
the public, private and voluntary sectors. Linkages between QM’s i. The model sought to estimate the values headline UK
effect on the different outcomes are discussed throughout, and economic indicators would assume under two scenarios: the
general conclusions are drawn at the end of the literature review. first, if no institutions had implemented QM at all; the second,
if all institutions had implemented QM as fully as possible.
The remainder of the report builds on the literature review, The use of scenario-based analysis enables the model to
using it to inform the structure of the case studies and survey. estimate the effect QM has already had on the UK economy,
The results of the literature review are compared to those of the and the further benefits which could result if it were rolled out
case studies and survey, to determine the extent to which the more comprehensively.
three different elements of the evidence base are consistent.
Finally, Cebr’s bespoke economic model builds on these three ii. The model attains these headline results by breaking the entire
elements, using the quantitative data they provide as inputs in economy down into eight broad sectors, analysing the effects
order to estimate the UK economy-wide impact of QM. The QM has on outcomes in each of these sectors, and then
model is not an evidence source in its own right. Rather, it is a aggregating the results.
tool of analysis which uses the evidence base provided by the
literature review, case studies and survey to estimate the effect of iii. The theory underlying this sector-based methodology,
QM on headline UK economic indicators.24 Cobb-Douglas production functions, is well-established in
the economic literature. The model estimates QM’s effect on
Following the literature review, the report moves on to consider sectoral production technology (as operationalised within the
the case studies that were formulated based on a process of in- Cobb-Douglas framework) and this feeds through into how
depth interviews that formed part of the research brief. Following QM affects the sectoral outcomes.
the objectives of the literature review, these case studies seek to
determine how QM techniques have affected the outcomes of iv. The modelling estimates of interest are QM’s effects on UK
different organisations. The case study responses will be linked to economy-wide GDP, net tax receipts and employment. The
the literature by examining the extent to which they agree with it. model also provides estimates for how QM implementation
2.1 Literature review introduction This literature review and the report as a whole adopt the working
This literature review discusses the real-world evidence of how definition of QM used by the CQI itself: “Quality management is
QM systems causally affect the outcomes of private sector an organisation-wide approach to understanding precisely what
businesses, and of public and voluntary sector organisations. customers need, and consistently delivering accurate solutions
The section seeks to further Cebr’s first research objective, that is within budget and on time. QM techniques ensure the effective
to demonstrate and quantify the extent to which more effective, design of processes that verify customer needs, plan product
intensive and longer-term use of QM systems and techniques lifecycle and design, and produce and deliver the product or
creates more productive and successful organisations. service. Finally, QM techniques measure all process elements,
the analysis of performance and the continual improvement of
In concluding our findings from the literature review, the different the products, services and processes that deliver them to the
strands of the discussion are pieced together to suggest that the customer.” This definition provides a rigorous description of QM,
widespread implementation of QM procedures can: (i) improve facilitating Cebr in determining which organisational practices
the UK’s international competitiveness; and (ii) boost its rate of have a prima facie right to be referred to as QM. At the same
economic growth. This furthers Cebr’s second research objective, time, it is not unduly restrictive. The application of this definition
that is to examine how QM programmes, taken in aggregate, in the literature review and throughout the report ensures that the
affect headline UK economic indicators. report’s findings will be attributable only to those organisational
practices which the CQI defines as QM.
The review adopts a structure whereby QM’s effects on different
outcome metrics are examined, cutting across the public, private The following preliminary discussion highlights four difficulties
and voluntary sectors. QM’s effects on the following outcomes that occur throughout the discussions of QM in the literature.
are examined: (i) stock prices; (ii) customer and user retention These will not be referred to going forward, but the reader should
and satisfaction, and employee and volunteer satisfaction; (iii) be aware of them:
costs; (iv) financial performance and profits; and (v) organisational 1. While this report adopts a working definition of QM, there
culture. The linkages between QM’s effects on these outcomes is actually no single widely-agreed definition of QM used in
will be highlighted throughout the literature review. This structure industry or across the public or third sectors. This means that
was chosen for three reasons: the precise features of any given QM programme will be case-
i. There are linkages between QM’s effects on these different specific. A QM programme may take the form of a Six Sigma,
outcomes and this structure enables those linkages to be Kaizen, ISO 9001, Total Quality Management (TQM), Taguchi,
highlighted. Any one QM programme or award can directly Lean Manufacturing, Kansei Engineering or another, perhaps
affect a number of different outcomes for an organisation. bespoke, programme.
For instance, a single programme might affect both costs and 2. The causal effects of specific QM mechanisms are difficult to
customer retention. Furthermore, any given programme might tie down. For example, if a business experiences rising profits,
also have indirect effects. For example, a QM programme it is difficult to determine the extent to which the rise was due
could improve employee satisfaction and this, by making to its QM mechanism(s) or to changing market conditions.29
employees more productive, could go on to increase profits. Statistical articles are generally better at identifying QM’s
ii. Similar (although non-identical) outcome metrics are affected effects than non-statistical papers.
by QM across the public, private and voluntary sectors. The 3. There is often a gap in time, or ‘lag’, between the
similarity of these metrics across the different sectors means implementation of a QM programme and its effects on
that it is appropriate to examine QM’s effect on them by outcomes.
cutting across the different sectors. 4. Authors tend to focus on reporting cases in which QM
iii. Often, a given article or book examines the effect that a wide programmes have been successful. Hence, the literature may
range of QM practices have on specific outcomes.28 Hence, well exhibit some bias in favour of successful cases of QM
the literature does not lend itself to being broken down by implementation.
different types of QM system, but does lend itself to being
broken down by QM’s effects on outcomes. The 1982 UK Parliament White Paper entitled ‘Standards, Quality
and International Competitiveness’ noted that “success in world
2.2 QM definition and preliminary discussion markets increasingly depends on a supplier’s ability to satisfy
The literature review begins by adopting a working definition customers on… quality.” The White Paper concluded that if UK
of QM and caveats the analysis by highlighting the four main businesses implemented QM systems widely, this would increase
difficulties associated with discussions of QM. the UK’s international competitiveness and economic growth.
Hannah (2011) shifts the focus of the discussion by reviewing The authors found a linked chain of improvements: QM increases
the literature comparing the return on assets (RoA) of “paired the reputation for quality, which increases market share, which
organistaions, which were initially similar in terms of size, sector, improves financial outcomes. Cole and Flynn (2009) also
profitability, etc,” but where one of the pair adopted ISO 9001 noted that there was often a delay between an automobile
and the other did not.53 Hannah finds that the RoA of the adopter manufacturer successfully instituting a QM programme and it’s
began increasing (relative to that of the non-adopter) two years achieving a reputation for high quality that supported its market
before certification occurred. The RoA differential continues to share. This was particularly true when competing against other
increase even after adoption. Because Hannah’s review examined automobile manufacturers that had already attained a reputation
‘paired’ businesses, his results indicate that ISO 9001 certification for quality. This suggests a lag between the implementation of a
does cause increased RoA. Hannah’s results indicate that the QM programme and it becoming effective in terms of increasing
RoA differential of matched ISO 9001-certified and non-certified market share.
businesses in the industrial machinery industry increases over
time. This suggests that ISO 9001 becomes more effective the QM also affects the financial performance of public sector
longer it is in place – ie it becomes more effective with a lag. organisations and similar linkages between QM, financial
performance and other metrics apply. For instance, the
Like Hannah (2011), CQE (2005) examined how attaining a QM aforementioned Scottish Executive report used case study
certificate or award under the European Foundation of Quality evidence to analyse how Lean QM affected Scottish public sector
Management (EFQM) Model framework affects a business’s organisations.56 Lean was originally applied to manufacturing
financial outcomes.54 CQE compared the financial results of by Toyota with five core principles: “specify the value desired;
businesses which won the award against those of similar, or identify the value stream… challenge all of the wasted steps;
‘matched’, businesses which had not won the award. Echoing make the product flow continuously; introduce pull between all
Hannah’s results, CQE finds that “award-winning companies steps; the time and information needed to serve the customer
experience higher increases in sales, capital expenditure [as a [should] continuously fall.” The Scottish Executive’s definition of
share of] assets, capital expenditure [as a share of] sales, asset Lean combines these principles with Rapid Improvement Events
growth and reductions in costs [as a share of] sales.” which make “small, quickly introduced changes.”
The Executive’s report found that Lean had improved public sector
These findings suggest that winning an EFQM Model award financial outcomes, to the extent that the case study respondents
improves financial performance. The following table summarises correctly identified causal effects. Implementing Lean produced
CQE’s main results, indicating that winning an EFQM Model quantifiable outcomes, some of which were as follows:
improves key financial indicators. The figure below details 1. “Processing times were reduced by two-thirds in one local
the average percentage differences between the changes in government department.”
performance measures for winners and for non-winners three 2. There was “improvement in patient flow time of 48%” for
years after winning the EFQM Model award. another department.
3.1 Structure of the case studies Estimates for three types of QM RoI are formulated:
Cebr conducted case studies with 18 private, public and 1.
voluntary sector organisations to determine the extent to which
QM mechanisms improved their outcomes in terms of cost 2.
restructuring and rebalancing, employee satisfaction, revenues
and customer retention. The return on investment (RoI) of private 3.
sector QM programmes is also estimated in cases where sufficient Depending on the data provided, different RoIs are estimated
data was provided by respondents and could, where necessary, be for each private sector case study. RoI estimates are expressed as
supplemented by information about the interviewed organisations ratios in the form X:1. A value for X of greater than one is taken
in the public domain. The investigation accords with the report’s as indicative that the QM programme was worthwhile. In all cases
first aim of examining how far the effective implementation of QM studied where it was possible to calculated RoIs, the estimates
techniques creates more productive and successful organisations. of X are greater than one. This implies that QM is beneficial
throughout the private sector for all three types of RoI.
The case studies are grouped into eight sectors.68 This structure
flows from the content of the literature review. In other words, In some instances, a case study respondent requested that his
the literature review contains broad predictions as to how QM or her own name and/or his or her organisation’s name not be
mechanisms affect the outcomes of organisations in different disclosed. In such instances, Cebr has anonymised the case study
sectors. Hence, the adoption of this structure means that the in accordance with the respondent’s wishes.
findings which each of the case studies yielded are readily
comparable with the literature’s sectoral predictions. 3.2 Manufacturing sector case studies
3.2.1 Case study 1
A comparison between the responses and our findings from the COMPANY: SUNSEEKER INTERNATIONAL
literature is included within each case study.69 Furthermore, this RESPONDENT: SIMON HANNAM, OPERATIONS MANAGER
structure allows Cebr to examine how far the case study responses PRINCIPAL PRODUCT LINES: YACHTS, MOTOR YACHTS AND
for each sector are coherent with the literature’s predictions. This SPORTS CRUISERS
more general analysis is undertaken in a conclusion at the end of This case study examines how the QM programme of a UK
each sectoral subsection.70 manufacturer affected its revenues, costs and customer-retention
rates since 2009. The UK-based manufacturing business has
This section’s grouped-sector structure means that the responses 2,300 employees and an associated global dealership network in
given by each case study respondent can be readily compared 64 countries. The UK business had a 2011 Financial Year turnover
to those yielded by other respondents in the same sector. This of £280m to which this case study pertains.
enabled Cebr to estimate how far the responses given by each
case study respondent were representative of their sector’s case Sunseeker International’s QM programme is named In Process
study responses taken as a whole. As a consequence, it is possible Control (IPC) and was introduced in early 2009. Its main organ
to determine how far general conclusions, as to the impact of QM is a QM team, whose job it is to ensure that finished products
on organisations’ outcomes, can be drawn for each sector on the meet three standards of quality: (i) regulatory standards; (ii)
basis of the case studies. This issue is discussed at the end of each internal company quality standards; and (iii) customers’ quality
subsection. expectations.
Estimating the RoI of private sector organisations’ QM The IPC programme includes technical process control aspects
programmes succinctly capture the net benefit each business drawn from the Kaizen ‘Plan, Do, Check, Act’ and ‘Lean
is believed to have derived from its programme. The RoI data Manufacturing’ QM frameworks. The management philosophy of
reported are estimates which have been inferred from the data the ‘Zero Defect’ framework is incorporated, with a heavy focus
provided by each respondent.71 RoI estimates are only formulated on product aesthetics, as would be expected in the manufacture
in cases where the respondent has provided sufficient information of such luxury items as yachts. The programme is currently used
to do so. Hence, RoI estimates exist for six of the 14 case studies in half of the company’s product lines, with incorporation into
which discuss the QM programmes of private sector institutions. additional product lines being viewed by the company as key to
future success. Senior management monitors IPC’s results via a
‘quality score card’ system and, as of 2012, will be financially
rewarded for QM successes.
Where it has already been implemented, the IPC programme Points i to iv demonstrate the respondent’s belief that the SPS
has substantially rebalanced costs away from ‘appraisal costs’, in programme has yielded notable cost reductions. The literature
which product quality is evaluated during or after the production coheres with this finding, in which there is a large body of
process, toward ‘prevention costs’, in which processes are evidence suggesting that QM programmes lower costs. In the
evaluated and designed to ensure that defective units are not manufacturing sector, Oliver and Qu (1999) found evidence that
produced in the first place. This rebalancing was predicted by most businesses believe that QM systems can be an effective cost-
Beecroft (2000) for all sectors. The respondent gave an example of reduction tool. Similarly, Hannah (2011) finds that manufacturers
cost rebalancing – one product line has already seen a decline in who were awarded ISO 9001 certification saw costs decrease
post-production per-unit test times of 200 hours. These reductions relative to businesses who were otherwise similar but which
are substantial enough to enable Sunseeker to reduce its cost had not been certified. Point iv is also corroborated by the
base in the future.74 Beecroft (2000) also predicted that cost literature. Across all sectors, Collins and Nussey (1994) found
rebalancing would often lead to a reduction in costs. that attainment of ISO 9000 certification altered organisation’s
business cultures, and that these cultural changes reduced costs
3.2.2 Case study 2 and drove increases in profits. Point v also ties in well with the
COMPANY: SMITH’S ENVIRONMENTAL PRODUCTS LTD literature. Rechheld and Sasser (1990) find that well-implemented
RESPONDENT: RON BROWN, QUALITY MANAGER QM programmes increased customer retention in the financial
PRINCIPAL PRODUCT LINES: ‘WET SYSTEM’ AND ‘DRY services sector and Farhoomand (2004) found a similar outcome
SYSTEM’ HEATERS in shipping services.
This case study discusses how the QM programme of a UK
manufacturer has affected its revenues, costs and customer- Point v implies that revenues would have been 50% lower than
retention rates since 1990. The business had approximately 60 they actually were in 2011, had the programme not existed.
The programme is overseen by a steering committee and senior There was only limited evidence that the QM programmes
management who track quality metrics such as customer had increased employees’ workplace satisfaction. This was the
complaints. The executive team is financially rewarded if the only notable point of departure between the literature and the
business meets quality targets. manufacturing sector case studies. Given that the literature
predicts that QM mechanisms often increase workplace
The pilot programme has already achieved the following results in satisfaction, this finding suggests that the manufacturing
the operations department: businesses studied above might not be typical of most
i. Machine uptime has increased by between 5% and 7%, as manufacturers or that they simply had not analysed this in the
has machine efficiency, reducing per-unit costs. context of their QM systems.
ii. Assuming that per-unit costs depend on machine efficiency,
this suggests that the programme has decreased marginal costs
per unit in the operations department.
The business’s costs structure has been altered. Throughout the Point i represents a point of departure from the thrust of the
UK arm of the business, the share of costs which are ‘appraisal literature’s findings. The fact that similar, as opposed to more
costs’ has fallen relative to those which are ‘prevention costs’. pronounced, outcomes are expected in future years implies that
This was predicted by Beecroft (2000). This change in cost- the business’s QM system realised its full potential soon after
shares occurred because the QM programme’s week six PPA being implemented. This does not accord with those papers in
reviews and attendant BIP measures increased prevention costs the literature which found that the impact of QM systems on
across Costain Group, while allowing the business to scale back costs and revenues often becomes more pronounced the longer
appraisal measures. This cost rebalancing is expected to persist they have been in place.92 Point i suggests that QM systems may
going forward. impact legal services businesses more rapidly than they impact
organisations in other sectors.93
3.5 Legal services sector case studies
3.5.1 Case study 7 The Chief Executive reasoned that the programme has helped to
COMPANY TYPE: COMMERCIAL LAW FIRM establish a well-structured and planned relationship with each
RESPONDENT: CHIEF EXECUTIVE client from the outset and that this gave clients peace of mind,
SERVICE LINES: CORPORATE AND COMMERCIAL LAW, thereby increasing customer-retention rates. On point ii, in a
INTELLECTUAL PROPERTY LAW, LITIGATION & DISPUTE manner analogous to engendering well-structured and planned
RESOLUTION, GROUP ACTION LITIGATION, INSURANCE relationships with clients, papers in the literature tend to find that
LITIGATION, EMPLOYMENT LAW, INSOLVENCY & QM programmes, by increasing product or service quality, increase
RESTRUCTURING, PROPERTY LAW AND PRIVATE CLIENT LAW customer-retention rates. Such papers include: Hendricks and
This case study examines how the QM programme of a UK Singhal (2001), Farhoomand (2004), and Cole and Flynn (2009).
Points iii and iv are corroborated in the literature. Although the Telefonica UK’s 2009 ongoing network quality drive has attained
literature did not discuss the transport and telecommunications several achievements of particular interest:
sector specifically, this indicates that LOROL’s case study findings i. In 2009, Telefonica UK ascertained that its network had an
are typical of the experiences of other businesses. Corroborating unacceptably-high drop call rate. It used a portion of the 2010
point iii, Hannah’s (2006) study on the effects of ISO 9001 Telefonica SA €4.3bn improvement and R&D budget to rectify
indicates that the certificate exerts more impact on businesses’ this. Since 2009, quality has improved significantly, reducing
headline financial results the longer it has been in place. Point iv the drop call rate. The Telefonica UK network is now ranked
finds support in Beecroft (2000). first for network quality by Ofcom.116
ii. The ‘Continuous Improvement’ aspect of the programme sets
According to industry surveys, LOROL’s customer satisfaction gradually rising, achievable quality targets. This increased
scores have risen substantially over the past four years, mainly employee morale.117
due to the company’s pre-existing quality culture and practices.
The academic literature suggests that this finding is by no means The Head of Quality reported that Telefonica Europe’s QM
uncommon: Reichheld and Sasser (1990), Farhoomand (2004) programmes, including network improvement, R&D and
and the Health Foundation (2006) all find that QM systems advertising, had achieved the following:
improve customer satisfaction. i. Customer-retention rates were 2% higher in 2010 than they
would have been had the programmes not been in place.
ii. Assuming that customers are homogenous in aggregate, this
suggests that revenues were 2% higher in 2010 than they
would have been had the programmes not been in place.
Based on the revenue data provided, and assuming that
customers are homogenous in aggregate, this suggests that in
2010 Telefonica Europe’s revenues would have been £305m
lower than they actually were.
iii. Customer-retention rates are expected to have increased
three years from today, especially in the corporate and SME
markets, implying that a significant part of QM mechanisms
have their effects on outcomes (customer retention, in this
case) after a lag of several years.
3.7.3 Conclusion to the transport and telecommunications The Quality Manager reported that, in 2011, £350,000 was spent
sector case studies on QM by the LMAs, approximately 1.4% of their collective
The case studies in this section were broadly in agreement with turnover. The QRP has yielded the following results:
each other and with the literature, suggesting that the findings i. It has identified members of the LMA network which had
reported by these businesses are typical of other companies in the not achieved the Level 1 minimum necessary standard. The
transport and telecommunications sector. process encouraged these underperforming members to work
to attain the Level 1 standard, and those that consistently
Both reported that their QM programme had exerted at least some failed to meet the Level 1 standard were disaffiliated. These
downward pressure on costs and rebalanced cost structures in disaffiliations increased the average service provision and
favour of “prevention.” Both had remuneration schemes or quality governance quality standards of the remaining LMAs in the
metrics in place which promoted management’s commitment to network.
the QM programme. Having such schemes and metrics in place ii. It fostered a culture of continuous improvement wherein
follows from the literature, which suggests that management’s LMAs self-motivate to progress up the Levels.
active commitment is important to a QM programme’s success. iii. It encouraged LMAs to increase user involvement and
The findings imply that the QM mechanisms supported profits in inclusivity, thereby putting upward pressure on user-retention
both companies. rates.120
iv. By improving governance standards, the QRP has increased
There were some points of departure between the companies’ the average turnover of each LMA over the current cycle. The
findings. One of them reported that its QM system had become QRP is expected to continue increasing the average turnover
effective with a lag and had exerted upward pressure on customer of each LMA over the next three years.
retention, just as the literature predicts. The respondent from the
other company, LOROL, did not identify these effects. However, Points ii, iii and iv suggest that Mind’s experiences are typical of
he noted that LOROL’s gaining ISO 9001 followed easily on from those other organisations which were discussed in the literature.
its pre-existing quality procedures owing to similarities between Of particular interest is point iv, which notes that the QRP’s effect
them. Any similarities between ISO 9001 and the pre-existing on governance standards has improved financial performance.
procedures may have obscured ISO 9001’s impact on customer Several authors note that the impact a QM programme has on
retention and obscured the length of time it took to become financial performance is dependent on management’s
effective. commitment to the programme. Such authors include Deming,
in Out of the Crisis, and Gallear and Ghobadian (2004), whose
3.8 Voluntary sector case studies survey of businesses finds that management’s leadership and
3.8.1 Case study 14 vision are key preconditions of successful QM implementation.
INSTITUTION: MIND Building on these authors, point iv suggests that, in the case of
RESPONDENT: PERRY MARSHALL, QUALITY MANAGER Mind, the QM system itself improved governance. To the extent
PRINCIPAL SERVICES: COUNSELLING, RESIDENTIAL that this improvement increased management’s commitment to
HOUSING AND SUPPORT, ADVOCACY AND LEGAL ADVICE, the QRP, this will have made the QRP more effective.
SOCIAL GROUPS AND CAMPAIGNING
Mind is a UK mental health charity, comprised of a national The Quality Manager reported that the QRP has increased
central organisation and a network of over 180 affiliated Local volunteer satisfaction by offering them better support and training.
Mind Associations (LMAs) in England and Wales. This case The respondent reasoned that this had caused volunteers to
study discusses how Mind’s QM programme affected the LMAs’ raise revenues more effectively, and so was partially responsible
turnover, volunteer satisfaction and quality of service provision for increasing LMA turnover. Discussing the voluntary sector,
since 2008. Each LMA is an autonomous affiliate of Mind, the Centre for Voluntary Action Research at Aston Business
responsible for its own fundraising and services provision. School (2004) noted that effective QM programmes can increase
Affiliation ensures each LMA meets Mind’s service provision volunteer satisfaction.
and governance quality standards. Each LMA provides some or
all of the following services: counselling, residential housing The LMAs devote significant effort toward implementing both
and support, advocacy and legal advice, social groups and appraisal and prevention mechanisms and, as predicted by
5.1 Introduction to the model with reference to this report’s working definition of QM.
In accordance with this report’s second aim, this section provides
quantitative estimates of the extent to which more effective, The values of (i) to (iv), above, under the Counterfactuals are
intensive and longer-term use of QM systems and techniques can compared to their values under a Baseline Scenario which
be expected to affect headline UK macroeconomic indicators. reflects each sector’s intensity of QM implementation as it
To further this end, Cebr developed a bespoke economic model actually is in reality for each year of the study period. For now,
with the purpose of formulating estimates of the effects of QM note that comparing the values the four indicators take under
on: (i) GDP, (ii) employment, (iii) net Exchequer tax receipts (or Counterfactual One against their actual current values (under the
net benefit to the Exchequer)142 ; and (iv) sectoral production Baseline Scenario) provides estimates of how far QM programmes
technology.143 have already positively impacted on UK macroeconomic
indicators. Comparing the values the indicators take under
Having just described the model’s purpose, this subsection Counterfactual Two against the values they take in actuality,
goes on to explain the modelling framework and, thereafter, provides estimates of how much potential QM has to improve
discusses the quality of the data which the model uses as inputs. UK macroeconomic indicators if it were rolled out as fully as
We highlight that the data is likely to be a close reflection of possible.
economic reality and that, consequently, the model’s estimates
of the impacts of QM on UK macroeconomic indicators are also The modelling analysis and the associated counterfactual scenario
likely to be good approximations of the economic reality. The comparisons take place for each year of the 2009-13 study period
reasons why this modelling methodology, as opposed to any in order to estimate QM’s effects on headline UK macroeconomic
other tool of economic investigation, has been employed are then indicators in the recent past, present and near future.
discussed. The following subsection gives an in-depth description
of the modelling method and discusses how the model’s key The model’s estimates for 2011 are the main subject of the
inputs were derived. The model’s limitations are discussed in this discussion, because an analysis of this year gives the most up-to-
subsection and the following subsection. The model’s assumptions date estimates of QM’s impacts on the UK economy. To ground
are also discussed in the following subsection. the 2011 estimates in the recent past and near future, figures
detailing the model’s estimates for each year of the 2009-13
Cebr’s bespoke economic model comes toward the end of the study period are also presented. To provide additional context,
report because it builds on data provided by the literature review, estimates for a ‘typical’ year are also provided.
case studies and survey. It uses these data as inputs to formulate
estimates as to the impact of QM on the aforementioned UK The model’s first limitation is that the estimates it yields will only
headline macroeconomic indicators.144 Hence, the model does be as good as the inputs used to produce them. This limitation
not provide ‘real world’ evidence per se, rather an assessment of applies to all economic models which, like this model, estimate
what can be expected to be the impact of QM under certain sets the impacts which one variable has on other variables under
of assumptions and inputs. a certain set of assumptions and conditions. This limitation is
unavoidable. Consequently, four points are of note:
In lieu of being able to provide real world evidence in its own i. Because the model is reliant on inputs from the literature
right, the model utilises the real world evidence provided by the review, case studies and survey, the estimates of the effects
preceding sections in the following analytical framework. The of QM on headline UK economic indicators will only be
model employs the empirical evidence to estimate the values that accurate to the extent that inputs from the literature review,
the headline UK economic indicators – (i) GDP, (ii) employment, case studies and survey are reflective of reality.
(iii) net Exchequer tax receipts; and (iv) sectoral production ii. The inputs into the model were drawn from a comprehensive
technology – can be expected to take under two counterfactual examination of empirical evidence provided by the QM
scenarios. Intuitively, the first counterfactual scenario considers literature, 18 case studies, and a survey of 120 organisations.
a situation in which no public, private or voluntary sector This constitutes a large evidence base. It is, therefore, not
organisation had implemented any QM programme at all. unreasonable to assume that the estimates produced by the
Intuitively, the second counterfactual scenario captures a situation model are a close approximation of the economic reality.
in which all organisations have implemented QM as fully as iii. Cebr’s bespoke economic model makes use of the QM input
possible. These situations are called Counterfactuals One and data and publically available macroeconomic data on GDP,
Two, respectively. Discussions in the latter half of subsection 5.2 employment and taxation, which is provided by the Office for
explain how Counterfactuals One and Two are defined rigorously National Statistics (ONS). These official ONS statistics, when
Had Cebr chosen to employ regression analysis in place of the In each sector, and in each year, there is level of efficiency
chosen model, we would have used regressions to estimate the implicit in that sector’s production technology. The degree of
values of the aforementioned headline macroeconomic indicators efficiency of a sector’s production technology reflects the ease
of interest (treating them as dependent variables), conditional with which it can convert inputs, labour and capital into goods
on the prevalence of QM in the UK economy (treating this as an and services. A sector with a low degree of efficiency in its
independent variable). In order to produce accurate estimates, sectoral production technology might only be able to produce
regression analysis requires a significant degree of variation in the one unit of good or service using one unit of capital and one
dependent and independent variables, and a comprehensive and unit of labour. This would imply that inputs cannot be converted
accurate observation of those variations. The overall prevalence into goods and services particularly easily in that sector. Another
of QM in the UK economy does not change dramatically from sector with a higher degree of efficiency in its sectoral production
For each sector in each year of the study period the intensity of The literature discussed how far QM programmes had been
the sector’s QM implementation is estimated on a 0-1 scale. A implemented across the UK education sector. This enabled
score of 0 implies that the sector has not implemented any QM Cebr to estimate the intensity of QM implementation in the UK
at all, Counterfactual One. A score of 1 implies that the sector education sector under the Baseline Scenario.155
has implemented QM as fully as possible, Counterfactual Two.
The estimates attained are reflective of the actual intensity of each The literature also allowed Cebr to estimate the intensity of QM
sector’s QM implementation which exists in reality under the implementation score for the retail and wholesale sector. Doms
Baseline Scenario. (2003) gave measures of IT and total investment across c.17,000
businesses in the sector.156 Cebr assumed that a business’s
Under the Baseline Scenario, each sector’s contribution to For each sector and for each year of the 2009-13 study period,
employment, GDP and net contribution to the Exchequer is the literature, case studies and survey data have enabled Cebr to
inferred from ONS statistics. The inference is a simple summing estimate how a hypothetical move from the level of QM intensity
procedure and does not make the model’s results any less described in Counterfactual One, to the level of intensity which
credible. was estimated in the Baseline Scenario, would have increased
the sector’s production technology efficiency. For each sector,
Under Counterfactual One, for each year of the study period, based on the literature, case studies and survey data, Cebr
each sector’s intensity of QM implementation score is assumed estimated how this change in the level of QM intensity would
to be zero. The rigorous definition of Counterfactual One, have increased that sector’s contribution to the UK’s economy-
which is now given, reflects a hypothetical situation in which wide GDP, employment and net contribution to the Exchequer.
Notes: C1 denotes Counterfactual One. B denotes the baseline In percentage terms, the estimates provided by Figure 10 indicate
scenario. C2 denotes Counterfactual Two. Results are in terms of that the GDP differentials between Counterfactual One and the
trillions of real 2009 pounds. Baseline Scenario were larger than those between Counterfactual
Two and the Baseline Scenario. This implies that, although QM
Note that in each year, and on average, the model’s estimate has the potential to contribute significantly to real annual GDP
of real GDP is lower under Counterfactual One than under the if it were rolled out further, the majority of the GDP gains which
baseline scenario. This suggests that the implementation of QM arise from QM implementation have already been achieved.
has already exerted upward pressure on GDP. Similarly, in each
year and on average the model’s estimate of real GDP is higher 5.4 Estimated QM impacts on sectoral production technology
under Counterfactual Two than under the baseline scenario. This Following previous discussions, the intensity of QM
suggests that further implementation of QM has the potential to implementation in a given sector impacts the efficiency of that
exert additional upward pressure on UK GDP. sector’s production technology. The efficiency of a sector’s
production technology captures the ease with which it can
For 2011 and for a ‘typical year’, there has already been some transform capital and labour inputs into goods and services. It is
discussion of the estimated percentage differences in real annual believed that the higher the intensity of QM implementation in a
UK GDP under the different QM scenarios. Figure 10 details given sector, the higher the efficiency of that sector’s production
the model’s percentage estimates of how much lower annual technology. Thus, raising sectoral QM intensity increases the
The intensity of QM implementation in a given sector varies as In percentage terms, the model’s estimates also indicate
the economy moves between the three QM scenarios.164 For that a hypothetical move to Counterfactual Two from the
each sector and in each year, the Baseline Scenario captures Baseline Scenario tends to increase the education and public
the intensity of QM implementation as it actually is. Hence, administration sectors’ levels of productive technology efficiency
this scenario also captures the efficiency of sectoral production noticeably more than those of the manufacturing and services
technology as it actually is. Counterfactual One describes an sectors.
economy in which no organisation in any sector has implemented
any QM at all. As such, under Counterfactual One, the efficiency 5.5 Estimated QM impacts on the Exchequer’s net tax receipts167
of each sector’s production technology is less than under the Based on the inputs drawn from the literature review, survey
Baseline Scenario. Counterfactual Two describes an economy and case studies, and the (previously discussed) assumptions
in which all organisations in all sectors have implemented QM about causality, the model predicts that that QM impacts the
as fully as possible. Under Counterfactual Two, the efficiency of Exchequer’s real annual net tax receipts from taxes imposed on
each sector’s production technology is greater than under the production and products. As the intensity of QM implementation
Baseline Scenario. in the economy increases, the levels of sectoral production
technology efficiency increase for all sectors. This causes each
Figures 11a through 11f detail the model’s percentage estimates of sector to produce more goods and services. Because these are
how much lower different sectors’ levels of productive technology taxed, this increases the Exchequer’s real annual net tax receipts
efficiency would have been under Counterfactual One than from taxes imposed on production and products. This is termed
under the Baseline Scenario.165 The model’s percentage estimates the “net benefit to the Exchequer.”
of how much higher the different sectors’ levels of productive
technology efficiency would have been under Counterfactual Returning again the most recent completed year; in 2011, these
Two than under the Baseline Scenario, are also given for each net tax receipts were £174.8bn under the baseline scenario.168
year of the study period.166 The findings given are not exhaustive, Because the intensity of QM implementation is lower under
but cover the manufacturing, services, education and public Counterfactual One than under the Baseline Scenario, it is
administration sectors. Figure 11f details the percentage estimates estimated that net tax takings would have been only £166.4bn
for a typical year. These reported findings typify all the model’s in 2011 under Counterfactual One. This estimate follows directly
estimates as to the impact of QM on different sectors’ levels of from the 2011 real annual GDP estimate under Counterfactual
productive technology efficiency. One. Moving from the Baseline Scenario to Counterfactual
One induces a real GDP decline as we move to an economy
It has already been explained how the different intensities of in which QM systems do not exist. This means that businesses
sectoral QM implementation, which pertain under the three produce fewer and/or less valuable products. As a consequence,
different QM scenarios, are estimated to impact sectoral levels of there are fewer products to tax and those which remain are
productive technology efficiency. The projected percentage effects less valuable, meaning each yields less tax revenue when it
on sectors’ productive technology efficiency, of moving between is taxed. Consequently, net tax takings decline. A comparison
the Baseline Scenario and the two Counterfactual scenarios of the Exchequer’s tax receipts under Counterfactual One and
(in Figures 11a to 11f below) are derived from these estimated the Baseline Scenario provides an estimate of how much QM
impacts. procedures, as they were actually instituted in the economy,
contributed to the Exchequer. In 2011, the model predicts
Based on literature, case study interviews and survey evidence, that QM procedures provided a net benefit of £8.4bn to the
the model assumes that QM programmes, as they are instituted Exchequer. The model’s results suggest that net tax receipts would
in reality, exert a relatively large upward effect on the productive have been 4.8% lower than they actually were in 2011, had
technology efficiency of the manufacturing and services sectors Counterfactual One attained.
under the Baseline Scenario. This is because, based on the
literature review, survey and case study evidence, the model In that same year, the model estimates that, had QM mechanisms
assumes that QM programmes have been implemented with a been instituted as fully as possible throughout the economy,
comparatively high degree of intensity in those sectors under the the Exchequer’s net tax receipts from taxes on production and
Baseline Scenario. products would have been £182.8bn. This is the situation which
would hold under Counterfactual Two. Comparing tax receipts
Based on the same body of evidence, the model assumes under the Baseline Scenario and Counterfactual Two provides
that QM programmes, as they are instituted in reality, exert the estimate that, if QM systems were instituted as widely as
a comparatively modest upward effect on the productive possible throughout the economy, the Exchequer’s net tax takings
technology efficiency of the education and public administration would have been £8bn higher than they actually were. Hence,
sectors under the Baseline Scenario. This is because the model the model estimated that net tax receipts would have been 4.6%
assumes that QM programmes have been implemented with a higher than they actually were in 2011, had Counterfactual Two
relatively slight degree of intensity in those sectors under the attained.
Baseline Scenario.
The estimates for a typical year suggest that under the Baseline
Scenario the Exchequer’s net tax receipts were £175.3bn. The
corresponding estimates for Counterfactuals One and Two are
£166.9bn and £183.4bn respectively. These estimates imply
that, in a typical year, QM mechanisms, as they actually exist in
the economy, contributed £8.4bn to the Exchequer. Otherwise
put, the model’s results suggest that net tax receipts would have
been 4.8% lower than they actually were in the typical year, had
Counterfactual One attained. Similarly, for a typical year, QM
mechanisms, had they been rolled out as fully as possible in all Notes: C1 denotes how much lower real net tax takings would
sectors of the economy, could be expected to have contributed an be under Counterfactual One than under the baseline scenario
additional £8.1bn to the Exchequer’s coffers. Hence, the model in percentage terms. C2 denotes how much higher real net tax
estimated that net tax receipts would have been 4.6% higher than receipts would be under Counterfactual Two than under the
they actually were in the typical year, had Counterfactual Two baseline scenario in percentage terms.
attained.
Figure 13 demonstrates that, in each year and on average, the
Figure 12: Real annual net tax receipts from taxes on production model estimates that, in percentage terms, the Exchequer’s net
and products under different QM scenarios tax receipts are lower under Counterfactual One than under the
Baseline Scenario. This suggests that the implementation of QM
programmes, as they are actually constituted in the economy,
have exerted upward pressure on the Exchequer’s net tax receipts.
The model estimates that real net tax receipts are higher under
Counterfactual Two than under the Baseline Scenario. This
suggests that further implementation of QM has the potential to
exert additional upward pressure on real net tax receipts.
Figure 13 details the model’s percentage estimates of how Increased labour efficiency incentivises organisations to
much lower the Exchequer’s annual net taxes on products and increase employment at the sector level. Because increasing
production would have been if Counterfactual One had attained, the intensity of QM implementation increases labour efficiency
rather than the Baseline Scenario. Percentage estimates of how across all sectors, it ultimately drives increases in economy-wide
much greater annual net tax takings would have been under employment.
Counterfactual Two than under the Baseline Scenario are also
given. (These percentage estimates have already been discussed
for 2011 and the typical year.)
6.1 Aims and structural overview of the report model had to rely on such a causal assumption.
On behalf of the CQI, Cebr has compiled a report which
investigated QM systems’ impacts at the microeconomic level – This is because there is no such thing as mathematical or statistical
of individual public, private and voluntary sector organisations causation. The model’s purpose was to estimate the magnitude of
– and at the macroeconomic level – of UK headline economy- QM’s impacts on UK economy-wide macroeconomic indicators,
wide indicators. Specifically, the report’s dual research aims were assuming that the causal assumption is correct.
to demonstrate and quantify the extent to which more effective,
intensive and longer-term use of QM systems and techniques (i) Having helped to establish causality, the literature review, case
creates more productive and successful organisations; and (ii) studies and survey were used to provide inputs into the model
affects headline UK economic indicators. and give convincing arguments as to why its results can be
trusted.174
The report made use of three investigative methods to gather
primary evidence – a literature review, case studies and a survey 6.2 Summary of the report’s findings
of 120 organisations – in achieving the first aim. The literature In relation to the report’s first aim, the literature review, survey
review adopted a working definition of QM (which agrees with and case studies consistently yielded evidence that the effective
the CQI’s definition) which applies to the report as a whole. implementation of QM procedures and the attainment of
As already described, the structure of investigation adopted by QM certification could improve a variety of outcomes for
the case study and survey sections was a product of the literature organisations in the public, private and voluntary sectors.
review. The adopted structure of those sections allowed their
findings to be easily compared to those of the literature review The literature review found evidence that QM had increased
throughout the report. The findings of the literature review, stock prices, profits, revenues, customer retention and employee,
case studies and survey were independent and usually found customer and user satisfaction across institutions in the public,
to be coherent with each other.173 Precisely because they are private and third sectors.175 The literature review also found
independent, this coherency suggests that the data provided by evidence that QM mechanisms reduce the costs associated with
the sources are correct. It is unlikely that three independent data identifying and rectifying problems during or after production,
sources would all be incorrect in the same way. while raising those expenditures which focus on stopping
problems before they occur. This cost rebalancing was found
Thereafter, the report used the inputs provided by the literature to be associated with a reduction in overall costs. The literature
review, case studies and survey to formulate a bespoke economic review also suggested that QM programmes could have their most
model which estimated the impacts of QM on headline UK substantial impacts on organisations’ outcomes several years after
macroeconomic indicators. Cebr reasoned that the construction of they were first instituted – ie they sometimes become effective
an economic model based on these inputs was likely to yield more with a lag. Finally, several of the authors under review noted
accurate estimates of QM’s impacts on the UK macroeconomy that managerial commitment to a QM programme was a key
than the only feasible alternative; regression analysis. The wide precondition of its success in all sectors.
range of inputs and Cebr’s scrutiny of them suggested that the
inputs used accorded closely with reality. This implication is that The survey of 120 organisations provided evidence which
the findings of Cebr’s bespoke economic model (which were corroborated the literature’s findings. Survey respondents indicated
ultimately derived from those inputs) also paralleled economic that QM mechanisms were important in driving down costs and
reality closely. Finally, three independent data inputs indicated maintaining customer or service-user retention rates. Private sector
that the causal assumption upon which the model was predicated organisations reported that QM programmes were often used to
– that QM can improve the efficiency of individual organisations’ help justify price premia on goods and services.
productive processes and that, in aggregate, this can improve
headline UK economic indicators – was correct. Because the The case studies largely support the findings of the literature review
literature review, survey and case study data were all independent, for organisations in specific sectors. There were some notable
it is extremely unlikely that the data they provided, as to the points of departure between the literature review and case study
validity of the causal assumption, would have been incorrect in findings for some sectors. For example, the case study respondents
the same way. As such, their coherency means Cebr is confident from the legal services sector note that their QM mechanisms
that the model’s underlying causal assumption was correct. became effective comparatively quickly – ie without the lag which
As discussed in subsection 5.2, like all methods of empirical was predicted by the literature. This suggests that QM mechanisms
economic investigation (modelling or regression analysis) the have their effects more rapidly in legal services businesses than in
Adam, Corbett, Flores, Harrison, Lee, Rho, Ribera, Samson and Cordy and Coryea (2006), Champion’s Practical Six Sigma
Westbrook (1997), ‘An international study of quality improvement Summary, Xlibris Corporation.
approach and firm performance’, International Journal of
Operations and Production Management, 17, pp.842–873 Cua, McKone and Schroeder (2001), ‘Relationships between
implementation of TQM, JIT, and TPM and manufacturing
Ahire (1997), ‘Management Science – Total Quality Management performance’, Journal of Operations Management, 19,
Interfaces: An integrative framework’, Interfaces, 27(6), pp.91-105. pp. 675–694.
Anon (n.d) Handbook for TQM and QCC – Volume 1. Deming and Stephan (1940), ‘On a least squares adjustment of a
sampled frequency table when the expected marginal totals are
Anthony (2008), ‘Pros and cons of Six Sigma: an academic known’, Annals of Mathematical Statistics, 11(4), pp. 427-444.
perspective’, www.onesixsigma.com
Deming (1982), Out of the Crisis, MIT Press.
Beattie and Sohal, A.S. (1999), ‘Implementing ISO 9000:
A study of its benefits among Australian organizations’, Deming (1993), The New Economics for Industry, Government,
Total Quality Management 10(1). Education, Cambridge, MA: MIT Center for Advanced Engineering
Study.
Beecroft (2000), ‘Cost of Quality, Planning and the Bottom Line’
(article), Dennis Beecroft Inc, Canada. Department for Business, Innovation and Skills website (1995),
Managing in the 90s Phase 2 – evaluation report 31.
Berry (2009), ‘Competing with Quality Services in Good Times
and Bad’, Kelly School of Business, Indiana University. Doms, Jarmin and Klimek (2003), “IT Investment and Firm
Performance in U.S. Retail Trade”, FRBSF Working Paper 2003-19.
Brignall and Modell (2000), ‘An institutional perspective on
performance measurement and management in the “new public Douglas, (1976), ‘The Cobb-Douglas Production Function Once
sector’’,’ Management Accounting Research, 11, pp.281–306. Again: Its History, Its Testing, and Some New Empirical Values’,
Journal of Political Economy 84 (5).
Centre for Voluntary Action Research (2004), The Adoption and
Use of Quality Systems in the Voluntary Sector: Final Report. Douglas and Judge (2001), ‘Total quality management
implementation and competitive advantage: the role of structural
Charities evaluation services, CES (n.d), ‘How to achieve the control and exploration’, Academy of Management Journal,
PQASSO quality mark’, http://www.ces-vol.org.uk/index. 44, pp.158–169.
cfm?pg=331
Fama (1998), ‘Market efficiency, long-term returns, and
Charities evaluation services, CES (n.d), ‘About PQASSO’, behavioural finance’, Journal of Financial Economics, 49,
http://www.ces-vol.org.uk/index.cfm?pg=172 pp.283-306.
Charlesworth, K. (2000) A question of quality?, Institute of Farhoomand (2004), ‘EURASIA INTERNATIONAL: TOTAL
Management. QUALITY MANAGEMENT IN THE SHIPPING INDUSTRY’,
Hong Kong University.
CIVITAS (2010), ‘The impact of the NHS market’,
www.civitas.org.uk/nhs/download/Civitas_LiteratureReview_ Gallear and Ghobadian (2004), ‘An empirical investigation of
NHS_market_Feb10.pdf the channels that facilitate a total quality culture’, Total Quality
Management, 15(8).
Cohen and Brand (1993), Total Quality Management in
Government: A Practical Guide for the Real World, Greene (2003), Econometric analysis, 5th edition, Prentice Hall.
San Francisco: The Jossey-Bass Public Administration Series.
Hannah (2011), ‘ISO and the bottom-line’, IRAC quarterly e-zine.
Cole and Flynn (2009), ‘Automotive Quality Reputation: Hard
to Achieve, Hard to Lose, Still Harder to Win Back’, California Hendricks and Singhal (2001), ‘The Long-Run Stock Price
Management Review, 52(1). Performance of Firms with Effective TQM Programs’, Management
Science, 47(3).
Collins and Nussey (1994), ‘UK Quality Management – policy
options’, Engineering Management Journal.
Juran (1951), Quality Control Handbook, McGraw Hill. Schwartz (2011), ‘Cloud computing can generate massive savings
for agencies’ ,Federal Computer Week.
Juran (1964), Managerial Breakthrough, McGraw Hill.
Scottish Executive (2006), Evaluation of the Lean Approach to
Kaner (1996), ‘Quality Cost Analysis: Benefits and Risks’ (article). Business Management and Its Use in the Public Sector.
Kaplan and Norton (1992), ‘The balanced scoreboard – measures Stringham (2004), ‘DOES QUALITY MANAGEMENT WORK IN
that drive performance’, Harvard Business Review, 70(1). THE PUBLIC SECTOR?’, Public Administration and Management:
An Interactive Journal, 9 (3), pp.182-211.
Kaynak (2003), ‘The relationship between total quality
management practices and their effects on business performance’, Swiss (1992), ‘Adapting Total Quality Management (TQM) to
Journal of Operations Management, 21, pp. 405–435. Government’, Public Administration Review, 54, pp. 356-362.
Keller (2004), Six Sigma Demystified, McGraw Hill. The Dr Foster Intelligence Unit, Imperial College, London (2009),
The Dr Foster Hospital Guide 2009.
Levine and Toffel (2010), ‘Quality Management and Job Quality:
How the ISO 9001 Standard for Quality Management Systems The Heath Foundation (Oct 2006), ‘Briefing: Measuring up: What
Affects Employees and Employers’, Quality Management and Job impact are national clinical measurement schemes having on the
Quality. NHS?’ (article).
Liker (2004), The Toyota Way: 14 Management Principles from the The Malcolm Baldrige National Quality Award (1987), US Public
World’s Greatest Manufacturer, New York: McGraw-Hill. Law 100-107.
Mani (1995), ‘Old Wine in New Bottles Tastes Better: A Case Tsai (1998), ‘Quality cost measurement under
Study of TQM Implementation in the IRS’, Public Administration activity-based costing’, International Journal of Quality
Review, 55, pp.147-158. & Reliability Management, 15(7), pp. 719-752.
McAdam, Reid and Saulters (2002), ‘Sustaining quality in the UK United Kingdom Parliament White Paper (1982),
public sector: Quality measurement frameworks’, International Standards, Quality and International Competitiveness.
journal of Quality and Reliability Management, 19(5).
United Nations and Schuurman (1997), QUALITY
Moen and Norman (2011), ‘Evolution of the PDCA Cycle’, MANAGEMENT AND COMPETITIVENESS: THE DIFFUSION
(article). OF THE ISO 9000 STANDARDS IN LATIN AMERICA AND
RECOMMENDATIONS FOR GOVERNMENT STRATEGIES.
Mohrman, Tenkasi Lawler III, and Ledford Jr (1995), ‘Total quality
management: practice and outcomes in the largest US firms’, Varian (1999), Intermediate Microeconomics:
Employee Relations, 17(3), pp.26–41. A modern approach, fifth edition.
Murray (1997) ‘Thinking about revolutions in military affairs’. Visualdata (2011), TRAI Performance Indicators Quality of Service
Report Q4 2010 – Part 1.
Oliver and Qu (1999), ‘Cost of quality reporting: Some Australian
Evidence’, International Journal of Applied Quality Management, Webber and Wallace (2007), Quality Control for Dummies, Aspen
2(2), pp.233-250. Publishing.
Osborne and Theodore (1992), Reinventing Government: White and Wolf (1995b), ‘Deming’s Total Quality Management
How the Entrepreneurial Spirit is Transforming the Public Sector, Movement and The Baskin Robbins Problem Part 2: Is This Ice
Reading, MA: Addison-Wesley. Cream American?’ Administration & Society, 27, pp.307-321.
Osseo-Asare, Longbottom and Chourides, (2007), ‘Managerial Womack, Jones and Roos (2007), The machine that changed the
leadership for total quality improvement in UK higher education’, world, 2007 Edition, Simon & Schuster.
The TQM Magazine, 19(6), pp.541 - 560.
Wooldridge (2009), Introductory Econometrics: A Modern
Reichheld and Sasser (1990), ‘Zero Defections: Quality Comes to Approach (4th edition), South Western.
Services’, Harvard Business Review, 68(5).
Yusof and Aspinwall (2001), ‘Case studies on the implementation
of TQM in the UK automotive SMEs’, International Journal of
Quality Relations Management, 18(7).