energies

Article
An Assessment of the Key Performance Indicators (KPIs) of
Energy Efficient Retrofits to Existing Residential Buildings
Orlaith McGinley 1,2 , Paul Moran 1 and Jamie Goggins 1,2, *

1 MaREI Centre, Ryan Institute & School of Engineering, College of Science and Engineering,
National University of Ireland, H91 TK33 Galway, Ireland; o.mcginley2@nuigalway.ie (O.M.);
paul.t.moran@nuigalway.ie (P.M.)
2 Energy Resilience and the Built Environment (ERBE) Centre for Doctoral Training, National University of
Ireland, H91 TK33 Galway, Ireland
* Correspondence: jamie.goggins@nuigalway.ie

Abstract: Quantifying the wider benefits of energy efficient building retrofits is crucial to incentivise
householder retrofit investments. This research recognises the value of key performance indicators
(KPIs) for assessing and demonstrating retrofitting benefits and provides an assessment of KPIs
for evaluating retrofits. An integrated framework for evaluating retrofits using a set of economic,
social, and environmental KPIs is proposed. This KPI framework is then applied in a pre- and
post-retrofit assessment of five case study dwellings located in Ireland, revealing its usefulness in
demonstrating the wider benefits of retrofitting to householders, with a view to driving retrofit
investment. Three of these case study dwellings had state-of-the-art retrofit technologies installed as
part of the works, including heat pumps and solar PV systems. In addition to demonstrating the wider
benefits of retrofitting, the framework allowed for the identification of potential causes for differences
in performance of these technologies across households, as well as patterns of underperformance.



Such insights are useful for the future design of these technologies and retrofit packages, as well

 as policy measures, which support householders in the adoption and use of these measures. The
Citation: McGinley, O.; Moran, P.; results demonstrate that householders experience various benefits from retrofitting. Showcasing
Goggins, J. An Assessment of the Key the different benefits that householders receive from retrofitting, and their satisfaction with the
Performance Indicators (KPIs) of
retrofit works, can serve to de-risk retrofit investments, and inspire others to seek similar benefits
Energy Efficient Retrofits to Existing
through retrofitting. Applying the developed framework to a larger, comparable sample size, can
Residential Buildings. Energies 2022,
distinguish the retrofit packages, which perform best across the KPIs and various household profiles.
15, 334. https://doi.org/10.3390/
en15010334
Furthermore, the application of the developed framework can serve as an evidence base for retrofit
designers, contractors, and policy makers in the design of retrofit packages and policy measures that
Academic Editor: Patrick Phelan
will maximise the benefit for householders.
Received: 21 November 2021
Accepted: 27 December 2021 Keywords: key performance indicators (KPIs); energy efficient retrofits; residential buildings;
Published: 4 January 2022 sustainability

Publisher’s Note: MDPI stays neutral

with regard to jurisdictional claims in
published maps and institutional affil-
iations.
1. Introduction
1.1. Background and Challenges to Retrofitting Buildings in Ireland
Improving the energy efficiency of building stock in the European Union (EU) will
play a key role in achieving the “carbon neutrality by 2050” target set by the European
Copyright: © 2022 by the authors. Green Deal [1]. To achieve this objective, the energy retrofit rate of the building stock
Licensee MDPI, Basel, Switzerland. in Europe will need to—at least—double the 2020 retrofit rate [1]. This is a significant
This article is an open access article
challenge facing many countries, including Ireland. Ireland’s retrofit activity during most
distributed under the terms and
of the last decade was low, averaging at approximately 23,000 (primarily shallow) retrofits
conditions of the Creative Commons
per annum from 2013 to 2019 [2]. This is a rate of 1.2% of the existing residential building
Attribution (CC BY) license (https://
stock per annum. In recognition of the pressing need for increased investment in this
creativecommons.org/licenses/by/
area, the Irish government’s Climate Action Plan 2021 has set ambitious targets for the
4.0/).

Energies 2022, 15, 334. https://doi.org/10.3390/en15010334 https://www.mdpi.com/journal/energies

Energies 2022, 15, 334 2 of 26

achievement of 500,000 residential energy efficiency retrofits to a building energy rating

(BER) [3,4] of B2 or better by 2030, at an average rate of 50,000 per year [2]. However, only
2600 residential buildings retrofitted in 2019 achieved a B2-BER (energy performance of at
least 125 kWh/m2 /year) or better [5].
Meeting the proposed targets will require convincing homeowners to invest in retrofit
measures. Ultimately, however, a homeowner’s decision-making process to invest in an
energy efficiency retrofit is highly complex, prevented by many barriers, and enabled
by various personal and contextual influences, such as a householder’s socioeconomic
characteristics and dwelling specific characteristics [6,7]. Persistent barriers include the high
upfront costs of measures [8] and uncertainty regarding the payback period [9] of retrofit
investments. This is further complicated when householders lack the financial resources to
cover the cost [8] and, thus, only invest in retrofit if financial subsidies are available [10],
with funding structures often being highly complex [7]. Moreover, the disruption and stress
often associated with retrofitting also contribute to low retrofit uptake rates [7], while others
argue that the limitations of the traditional retrofit delivery model majorly contributes
to the slow diffusion of comprehensive energy retrofit [11]. Additionally, behavioural,
rational, and cognitive limitations often inhibit householder understanding of retrofitting
benefits; including the lack of an energy efficiency culture, lack of information, and lack
of awareness [7,12–14]

1.2. Retrofit Benefits and the Use of KPIs

Despite the challenges of retrofitting buildings, there are also multiple benefits [15].
These are not limited to energy efficiency alone [16], but include economic, environmental,
and social benefits [17,18]. In the economic sense, these include the effect of retrofitting
on the building’s market value and reductions in operating costs [17–20]. Environmental
benefits include energy consumption savings and emission reductions [18,21,22]. From
the householder perspective, social benefits can include improved occupant satisfaction,
comfort, and health [15,17,18]. Furthermore, a more energy efficient domestic sector has the
potential to resolve a variety of social policy issues, such as fuel poverty and deprivation,
public health, and high rates of winter mortality [18,23].
The literature has demonstrated that several efforts have been made to evaluate the
impacts of retrofits, although these efforts are severely limited by their over-reliance on a
narrow set of economic, techno-centric, and environmental indicators, with much focus
placed on optimizing the technical and economic performance of dwellings [24]. The
importance of economic influences, such as cost and profitability, on a householder’s
decision to invest in a building retrofit is demonstrated across the literature, such as in [25].
However, not all homeowners decide to retrofit based on economic considerations alone.
Recent research found that the majority of Irish homeowners consider the comfort impacts
of energy efficiency investments, with many prioritising comfort as the main driver for
taking action in the Irish context [26]. Wider literature on homeowners’ energy efficient
investment decisions across Europe echoes such findings that homeowners retrofit choices
are influenced by economic benefits, as well as a range of other benefits that may potentially
arise, such as comfort improvements and environmental benefits [27].
Ultimately, the net benefit obtained from retrofitting is the main determinant of the
householder’s decision to engage in retrofit works [13]. In other words, the householder’s
decision to retrofit is in itself a trade-off between the benefits obtained, and the costs
involved. Creating an evidence base of these benefits is important, to inform retrofit
policy decisions, de-risk retrofit investment from a householder perspective and motivate
the uptake of deeper retrofits by demonstrating the tangible benefits of such [28]. Irish
policy has stressed the importance of effective communication of the multiple benefits
of retrofitting in incentivising householder investment in retrofitting [29]. However, as
pointed out by Wilson et al. [30], the non-monetary influences on a householder’s retrofit
investment decision are systematically understudied.
Energies 2022, 15, 334 3 of 26

Therefore, the aim of this paper is to develop an integrated framework of key per-
formance indicators (KPIs) which are to be used to demonstrate the wider benefits of
retrofitting to householders, with a view to encouraging homeowners to invest in retrofitting.
KPIs are used to assess the performance of the critical project goals and are considered
especially useful for dealing with complex contexts such as the sustainability assessment
of construction projects [31,32]. Moreover, given its applicability for the performance
assessment of retrofitted buildings, the KPI approach is fast becoming one of the most
valuable tools for the quantification of the benefits of retrofit implementation [31,33]. This
paper, firstly, provides an assessment of the KPIs used for evaluating retrofits, based on a
review of the existing literature. Based on the critique of existing studies and models, this
research develops an integrated framework of KPIs for evaluating the economic, social, and
environmental benefits of building retrofits that should be included in retrofit evaluations at
a minimum. This integrated framework is then applied to five case study dwellings in the
west of Ireland, to reveal its usefulness in demonstrating the wider benefits of retrofitting
to householders, with a view to encouraging homeowners to invest in retrofitting. Finally,
the implications of applying the proposed framework for policy and practice are presented.

2. Literature Review: Key Performance Indicators (KPIs) in Retrofit Projects

This section presents a discussion of the economic, social, and environmental KPIs
prevalent in literature, regarding energy efficient retrofit projects. The literature review
focused on studies that (i) specifically focus on developing, classifying, and prioritising the
KPIs of retrofit projects from various stakeholder perspectives; (ii) incorporated and used
KPIs in the development of retrofit design decision-making frameworks; and (iii) assessed
the performance and, subsequently, the benefits received from retrofits, either in post-
occupancy evaluation (POE) studies [34] or in pre- and post-retrofit evaluation studies.
Such studies referred to in (iii) may not specifically refer to performance measures as KPIs;
however, they are regarded as KPIs in this study. The KPIs identified for demonstrating the
multiple benefits of retrofitting to householders are categorised as shown in Table 1. The
categories identified in Table 1 are considered the core categories that should be included
at a minimum for demonstrating the wider benefits of building retrofits to householders.
The KPIs identified for each category are those that are common among the existing
literature. While health and wellbeing are considered a core category, no specific health
and wellbeing KPIs have been included, given the lack of a standardised methodology for
their assessment.
The justification for including various KPIs based on the reviewed literature are dis-
cussed in the following sections, while a summary of the recommended KPI categories to
use in evaluating energy efficient retrofits to existing residential buildings from a house-
holder’s perspective are summarised in Table 2.

2.1. Economic KPI Categories

A significant number of studies have emphasized the prevalence of economic influ-
ences on a householder’s decision to retrofit, with many of the structural barriers and
drivers of retrofit investment being related to the cost structure [8]. This section discusses
the various economic KPIs, which are prevalent in the existing literature, and those included
in the KPI framework.
Energies 2022, 15, 334 4 of 26

Table 1. KPI categories identified in the existing literature for demonstrating the multiple benefits of
retrofitting to householders.

Economic Social Environmental

Indoor Satisfaction Energy
Category Market Health and Fuel
Cost Environmental with Energy Carbon Performance
Ref Value Well-Being Poverty
Quality (IEQ) Retrofit Certificate (EPC)
[17] •
[18] • • •
[22] • • •
[31] • • • •
[33] • • •
[35] • • •
[36] • •
[37] • •
[38] • •
[39] • •
[40] • • • •
[41] • • • •
[42] • • •
[43] • • •
[44] •
[45] • •
[46] •
[47] • • • •
[48] • • •
[49] • •
[50] • • •
[51] • • •
[52] • •
[53] •
[54] •
[55] • •
[56] •
[57] •
[58] •
[59] •
[60] •
[61] • •

Table 2. Recommended key performance indicators (KPIs) of energy efficient retrofits to existing
residential buildings.

KPI Category
Economic Investment cost
Life cycle costs (LCC)
Payback period
Change in market value
Social Change in Indoor environmental quality (IEQ)
Change in health & well-being
Change in fuel poverty
Satisfaction with retrofit
Environmental Energy consumption savings
CO2e emissions savings
Change in Energy Performance Certificate (EPC)

2.1.1. Cost
Firstly, the investment cost was identified as a KPI across various studies [17,22,31,33,38].
Typically, the minimisation of investment cost is an objective function in the design of
retrofit solutions [17,22,31,33,38] and in pre- and post-retrofit evaluation studies [39–41].
From the householder perspective, the investment cost is considered an important KPI,
given that a householder’s willingness to invest in retrofit often depends on the level
Energies 2022, 15, 334 5 of 26

of benefit they receive relative to the investment required [43]. Additionally, the high
investment costs associated with energy efficiency upgrades and a householder lacking
the financial resources to undertake a retrofit are major obstacles [16,17,62–65]. Therefore,
the investment cost is included as an economic KPI, as it provides evidence of the various
types of benefits householders could receive, depending on the level of investment they
are willing to commit to the retrofit. Indirect costs, such as stable labour costs, static mate-
rials costs, and minimum variations costs have been included as economic KPIs in other
studies [31,33], but are excluded as part of the investment cost KPI used in the framework.
Life cycle cost (LCC) is frequently included in the economic assessment of
retrofits [22,31,33,35,42] and is commonly used to compare the investment cost of a retrofit
with the economic benefit of alternative retrofit design solutions [17]. Moreover, LCC
analysis is mandatory for the achievement of cost-optimal levels of energy performance, as
required under the energy performance of buildings directive (EPBD) [66]. From a house-
holder perspective, the LCC KPI is considered useful, as it indicates the economic benefit a
householder will receive over a certain time period following a retrofit [67], thereby making
it possible to identify the most cost-effective retrofit strategy [42]. Given its usefulness in
this regard from a householder’s perspective, the LCC is included as an economic KPI in
the cost category in the KPI framework.
Other economic KPIs prevalent in the literature include the payback period and net
present value (or net present cost) [21,31,33,35,43]. For the KPI framework, the net present
value KPI is not included as a distinct KPI as it is accounted for in the LCC analysis.
The payback period measures the length of time necessary to recover any investments
made [68]. This is often considered a crucial factor to speculative householders, who may
prioritise a fast recovery of their retrofit investment [67]. A reasonable payback time is
often considered a motivator for retrofitting [68,69], while on the other hand, both the
perceived lengthy payback periods and lack of knowledge with regards to payback periods
associated with retrofits are some of the frequently cited barriers to householder investment
in retrofit [16,17,70]. Therefore, from a householder perspective, the payback period is
considered a useful economic KPI [22], and is generally considered an accessible KPI that
can be easily understood by householders. However, while the payback period is often
used as an additional KPI [21,35–37], its inherent limitations do not make it appropriate
for use as a distinct KPI, as it does not take into consideration any benefits or costs that
occur after the payback period [67]. Therefore, it is better used in conjunction with more
accurate indicators, such as the net present value or in this case the LCC, which consider any
benefits that occur after the payback period and provide a better measure of the investments
profitability [66,67]. Additionally, care should be taken in handling the payback period,
as it may result in an over-emphasis on how quickly householder investments can be
recovered, meaning that householders may favour less efficient retrofit investments, with
short-term paybacks, as opposed to more efficient retrofit investments, with long-term
paybacks [67]. Nonetheless, its usefulness is recognised, and it is therefore included as part
of the KPI framework.

2.1.2. Market Value

A frequently discussed benefit of retrofitting and, subsequently, an important driver
of householder retrofit investments, is the resulting increase in the market value of prop-
erty [44,69]. Economic theory suggests that householders will place increased value on
energy efficiency, and will pay a price premium for more energy efficient homes, anticipat-
ing lower energy bills and increased comfort [67]. However, despite its importance as a
driver for retrofit investment, and as an important economic benefit to the householder,
it is frequently excluded from economic evaluation methods [67]. While Reuter et al. [71]
suggest that a market value multiple benefit indicator is more applicable to commercial
buildings rather than residential buildings, other existing research such as those papers
reviewed by [44] has suggested otherwise. Laquatra and Carswell [67] believe that market
Energies 2022, 15, 334 6 of 26

value should be included in economic evaluations to allow householders to make optimal

decisions in energy efficiency investments and is included as part of the KPI framework.
Overall, the four economic KPIs selected are investment cost, LCC, payback period
and market value. While it is recognised that these indicators do not present a great deal
of novelty, the importance of accessibility and ease of householder understanding justify
their selection.

2.2. Social KPI Categories

The measurement of social benefits of retrofitting is less developed than the economic
and environmental benefits [55]. Those that are prevalent in existing literature and included
as part of the KPI framework are discussed in the following sections.

2.2.1. Health and Well-Being

One of the most important social benefits of retrofitting is the positive health impacts
associated with it [55]. In fact, the relationship between energy efficiency and health and
well-being is one of increasing research interest. The general focus of such research is on the
effects of improved indoor environmental quality, and in particular indoor air quality on
occupant health, such as sick building syndrome, asthma, allergies, and other respiratory
conditions [55]. Several studies reviewed sought to quantify these physical and mental
health impacts of building energy efficiency [23,47,48,56–59].
Coyne et al. [18] point to the difficulty associated with evaluating the health impacts
of retrofitting, in that these health effects often take a longer time to emerge in a measurable
way as compared with the other benefits of retrofit, suggesting that reliable measurement
would require a significant period of time of data collection. No standard approach or KPI
exists to evaluate health and well-being, as this depends on the physical or mental health
condition under consideration. Therefore, a KPI is not included as part of the presented
KPI framework, and has not been included in the evaluation results presented in Section 5
due to data limitations. However, other studies, where possible, should demonstrate the
health and well-being benefits of retrofitting to householders.

2.2.2. Indoor Environmental Quality

The social impacts of retrofitting include those that are experienced or felt in a per-
ceptual (cognitive) or corporeal (physical, bodily) sense [55]. In this regard, improved
indoor environmental quality (IEQ) is considered a social benefit of retrofitting. IEQ KPIs
have been used in pre- and post-retrofit evaluations and post-occupancy evaluations in the
literature [46,49,51–54]. In fact, most of the post-occupancy evaluation protocols reviewed
in [34] included IEQ measurements. These IEQ KPIs include indoor air quality (IAQ),
thermal comfort, visual comfort, and acoustic comfort.
Improved occupant comfort has been cited as a social benefit of retrofitting build-
ings [17]. Many studies have assessed thermal comfort improvements resulting from
retrofitting buildings, in both pre- and post-retrofit evaluations, and post-occupancy evalu-
ation studies [45–47,49,51]. Such studies assessed thermal comfort using either measured
temperature and relative humidity (RH) sensor data, occupant surveys or a combination of
both. Moreover, thermal comfort parameters were frequently included in retrofit design
decision-making models [22]. It is also regarded as an accessible KPI that can be easily
understood by householders. Improved comfort has also been identified as one of the
factors for Irish householder’s willingness to invest in retrofit measures [25]. Therefore,
thermal comfort is considered a KPI in the IEQ category.
The World Health Organisation has issued guidelines for pollutants to monitor to
assess IAQ [72]. Retrofitting can have both positive and negative consequences on the
indoor environment. Thus, evaluating IAQ KPIs, including increased concentrations of
indoor air pollutants as a result of increased air tightness post-retrofit, is important and
incorporated as part of the KPI framework [73–76]. Lighting and acoustics have also been
evaluated in both pre- and post-retrofit evaluations [51,52] and are also included as part of
Energies 2022, 15, 334 7 of 26

the KPI framework. However, IAQ, lighting and acoustics are not evaluated in the case
study presented in this paper due to a lack of data.

2.2.3. Occupant Satisfaction

Perceptual measures, such as stakeholder satisfaction, are often included as social
KPIs [31]. At the building level, stakeholder satisfaction relates to occupant satisfaction. It
is widely accepted that failing to address and incorporate occupant needs and expectations
into building retrofits, has severe negative effects on the outcomes of the retrofitting efforts
and occupant satisfaction [60]. Additionally, identifying and assessing the sources of
occupant dissatisfaction is equally important to determine priority focus areas in retrofit
design phases [60]. Effective occupant satisfaction measurement tools, therefore, address
all factors related to the building occupants’ needs, activities, and goals [77].
Research has stressed the importance of positive feedback loops on stimulating further
or new adoption of retrofit measures, while implying the potential impacts of negative
feedback in creating barriers to such [78]. In other words, householders who have had
previous positive renovation experiences (or heard accounts of positive renovation experi-
ences), will be more likely to invest in retrofitting, while the opposite happens for those
who have had previous negative renovation experiences (or heard accounts of negative
renovation experiences) [25,78].
Various aspects of the retrofit process and the experience of the retrofit such as the
efficiency and flexibility of the process, the level of control householders had in the process,
or the level of inconvenience caused throughout the retrofit have been evaluated in the
literature [18,25,78]. The level of information provided to the householders throughout the
retrofit process, the satisfaction with the contractors involved [25], and the householder’s
satisfaction with the implemented retrofits and the perceived benefits of such [18,25,54],
have also been evaluated.
Therefore, KPIs assessing householder satisfaction regarding (i) the benefits received
as a result of a retrofit; (ii) the retrofit process, quality of the works, and level of disruption
(if any); (iii) the level of engagement with contractors in both the retrofit design and the
handover process; and (iv) the retrofit technologies implemented are included in the core
category of satisfaction in the KPI framework.

2.2.4. Fuel Poverty

Fuel poverty, also referred to as energy poverty, is increasingly being incorporated
into pre- and post-retrofit evaluations of retrofit projects [18,40,41,47], with alleviation of
fuel poverty being an important additional benefit of building energy efficiency [71]. Fuel
poverty refers to the inability of householders to adequately heat or power a home and
afford the energy services that ensure basic living standards [79–81]. This is considered
the most significant negative social impact of domestic energy inefficiency [81]. In fact, the
Building Performance Institute of Europe found that, as of 2015, between 50 and 125 million
people in the EU experienced fuel poverty, and were unable to afford proper indoor thermal
comfort [82]. The European Green Deal highlights the issue of fuel poverty by identifying
it as an issue to be addressed as part of a ‘renovation wave’ [79]. Given the prevalence of
fuel poverty, and its centrality in energy efficiency policy actions in Ireland and beyond, it
has been included as part of the KPI framework.

2.3. Environmental KPI Categories

The most common environmental KPIs throughout the literature were energy and
carbon emissions related KPIs [31].

2.3.1. Energy and Carbon Emissions KPIs

Almost all studies reviewed incorporated energy related KPIs into their environmental
assessments [18,22,33,34,40,41,47,49,50]. Energy performance calculations are essential for
the calculation of environmental impact and emissions [66]. Carbon emission related KPIs
Energies 2022, 15, 334 8 of 26

have also been included in retrofit design decision-making frameworks [22,31,33], and
retrofit performance evaluations [35,40,41,43,50,51].
While energy and carbon emissions savings are a well-discussed benefit of retrofitting,
the influence of environmental benefits as a motive for householders’ decisions to undertake
retrofit projects is questionable, with conflicting findings being present in the literature.
For example, some research has found that often, it is the non-energy related benefits that
motivate householders to invest in retrofitting [26,83], with environmental benefits being
of little concern or irrelevant in the decision [25,84,85]. On the other hand, however, some
research has found evidence that environmental benefits and concerns are relevant in a
householder’s decision to invest in retrofitting [9,12,27,86]. As such, this would suggest
that demonstrating the energy consumption and emissions savings resulting from retrofit
implementation may result in increased engagement by environment and climate motivated
householders. Increasing energy efficiency and targeting emissions on a global scale is
crucial. Moreover, energy models in the design phase must be validated [50], and the
potential rebound effects of retrofitting, which form key barriers to residential energy
efficiency must be examined [67]. Thus, energy and carbon emission related KPIs have
been incorporated as core KPI categories in the developed framework.

2.3.2. Energy Performance Certificate

Energy performance certificates (EPCs) are seen as tools for providing clear and reliable
information to homeowners and tenants to compare and assess the energy performance of
buildings [87], encourage owners to invest in improving the energy efficiency of the build-
ing through the provision of cost-effective retrofit measures [87], and assist governments in
developing policies to achieve national energy reduction targets in the building sector [88].
Countries use various scales and labels to represent the energy performance of dwellings to
building occupants [89]. As some homeowners may struggle to grasp the energy demand
savings level based on numerical energy demand values, the energy savings KPI should be
complemented using an established certification to demonstrate the energy savings in a
simpler way to a homeowner. It can also serve to highlight to homeowners interested in
retrofitting their homes the potential impact of various retrofit measures and/or encourage
homeowners to invest in additional retrofit measures. Therefore, an energy performance
certificate rating is considered a core category of the KPI framework.

2.4. Summary of Literature Review Findings

As is evident from the literature review presented in Sections 2.1–2.3, there are a
lack of studies, which evaluate energy retrofit projects using economic, social, and envi-
ronmental KPIs. Typically, existing studies evaluate economic and environmental KPIs,
while neglecting social KPIs. Existing studies also tend to focus on evaluating one or two
categories of KPIs, but very rarely, evaluate several categories of KPIs, within an integrated
framework. Thus, an integrated framework for evaluating the wider benefits of dwelling
retrofits, consisting of economic, social, and environmental KPIs (Table 2), is proposed and
assessed in this study. The methods used to evaluate these KPIs are detailed in Section 3.
This framework is applied in a pre-and post-retrofit assessment of five case study dwellings
located in Ireland, to reveal and validate its usefulness in demonstrating the wider benefits
of retrofitting to householders. Further detail of these case study dwellings is provided
in Section 4.

3. Methodology
3.1. Data Collection
Quantitative and qualitative data, obtained from pre- and post-retrofit monitoring of
case study dwellings, were used to evaluate the KPIs. There were four main forms of data
collection during the pre-retrofit and post-retrofit monitoring of the case study dwellings,
including: (i) surveys on the physical characteristics of the buildings; (ii) pre-retrofit and
post-retrofit participant surveys; (iii) installation of temperature, relative humidity (RH),
Energies 2022, 15, 334 9 of 26

and electricity consumption data-logging instrumentation; and (iv) monthly readings of

electricity and oil energy usage. At least four temperature and RH data loggers were
installed in each case study dwelling. Details of the procedure followed to recruit potential
research participants is given in Appendix A.
Pre- and post-retrofit, face-to-face semi-structured surveys were conducted with an
adult (aged 18 years or older) in each household. Information was gathered on the house-
holders’ demographic profiles, their attitudes towards energy use and conservation, quality
of life and the environment, which items they viewed to be necessities or luxuries, their
energy-related practices, and their thermal satisfaction within their homes. The level of
householder satisfaction with various aspects of the retrofit was also gathered through
these surveys. It should be noted, however, that while a large data set was obtained through
these surveys, only data obtained on (i) householder demographics and socioeconomics;
(ii) householder’s thermal satisfaction within their homes; (iii) household self-reported en-
ergy use; and (iv) satisfaction with various aspects of the retrofit are used in the evaluation
of the proposed KPIs. Analysis of the remaining data were outside of the scope of this
study. Further details on the other type of data collected as part of the semi-structured
surveys are given in with the data used to examine the impact retrofitting has on the energy
cultures and the sustainable-related outcomes among inhabitants of social housing units
in Ireland [90].

3.2. Methods for Assessing Economic Indicators

3.2.1. Investment Cost
The investment cost for each retrofit was calculated by obtaining from each household
the total cost borne by the household and the level of grant (if any) which householders
received from granting authorities. From this information, the total investment cost for
each retrofit design was calculated.

3.2.2. Life Cycle Cost (LCC)

The LCC was determined based on the methodology for the ‘calculation of the global
cost in terms of net present value for each reference building’ [91]. A discount rate of
4% was used and a building life span of 30 years was assumed. The variables calculated as
part of the LCC method included the investment cost and the annual operational energy
consumption costs. Maintenance, repair, and replacement costs were excluded from the
analysis. The annual operational energy costs were calculated based on the estimated
annual pre- and post-retrofit energy consumption combined with the price per kWh for
each fuel type. The life cycle energy consumption costs account for future fuel prices.
Future fuel prices were estimated using an average annual percentage increase of fuel price
per kWh.

3.2.3. Payback Period

The discounted payback period was calculated using a discounted payback method [92]
and a discount rate of 4%.

3.2.4. Market Value

Price premiums for dwellings with better energy performance certificates (EPCs) have
been noted in various countries (for example, Wales [93], Italy [94], Northern Ireland [95],
and Ireland [44]). There are standard assessment procedures for the calculation of EPCs for
member states across Europe. Market value improvements are estimated by calculating the
improvement of EPC rating in each dwelling, and determining the resulting improvement
in market value, using secondary data on the price premiums in particular housing markets,
for each improvement in EPC-ratings.
In Ireland, a dwelling’s EPC is referred to as its building energy rating (BER). In the
present study, the BER scale for residential buildings in Ireland has 15 ratings ranging from
A1-G. Lyons et al. [44] found that each rating decline along the BER scale has a reduction of
Energies 2022, 15, 334 10 of 26

1.3% in the sale value of property in Ireland. Assuming each rating increase in the BER scale
results in a 1.3% value increase in residential buildings following a retrofit, the increase
in market value is determined. In this case, secondary data specific to Ireland was used.
While this was useful in this instance, it is acknowledged that such an approach may not
be applicable to other countries.

3.3. Methods for Assessing Social Indicators

3.3.1. Indoor Environmental Quality
While many studies have assessed thermal comfort improvements as a result of retrofit
projects, the quantification of comfort is often challenging due to the inherent subjectivity
of its nature [23]. Therefore, a combination of quantitative temperature and RH data from
data loggers and qualitative data from occupant surveys have been used in this study.
Two types of indicators were assessed with the quantitative data. The first compared
the amount of time the average temperature and RH fell outside of recommended tem-
perature and RH values in each of the residential buildings. The recommended values for
temperature and RH for residential buildings used in this assessment, as specified in [96],
ranged from 18 ◦ C to 26 ◦ C and 30–60% RH, respectively. The percentage of temperature
and RH readings recorded as either below and above the lower and upper temperature
and RH limits were determined and compared pre- and post-retrofit.
The second type of quantitative indicator compared the average temperature and RH
in each dwelling during pre- and post-retrofit heating seasons. The average temperature
and RH were taken as the average temperature and RH recorded by the data loggers in each
dwelling. In addition to this quantitative data, qualitative data on thermal comfort were
obtained by asking householders to rate their satisfaction with the thermal environment, as
part of pre- and post-retrofit semi-structured surveys, using a seven-point scale from ‘very
satisfied’ to ‘very dissatisfied’.

3.3.2. Fuel Poverty Alleviations

Whether the householders were in fuel poverty was determined using the ‘expenditure
method’ [97], whereby householders were considered as suffering fuel poverty if their
estimated annual fuel expenditure was greater than 10% of their annual income. Data on the
householders’ annual income were gathered in the pre- and post-retrofit semi-structured
surveys. Households’ annual fuel expenditure was based on the annual operational energy
costs calculated as part of the LCC. Predictions were made as to whether householders
would experience fuel poverty alleviations over 30 years, at both the pre- and post-retrofit
fuel consumption levels, taking into consideration the annual average percentage increase
in fuel costs over 30 years, and the annual rate of income inflation.

3.3.3. Householder Satisfaction

Householder satisfaction was assessed via both the face-to-face pre- and post-retrofit
semi-structured surveys, and follow-up semi-structured surveys conducted in October 2019.
This was assessed in terms of their satisfaction with (i) the benefits received as a result of
the retrofit; (ii) the retrofit process, quality, and disruption (if any) caused; (iii) the level
of engagement with contractors in both the retrofit design and the handover process; and
(iv) the technologies implemented.

3.4. Methods for Assessing Environmental KPIs

3.4.1. Annual Energy Demand Savings
Heating energy data obtained from case study dwellings were normalised using
heating degree days (HDDs) based on the external temperatures experienced in each case
study dwelling’s locality, during the periods of time the heating data represented. It was
not possible to disaggregate the amount of heating energy that accounted for space heating
and water heating purposes in this study.
Energies 2022, 15, 334 11 of 26

The normalised heating energy data (kWh/HDDs) for each phase (i.e., pre-retrofit and
post-retrofit works) was multiplied by the average HDDs experienced in the case study
dwellings locality during the heating season, for a period of 10 years beginning in 2005, to
estimate an annual heating energy usage. A base temperature of 15.5 ◦ C was assumed in
this analysis. Base temperatures are considered the temperatures at which no heating is
required for buildings to maintain comfortable indoor temperatures [98].
Electricity and oil energy usage levels were recorded once a month. For the purposes
of the analysis, six months of pre-retrofit electricity and oil energy consumption data, and
six months of post-retrofit electricity and oil energy consumption data have been utilised.
Householders were asked to estimate their annual solid fuel costs during pre- and post-
retrofit surveys. Solid fuel annual energy usage (including timber, briquettes, coal, and
turf), was estimated using fuel costs per kWh for the relevant fuel type [99].
Electricity usage for lighting and appliances (that is, other than for space heating) was
normalised to kWh/day and multiplied by the number of days in a year to determine the
annual energy use. Specific details on how annual energy use for electricity was calculated
in specific case studies where electricity usage is also used for space heating is outlined
for each specific case in Sections 4.1–4.5. By subtracting the post-retrofit energy demand
from the pre-retrofit energy demand, the estimated annual energy demand savings were
determined for each case.

3.4.2. Annual CO2 Emissions Savings

Using the estimated annual energy consumption pre- and post-retrofit and multiplying
each fuel type by its corresponding CO2 emissions factor in kgCO2 /kWh [98], annual CO2
emission savings were calculated. The annual rate of decarbonisation of the electricity grid
should also be accounted for in the results.

3.4.3. Energy Performance Certificate

There are standard assessment procedures across EU member states for the assessment
of building EPCs. Further details on the use of the standard assessment procedure in
Ireland for this case study are given in Section 4.

4. Case Study
Data collected from a pre- and post-retrofit study of five case study dwellings in the
west of Ireland are used to demonstrate the wider benefits of retrofitting based on the
economic, social, and environmental KPIs of the integrated framework. Details of the
procedure followed to recruit potential research participants is given in Appendix A. The
five detached rural case study dwellings, otherwise referred to in this paper as Case A–Case
E, were retrofitted as part of SEAI’s Better Energy Community scheme [100]. Each case
study received varying levels of grant aid for their retrofit works from the SEAI (see Table 3).
Retrofits were completed between July and November 2016, with Case A, Case B, and Case
E having photovoltaic (PV) systems installed in February 2017.
For the calculation of thermal comfort improvements in the dwelling, using the method
described in Section 3.3.1, temperature and RH data loggers were installed in each case
study dwelling, in the kitchen, living room, and three bedrooms of each dwelling. The
data loggers used were ‘Easy Log EL-USB-2+’. It should be noted that temperature and RH
readings recorded in one of the bedrooms in Case C were removed from the analysis due to
the sensor recording erroneous data. Temperature and RH data were recorded every 15 min,
both pre- and post-retrofit, from December 2015 to February 2018. The temperature and RH
data are based on data recorded from the 16 December 2015 to 25 May 2016 (pre-retrofit)
and the 15 December 2016–18 May 2017 (post-retrofit). The possible effects of external
temperature on the thermal comfort results were considered, using historical weather data
that was obtained from the Claremorris weather station, which is within 30 km of the case
study dwellings [101]. However, detailed analysis of the effect of external temperature on
temperature improvements resulting from retrofitting was outside the scope of this study.
Energies 2022, 15, 334 12 of 26

Table 3. Post-retrofit KPI results for each of the case study buildings. Values in brackets are
the a percentage change of post-retrofit results relative to the pre-retrofit results or b pre-retrofit result.

KPI Category KPI (Unit) A B C D E

Cost Investment (EUR) 45,739 25,000 10,000 9000 23,000
Grant aid (%) 35 90 90 90 90
Life cycle cost-with grant
892 (−39%) 480 (−48%) 746 (7%) 955 (−13%) 809 (10%)
aid (EUR/m2 ) a
Life cycle cost-without grant
1062 (−27%) 671 (−27%) 830 (20%) 1067 (−3%) 1101 (50%)
aid (EUR/m2 ) a
Payback period-with grant
9.6 0.4 N/A 1.4 N/A
aid (years)
Payback period-without
15.5 13.3 N/A 23.2 N/A
grant aid (years)
Market Value Market Value a N/A (9.1%) N/A (7.8%) N/A (3.9%) N/A (2.6%) N/A (7.8%)
Thermal Comfort Avg. Temp. (◦ C) a 19.8 (19%) 20.3 (−4%) 18.1 (6%) 16.4 (1%) 18.9 (7%)
Avg. Temp. (% < 18 ◦ C) b 7 (−34%) 11 (9%) 37 (−17%) 66 (−3%) 21 (−31%)
Avg. Temp. (% > 26 ◦ C) b 0 (0%) (0%) 2 (−4%) 0 (0%) 0 (0%) 0 (0%)
Avg. RH (%) a 56 (−10%) 45 (5%) 56 (1%) 58 (0%) 66 (−3%)
Avg. RH (% < 30%) b 0 (0%) 2 (1%) 0 (0%) 0 (0%) 0 (0%)
Avg. RH (% > 60%) b 48 (−29%) 23 (21%) 53 (17%) 56 (5%) 65 (−10%)
Survey VS (VD) VS (GS) GS (NSD) VS (NSD) VS (VS)
Health and
- - - - - -
Wellbeing
Fuel poverty status
Fuel Poverty No (No) No (No) Yes (Yes) Yes (Yes) Yes (Yes)
(Yes/No) b
Satisfaction with
Benefits received VS VS VS NSD S
retrofit
Retrofit process and quality
NSD VS VS VS GS
of work
Contractor engagement GDS NSD VS NSD NSD
Technology NSD VS VS GDS NSD
Energy Secondary (kWh/m2 ) a 98 (−71%) 152 (−70%) 228 (−3%) 412 (−21%) 202 (−59%)
Primary (kWh/m2 ) a 233 (−65%) 212 (−66%) 289 (−1%) 503 (−20%) 369 (−43%)
Carbon Emissions (CO2 /m2 ) a 50 (−59%) 61 (−66%) 74 (−8%) 150 (−23%) 61 (−62%)
EPC Theoretical (BER) b C2 (G) C2 (F) D2 (C2) D1 (E1) C1 (E2)
Measured (BER) b D1 (G) C3 (G) D2 (D2) G (G) E2 (G)
VS—very satisfied, GS—generally satisfied, S—satisfied, NSD—neither satisfied nor dissatisfied, D—dissatisfied,
GDS—generally dissatisfied, VD—very dissatisfied. Avg.—Average.

For the calculation of fuel poverty alleviations, using the methodology described in
Section 3.3.2, the annual rate of income inflation in the Irish context was taken as 1.0 %,
based on data obtained from the Central Statistics Office (CSO, Cork, Ireland), for the period
2008–2019 [102]. To take into consideration any uncertainty with regard to the income
inflation rate, future predictions were also made at income inflation rates of 3% and 5%.
For the calculation of annual energy demand savings, using the methodology de-
scribed in Section 3.4.1, electricity and oil energy usage levels were recorded once a month.
For the purposes of the analysis, six months of pre-retrofit electricity and oil energy con-
sumption data (16 December 2015–25 May 2016) and six months of post-retrofit electricity
and oil energy consumption data (15 December 2016–18 May 2017) have been utilised.
Householders were asked to estimate their annual solid fuel costs during pre- and post-
retrofit surveys. Solid fuel annual energy usage (including timber, briquettes, coal, and turf),
was estimated using fuel costs per kWh for the relevant fuel type [99]. In this instance, fuel
prices were sourced from SEAI’s domestic fuel cost archive [99]. The annual operational
energy costs are inclusive of 13.5% VAT [99]. To determine the average annual price increase
rate, fuel prices from 1998 to 2018 were sourced from SEAI’s domestic fuel cost archive [99].
Fuel prices for wood and turf were only available from periods 2005–2018 and 1999–2003,
respectively. External temperature data for Claremorris (Ireland) was used to normalise this
heating energy data, using the method described in Section 3.4.1. In this instance, a base
Energies 2022, 15, 334 13 of 26

temperature of 15.5 ◦ C in Ireland was assumed by SEAI when using the HDD method [98].
Electricity was used for lighting and appliances in all cases. Specific details on how annual
energy use for electricity was calculated in specific case studies where electricity usage is
also used for space heating is outlined for each specific case in Sections 4.1–4.5.
In the calculation of annual CO2 emissions savings, using the methodology described
in Section 3.4.2, the annual rate of decarbonisation of the Irish electricity grid was taken
from [103] and accounted for in the results.
For the calculation of pre- and post-retrofit EPCs for each case study dwelling, the
standard assessment procedure for Ireland was used. A BER was assessed using a standard
assessment procedure referred to as Domestic Energy Assessment Procedure (DEAP).
The theoretical energy demand was estimated based on the version of DEAP (when it
was known as the Dwelling Energy Assessment Procedure) published in 2012 [104]. The
following version, published in 2019 [105], provides a more detailed procedure for assessing
the theoretical domestic hot water energy demand. Some of the information required for the
new procedure was not collected during the building inspections. A BER was determined
pre- and post-retrofit.
Using the estimated annual energy consumption pre- and post-retrofit and the level of
energy demand associated with each BER ranging from A1-G, BERs based on the measured
energy consumption were determined. The electricity demand for appliances was included
when assessing the BER even though it is not accounted for in a theoretical BER estimation.
This represented the energy demand for a full year, whereas the theoretical BER is based
on the energy demand for the heating months (October–May).
Figure 1 shows the cases pre-retrofit with a description of the cases and the retrofit
measures given in Section 4.1–Section 4.5.

4.1. Case A
Case A is a solid masonry wall house (94 m2 heated floor area) constructed in the 1960s
occupied by a family of four, including two children. The house underwent substantial
work, including retrofit measures to the building fabric and heating system. Double-
glazed PVC windows and doors replaced single pane timber windows and doors; 100 mm
expanded polystyrene external insulation and acrylic render were added to the solid
masonry external walls. Electric storage radiators and instantaneous domestic hot water
heaters were replaced with an air source heat pump (ASHP), heating controls, radiators,
and a hot water tank. In addition, a 2.1 kWp PV system with an inverter was installed.
It should be noted that Case A used electricity for space heating and water heating pre-
and post-retrofit (as well as for lighting and appliances). Case A had an ASHP installed as
part of the retrofit works. In this case, to normalise the space heating energy using HDDs
(as described in Section 3.4.1), it was assumed that 61% of the electricity usage for Case A
was related to space heating, based on the finding that 61% of end-use residential energy
in Ireland is accounted for by space heating [98]. The remaining 39% of electricity energy
usage was normalised to kWh/day and multiplied by the number of days in a year to
determine the annual energy use.

4.2. Case B
The retrofit works of Case B primarily focused on the heating system. The two-storey
detached house (118 m2 heated floor area) had an ASHP, heating controls, radiators, hot
water tank, 2.1 kWp PV system and inverter installed. The new electricity-based heating
system replaced an oil-based central heating system. The owner of the 1960s detached
house complemented the oil-based heating system pre-retrofit with a solid fuel stove and
maintained the option of using the solid fuel stove post-retrofit. The occupancy of the
home also changed following the retrofit with one of the occupants (a woman of more than
75 years of age) passing away, leaving the son aged between 46 and 55 years of age as the
sole occupant.
Energies 2022, 15, x FOR PEER REVIEW 14 of 27
Energies 2022, 15, 334 14 of 26

(a) (b)

(c) (d)

(e)
Figure 1. (a)
Figure 1. Case A,A,
(a) Case (b)(b)Case
CaseB,
B, (c) CaseC,C,(d)
(c) Case (d)Case
CaseD, D,
andand (e) Case
(e) Case E. E.

4.1. CaseAs
A the retrofit work consisted of changing the oil-based space and water heating
system to an electricity-based ASHP, it was important to differentiate the electricity con-
Case A for
sumption is aheating,
solid lighting,
masonry andwall
appliances, (94 m2 heated
house post-retrofit. To dofloor area)
this, the constructed
pre-retrofit daily in the
1960s occupied
electricity byfor
usage a lighting
family andof four, including
appliances two children.
was assumed The post-retrofit.
to be the same house underwentThus, sub-
the difference between the pre-retrofit and post-retrofit energy usage was
stantial work, including retrofit measures to the building fabric and heating system.assumed to be the Dou-
post-retrofit space and water heating energy required in Case B. Case B
ble-glazed PVC windows and doors replaced single pane timber windows and doors; 100also had a solid fuel
stove acting as a secondary heating system that remained in operation post-retrofit. Data
mm expanded polystyrene external insulation and acrylic render were added to the solid
from the electricity meter for Case B was unavailable for the post-retrofit stage of the study.
masonry external walls. Electric storage radiators and instantaneous domestic hot water
heaters were replaced with an air source heat pump (ASHP), heating controls, radiators,
and a hot water tank. In addition, a 2.1 kWp PV system with an inverter was installed.
It should be noted that Case A used electricity for space heating and water heating
Energies 2022, 15, 334 15 of 26

Thus, electricity bills from April 2018 to March 2019 were used to estimate the electricity
energy usage post-retrofit, with the heating energy normalised for the period 1 April 2018
to the 31 March 2019 using the HDD procedure described earlier in Section 3.4.1.
As electricity was not used for space heating purposes in Case B pre-retrofit, the
electricity usage data from the pre-retrofit six-month monitoring period was normalised
per day and multiplied by the number of days in a year to determine their annual electricity
usage for lighting and appliances.

4.3. Case C
Case C, with a heated floor area of 107 m2 , received retrofit measures for the building
fabric and heating system. The bungalow home constructed in the 1950s and occupied by a
woman more than 75 years old, installed 200 mm of earth wool insulation along the joists
of the attic. The oil boiler and hot water tank components of the primary heating system
were replaced with more energy efficient versions as part of the retrofit works. A solid fuel
range, which acted as a secondary space heating system, was replaced with a solid fuel
boiler. In addition, three radiators were replaced and heating controls installed. Oil and
solid fuel were used for the space and water heating requirements of Case C before and
after the retrofit works.
As electricity was not used for space heating purposes in Case C pre-retrofit or post-
retrofit, the electricity usage data from the monitoring periods were normalised per day
and multiplied by the number of days in a year to determine their annual electricity usage
for lighting and appliances. By subtracting the post-retrofit energy demand from the pre-
retrofit energy demand, the estimated annual energy demand savings were determined for
each case.

4.4. Case D
Case D is a bungalow originally constructed in the late 1970s with a heated floor area
of 72 m2 . The house, which is occupied by a woman more than 65 years old, underwent a
shallow retrofit. The energy efficiency upgrades mainly focused on the space and water
heating system. A more energy efficient hot water tank and oil boiler replaced less energy
efficient versions. In addition, a new space and water heating control panel was installed for
the homeowner. Oil and solid fuel were used for the space and water heating requirements
of Case D before and after the retrofitting works
Pre-retrofit, the householder relied on their oil boiler for domestic hot water heating
purposes. The householder used a solid fuel range installed in the kitchen working in
tandem with a back boiler to circulate hot water to the radiators installed throughout the
house to provide space heating. Following the retrofit, oil was used for both space and
water-heating purposes, as the householder was advised she could not receive a grant for a
new oil boiler without switching the central space heating to operate with the oil boiler. For
the building fabric, an adhesive was added to cavity wall insulation that had been pumped
into the cavity during previous retrofit work. Furthermore, air vents were added to each of
the rooms in the house.
As electricity was not used for space heating purposes in Case D pre-retrofit or post-
retrofit, the electricity usage data from the monitoring periods were normalised per day
and multiplied by the number of days in a year to determine their annual electricity usage
for lighting and appliances. By subtracting the post-retrofit energy demand from the pre-
retrofit energy demand, the estimated annual energy demand savings were determined for
each case.

4.5. Case E
Case E switched from a solid fuel-based heating system to an electricity-based heating
system following the retrofit works. The couple, aged between 56 and 64 years, removed
the solid fuel stove installed in their bungalow home and installed an ASHP in addition to
heating controls, radiators, and a 2.1 kWp PV system with an inverter. The house, with a
Energies 2022, 15, 334 16 of 26

heated floor area of 71 m2 and originally constructed in the 1960s, had undergone previous
retrofit work including external wall insulation.
As electricity was not used for space heating purposes in Case E pre-retrofit, the
electricity usage data from the pre-retrofit six-month monitoring period was normalised
per day and multiplied by the number of days in a year to determine their annual electricity
usage for lighting and appliances.
To differentiate between the electricity consumption for heating, lighting, and ap-
pliances for Case E post-retrofit, the pre-retrofit daily electricity usage for lighting and
appliances was assumed to be the same post-retrofit. Thus, the difference between the
pre-retrofit and post-retrofit energy usage was assumed to be the post-retrofit space and
water heating energy required in Case E.

5. Results
The impact to each of the KPIs assessed using the data collected from the five case
study buildings is given in Table 3 and discussed in the following sections.

5.1. Case A
The household of Case A experienced benefits across multiple KPIs. This household
invested the largest amount of money into their retrofit works of the five cases. Despite
having an investment of close to EUR 30,000 (net of grant), the householders are predicted
to achieve payback for the works within 10 years, providing their post-retrofit energy
demand remains constant during this period. Even without grant aid, the householders
would achieve payback within 15 years.
The householders reported being very satisfied with their thermal comfort following
the retrofit. Post-retrofit, the average household temperature increased by 3.1 ◦ C and RH
decreased by 10%, respectively. In addition, one householder felt that the thermal comfort
improvements helped address the health risk their home posed pre-retrofit, stating “the
house was a health risk before . . . something had to be done or we would have had to move.
Our quality of life has improved”. Furthermore, the householder reported that previous
issues with draughts, cold, condensation, mould, and dampness no longer persisted post-
retrofit. While the householder noted that “no major hassle was caused” by the works,
they believed the retrofit process overall could be improved with better engagement with
contractors, more choice in the design of the retrofit, more information on maintenance and
guarantee of the technologies, and a better financial payment plan for the works.
Regarding the level of engagement with contractors throughout the process, the
householder stated, “no choice was given in the design of the windows and doors installed”,
or in the location of the PV invertor to allow convenient monitoring of when the panels
were generating energy. In relation to the technology installed, the householder stated, “no
one showed us how to use anything. They simply installed them and left. They didn’t
tell us how to maintain these technologies”, while also adding “no details on product
guarantees were offered either”.
Furthermore, the householder was not satisfied with all the retrofit measures installed.
In particular, the householders criticised the PV panels, stating, “the (PV) panels don’t
generate electricity consistently, so I don’t think I’m getting the payback I thought I would.
No one told me that I might need a battery to store the energy I’m not consuming until after,
and those are very expensive”. However, despite the issues with the retrofit process, the
household achieved a 71%, 65%, and 59% reduction in secondary energy, primary energy
and carbon emissions, respectively.

5.2. Case B
The householder in Case B decided to switch from an oil and solid fuel based heating
system to an electric heat pump complemented with PV panels, resulting in a 73% decrease
in LCC. The householder achieved payback within one year, given the high percentage of
Energies 2022, 15, 334 17 of 26

grant aid the householder received for their retrofit works. Without the grant, the payback
period would have been close to 13 years, based on the post-retrofit energy demand.
It is expected that the reduction in operational energy demand, which led to a lower
LCC is a result of the retrofit technology installed, and the decrease in temperature to which
the dwelling was heated. The decrease in average temperature could be partially attributed
to several factors, including the post-retrofit change in occupancy in the dwelling, and
the impact of the retrofit measures installed. Specifically, the occupancy profile changed
post-retrofit, following the death of the elderly mother that had been living in the dwelling
pre-retrofit. Post-retrofit, the son lived in the house alone. As a result, he did not heat
the dwelling to as high a temperature as he had pre-retrofit to ensure his mother was
comfortable. The second possibility is that the installation of heating controls gave the
householder stricter control over the thermal conditions post-retrofit. Despite the quantita-
tive data showing reductions in the amount of time the indoor environment was within
recommended temperature and RH levels, the householder was very satisfied with his
thermal comfort, illustrating the benefit of collecting both quantitative and qualitative data,
and the subjectivity associated with householder’s thermal comfort.
While the householder was satisfied with many aspects of the retrofit, as reflected in
Table 2, the householder believed that contractor engagement during the handover process
could be improved, stating that when the heat pump cut out, he struggled to restart it as he
was not shown how to “get it started if that happened”.

5.3. Case C
Despite a negligible decrease in energy demand (3%) and an increase in LCC (7%), the
householder in Case C believed their dwelling to be “really great” post-retrofit. The house-
holder also expressed complete satisfaction with the level of engagement with contractors
and the quality of the works, stating that the workers “were absolutely brilliant”, and “did
not stop working until the work was done perfect and were always here when they said
they would be”.
The negligible decrease in energy demand was a result of the post-retrofit coal and
briquette fuel savings only slightly outweighing the post-retrofit increase in electricity and
oil demand. The additional cost of electricity and oil per kWh, relative to that of coal and
briquettes, resulted in the dwelling’s operational cost increasing post-retrofit. Despite a
more efficient oil boiler being installed, the householder felt she used the new oil boiler
more post-retrofit than the previous boiler, as she preferred to keep the house warmer than
it was pre-retrofit. This demand for a higher temperature is reflected in the thermal comfort
results, with the average temperature increasing post-retrofit, and the amount of time the
temperature was less than 18 ◦ C decreasing post-retrofit.

5.4. Case D
The operational secondary energy, primary energy and carbon emissions of Case D
reduced post-retrofit by 21%, 20% and 23%, respectively. Despite these environmental
improvements, the LCC savings were not as high due to a higher oil demand post-retrofit.
This higher post-retrofit oil demand can be accounted for by the fact that post-retrofit, oil
was used for both space and water heating purposes. Pre-retrofit, oil was used for water
heating purposes only, with the householder using a solid fuel range for central space
heating purposes. The householder was advised that she could not receive a grant for the
new oil boiler without switching the central space heating to oil also.
The householder still achieved a relatively quick payback on the investment (<2 years),
given that the householder invested only EUR 900 into the works as she was entitled to
substantial grant aid as part of the BEC scheme. If this grant was not available, however, it
would take over 20 years for the householder to see a return on her investment, despite
only undertaking shallow retrofit works.
The householder had some issues with the level of contractor engagement and the
technologies installed, despite having no other issues with the retrofit process itself and
Energies 2022, 15, 334 18 of 26

the works carried out. The householder stated that she was not shown how to use her new
heating controls. This eventually led her to request her old heating controls be reinstalled,
as she found the new heating controls too complicated. She stated, “I liked my old heating
controls better. The new ones were far too complicated. I just want to be able to switch
them on and off . . . so they took out my new ones and put the old ones back in”. The
householder also preferred the solid fuel range for central heating as opposed to the oil
boiler, but this could not be reversed.

5.5. Case E
Case E switched from a solid fuel-based heating system to an electricity-based heating
system post-retrofit. This resulted in increased electricity consumption post-retrofit. Despite
this increased electricity consumption, the use of solid fuel in the dwelling post-retrofit
resulted in a reduction in secondary energy demand of 59%. However, the LCC increased
post-retrofit due to the cost per kWh of electricity relative to solid fuel.
The householder was completely satisfied with the heat pump installed, stating that
they had “no regrets whatsoever in choosing the heat pump, as heating the house before
was like a full-time job”. The householder also felt that the dwelling was warmer and
more comfortable post-retrofit, noting that it was also “nice to have hot water during
the day instead of switching on the immersion”. The thermal comfort improvements are
reflected in the quantitative temperature data, whereby the average temperature increased
by 1.3% post-retrofit, with the amount of time the temperature was less than 18 ◦ C reducing
by 31%.
While the householder was satisfied overall with the retrofit having “absolutely no
regrets in undertaking the works”, the householder did note that the retrofit installers were
sometimes “sloppy”, and often had a start-stop nature in completing the works.
The householder also noted problems with the level of engagement with the contractor
and the technology installed. The householder stated that in the handover process, “there
was no briefing on any of it”, in terms of how to use the installed technologies. The
householder noted there were “no manuals for anything. If it doesn’t work, we have to
figure out ourselves how to fix it”. Furthermore, the householder found the PV system
unimpressive, stating that it “seemed more interesting than it is in reality”, and that they
were not sure if they would invest in maintaining it in the future. Moreover, as a battery
was not installed to complement the PV panels, the householder noted a similar complaint
to that of Case A, whereby they found it difficult to match the electricity demand of the
house with the electricity generation of the PV panels.

6. Discussion
To date, many efforts to evaluate retrofit projects have done so through a rather
narrow lens, focusing primarily on economic and environmental KPIs, while failing to give
due consideration to social KPIs. Moreover, many studies focus on evaluating one or two
categories of KPIs. They very rarely, however, evaluate economic, social, and environmental
KPIs, within an integrated framework. This is considered less than ideal, given the fact that
other non-economic and environmental factors are important drivers to retrofit investment
decisions. Thus, the full value of retrofit improvements is underestimated.
As demonstrated by the results of the case study dwellings, householders can expe-
rience various benefits from a building retrofit. For instance, although the householder
in Case C spent more to heat the home following the retrofit, they were happy to have
completed the work and believed their home to be “really great” post-retrofit thanks to their
improved thermal comfort. The householder in Case A is estimated to achieve payback
for their investment of nearly EUR 30,000 within 10 years, with the householders also
experiencing a significant improvement in their thermal comfort. Additionally, Case B and
Case E illustrate the different benefits homes can receive from a similar retrofit package.
While both dwellings switched to an ASHP-based heating system complemented by a PV
system, one saved energy and money (Case B), while the other had a warmer home (Case E).
Energies 2022, 15, 334 19 of 26

It is acknowledged that the differences in the case study dwellings presented makes it
difficult for a cross-comparison of the benefits received following each retrofit. While this
is a limitation of this study, the importance of collecting data that showcases the different
benefits (or lack thereof) people can experience from retrofitting cannot be underestimated.
As householders are often unable to quantify and evaluate retrofit performance, there is
large potential to increase satisfaction and reduce post-purchase regret [106], by demon-
strating the multiple benefits they have received through pre- and post-retrofit comparisons.
Furthermore, it has real potential in convincing householders to undertake further retrofit
works (see [25,30,107]), and in inspiring others seeking similar benefits, especially given the
importance of positive feedback, social proof and demonstration projects in householder
retrofit decision-making [79,108,109]. In fact, the importance of such is demonstrated in
the present study, as since the end of data collection, Case C has gone on to install further
retrofit measures, including external wall insulation and a PV system.
The Irish government’s Climate Action Plan [2] aims to install 400,000 heat pumps
to existing dwellings in Ireland by 2030, in addition to the retrofit of 500,000 homes to a
B2-BER or better (i.e., primary energy consumption less than or equal to 125 kWh/m2 /y).
Three out of the five case study dwellings had state-of-the-art heat pumps installed as part
of their retrofit works, with interesting findings as to their satisfaction and experience with
these heat pumps. Existing research on heat pump adoption highlights that one of the
key barriers to heat pump adoption is a concern among householders that heat pumps are
slow to heat rooms [110], which may result from a persistent lack of understanding among
householders as to how heat pumps operate, compared with gas or oil boilers [111]. Our
study revealed, however, that householders had satisfactory experiences relating to the
heat pump and its ability to heat the home, with a householder in Case E expressing their
satisfaction with the heat pump’s ability to remove the effort needed to continually add fuel
to the stove to heat the house pre-retrofit. However, all three householders (with varying
demographic and socioeconomic statuses) in Case A, Case B, and Case E, highlighted the
lack of information provided at handover as to how to best operate and maintain these
technologies. Such findings agree with those of existing literature which finds that a poor
understanding of how heat pumps and their controls work (see [110,112]), as well as a
lack of training provision from installers on heat pump operation (see [113]), constitute
significant barriers to heat pump uptake. Thus, our findings agree with the importance
of adequate training at handover on the operation of such technologies in encouraging
heat pump uptake, as recently suggested by the SEAI [111]. This is particularly pertinent,
given the influence inappropriate heat pump use has on energy savings, and comfort levels
obtained post-retrofit [111]. If these issues persist on a wider scale, there are significant
challenges to be overcome for the achievement of the Irish government’s Climate Action
Plan targets set.
The householders in Case A, Case B, and Case E, also installed state-of-the-art PV
systems, which normally complement heat pumps from an electricity consumption per-
spective. However, a source of dissatisfaction with this technology in two out of the three
households (Case A and Case E) agreed on the difficulty of matching the electricity demand
of their dwellings, to the electricity generation from the PV system.
While the householders in Case C and Case D did not install heat pumps or PV systems
as part of their works, they did install state-of-the-art heating controls. However, despite
the similar occupant profiles in these dwellings (a widow, living alone, aged >65 years), the
householders had very different experiences of using this technology, with one householder
even having the new controls removed, given her dissatisfaction with the technology and
its use. Existing research has shown that the energy savings resulting from a retrofit depend
strongly on heating system operation; yet, heating controls are consistently regarded as
difficult to use by homeowners, particularly, in older homeowners [114]. Our findings agree
with such, and reinforce the importance of understanding and incorporating the energy
impacts of poor usability of such controls into the future design of these technologies, as
Energies 2022, 15, 334 20 of 26

well as, the need for appropriate training provision on their use at retrofit handover, and
continued customer support.
Thus, while the framework is not capable of explaining reasons for differences in
benefit levels across homes (which is a limitation), it can allow for the identification of
potential factors for differences in performance across households (e.g., temperature take-
back, reduction in temperature demand, switching fuel source, etc.). It could also be used to
identify patterns of underperformance for specific parameters (e.g., difficulty in matching
the electricity demand of the house with the electricity generation of the PV panels as seen
in Case A and E), which may need to be further investigated to understand why, and the
level to which certain retrofit packages are not obtaining certain benefits. These insights are
particularly useful for the future design of retrofit technologies, the future design of retrofit
packages, as well as the design of future policy measures, that support householders not
only in their adoption of retrofit measures, but also throughout their experiences of living
in a retrofitted home.

Limitations
While this study has demonstrated the usefulness of an integrated framework of KPIs
in demonstrating the economic, social, and environmental benefits of retrofitting, some
limitations should be acknowledged. Firstly, even though the KPIs representing each core
category assessed are justified in their inclusion, they are certainly non-exhaustive, with
other KPIs in each category being discussed in the literature. They are considered to be the
minimum captured for demonstrating the wider benefits of retrofitting to homeowners and
encouraging homeowners to invest in building retrofits. As retrofit projects are complex
and can have other benefits that may not be captured using the selected set of KPIs, other
KPIs should be added if required. In addition, it should be noted that while the KPIs
assessed, and the methods used for their assessment, resulted in useful knowledge on
the wider benefits of retrofitting, it is not suggested that these methods be considered a
standard methodology for the assessment of these KPIs in the future. There is a multitude
of ways to assess these KPIs, and further, critical analysis of best practice methodologies
for doing so is needed. This is an interesting direction for future research, particularly, for
developing standardised integrated frameworks that can be applied to large sample sets.
Other researchers agree on the importance of developing standardised methods for the
assessment of such KPIs [33].
It is also acknowledged that a small sample of just five case study dwellings was used
in this study. The case studies used in this paper were part of a wider monitoring study,
consisting of a total of 13 dwellings. However, due to the loss of data collected by the data
loggers in three of the eight dwellings that invested in a retrofit, five case study dwellings
were selected for use in this study.

7. Conclusions and Implications for Policy, Practice, and Knowledge

This study reviewed the available literature on the state-of-the-art of the use of KPIs
to evaluate energy retrofits and sustainable building performance. There are a lack of
studies that assess the economic, social, and environmental benefits of retrofitting within
an integrated framework. Thus, this paper applied a framework of KPIs to five case study
dwellings located in the west of Ireland, to demonstrate the wider benefits householders
can receive through retrofitting. This paper is significant in that it contributes to the
literature by firstly providing a framework of core economic, social, and environmental
KPI categories that should be included in retrofit evaluations at a minimum, and common
KPIs for their assessment.
While the primary function of the KPI framework is to demonstrate the wider ben-
efits obtained by householders following a retrofit investment as discussed, it also has
a potential function from a retrofit design perspective, in that its application to a much
larger, comparable sample size, could help designers distinguish the retrofit packages that
typically perform best across all KPIs, across various household compositions, and dwelling
Energies 2022, 15, 334 21 of 26

types. As discussed, reasons for differences in performance, and underperformance, across

households could be identified and rectified in retrofit design. Subsequently, rather like a
feedback loop, designers can then demonstrate to future homeowners the benefits achieved
in implemented retrofit projects following a straightforward retrofit journey for the home-
owner, with a view to driving householder investment in residential retrofitting.
While the collection of such information on a large-scale basis would require a stan-
dardised data collection methodology to be implemented, it would serve as an evidence
base for retrofit designers, contractors, and policy makers to incentivise and de-risk in-
vestment by homeowners in deeper building retrofits, which would aid in helping not
only Ireland achieve its target of 500,000 deep retrofits by 2030, but also the EU in meeting
its ‘renovation wave’ targets. Thus, the framework of KPIs developed in this study can
serve as an invaluable tool to assess, demonstrate, and maximise the wider retrofitting
benefits of various policy measures, retrofit schemes and/or retrofit packages to drive
retrofit investment by householders in the residential sector.
However, research gaps remain. Future research, which aims to develop standard-
ised KPIs for the assessment of energy retrofit projects, as well as research that develops
standardised methods and guidelines for their assessment, is considered critical to the
expansion of knowledge in this area, to support design decisions, and to inform national
and international retrofit policies alike.
Overall, this paper made several key findings:
• There remains a need to develop a set of standardized economic, social, and environ-
mental KPIs for the evaluation of building retrofits, as well as standardized methods
for their assessment.
• The assessment of an integrated framework of economic, social, and environmental
KPIs, in a pre- and post-retrofit case study is not only useful for the demonstration of
the wider benefits of retrofitting, but also for identifying potential issues for differences
in performance, and underperformance, of state-of-the-art retrofit technologies.
• Householders report difficulties in understanding the operation and maintenance of
state-of-the-art technologies, including heat pumps, PV systems, and heating controls.
• Householders with similar demographics and socioeconomic backgrounds can have
very different experiences in the use of retrofit technologies.

Author Contributions: Conceptualization, O.M., P.M. and J.G.; methodology, O.M., P.M. and J.G.;
validation, O.M. and P.M.; formal analysis, O.M.; investigation, O.M., P.M. and J.G.; resources, J.G.;
data curation, O.M.; writing—original draft preparation, O.M., P.M. and J.G.; writing—review and
editing, O.M., P.M. and J.G.; visualization, O.M.; supervision, P.M. and J.G.; project administration,
J.G.; funding acquisition, P.M. and J.G. All authors have read and agreed to the published version of
the manuscript.
Funding: The authors would like to acknowledge the financial support from the European Union’s
Horizon 2020 research and innovation programme under grant agreement no. 839134, as well as from
Science Foundation Ireland (SFI) for the ERBE Centre for Doctoral Training under grant agreement no.
18/EPSRC-CDT/3586 and the Engineering and Physical Sciences Research Council EP/S021671/1
and the MaREI Centre under grant agreement no. 12/RC/2302_P2. The authors also acknowledge the
financial support from the Sustainable Energy Authority of Ireland (SEAI) through the HEAT CHECK
project (grant agreement 19/RDD/492). The authors would also like to acknowledge financial
support from the Science Foundation Ireland (grant no. 13/CDA/2200).
Institutional Review Board Statement: The study was conducted in accordance with the Dec-
laration of Helsinki, and approved by the Institutional Research Ethics Committee of National
University of Ireland Galway (ethics ref: 16-Sept-12: ‘Achieving nearly zero energy buildings—A
lifecycle assessment approach to retrofitting existing buildings (nZEB-RETROFIT)’; date of approval
24th September 2016).
Informed Consent Statement: Informed consent was obtained from all subjects involved in the study.
Data Availability Statement: Data can be requested from the corresponding author.
Energies 2022, 15, 334 22 of 26

Conflicts of Interest: The authors declare no conflict of interest. The funders had no role in the design
of the study; in the collection, analyses, or interpretation of data; in the writing of the manuscript, or
in the decision to publish the results.

Appendix A
The research was carried out as part of the SFI-funded nZEB-RETROFIT project. The
monitoring of the case study buildings focused on examining changes in household energy
consumption and energy-related attitudes in retrofitted domestic buildings.
Potential research participants were provided with a participant information sheet.
The participant information sheet provided participants with (i) information about the
research; (ii) their role in the project; (iii) details of the organisations involved; (iv) any
conditions associated with participating, (v) any benefits or risks involved in participating;
(vi) how the information research participants provided will be used, stored, and shared;
and (vii) sources for further information to answer any queries participants mad.
If the householders wished to proceed as part of the research after reviewing the
participant information sheet, they were asked to sign a consent form. The consent form
was an agreement that outlined the roles and responsibilities they were taking on in the
research process.
Following the signing of the consent form, the participants were assigned Unique
Identifier Codes. The non-personal data were stored in pseudonymised form and not
traceable to individual participants. Research results based on personal data were shared
in aggregated or pseudonymised form and not traceable to individual participants.
Households included as part of an application to the Sustainable Energy Authority of
Ireland’s Better Energy Communities grant scheme were approached to participate in the
research project. The grant scheme supports energy efficient community projects through
capital funding, partnerships, and technical support.
A local community officer, who assisted in generating local interest in applying to the
Better Energy Communities grant scheme in collaboration with the contractor overseeing
the works, contacted locals to participate in the research study. The community officer
approached 31 households with an invitation and information letter to participate in the
research with 13 households agreeing to participate.
A suitable time for the researchers to visit the participant’s homes was arranged to
survey the physical and technical characteristics of the buildings, install the data logging
instrumentation, and carry out the semi-structured surveys. The generally took between
1.5 and 2 h, depending on the case study building.
Of the thirteen households that agreed to participate, eight decided to move ahead
with the retrofit works after funding was approved. Due to the loss of data collected by
the data loggers in three of the eight dwellings that invested in a retrofit, five case study
dwellings were selected for use in this study.
Details on the quantitative and qualitative data collection instruments are included in
Section 3 of this article and as part of Rau et al.’s [90] study on the impact retrofitting has
on the energy cultures and the sustainable-related outcomes among inhabitants of social
housing units in Ireland. Given the small number of households involved in the study, only
a descriptive data analysis could be performed with the datasets collected.

References
1. European Commission. Communication from the Commission to the European Parliament, the Council, the European Economic and Social
Committee and the Committee of the regions. A Renovation Wave for Europe—Greening our Buildings, Creating Jobs, Improving Lives.
COM/2020/662; European Commission: Brussels, Belgium, 2020.
2. Department of Communications, Climate Action and Environment. Climate Action Plan 2021—Securing our Future. 4 November 2021.
Available online: https://www.gov.ie/en/publication/6223e-climate-action-plan-2021/ (accessed on 19 November 2021).
3. Sustainable Energy Authority of Ireland. Building Energy Rating Certificate. 2017. Available online: https://www.seai.ie/home-
energy/building-energy-rating-ber/ (accessed on 22 September 2020).
4. Sustainable Energy Authority of Ireland. Domestic Energy Assessment Procedure (DEAP); SEAI: Dublin, Ireland, 2020.
Energies 2022, 15, 334 23 of 26

5. Sustainable Energy Authority of Ireland. National BER Research Tool. Available online: https://ndber.seai.ie/BERResearchTool/
Register/Register.aspx (accessed on 16 January 2020).
6. Trotta, G. The determinants of energy efficient retrofit investments in the English residential sector. Energy Policy
2018, 120, 175–182. [CrossRef]
7. Collins, M.; Curtis, J. An examination of the abandonment of applications for energy efficiency retrofit grants in Ireland. Energy
Policy 2017, 100, 260–270. [CrossRef]
8. Klöckner, C.A.; Nayum, A. Specific Barriers and Drivers in Different Stages of Decision-Making about Energy Efficiency Upgrades
in Private Homes. Front. Psychol. 2016, 7, 1362. [CrossRef]
9. Achtnicht, M.; Madlener, R. Factors influencing German house owners’ preferences on energy retrofits. Energy Policy
2014, 68, 254–263. [CrossRef]
10. Neuhoff, K.; Stelmakh, K.; Amecke, H.; Novikova, A.; Deason, J.; Hobbs, A. Financial incentives for energy efficiency retrofits in
buildings. In Proceedings of the ACEEE Summer Study on Energy Efficiency in Buildings, Pacific Grove, CA, USA, 12–17 August 2012.
11. Brown, D. Business models for residential retrofit in the UK: A critical assessment of five key archetypes. Energy Effic.
2018, 11, 1497–1517. [CrossRef]
12. Desmaris, R.; Jauregui, O.; McGinley, O.; Volt, J. D 2.1 Market and PESTLE Analysis; CSTB: Paris, France, 2019.
13. Collins, M.; Curtis, J. Identification of the Information Gap in Residential Energy Efficiency: How Information Asymmetry Can Be Mitigated
to Induce Energy Efficiency Renovations; Working Paper; Economic and Social Research Institute (ESRI): Dublin, Ireland, 2017.
14. Sustainable Energy Authority of Ireland; Economic Social Research Institute. Policy Insights for Encouraging Energy Efficiency in the
Home: A Compilation of Findings from a Research Fellowship Co-Funded by the SEAI and ESRI; SEAI: Dublin, Ireland, 2018.
15. Collins, M.; Curtis, J. Value for money in energy efficiency retrofits in Ireland: Grant provider and grant recipients. Appl. Econ.
2017, 49, 5245–5267. [CrossRef]
16. Ma, Z.; Cooper, P.; Daly, D.; Ledo, L. Existing building retrofits: Methodology and state-of-the-art. Energy Build. 2012, 55, 889–902.
[CrossRef]
17. Jafari, A.; Valentin, V. An optimization framework for building energy retrofits decision-making. Build. Environ. 2017, 115, 118–129.
[CrossRef]
18. Coyne, B.; Lyons, S.; McCoy, D. The effects of home energy efficiency upgrades on social housing tenants: Evidence from Ireland.
Energy Effic. 2018, 11, 2077–2100. [CrossRef]
19. Dall’O, G.; Galante, A.; Pasetti, G. A methodology for evaluating the potential energy savings of retrofitting residential building
stocks. Sustain. Cities Soc. 2012, 4, 12–21. [CrossRef]
20. Stanley, S.; Lyons, R.; Lyons, S. The price effect of building energy ratings in the Dublin residential market. Energy Effic.
2015, 9, 875–885. [CrossRef]
21. De Boeck, L.; Verbeke, S.; Audenaert, A.; De Mesmaeker, L. Improving the energy performance of residential buildings:
A literature review. Renew. Sustain. Energy Rev. 2015, 52, 960–975. [CrossRef]
22. Lizana, J.; Barrios-Padura, Y.; Molina-Huelva, M.; Chacarteguic, R. Multi-criteria assessment for the effective decision management
in residential energy retrofitting. Energy Build. 2016, 129, 284–307. [CrossRef]
23. Clinch, J.; Healy, J.D. Cost-benefit analysis of domestic energy efficiency. Energy Policy 2001, 29, 113–124. [CrossRef]
24. Vlasova, L.; Gram-Hanssen, K. Incorporating inhabitants’ everyday practices into domestic retrofits. Build. Res. Inf. 2014, 42, 512–524.
[CrossRef]
25. Aravena, C.; Riquelme, A.; Denny, E. Money, comfort or environment? Priorities and determinants of energy efficiency
investments in Irish households. J. Consum. Policy 2016, 39, 159–186. [CrossRef]
26. Sustainable Energy Authority of Ireland. Behavioural Insights on Energy Efficiency in the Residential Sector; Sustainable Energy
Authority of Ireland: Dublin, Ireland, 2017.
27. Achtnicht, M. Do environmental benefits matter? Evidence from a choice experiment among house owners in Germany. Ecol.
Econ. 2011, 70, 2191–2200. [CrossRef]
28. Department of Communications, Climate Action and Environment. Ireland’s Long Term Renovation Strategy 2017–2020; Department
of Communications, Climate Action, and Environment: Dublin, Ireland, 2017.
29. Department of Communications, Climate Action and Environment. National Mitigation Plan; Department of Communications,
Climate Action and Environment: Dublin, Ireland, 2017.
30. Wilson, C.; Crane, L.; Chryssochoidis, G. Why Do People Decide to Renovate Their Homes to Improve Energy Efficiency; Tyndall Centre
for Climate Change Research: Norwich, UK, 2013.
31. Khudhair, H.; Isik, Z. Key Performance Indicators in retrofit projects: A review. In Proceedings of the 10th International
Conference on Studies in Architecture, Civil, Design & Environmental Engineering (SACDEE-18), Istanbul, Turkey, 1–2 May 2018.
32. Li, Y.; O’Donnell, J.; García-Castro, R.; Vega-Sánchez, S. Identifying stakeholders and key performance indicators for district and
building energy performance analysis. Energy Build. 2017, 155, 1–15. [CrossRef]
33. Kylili, A.; Fokaides, P.; Lopez Jimenez, P. Key Performance Indicators (KPIs) approach in buildings renovation for the sustainability
of the built environment. Renew. Sustain. Energy Rev. 2016, 56, 906–915. [CrossRef]
34. Li, P.; Froese, T.M.; Brager, G. Post-occupancy evaluation: State-of-the-art analysis and state-of-the-practice review. Build. Environ.
2018, 133, 187–202. [CrossRef]
Energies 2022, 15, 334 24 of 26

35. Mohammadpourkarbasi, H.; Sharples, S. The Eco-Refurbishment of a 19th Century Terraced House: Energy and Cost Performance
for Current and Future UK Climates. Buildings 2013, 3, 220–244. [CrossRef]
36. Kolaitis, D.; Malliotakis, E.; Kontogeorgos, D.; Mandilaras, I.; Katsourinis, D.I.; Founti, M. Comparative assessment of internal
and external thermal insulation systems for energy efficient retrofitting of residential buildings. Energy Build. 2013, 64, 123–131.
[CrossRef]
37. Ballarini, I.; Corrado, V.; Madonna, F.; Paduos, S.; Ravasio, F. Energy refurbishment of the Italian residential building stock:
Energy and cost analysis through the application of the building typology. Energy Policy 2017, 105, 148–160. [CrossRef]
38. Asadi, E.; da Silva, M.; Antunes, C.; Dias, L. Multi-objective optimization for building retrofit strategies: A model and an
application. Energy Build. 2012, 44, 81–87. [CrossRef]
39. Goldman, C.A.; Greely, K.M.; Harris, J.P. Retrofit experience in U.S. multifamily buildings: Energy savings, costs, and economics.
Energy 1988, 13, 797–811. [CrossRef]
40. Atkinson, J.; Littlewood, J.; Geens, A.; Karani, G. Did ARBED I Save Energy in Wales’ Deprived Dwellings. Energy Procedia
2015, 83, 444–453. [CrossRef]
41. Atkinson, J.; Littlewood, J.; Karani, G.; Geens, A. Relieving fuel poverty in Wales with external wall insulation. Proc. Inst. Civ.
Eng.-Eng. Sustain. 2017, 170, 93–101. [CrossRef]
42. Risholt, B.; Time, B.; Hestnes, A.G. Sustainability assessment of nearly zero energy renovation of dwellings based on energy,
economy and home quality indicators. Energy Build. 2013, 60, 217–224. [CrossRef]
43. Dijkstra, L. An Environmental and Economic Impact Comparison of Renovation Concepts for Dutch Residential Buildings.
Master’s Thesis, Utrecht University, Utrecht, The Netherlands, 2013.
44. Hyland, M.; Lyons, R.; Lyons, S. The value of domestic building energy efficiency—Evidence from Ireland. Energy Econ.
2013, 40, 943–952. [CrossRef]
45. Stazi, F.; Vegliò, A.; DI Perna, C.; Munafò, P. Retrofitting using a dynamic envelope to ensure thermal comfort, energy savings
and low environmental impact in Mediterranean climates. Energy Build. 2012, 54, 350–362. [CrossRef]
46. Broderick, Á.; Byrne, M.; Armstrong, S.; Sheahan, J.; Coggins, A.M. A pre and post evaluation of indoor air quality, ventilation,
and thermal comfort in retrofitted co-operative social housing. Build. Environ. 2017, 122, 126–133. [CrossRef]
47. Littlewood, J.; Karani, G.; Atkinson, J.; Bolton, D.; Geens, A.; Jahic, D. Introduction to a Wales project for evaluating residential
retrofit measures and impacts on energy performance, occupant fuel poverty, health and thermal comfort. Energy Procedia
2017, 134, 835–844. [CrossRef]
48. Poortinga, W.; E Rodgers, S.; A Lyons, R.; Anderson, P.; Tweed, C.; Grey, C.; Jiang, S.; Johnson, R.; Watkins, A.; Winfield, T.G.
The health impacts of energy performance investments in low-income areas: A mixed-methods approach. Public Health Res.
2018, 6, 1–182. [CrossRef]
49. Gupta, R.; Barnfield, L.; Hipwood, T. Impacts of community-led energy retrofitting of owner-occupied dwellings. Build. Res. Inf.
2014, 42, 446–461. [CrossRef]
50. Gupta, R.; Gregg, M.; Passmore, S.; Stevens, G. Intent and outcomes from the Retrofit for the Future programme: Key lessons.
Build. Res. Inf. 2015, 43, 435–451. [CrossRef]
51. Thomas, L.E. Evaluating design strategies, performance and occupant satisfaction: A low carbon office refurbishment. Build. Res.
Inf. 2010, 38, 610–624. [CrossRef]
52. Haverinen-Shaughnessy, U.; Martuzevicius, D. Occupant satisfaction with indoor environmental quality and health after energy
retrofits of multi-family buildings: Results from INSULAtE-project. Int. J. Hyg. Environ. Health 2018, 221, 921–928. [CrossRef]
53. Prasauskas, T.; Martuzevicius, D.; Kalamees, T.; Kuusk, K.; Leivo, V.; Haverinen-Shaughnessy, U. Effects of Energy Retrofits on
Indoor Air Quality in Three Northern European Countries. Energy Procedia 2016, 96, 253–259. [CrossRef]
54. Noris, F.; Adamkiewicz, G.; Delp, W.W.; Hotchi, T.; Russell, M.; Singer, B.C.; Spears, M.; Vermeer, K.; Fisk, W.J. Indoor
environmental quality benefits of apartment energy retrofits. Build. Environ. 2013, 68, 170–178. [CrossRef]
55. Jafari, A.; Valentin, V.; Bogus, S. Assessment of Social Indicators in Energy Housing Retrofits. In Proceedings of the Construction
Research Congress 2016, San Juan, Puerto Rico, 31 May–2 June 2016.
56. Maidment, C.D.; Jones, C.R.; Webb, T.L.; Hathway, E.A.; Gilbertson, J. The impact of household energy efficiency measures on
health: A meta-analysis. Energy Policy 2014, 65, 583–593. [CrossRef]
57. Willand, N.; Ridley, I.; Maller, C. Towards explaining the health impacts of residential energy efficiency interventions: A realist
review. Soc. Sci. Med. 2015, 133, 191–201. [CrossRef]
58. Bray, N.; Burns, P.; Jones, A.; Winrow, E.; Edwards, R.T. Costs and outcomes of improving population health through better social
housing: A cohort study and economic analysis. Int. J. Public Health 2017, 62, 1039–1050. [CrossRef]
59. Clark, J.E.C.; Kearns, A. Housing Improvements, Perceived Housing Quality and Psychosocial Benefits From the Home. Hous.
Stud. 2012, 27, 915–939. [CrossRef]
60. Ilter, D.; Tekce, I.; Ergen, E.; Seyis, S. Toward an Occupant Satisfaction Measure for Office Building Retrofits. In Proceedings of the
CIB World Building Congress, Tampere, Finland, 1–3 June 2016.
61. Ardente, F.; Marco, B.; Maurizio, C.; Marina, M. Energy and environmental benefits in public buildings as a result of retrofit
actions. Renew. Sustain. Energy Rev. 2011, 15, 460–470. [CrossRef]
62. Black, J.; Stern, P.; Elworth, J. Personal and contextual influences on household energy adaptations. J. Appl. Psychol. 1985, 70, 3–21.
[CrossRef]
Energies 2022, 15, 334 25 of 26

63. Jakob, M. The Drivers of and Barriers to Energy Efficiency in Renovation Decisions of Single Family Home Owners; Center for Energy
Policy and Economics (CEPE), Department of Management, Technology and Economics (ETH): Zurich, Switzerland, 2007.
64. Nair, G.; Gustavsson, L.; Mahapatra, K. Factors influencing energy efficiency investments in existing Swedish residential buildings.
Energy Policy 2010, 38, 2956–2963. [CrossRef]
65. Rosenow, J.; Eyre, N. The Green Deal and the Energy Company Obligation. Proc. Inst. Civ. Eng. 2013, 166, 127–136. [CrossRef]
66. Balaras, C.; Dascalaki, E.; Droutsa, K.; Kontoyiannidis, S.; Guruz, R.; Gudnason, G. Energy & other key performance indicators
for buildings–examples for Hellenic buildings. Glob. J. Energy Technol. Res. Updates 2014, 1, 71–89.
67. Laquatra, J.; Carswell, A. Re-assessing the economic and analytical tools that measure and optimize household’s energy-efficiency
improvements. Hous. Soc. 2015, 42, 166–178. [CrossRef]
68. Zundel, S.; Steiß, I. Beyond profitability of energy saving measures-attitudes towards energy saving. J. Consum. Policy 2011, 34, 91–105.
[CrossRef]
69. Organ, S.; Proverbs, D.; Squires, G. Motivations for energy efficiency refurbishment in owner-occupied housing. Struct. Surv.
2013, 31, 101–120. [CrossRef]
70. Dowson, M.; Poole, A.; Harrison, D.; Susman, G. Domestic UK retrofit challenge: Barriers, incentives and current performance
leading into the Green Deal. Energy Policy 2012, 50, 294–305. [CrossRef]
71. Reuter, M.; Patel, M.K.; Eichhammer, W.; Lapillonne, B.; Pollier, K. A comprehensive indicator set for measuring multiple benefits
of energy efficiency. Energy Policy 2020, 139, 111284. [CrossRef]
72. World Health Organisation. WHO Guidelines for Indoor Air Quality: Selected Pollutants; WHO: Copenhagen, Denmark, 2010.
73. Monteiro, C.S.; Causone, F.; Cunha, S.; Pina, A.; Erba, S. Addressing the challenges of public housing retrofits. Energy Procedia
2017, 134, 442–451. [CrossRef]
74. Collins, M.; Dempsey, S. Residential energy efficiency retrofits: Potential unintended consequences. J. Environ. Plan. Manag.
2019, 62, 2010–2025. [CrossRef]
75. Davies, M.; Oreszczyn, T. The unintended consequences of decarbonising the built environment: A UK case study. Energy Build.
2012, 46, 80–85. [CrossRef]
76. Mavrogianni, A.; Davies, M.; Taylor, J.; Oikonomou, E. The unintended consequences of energy efficient retrofit on indoor air
pollution and overheating risk in a typical Edwardian mid-terraced house. In Proceedings of the Future Build-International
Conference, Bath, UK, 4–6 September 2013.
77. Turpin-Brooks, S.; Viccars, G. The development of robust methods of post occupancy evaluation. Facilities 2006, 24, 177–196.
[CrossRef]
78. Long, T.B.; Young, W.; Webber, P.; Gouldson, A.; Harwatt, H. The impact of domestic energy efficiency retrofit schemes on
householder attitudes and behaviours. J. Environ. Plan. Manag. 2015, 58, 1853–1876. [CrossRef]
79. European Union: European Commission. Communication from the Commission to the European Parliament, the European Council,
the Council, the European Economic and Social Committee and the Committee of the Regions. The European Green Deal; 11.12.2019,
COM/2019/640 Final; European Commission: Brussels, Belgium, 2019.
80. Department of Communications, Climate Action and Environment. A Strategy to Combat Energy Poverty; Department of
Communications, Energy and Natural Resources: Dublin, Ireland, 2016.
81. Healy, J.D.; Clinch, J. Fuel poverty, thermal comfort and occupancy: Results of a national household-survey in Ireland. Appl.
Energy 2002, 73, 329–343. [CrossRef]
82. Buildings Performance Institute of Europe. Alleviating Fuel Poverty in the EU: Investing in Home Renovation, a Sustainable and
Inclusive Solution; BPIE: Brussels, Belgium, 2015.
83. Mills, E.; Rosenfeld, A. Consumer non-energy benefits as a motivation for making energy-efficiency improvements. Energy
1996, 21, 707–720. [CrossRef]
84. Trotta, G. Factors affecting energy-saving behaviours and energy efficiency investments in British households. Energy Policy
2018, 114, 529–539. [CrossRef]
85. Galassi, V.; Madlener, R. The Role of Environmental Concern and Comfort Expectations in Energy Retrofit Decisions. Ecol. Econ.
2017, 141, 53–65. [CrossRef]
86. Alberini, A.; Banfi, S.; Ramseier, C. Energy Efficiency Investments in the Home: Swiss Homeowners and Expectations about
Future Energy Prices. Energy J. 2013, 34, 49–86. [CrossRef]
87. Bio Intelligence Service; Lyons, R.; IEEP. Energy Performance Certificates in Buildings and Their Impact on Transaction Prices and Rents
in Selected EU Countries; Final Report Prepared for European Commission; DG Energy: Brussels, Belgium, 2013.
88. International Energy Agency. Energy Performance Certification of Buildings—A Policy Tool to Improve Energy Efficiency; IEA:
Paris, France, 2010.
89. Volt, J.; Zuhaib, S.; Schmatzberger, S.; Toth, Z. Energy Performance Certificates Assessing their Status and Potential; Building
Performance Institute Europe: Brussels, Belgium, 2020.
90. Rau, H.; Moran, P.; Manton, R.; Goggins, J. Changing energy cultures? Household energy use before and after a building energy
efficiency retrofit. Sustain. Cities Soc. 2020, 54, 101983. [CrossRef]
91. European Union: European Commission. Comission Delegated Regulation (EU) No. 244/2012 of 16 January 2012 Supplementing
Directive 2010/31/EU of the European Parliament and of the Council on the Energy Performance of Buildings by Establishing a Comparative
Energies 2022, 15, 334 26 of 26

Methodology Framework for Calculating Cost Optimal Levels of Minimum Energy Performance Requirements for Buildings and Building
Elements; European Commission: Brussels, Belgium, 2012.
92. Rogers, M.; Duffy, A. Engineering Project Appraisal, 2nd ed.; Wiley-Blackwell: Chicester, UK, 2012.
93. Fuerst, F.; McAllister, P.; Nanda, A.; Wyatt, P. Energy performance ratings and house prices in Wales: An empirical study. Energy
Policy 2016, 92, 20–33. [CrossRef]
94. Fregonara, E.; Rolando, D.; Semeraro, P. Energy performance certificates in the Turin real estate market. J. Eur. Real Estate Res.
2017, 10, 149–169. [CrossRef]
95. Davis, P.T.; McCord, J.A.; Mccord, M.J.; Haran, M. Modelling the effect of energy performance certificate rating on property value
in the Belfast housing market. Int. J. Hous. Mark. Anal. 2015, 8, 292–317. [CrossRef]
96. British Standards Institution. Indoor Environmental Input Parameters for Design and Assessment of Energy Performance of Build-
ings Addressing Indoor Air Quality, Thermal Environment, Lighting and Acoustics; EN 16798, 2019; British Standards Institution:
London, UK, 2018.
97. Vilches, A.; Padura Ángela, B.; Huelva, M.M. Retrofitting of homes for people in fuel poverty: Approach based on household
thermal comfort. Energy Policy 2017, 100, 283–291. [CrossRef]
98. Sustainable Energy Authority of Ireland. Energy in the Residential Sector; Sustainable Energy Authority of Ireland: Dublin, Ireland, 2018.
99. Sustainable Energy Authority of Ireland. Archived Domestic Fuel Costs; Sustainable Energy Authority of Ireland: Dublin, Ireland, 2018.
100. Sustainable Energy Authority of Ireland. Community Grants. Available online: https://www.seai.ie/grants/community-grants/
(accessed on 31 October 2019).
101. Met Eireann. Historical Data—Met Eireann—The Irish Meteorological Service. Available online: https://www.met.ie//climate/
available-data/historical-data (accessed on 25 March 2019).
102. Central Statistics Office. CSO Statbank. EHQ15: Average Weekly, Hourly Earnings and Weekly Paid Hour of All Em-
ployees by Economic Sector 2 Digit NACE Rev 2, Quarter and Statistic. Central Statistics Office. 2019. Available online:
https://statbank.cso.ie/px/pxeirestat/Database/eirestat/EHECS%20Earnings%20Hours%20and%20Employment%20Costs%
20Survey%20Quarterly/EHECS%20Earnings%20Hours%20and%20Employment%20Costs%20Survey%20Quarterly_statbank.
asp?sp=EHECS%20Earnings%20Hours%20and%20Empl (accessed on 30 January 2020).
103. Moran, P.; O’Connell, J.; Goggins, J. Sustainable energy efficiency retrofits as residential buildings move towards nearly zero
energy building (NZEB) standards. Energy Build. 2020, 211, 109816. [CrossRef]
104. Sustainable Energy Authority of Ireland. Dwelling Energy Assessment Procedure (DEAP). Version 3.2.1. Irish Official Method for
Calculating and Rating the Energy Performance of Dwellings; SEAI: Dublin, Ireland, 2012.
105. Sustainable Energy Authority of Ireland. Domestic Energy Assessment Procedure (DEAP). Version 4.2.1. Ireland’s Official Method for
Calculating and Rating the Energy Performance of Dwellings; SEAI: Dublin, Ireland, 2019.
106. Baginski, J.; Weber, C. A Consumer Decision-Making Process? Unfolding Energy Efficiency Decisions of German Owner-Occupiers;
HEMF Working Paper No. 08/2017; University of Duisburg-Essen, House of Energy Markets & Finance: Essen, Germany, 2017.
107. Risholt, B.; Berker, T. Success for energy efficient renovation of dwellings—Learning from private homeowners. Energy Policy
2013, 61, 1022–1030. [CrossRef]
108. Berry, S.; Sharp, A.; Hamilton, J.; Killip, G. Inspiring low-energy retrofits: The influence of ‘open home’ events. Build. Res. Inf.
2014, 42, 422–433. [CrossRef]
109. McMichael, M.; Shipworth, D. The value of social networks in the diffusion of energy-efficiency innovations in UK households.
Energy Policy 2013, 53, 159–168. [CrossRef]
110. Caird, S.; Roy, R.; Potter, S. Domestic heat pumps in the UK: User behaviour, satisfaction and performance. Energy Effic.
2012, 5, 283–301. [CrossRef]
111. Sustainable Energy Authority of Ireland. Encouraging Heat Pump Installations in Ireland; SEAI: Dublin, Ireland, 2020.
112. Mukherjee, S.; Meles, T.; Ryan, L.; Healy, S.; Mooney, R.; Sharpe, L.; Hayes, P. Renewable Energy Technology Uptake: Public Preferences
and Policy Design in Early Adoption; Working Paper Series (No. WP20/04); University College Dublin: Dublin, Ireland, 2020.
113. Owen, A.; Mitchell, G.; Unsworth, R. Reducing carbon, tackling fuel poverty: Adoption and performance of air-source heat
pumps in East Yorkshire, UK. Local Environ. 2013, 18, 817–833. [CrossRef]
114. Lomas, K.; Oliveira, S.; Warren, P.; Haines, V.; Chatterton, T.; Beizaee, A.; Prestwood, E.; Gething, B. Do domestic heating controls
save energy? A review of the evidence. Renew. Sustain. Energy Rev. 2018, 93, 52–75. [CrossRef]