0% found this document useful (0 votes)
134 views24 pages

ICT Business Continuity Plan

Download as pdf or txt
Download as pdf or txt
Download as pdf or txt
You are on page 1/ 24

Disaster Recovery & Business

Continuity Plan for ICT Services


Policy Number: P31 Effective Date: 21.04.2021
Version Number: One Review Date: 21.04.2025
Policy Compiled by: Information Technology Officer
Policy Approved by: Chief Executive Officer
INTRODUCTION
A Business Continuity Plan for ICT Services was first introduced in 2021 following an audit
recommendation. It is reviewed annually or following any major change to hardware or systems
covered by the plan, to ensure it is always relevant and up to date.
Disasters are, fortunately, are rare but when they do occur, they can have devasting consequences.
Many services will quickly be brought to a standstill in the event of prolonged IT (Network, Device, or
Etc.) failure. The vulnerability of the Council’s services to the effects of an IT failure have increased
markedly in recent years as more and more reliance has been placed on computerised systems to
manage services. This is likely to continue in the coming years as IT systems are increasingly used as
a means of generating efficiencies.

DEFINITIONS
For the purposes of this plan a Disaster is defined as loss or damage of part or all of the Council’s IT
Infrastructure, which would have a high or very high, business impact on the Council.
Disaster, as outlined in the above definition, includes:
• Total loss of one site, (i.e., due to fire damage)
• Loss or technical failure of one or more network\cloud servers
• Loss or technical failure of network infrastructure (i.e., router, switch, Telstra or JustISP-FSG
comms connectivity)
• Extended loss of electrical power
• Failure of key software or cloud service
Key software or cloud services which are specifically referred to in this plan include:
• PCS+ - Financial System
• Assetic Cloud – Asset Management System
• Microsoft 365 – Office Apps, Email and Cloud Storage
• Azure – Microsoft’s Cloud platform
• MAGIQ Documents

Document #: P31 Date Effective: 21.04.2021 Version: One Page 1 of 24


Disaster Recovery & Business
Continuity Plan for ICT Services
HOW THE PLAN IS ACTIVATED
In the event that a disaster is identified by the IT Officer, the IT Department will be responsible for
activating the plan and monitoring the progress of disaster recovery procedures, reporting to the
Disaster Management Committee and undertaking any further action as necessary.

OVERVIEW OF IT INFRASTRUCTURE
The Blackall-Tambo Regional Council currently has eight sites that are connected to its corporate
network (All sites except Blackall Office and Depot, use Layer-3 connectivity to connect corporate
network). These sites are the Blackall Office, Blackall Depot, Blackall CNC, Tambo Office/Depot,
Tambo Library, Tambo Childcare Centre, Tambo MPC, and Tambo Grasslands.
The corporate network at the Council comprises:
Blackall Admin Office/Depot (Telstra Network)
• 4 physical servers (3 Hyper-V Hosts, storage server)
• 8 virtual on-premises servers
• 5 Azure virtual machines
• 1 Cisco Router to Telstra via 50Mbps
• 2 Cisco Catalyst 3650 Switch
• 2 Cisco Catalyst 3850 48 UPOE – Managed Switch - Telstra Switch (Blackall Office & Depot)
• 1 Juniper Router
• 2 Mikrotik Switch (Blackall Office & Depot)
• 3 Cisco Meraki
• 2 Wi-Fi hotspots
• 36 Desktops/Notebooks/Tablets
• 25 TIPT Phones
Blackall CNC (JustISP/FSG Network)
• 1 Juniper Router
• 1 Mikrotik Switch
• 4 VoIP Desk phones
• 4 Desktops/Notebooks
Tambo Admin Office/Depot (JustISP/FSG Network)
• 1 Juniper Router
• 2 Mikrotik Switch
• 1 RODC Server
• 1 Cisco router
• 1 Cisco switch
• 2 Cisco Meraki
• 2 Wi-Fi hotspots
• 16 Desktops/Notebooks/Tablets
Tambo Library (JustISP/FSG Network)
• 1 Juniper Router
• 1 Mikrotik Switch
• 1 VoIP Desk phones
Document #: P31 Date Effective: 21.04.2021 Version: One Page 2 of 24
Disaster Recovery & Business
Continuity Plan for ICT Services
• 1 Desktop connected to L3 JustISP-FSG
• 3 Desktops for Library Patrons on Guest Network
Tambo Childcare Centre (JustISP/FSG Network)
• 1 Juniper Router
• 1 Mikrotik Switch
• 1 VoIP Desk phones
• 1 Desktop connected to L3 JustISP-FSG
Tambo MPC (JustISP/FSG Network)
• 1 Juniper Router
• 1 Mikrotik Switch
• 5 VoIP Desk phones
• 5 Desktop connected to L3 JustISP-FSG
• 1 Notebook connected to L3 JustISP-FSG
Tambo Grasslands (JustISP/FSG Network)
• 1 Juniper Router
• 1 Mikrotik Switch
• 3 VoIP Desk phones
• 3 Desktops connected to L3 JustISP-FSG

A detailed network topology diagram shown in appendix A.


Server rooms at both the Blackall Admin Office and Depot are located on the ground floor, behind
electronic locked doors, away from the entrances to the buildings from outside to minimise the risk of
theft and flood. The rooms are also air conditioned to maintain temperatures suitable for the equipment
located in them.
The other sites have locked wall mounted server cabinets, that are appropriately ventilated.
The Councils financial system, Practical Plus, is hosted on a Windows Server 2019 in Microsoft Azure.
Access to the financial system is provided via Telstra Intranet using Azure Gateway Link. All Layer-3
connected sites have access to Practical Plus also.
Microsoft 365 E3 is used to provide email and hosted data services to all sites.

RISK ASSESSMENT AND BUSINESS IMPACT REVIEW


Likelihood

Negligible
Severity Minor (2) Moderate (3) Major (4) Extreme (5)
(1)

Rare (1) Low Low Low Low Medium


Unlikely (2) Low Low Medium Medium High
Possible (3) Low Medium Medium High High
Likely (4) Low Medium High High Very High
Almost Certain (5) Medium High High Very High Very High
Document #: P31 Date Effective: 21.04.2021 Version: One Page 3 of 24
PHYSICAL EQUIPMENT
Location Network Type of loss / Likelihood Severity Business Impact Precautions in place
Element damage
Blackall Hyper-V Host and Fire 1 1 Loss of a single Hyper-V, Hyper-V Host on-premises is
Admin Hyper-V Virtual Theft would result in downtime, till back-up to Azure Cloud
Office Machines Water Damage Veeam in Azure creates the Services, if there is a loss, the
(Hive01, Hive02) Vandalism affected virtual machines in affected hosts virtual machines
Wind Azure instead of on the Lost are than created in Azure till
Accidental Host. Host is repaired or replaced.

Hard Disk failure 3 1 No impact from loss of a Each Hyper-V Host is


single or two hard disk(s). configured RAID 6, which has
dual parity and can survive two
The impact of the loss of more concurrent disk failures.
than two disks would be as
described under Equipment protected by Dell
Fire/Theft/etc above Pro Plus Warranty – next day
delivery of replacement of
failed disks
Other Failure 3 1 Depending on the type of Equipment protected by Dell
failure, worse case would be Pro Plus Warranty.
as described under In case of a software
Fire/Theft/etc above. corruption, this is covered by
Veeam-to-Veeam Azure
restore.
Data Breach 2 4 Ransomware attack, loss of See Data Breach Response
Data or personal information Plan Appendix B
Power Failure 3 2 Environmental Power Failure UPS installed – approximately
(short term) would affect all Hyper-V 1:10 minutes of back-up. Only
hosts, in these situations, the need 2 minutes for back-up
back-up generator kicks in generator to start. The back-up
within 2 minutes. The UPS generator is diesel, with a long
and battery back-ups keep run time, between need
power going till generator refuels.
kicks in.
Document #: Date Effective: 21.04.2021 Version: One Page 4 of 24
Disaster Recovery & Business
Continuity Plan for ICT Services
Azure Virtual Fire 1 1 Due to Azure using Data Azure Data Centres have
Machines Theft Centres in three Australian copies of Data in all three
Water Damage locations and Disaster locations in Australia and a
Vandalism Recovery in a chosen cross-region disaster recovery
Wind recovery location out of site.
Accidental country, this is really a
negligible risk
Hard Disk failure 3 1 See above See above
Other Failure 3 1
Data Breach 2 4 Ransomware attack, loss of See Data Breach Response
Data or personal information Plan Appendix B
Power Failure 2 1 see Power Failure (if local) see Power Failure (if local)
(short term) from Hyper-V Hosts Network from Hyper-V Hosts Network
Element. For Power Failure Element. For Power Failure
(Azure) see above as (Azure) see above as
described in Fire/Theft/etc. described in Fire/Theft/etc.
Storage Server Fire 1 1 Unable to store data onsite All Data stored on server is
Theft already backed up in Azure.
Water Damage
Vandalism Equipment protected by Dell
Wind Pro Plus Warranty.
Accidental
Hard Disk 3 1 No impact from loss of a The Storage Server is
Failure single or two hard disk(s). configured RAID 6, which has
dual parity and can survive two
The impact of the loss of more concurrent disk failures.
than two disks would be as
described under Equipment protected by Dell
Fire/Theft/etc above Pro Plus Warranty – next day
delivery of replacement of
failed disks
Other Failure 3 1
Data Breach 2 4 Ransomware attack, loss of See Data Breach Response
Data or personal information Plan Appendix B

Document #: Date Effective: 21.04.2021 Version: One Page 5 of 24


Disaster Recovery & Business
Continuity Plan for ICT Services
Power Failure 3 2 Environmental Power Failure UPS installed – approximately
(short term) would affect the Storage 1:10 minutes of back-up. Only
Server, in these situations, the need 2 minutes for back-up
back-up generator kicks in generator to start. The back-up
within 2 minutes. The UPS generator is diesel, with a long
and battery back-ups keep run time, between need
power going till generator refuels.
kicks in.
Cisco Router Fire 1 1 Loss of access to internet via Equipment protected by
Theft Telstra and all networked maintenance agreement with
Water Damage devices and other Telstra.
Vandalism infrastructure connected via
Wind the affected Router. Telstra have all configuration
Accidental settings backed up. Telstra
will replace router with new
device as soon as possible.
Technological 2 2 As Above The router has the ability to
Failure switch to LTE mode if we have
power, but no wired network
connection due to some other
fault. It can run this way until
failure has been remedied.
Power Failure 3 2 Environmental Power Failure UPS installed – approximately
(short term) would affect the Telstra 45 minutes of back-up. Only
Managed Router, in these need 2 minutes for back-up
situations, the back-up generator to start. The back-up
generator kicks in within 2 generator is diesel, with a long
minutes. The UPS and run time, between need
battery back-ups keep power refuels.
going till generator kicks in.
Cisco Catalyst Fire 1 1 Loss of access to all Equipment protected by
3850 48 UPOE – Theft networked devices and other maintenance agreement with
Managed Switch - Water Damage infrastructure connected via Telstra.
Telstra Vandalism the affected switch
Wind
Document #: Date Effective: 21.04.2021 Version: One Page 6 of 24
Disaster Recovery & Business
Continuity Plan for ICT Services
Telstra have all configuration
settings backed up. Telstra
will replace switch with new
device as soon as possible.

The other 2 Cisco switches


can be repurposed to become
the main managed switch
within an hour.
Technological 2 2 As Above As Above
Failure
Power Failure 3 2 Environmental Power Failure UPS installed – approximately
(short term) would affect the Managed 45 minutes of back-up. Only
Switch, in these situations, the need 2 minutes for back-up
back-up generator kicks in generator to start. The back-up
within 2 minutes. The UPS generator is diesel, with a long
and battery back-ups keep run time, between need
power going till generator refuels.
kicks in.
Cisco Catalyst Fire 1 1 Loss of access to all Sufficient spare capacity is
Theft networked devices and other maintained so that in the event
Water Damage infrastructure connected via of failure equipment can be
Vandalism the affected switch connected via alternate switch.
Wind

Technological 2 2 As Above As Above


Failure
Power Failure 3 2 Environmental Power Failure UPS installed – approximately
(short term) would affect the Switch, in 45 minutes of back-up. Only
these situations, the back-up need 2 minutes for back-up
generator kicks in within 2 generator to start. The back-up
minutes. The UPS and generator is diesel, with a long
battery back-ups keep power run time, between need
going till generator kicks in. refuels.

Document #: Date Effective: 21.04.2021 Version: One Page 7 of 24


Disaster Recovery & Business
Continuity Plan for ICT Services
Cisco Catalyst Fire 1 1 Loss of access to all Sufficient spare capacity is
Theft networked devices and other maintained so that in the event
Water Damage infrastructure connected via of failure equipment can be
Vandalism the affected switch. connected via alternate switch.
Wind

Technological 2 2 As Above As Above


Failure
Power Failure 3 2 Environmental Power Failure UPS installed – approximately
(short term) would affect the Switch, in 45 minutes of back-up. Only
these situations, the back-up need 2 minutes for back-up
generator kicks in within 2 generator to start. The back-up
minutes. The UPS and generator is diesel, with a long
battery back-ups keep power run time, between need
going till generator kicks in. refuels.

Juniper (Guest Fire 1 1 Loss of access to internet via Equipment protected by


Network) Theft JustISP/FSG and all maintenance agreement with
Water Damage networked devices and other JustISP/FSG.
Vandalism infrastructure connected via
Wind the affected Router. JustISP/FSG have all
configuration settings backed
up. JustISP/FSG will replace
router with new device as soon
as possible.
Technological 2 2 As Above As Above
Failure
Power Failure 3 2 Environmental Power Failure UPS installed – approximately
(short term) would affect the Switch, in 45 minutes of back-up. Only
these situations, the back-up need 2 minutes for back-up
generator kicks in within 2 generator to start. The back-up
minutes. The UPS and generator is diesel, with a long
battery back-ups keep power run time, between need
going till generator kicks in. refuels.

Document #: Date Effective: 21.04.2021 Version: One Page 8 of 24


Disaster Recovery & Business
Continuity Plan for ICT Services
Switch Fire 1 1 Loss of access to all Equipment protected by
Theft networked devices and other maintenance agreement with
Water Damage infrastructure connected via JustISP/FSG.
Vandalism the affected switch.
Wind JustISP/FSG have all
configuration settings backed
up. JustISP/FSG will replace
router with new device as soon
as possible.
Technological 2 2 As Above As Above
Failure
Power Failure 3 2 Environmental Power Failure UPS installed – approximately
(short term) would affect the Switch, in 45 minutes of back-up. Only
these situations, the back-up need 2 minutes for back-up
generator kicks in within 2 generator to start. The back-up
minutes. The UPS and generator is diesel, with a long
battery back-ups keep power run time, between need
going till generator kicks in. refuels.

Meraki Wi-Fi Fire 1 1 Loss of Wi-Fi connectivity Contact Telstra to purchase a


Theft replacement.
Water Damage
Vandalism
Wind

Technological 2 2 As Above As Above


Failure
Power Failure 3 2 Environmental Power Failure UPS installed – approximately
(short term) would affect the hot spot, in 45 minutes of back-up. Only
these situations, the back-up need 2 minutes for back-up
generator kicks in within 2 generator to start. The back-up
minutes. The UPS and generator is diesel, with a long
battery back-ups keep power run time, between need
going till generator kicks in. refuels.

Document #: Date Effective: 21.04.2021 Version: One Page 9 of 24


Disaster Recovery & Business
Continuity Plan for ICT Services
Cambium Fire 1 1 Loss of Wi-Fi connectivity
Networks cnPilot Theft
e410 Wi-Fi Water Damage
Access Point Vandalism
Wind

Technological 2 2 As above
Failure
Power Failure 3 2 Environmental Power Failure UPS installed – approximately
(short term) would affect the hot spot, in 45 minutes of back-up. Only
these situations, the back-up need 2 minutes for back-up
generator kicks in within 2 generator to start. The back-up
minutes. The UPS and generator is diesel, with a long
battery back-ups keep power run time, between need
going till generator kicks in. refuels.

APC UPS & Fire 1 1 Connected equipment would Two UPSs independently
Battery Back-up Theft no longer receive power and supply power to separate
Water Damage would shut down. Equipment redundant PSUs within each
Vandalism could then be connected Hyper-V hosts. In the event of
Wind directly to the mains supply to failure of either UPS there is no
restart equipment so interruption to service.
downtime in office hours
would be limited to 10-15 Comms equipment (switches,
minutes routers etc) are only supplied
by a single UPS and daisy
chained to the battery back-up,
then would need to be
connected to the mains in the
event of a UPS failure.
Hardware 2 2 As above As above
Failure
Power Failure 3 2 Environmental Power Failure Only need 2 minutes for back-
(short term) would affect all UPSs, in these up generator to start. The
situations, the back-up back-up generator is diesel,
Document #: Date Effective: 21.04.2021 Version: One Page 10 of 24
Disaster Recovery & Business
Continuity Plan for ICT Services
generator kicks in within 2 with a long run time, between
minutes. The UPS and need refuels.
battery back-ups keep power
going till generator kicks in.
Tambo RODC Server Fire 1 1
Admin & Theft
Depot Water Damage
Office Vandalism
Wind
Accidental
Hard Disk 3 1 No impact from loss of a The RODC Server is
Failure single or two hard disk(s). configured RAID 6, which has
dual parity and can survive two
The impact of the loss of more concurrent disk failures.
than two disks would be as
described under Equipment protected by Dell
Fire/Theft/etc above Pro Plus Warranty – next day
delivery of replacement of
failed disks
Other Failure 3 1
Power Failure 3 2 Environmental Power Failure UPS installed – approximately
(short term) would affect the RODC 30 minutes of back-up. Only
Server, in these situations, the need 2 minutes for back-up
back-up generator kicks in generator to start. The back-up
within 2 minutes. The UPS generator is diesel, with a long
and battery back-ups keep run time, between need
power going till generator refuels.
kicks in.
Juniper Router Fire 1 1 Loss of access to Internet via Equipment protected by
Theft JustISP/FSG, L3 connectivity maintenance agreement with
Water Damage to Blackall and all networked JustISP/FSG.
Vandalism devices and other
Wind infrastructure connected via JustISP/FSG have all
the affected Router. configuration settings backed
up. JustISP/FSG will replace
Document #: Date Effective: 21.04.2021 Version: One Page 11 of 24
Disaster Recovery & Business
Continuity Plan for ICT Services
router with new device as soon
as possible.
Technological 2 2 As Above As Above
Failure
Power Failure 3 2 Environmental Power Failure UPS installed – approximately
(short term) would affect the Router, in 45 minutes of back-up. Only
these situations, the back-up need 2 minutes for back-up
generator kicks in within 2 generator to start. The back-up
minutes. The UPS and generator is diesel, with a long
battery back-ups keep power run time, between need
going till generator kicks in. refuels.

Switch Fire 1 1 Loss of access to L3 Equipment protected by


Theft connectivity and all networked maintenance agreement with
Water Damage devices and other JustISP/FSG.
Vandalism infrastructure connected via
Wind the affected switch. JustISP/FSG have all
configuration settings backed
up. JustISP/FSG will replace
router with new device as soon
as possible.
Technological 2 2 As Above As Above
Failure
Power Failure 3 2 Environmental Power Failure UPS installed – approximately
(short term) would affect the Switch, in 45 minutes of back-up. Only
these situations, the back-up need 2 minutes for back-up
generator kicks in within 2 generator to start. The back-up
minutes. The UPS and generator is diesel, with a long
battery back-ups keep power run time, between need
going till generator kicks in. refuels.

Cisco Router Fire 1 1 This Telstra managed router


Theft is for the TIPT phone system,
Water Damage it allows Tambo to use same
Vandalism phone exchange, if this is lost,
Document #: Date Effective: 21.04.2021 Version: One Page 12 of 24
Disaster Recovery & Business
Continuity Plan for ICT Services
Wind Tambo will have no TIPT
phone systems
Technological 2 2 As Above As Above
Failure
Power Failure 3 2 Environmental Power Failure UPS installed – approximately
(short term) would affect the Router, in 45 minutes of back-up. Only
these situations, the back-up need 2 minutes for back-up
generator kicks in within 2 generator to start. The back-up
minutes. The UPS and generator is diesel, with a long
battery back-ups keep power run time, between need
going till generator kicks in. refuels.

Cisco switch Fire 1 1 This Telstra managed router


Theft is for the TIPT phone system,
Water Damage it allows Tambo to use same
Vandalism phone exchange, if this is lost,
Wind Tambo will have no TIPT
phone systems
Technological 2 2 As Above As Above
Failure
Power Failure 3 2 Environmental Power Failure UPS installed – approximately
(short term) would affect the Switch, in 45 minutes of back-up. Only
these situations, the back-up need 2 minutes for back-up
generator kicks in within 2 generator to start. The back-up
minutes. The UPS and generator is diesel, with a long
battery back-ups keep power run time, between need
going till generator kicks in. refuels.

Meraki Fire 1 1 Loss of Wi-Fi connectivity


Theft
Water Damage
Vandalism
Wind

Document #: Date Effective: 21.04.2021 Version: One Page 13 of 24


Disaster Recovery & Business
Continuity Plan for ICT Services
Technological 2 2 As above
Failure
Power Failure 3 2 Environmental Power Failure UPS installed – approximately
(short term) would affect the hot spot, in 45 minutes of back-up. Only
these situations, the back-up need 2 minutes for back-up
generator kicks in within 2 generator to start. The back-up
minutes. The UPS and generator is diesel, with a long
battery back-ups keep power run time, between need
going till generator kicks in. refuels.
Cambium Fire 1 1 Loss of Wi-Fi connectivity
Networks cnPilot Theft
e410 Wi-Fi Water Damage
Access Point Vandalism
Wind

Technological 2 2 As above
Failure
Power Failure 3 2 Environmental Power Failure UPS installed – approximately
(short term) would affect the hot spot, in 45 minutes of back-up. Only
these situations, the back-up need 2 minutes for back-up
generator kicks in within 2 generator to start. The back-up
minutes. The UPS and generator is diesel, with a long
battery back-ups keep power run time, between need
going till generator kicks in. refuels.
APC UPS & Fire 1 1 Connected equipment would Two UPSs independently
Battery Back-up Theft no longer receive power and supply power to separate
Water Damage would shut down. Equipment redundant PSUs within each
Vandalism could then be connected Hyper-V hosts. In the event of
Wind directly to the mains supply to failure of either UPS there is no
restart equipment so interruption to service.
downtime in office hours
would be limited to 10-15 Comms equipment (switches,
minutes routers etc) are only supplied
by a single UPS and daisy
chained to the battery back-up,
Document #: Date Effective: 21.04.2021 Version: One Page 14 of 24
Disaster Recovery & Business
Continuity Plan for ICT Services
then would need to be
connected to the mains in the
event of a UPS failure.
Hardware 2 2 As above As above
Failure
Power Failure 3 2 Environmental Power Failure Only need 2 minutes for back-
(short term) would affect all UPSs, in these up generator to start. The
situations, the back-up back-up generator is diesel,
generator kicks in within 2 with a long run time, between
minutes. The UPS and need refuels.
battery back-ups keep power
going till generator kicks in.
All Layer Router Fire 1 1 Loss of access to Internet via Equipment protected by
3 offsite Theft JustISP/FSG, L3 connectivity maintenance agreement with
locations Water Damage to Blackall and all networked JustISP/FSG.
Vandalism devices and other
Wind infrastructure connected via JustISP/FSG have all
the affected Router. configuration settings backed
up. JustISP/FSG will replace
router with new device as soon
as possible.
Technological 2 2 As Above As Above
Failure
Power Failure 3 4 As Above UPS installed – approximately
(short term) 20 minutes of back-up power.
Switch Fire 1 1 Loss of access to L3 Equipment protected by
Theft connectivity and all networked maintenance agreement with
Water Damage devices and other JustISP/FSG.
Vandalism infrastructure connected via
Wind the affected switch. JustISP/FSG have all
configuration settings backed
up. JustISP/FSG will replace
router with new device as soon
as possible.

Document #: Date Effective: 21.04.2021 Version: One Page 15 of 24


Disaster Recovery & Business
Continuity Plan for ICT Services
Technological 2 2 As Above As Above
Failure
Power Failure 3 4 As Above UPS installed – approximately
(short term) 20 minutes of back-up power.

DISASTER RECOVERY PLAN


There are two distinct elements to this Plan. Disaster could consist of failure of a particular element of the IT infrastructure, for example, a
server or switch. It may also be a Cyber-attack or additionally, a major disaster such as Fire or Flood could knock out an entire site, large
part of a site which contains key systems.
The first table below details steps to be taken in the event of loss any individual key system. The second table then outlines procedures to be
followed in the event of loss of an entire site or large part of a site which contains key systems.

Table showing procedures for recovery of individual network elements

Location Network Element Type of Loss / Damage Recovery Procedures


Blackall Hyper-V Host and Total Loss of a single Purchase replacement server from Dell
Admin Hyper-V Virtual Hyper-V Host The affected Virtual Machines will be spun up on Azure, until Host is replaced.
Office / Machines Hard Disk Failure Identify failed hard drive – indicator on RAID controller
Depot (Hive01, Hive02) Contact Dell to arrange shipment of replacement drive ()
IT staff to hot swap hard drive on arrival
Other hardware failure Troubleshoot hardware failure and Identify fault
Contact Dell to arrange shipment of replacement part
Software failure Use Veeam to restore most recent image to disk
Restart system
Power failure Ensure UPS is operating correctly.
If generator does not cut over in 2 minutes shutdown server and wait for power
restore.
When power is restored, (or generator cuts over) restart server.
Storage Server Total Loss Purchase replacement server from Dell
The data stored on this server is just an on-site backup of what is stored in Veeam
in Azure
Hard Disk Failure Identify failed hard drive – indicator on RAID controller
Contact Dell to arrange shipment of replacement drive ()
IT staff to hot swap hard drive on arrival
Document #: Date Effective: 21.04.2021 Version: One Page 16 of 24
Disaster Recovery & Business
Continuity Plan for ICT Services
Other hardware failure Troubleshoot hardware failure and Identify fault
Contact Dell to arrange shipment of replacement part
Software failure Use Veeam to restore most recent image to disk
Restart system
Power failure Ensure UPS is operating correctly.
If generator does not cut over in 2 minutes shutdown server and wait for power
restore.
When power is restored, (or generator cuts over) restart server.
Cisco Router Total Loss Contact Telstra for Replacement
Telstra Technician will install replacement router
Hardware failure As Above
Power failure Ensure UPS is operating correctly.
If generator does not cut over in 2 minutes shutdown system and wait for power
restore.
When power is restored, (or generator cuts over) restart system.
Cisco Catalyst Total Loss Re-connect devices from affected switch to alternative switches and restart.
3850 48 UPOE – Order replacement switch and install.
Managed Switch - Re-distribute devices across available switches
Telstra Hardware failure As above
Power failure Ensure UPS is operating correctly.
If generator does not cut over in 2 minutes shutdown system and wait for power
restore.
When power is restored, (or generator cuts over) restart system.
Cisco Catalyst Total Loss Re-connect devices from affected switch to alternative switches and restart.
3650 Order replacement switch and install.
Re-distribute devices across available switches
Hardware failure As above
Power failure Ensure UPS is operating correctly.
If generator does not cut over in 2 minutes shutdown system and wait for power
restore.
When power is restored, (or generator cuts over) restart system.
Juniper Router Total Loss Contact JustISP/FSG for replacement
(Guest Network) Jamie Black or Harry Noble will install replacement router
Hardware failure As above
Power failure Ensure UPS is operating correctly.
Document #: Date Effective: 21.04.2021 Version: One Page 17 of 24
Disaster Recovery & Business
Continuity Plan for ICT Services
If generator does not cut over in 2 minutes shutdown system and wait for power
restore.
When power is restored, (or generator cuts over) restart system.
Switch (Guest Total Loss Contact JustISP/FSG for replacement
Network) Jamie Black or Harry Noble will install replacement switch
Hardware failure As above
Power failure Ensure UPS is operating correctly.
If generator does not cut over in 2 minutes shutdown system and wait for power
restore.
When power is restored, (or generator cuts over) restart system.
Meraki MR18 Wi-Fi Total Loss Contact Telstra for Replacement
Access Point Install, load configurations and test
Hardware failure As above
Power failure Ensure UPS is operating correctly.
If generator does not cut over in 2 minutes shutdown system and wait for power
restore.
When power is restored, (or generator cuts over) restart system.
Cambium Networks Total Loss Contact JustISP/FSG for replacement
cnPilot e410 Wi-Fi Jamie Black or Harry Noble will install replacement Wi-Fi Hotspot
Access Point Hardware failure As above
Power failure Ensure UPS is operating correctly.
If generator does not cut over in 2 minutes shutdown system and wait for power
restore.
When power is restored, (or generator cuts over) restart system.
APC UPS & Battery Total Loss Bypass UPS or Battery back-up to mains power,
Back-up Will have no back-up, but generator.
Contact Insight, Truis or Dell for replacement
When replacement arrives have electrician install and turn off IT equipment and
plug into new UPS or Battery Back-up, power up UPS, then restart IT equipment.
Hardware failure As Above
Power failure Ensure UPS is operating correctly.
If generator does not cut over in 2 minutes. Call Electrician.
When power is restored, (or generator cuts over) restart system.
RODC Server Total Loss Purchase replacement server from Dell

Document #: Date Effective: 21.04.2021 Version: One Page 18 of 24


Disaster Recovery & Business
Continuity Plan for ICT Services
Tambo This is a Read-Only Domain Controller; Network will run adequately without. It
Admin is for faster logins for Tambo.
Office & Hard Disk Failure Identify failed hard drive – indicator on RAID controller.
Depot Contact Dell to arrange shipment of replacement drive ()
IT staff to hot swap hard drive on arrival
Other hardware failure Troubleshoot hardware failure and Identify fault.
Contact Dell to arrange shipment of replacement part
Software failure Use Veeam to restore most recent image to disk.
Restart system
Power failure Ensure UPS is operating correctly.
If generator does not cut over in 2 minutes shutdown server and wait for power
restore.
When power is restored, (or generator cuts over) restart server.
Juniper Router Total Loss Contact JustISP/FSG for replacement
Jamie Black or Harry Noble will install replacement router
Hardware failure As above
Power failure Ensure UPS is operating correctly.
If generator does not cut over in 2 minutes shutdown system and wait for power
restore.
When power is restored, (or generator cuts over) restart system.
Switch Total Loss Contact JustISP/FSG for replacement
Jamie Black or Harry Noble will install replacement switch
Hardware failure As above
Power failure Ensure UPS is operating correctly.
If generator does not cut over in 2 minutes shutdown system and wait for power
restore.
When power is restored, (or generator cuts over) restart system.
Meraki MR18 Wi-Fi Total Loss Contact Telstra for Replacement
Access Point Install, load configurations and test
Hardware failure As above
Power failure Ensure UPS is operating correctly.
If generator does not cut over in 2 minutes shutdown system and wait for power
restore.
When power is restored, (or generator cuts over) restart system.
Total Loss Contact Telstra for Replacement
Document #: Date Effective: 21.04.2021 Version: One Page 19 of 24
Disaster Recovery & Business
Continuity Plan for ICT Services
Cisco Router (TIPT Telstra Technician will install replacement router
VoIP) Hardware failure As Above
Power failure Ensure UPS is operating correctly.
If generator does not cut over in 2 minutes shutdown system and wait for power
restore.
When power is restored, (or generator cuts over) restart system.
Cisco Catalyst Total Loss Re-connect devices from affected switch to alternative switches and restart.
3650 (TIPT VoIP) Order replacement switch and install.
Re-distribute devices across available switches
Hardware failure As above
Power failure Ensure UPS is operating correctly.
If generator does not cut over in 2 minutes shutdown system and wait for power
restore.
When power is restored, (or generator cuts over) restart system.
APC UPS & Battery Total Loss Bypass UPS or Battery back-up to mains power,
Back-up Will have no back-up, but generator.
Contact Insight, Truis or Dell for replacement
When replacement arrives have electrician install and turn off IT equipment and
plug into new UPS or Battery Back-up, power up UPS, then restart IT equipment.
Hardware failure As Above
Power failure Ensure UPS is operating correctly.
If generator does not cut over in 2 minutes. Call Electrician.
When power is restored, (or generator cuts over) restart system.
All Layer 3 Juniper Router Total Loss Contact JustISP/FSG for replacement
offsite Jamie Black or Harry Noble will install replacement router
locations Hardware failure As above
Power failure Ensure UPS is operating correctly.
If generator does not cut over in 2 minutes shutdown system and wait for power
restore.
When power is restored, (or generator cuts over) restart system.
Switch Total Loss Contact JustISP/FSG for replacement
Jamie Black or Harry Noble will install replacement switch
Hardware failure As above
Power failure Ensure UPS is operating correctly.

Document #: Date Effective: 21.04.2021 Version: One Page 20 of 24


Disaster Recovery & Business
Continuity Plan for ICT Services
If generator does not cut over in 2 minutes shutdown system and wait for power
restore.
When power is restored, (or generator cuts over) restart system.

Table showing procedures for recovery in case of loss of entire site or large part of a site which contains key systems.
Location Type and extent Recovery procedure Persons
of loss/damage responsible
Blackall Flood / Fire Key software systems Practical Plus, Assetic, Microsoft 365 E3 are cloud based. IT Team /
Admin (Entire site) MAGIQ is an on-premises VM, it would be spun up in Azure with last back-up. PinnacleIT
Office
Telstra to re-route TIPT to mobiles. IT Team / Telstra

Replacement equipment, as per inventory, to be ordered at the first opportunity for IT Team
installation as soon as suitable alternative accommodation becomes available.

Flood / Fire Replacement equipment, as per inventory, to be ordered at the first opportunity for IT Team
(Localised to part installation at alternative cabling position.
of building
containing server
room)
Tambo Flood / Fire Replacement equipment, as per inventory, to be ordered at the first opportunity for IT Team / Telstra
Admin (Entire site) installation as soon as suitable alternative accommodation becomes available. (TIPT) or
Office / JustISP-FSG
Depot Flood / Fire Replacement equipment, as per inventory, to be ordered at the first opportunity for IT Team / Telstra
(Localised to part installation at alternative cabling position. (TIPT) or
of building JustISP-FSG
containing server
room)
All Layer 3 Flood / Fire Replacement equipment, as per inventory, to be ordered at the first opportunity for IT Team /
Offsite (Entire site) installation as soon as suitable alternative accommodation becomes available. JustISP-FSG
locations Flood / Fire Replacement equipment, as per inventory, to be ordered at the first opportunity for IT Team /
(Localised to part installation at alternative cabling position. JustISP-FSG
of building

Document #: Date Effective: 21.04.2021 Version: One Page 21 of 24


Disaster Recovery & Business
Continuity Plan for ICT Services
containing server
cabinet)

Document #: Date Effective: 21.04.2021 Version: One Page 22 of 24


TESTING THE PLAN
It is essential that each of the various elements of this plan are tested to ensure that in the event of an
actual disaster, systems can be recovered in line with this plan with a minimal interruption to users.
It will not be necessary to fully test the plan for all the virtual servers which currently make-up the BTRC
network, because the recovery procedure is the same for each. However, it is considered important
that each system which has a different procedure for recovery is tested. Therefore, following tests
should be carried out:
• Recovery of one or more on-premises virtual servers from backup
• Recovery of one or more Azure virtual servers from backup
• Recovery of TIPT phone system
• Recovery of one of the physical hosts from
• Full Test of all the UPS and backup generators to ensure correct operation, and sufficient battery
life of the UPS.

APPENDICES
Appendix A: Network topology diagram

POLICY REVIEW
This policy will be reviewed when any of the following occur:
a) As required by legislation
b) shortly after the installation of any new key IT infrastructure by the IT Officer. When installing
any new infrastructure due regard must be given beforehand to any impact that the installation
will have on this plan.
c) Other circumstances as determined by the Chief Executive Officer
Notwithstanding the above, this policy is to be reviewed annually.

VERSION CONTROL

Version 1 New Document 21-04-21

RECORDS
When completed and approved, the original signed hard copy of the policy is filed in the Master File.
Electronic copies are saved in the appropriately labelled folder in Magiq.

Document #: Date Effective: 21.04.2021 Version: One Page 23 of 24


Disaster Recovery & Business
Continuity Plan for ICT Services

Document #: Date Effective: 21.04.2021 Version: One Page 24 of 24

You might also like