PATCH//NOTES Open the interactive version
← All lessons
Foundations · Beginner · 6 min

Running a network

Racks, power, changes, monitoring and the plan for the worst day.

What it is

Keeping a network running is mostly careful routine, and much of it is on the exam. Physically, equipment sits in racks measured in rack units (1U is 1.75 inches, 44.45 mm). A UPS (a battery unit) rides through short power cuts and gives a generator time to start, and PDUs share power out to each device. Hot and cold aisles keep air moving, and temperature, humidity and fire suppression are watched. Processes keep it known: change management means every change is requested, assessed, approved, scheduled and recorded, with a way to roll it back. Documentation covers physical and logical diagrams, IP address records and an asset inventory, and life-cycle tracking flags kit reaching end of life or end of support. For monitoring, SNMP lets a monitoring server poll devices and receive traps (alerts); use SNMPv3, which adds authentication and encryption. Flow data such as NetFlow shows who talked to whom, syslog gathers logs, and a baseline shows what normal looks like. For disaster recovery, the RPO is how much data you can afford to lose and the RTO is how long you can afford to be down. MTBF is the average time between failures, and MTTR the average time to repair. A hot site can take over at once, a warm site has hardware but needs data and setup, and a cold site is space and power only. Plans are tested, often with a tabletop exercise.

Real case · 2017

British Airways data centre outage

On a bank holiday weekend in May 2017, British Airways lost its UK data centre. BA said an engineer disconnected a power supply and it was restored in an uncontrolled way, causing a surge that damaged its IT systems, and its backups didn't take over. Hundreds of flights were cancelled and about 75,000 passengers were affected.

Source: Data Center Knowledge: BA says an engineer disconnected the power supply

How defenders stop it

  • Route every change through change management, with a tested way to roll it back
  • Put critical kit on a UPS, and test the generator and failover rather than just owning them
  • Use SNMPv3 rather than v1 or v2c, and record a baseline so you can spot what isn't normal
  • Agree an RPO and RTO for each system, and prove backups work by restoring them

Try it yourself

Find a change that slowed a network in the slow network lab

Check yourself

1. A business can afford to lose at most four hours of data. Which number is that?

  1. RTO
  2. RPO
  3. MTBF
  4. MTTR
Show answer

RPO. The recovery point objective is how far back you can afford to go: so backups must run at least every four hours.

2. Which SNMP version adds authentication and encryption?

  1. SNMPv1
  2. SNMPv2c
  3. SNMPv3
  4. None of them
Show answer

SNMPv3. v1 and v2c send a community string in plain text. SNMPv3 adds user logins and encryption.

3. What turned BA's 2017 power problem into a three-day disruption?

  1. A ransomware attack
  2. Power was restored in an uncontrolled way, damaging systems, and the backups didn't take over
  3. A DDoS attack on its website
  4. A leaked password
Show answer

Power was restored in an uncontrolled way, damaging systems, and the backups didn't take over. Power and failover matter as much as cyber defences: owning a backup isn't the same as having tested it.

Answer them in the app to earn XP.

Next: Modern networks: IPv6, SDN and zero trust →