If your utility lost SCADA communications or automatic control tomorrow, could your operators continue to safely operate the system?
Cybersecurity, redundant servers, networks, backups, and disaster recovery are all critical parts of SCADA resiliency. But true operational resiliency also means being prepared for situations when the technology simply isn’t available. Whether the disruption lasts a few hours or longer, your team needs to understand the process behind the automation and have a plan for maintaining critical operations.
Can Your Operators Run the System Manually?
Automation makes operating water and wastewater systems more efficient, but operators still need to understand how those systems function without it.
If automatic control were unavailable, would your operators know:
- Which pumps need to run?
- When should those pumps start and stop?
- Which valves need to be positioned?
- What levels or pressures need to be maintained?
- Which conditions require immediate action?
Knowing how SCADA works is important. Knowing how to safely operate the underlying process without SCADA is just as critical.
Establish Response Priorities
When SCADA alarms and remote monitoring are unavailable, operators may need to physically visit facilities to assess conditions and make adjustments.
A response plan should clearly identify:
- Who needs to respond: Maintain a current callout tree with roles and responsibilities.
- Where operators should go first: Identify the stations, facilities, and processes with the highest operational priority.
- What operators should check: Establish the critical conditions that need to be monitored at each location.
- How often sites should be checked: Determine appropriate inspection frequencies when remote monitoring and alarms are unavailable.
These decisions are much easier to make before an outage than during one.
Keep Critical Information Available Offline
Operators also need access to the information required to make those decisions.
Important resources may include:
- Site documentation
- Network diagrams
- Standard operating procedures
- Equipment information
- Manual operating instructions
- Emergency contact information
Consider how operators would access this information if normal servers, networks, or other IT systems were unavailable. Sometimes the simplest tools can be among the most useful. Paper-based operator round sheets, for example, can provide a structured way to visit sites and record levels, pressures, pump status, run hours, and other critical operating conditions. The goal is not to replace your digital systems. It is to make sure critical information remains available when those systems cannot be accessed.
Plan for Communications
SCADA may not be the only technology affected during a larger disruption. If normal communications are unavailable or limited, how will operators in the field report conditions? How will teams coordinate site visits or communicate changes in system status? How will an urgent condition be escalated? Your continuity plan should identify backup communication methods and establish how information will move between operators, supervisors, and other personnel during an outage.
Put Your Plan to the Test
Having a plan is important. Practicing it is even better. A simple tabletop exercise can help identify gaps before an actual disruption occurs.
Start with one scenario:
Assume SCADA communications and automatic control will be unavailable for the next 24 hours.
Then walk through the response:
- Who gets called?
- Which facilities need to be visited first?
- How will each station be operated manually?
- What conditions need to be checked?
- How frequently should those checks occur?
- How will operators communicate with one another?
- Where will operators find the procedures and documentation they need?
The exercise does not need to be complicated. The objective is to determine whether everyone understands their responsibilities and whether the resources needed to operate manually are actually available. Any gaps identified during the exercise become opportunities to strengthen your response plan before a real event puts it to the test.
How Long Could You Safely Operate?
SCADA resiliency isn’t just about keeping technology running. It’s about knowing your process well enough to keep the operation running when the technology doesn’t.
The question may not simply be: “How quickly can we restore SCADA?”
It may also be: “How long can we safely operate without it?”
Is Your Utility Prepared?
Concentric Integration can help your team evaluate operational vulnerabilities, document manual operating procedures, and develop a practical response plan for maintaining critical operations when SCADA or automatic control is unavailable.