Optimizing SCADA Network Communications An Overview of Metropolitan

Optimizing SCADA Network Communications: An Overview of Metropolitan Wide SCADA Communications Options by John Mc. Cain and Russ Straayer WWW. DCBNET. COM

The Legacy Approach • • 2 and 4 wire phones lines, 1200 bps VHF and UHF radios Point-to-Point Microwave These Were Typically… – Homogeneous – Well Understood – User-Controlled WWW. DCBNET. COM

Today’s World • • • Open Standards Many Possible Solutions Simple to Complex Economical to Expensive Wired, Wireless, Public, Private WWW. DCBNET. COM

Wire Line Methods • • Analog Point to Point Modems Analog Multipoint Modems DDS Frame Relay Point-to-Point and Mesh Networks • ATM • T 1 and Higher WWW. DCBNET. COM

Fiber • SONET or Fiber Ring • Fiber Ethernet • New! Fiber Modem WWW. DCBNET. COM

Wireless • Wireless Common Carrier Networks • VHF and UHF Point-to-Point and Multi. Point • ISM Band License Free – 900 MHz, 2. 4 GHz, 5 GHz • Point-to-Point Licensed Microwave WWW. DCBNET. COM

Analog Modems • Point-to-Point to 19. 2 Kbps (Private Wire) • Multi-Point to 9. 6 Kbps • Hard to purchase, not always available • The base line for comparison WWW. DCBNET. COM

DDS • • • 56/64 Kbps Point-to-Point or Multi-Point (56) Digital May be used with T-1 access line at host Not always available WWW. DCBNET. COM

Frame Relay • • • Packet Switched Network Bandwidth available in small increments Not always available ECONOMICAL for longer distances “Automatic” Redundancy WWW. DCBNET. COM

ATM • High Speed • Expensive • Not usually appropriate for SCADA WWW. DCBNET. COM

T 1 and Higher • • T 1, T 3, OC-3, etc. More bandwidth than normally needed Minimum speed for “useful” Ethernet May be expensive WWW. DCBNET. COM

Fiber & SONET • • High cost High bandwidth Expertise Complexity WWW. DCBNET. COM

Fiber Modem • Economical addition when adding fiber for other uses • Low cost termination for RS-232 equipment • Lower speed option for fiber WWW. DCBNET. COM

Fiber Ethernet • Uses standard Ethernet equipment for small networks • Lower cost than SONET • 10/100 Mbps WWW. DCBNET. COM

VHF and UHF Radio • • Privately Owned and Maintained Lower speeds (19. 2 Kbps or less) New frequencies hard to obtain ISM band equipment often has higher bandwidth and easier implementation WWW. DCBNET. COM

Wireless Common-Carrier Networks • CDPD pay-per-byte • Satellite delivery • Wireless Internet • Missing Coverage Areas • Cost • May be used to fill in “holes” WWW. DCBNET. COM

ISM Band Radio • • • 9. 6 Kbps to 100 Mbps (claimed: -) 900 Mhz, 2. 4 Ghz, 5. 8 Ghz Serial or Ethernet interfaces Insecure frequencies Range from several to 100 Miles+ Too Many Unrealistic Vendor Claims!! WWW. DCBNET. COM

Point-to-Point Microwave • • Licensed, secure May be expensive Always Point-to-Point High Bandwidth WWW. DCBNET. COM

The Organization Office WAN • • Lay the cost on someone else! Being forced upon SCADA users Not Deterministic Not SCADA-Reliable, No Accountability • Be Careful Here WWW. DCBNET. COM

What to Do…. • Start with a Needs Analysis – Analyze for total life cycle cost – Determine actual bandwidth requirements – Examine in-house expertise – Get to know your vendors…. well – What growth requirements are there – Physical and geographic criteria? • Consider a “MIXED” system! WWW. DCBNET. COM

Conclusion • A successful SCADA WAN network is usually a compromise between reliability, cost, bandwidth, and flexibility. Today, more than ever, SCADA operators must economize while still providing the necessary control and data acquisition functions with increased reliability. Most SCADA networks contain a technology mixture that grew in complexity over the years. Insure that your analysis allows for even more growth in the future as well as flexibility and reliability. WWW. DCBNET. COM

For More Information • WWW. Scada. Communications. COM • WWW. DCBNET. COM • Our Booth at Power. Gen WWW. DCBNET. COM

Point to Point Example • Frame Relay WWW. DCBNET. COM

Point to Multipoint Example • Frame Relay WWW. DCBNET. COM

Multiple Redundant Hosts Frame Relay Primary Host Site SR-BPF-04 Digi. CHANNEL AC I/O Device Multiple Units Athena Frame Switch SR DATA MULTIPLEXER DCB SR-BPF-01/DSU DCB Host Computer T 1 DSU T-1 RTU 56 kbps Multiple Remote RTUs SR-BPF-04 Frame Relay-1 T-1 56 kbps SR DATA MULTIPLEXER DCB Backup Host Site T 1 DSU SR-BPF-01/DSU SR-BPF-04 Digi. CHANNEL Athena Frame Switch AC I/O Device Multiple Units Host Computer Data Comm for Business Inc. SR-BPF-04 WWW. DCBNET. COM September 21, 2001 RTU

Scada F/R with Ethernet Access, Remote Management LAN Etherpath ACCESS SWITCH DCB Access Switch To Management Ports Primary Host Site SR-BPF-04 Digi. CHANNEL AC I/O Device Multiple Units Athena Frame Switch SR DATA MULTIPLEXER DCB SR-BPF-01/DSU DCB Host Computer T 1 DSU T-1 RTU 56 kbps 1 -250 Remote RTUs SR-BPF-04 Frame Relay-1 56 kbps T-1 SR DATA MULTIPLEXER SR-BPF-04 DCB T 1 DSU Multiple Units Digi. CHANNEL Athena Frame Switch AC I/O Device SR-BPF-04 Host Computer To Management Ports ACCESS SWITCH WWW. DCBNET. COM Etherpath LAN DCB Access Switch Backup Host Site SR-BPF-01/DSU RTU

SCADA with F/R, Voice, Ethernet, Backup Links Primary Host Site Phone Ethernet Hub Athena Access Phone 10 Base. T SR-BPF-04 Digi. CHANNEL AC I/O Device Multiple Units Athena Frame Switch SR DATA MULTIPLEXER Athena Access w/56 K DCB Polling Host Computer T 1 DSU DCB SR-BPF-01 RTU 56 kbps T-1 Multiple Remote RTUs SR-BPF-04 Frame Relay-1 T-1 Backup Host Site 56 kbps DCB T 1 DSU RTU SR DATA MULTIPLEXER SR-BPF-04 DCB Athena Access w/56 K SR-BPF-01 Multiple Units Digi. CHANNEL Athena Frame Switch AC 10 Base. T I/O Device Phone Polling Host Computer SR-BPF-04 Athena Access Ethernet Hub WWW. DCBNET. COM Phone

SCADA Via Ethernet WWW. DCBNET. COM

SCADA Via Frame Relay WWW. DCBNET. COM

Scada via Frame Relay with Redundant Host Site WWW. DCBNET. COM

Legacy (Conitel) Protocol Via Frame Relay WWW. DCBNET. COM

SCADA Via Routed Ethernet WWW. DCBNET. COM

Scada Via F/R with Modem or Radio Backup using ASU-BU BPF-BU RTU Async RS 232 Sync Frame Relay BPF-04 Async BU Sharing Unit Async RS 232 SCADA Host Digi. CHANNEL RS-232/V. 24 -3 Frac. T 1 DSU ACCESS SWITCH AC DCB Host Serial Ports Frac. T 1 Async RS 232 Frame Relay Network Async RS 232 Modem Sync Frame Relay Radio Dial-up Link Modem BPF-BU Dial-up Link Async RS 232 RTU Sunc Frame Relay Tower Modem Async RS 232 RS-232/V. 24 -14 RTU RF Link Modem Async RS 232 Sync Frame Relay 6/21/01 Russ Straayer Async RS 232 RTU Tower Radio BPF-BU WWW. DCBNET. COM BPF-BU

BPF Frame Relay Solution • • • 1 or 4 ports Async ports 300 bps to 57600 bps Composite speeds to 128 kbps Async protocol transparent Fast data propagation Easy to configure WWW. DCBNET. COM

1 and 4 Ports Units • Multiple polling systems, one line • 40 DLCI’s per port • Support multiple or redundant RTU’s WWW. DCBNET. COM

Multiple Speeds • • Not all systems run the same speed Different speeds at each end of the line Mix systems over the same phone lines Mix polling and non-polling applications WWW. DCBNET. COM

Fast Composite • Faster data propagation • Matches vendor offerings WWW. DCBNET. COM

Protocol Transparent • Setup is much more simple • More general purpose • More future proof WWW. DCBNET. COM

Fast Propagation Times • 50 to 100 ms • Comparable to modems • Less than host timeouts WWW. DCBNET. COM

Easy Configuration AT YOUR COMMAND >> SM SHOW MAP ---------------PORT DLCI ASSIGNMENTS [Total 1: 3, 2: 3, 3: 3, 4: 3] ---------------------------------1 16 17 18 2 16 17 18 3 16 17 18 4 16 17 18 WWW. DCBNET. COM

Other DCB SCADA Solutions • • • Ether. Poll 202 T Modems Fast Poll Modems SCADA Point to Point Multiplexer SCADA Point to Multipoint Multiplexer WWW. DCBNET. COM