Speaker Doug Mc Ginnis Company Exelon Session Title

Speaker: Doug Mc. Ginnis Company: Exelon Session Title Smart Grid Communication Architecture

Smart Grid at Exelon Smart Home / Business • Real-time usage and pricing statistics • Home Area Network (HAN) composed of smart devices and appliances that know the price of energy Smart Meters (AMI) Smart Distribution System 2 Smart Utility • A method to enable two-way • Real-time reporting of status and • More efficient data outages information flow collection, processing and back office functions • Automated controls of relays and • System status, customer reclosers. Efficient field force outage status, usage and • Asset Monitoring management pricing signals delivered to and from location • Effective interconnection of renewable energy sources Leveraging integrated communication systems and information processing is critical Customer End-Use Advanced Pricing & Billing In-home Devices Power. Co 1234567 1234 Vehicle Electrification Plug-in Hybrid Electric Vehicles Customer Gateway Advanced Metering Infrastructure (AMI) Grid Modernization Distribution Automation Smart Substations Renewable Interconnection

Fundamental Design Principles 1. 2. 3. 4. 5. 6. 7. 8. Security – Robust end-to-end, aligned with NISTIR 7628 Deterministic – Smart Grid applications will share a logically isolated deterministic communications infrastructure. Interoperable – Industry standard protocols will be utilized with a focus on migrating to IP/Ethernet consistent with industry direction Privately Owned – Privately owned communications is preferred. Eliminate telecom circuits, O&M cost savings. No Unanalyzed Single Points of Failure (Self Healing) – The communication architecture will be designed with no unanalyzed single points of failure. Communications Maintenance Management & Monitoring – Inherent to the communications Architecture will be Communications Maintenance Management & Monitoring, i. e. the ability to maintain, monitor and control network devices. Tiered Architecture – Unit/Distribution substations are linked to larger Transmission substations in a hierarchical design through new wireless technologies Relay Protection Communications – Highest level of reliability and availability including diverse backup paths.

Architectural Framework Substation Application Portfolio – 6 application groups exist in the substation and are logically partitioned over common transport ◦ Telemetry – RTU/IED – EMS/DMS communications (encrypted) ◦ CIP Telemetry – NERC CCA sites (encrypted) ◦ DA – Field Distribution Automation traffic aggregated by TGB (encrypted) ◦ Enterprise – Business applications (email, Vo. IP, surveillance video) ◦ Security – Card readers ◦ AMI – TGB backhaul handoff to Core Po. P Tier 1 – Substation will be a point-of-presence to the SONET backbone. ◦ SONET infrastructure provides Ethernet and TDM provisioning ◦ Routing capability to permit application provisioning over Ethernet (Layer 3) ◦ Quality of service management, data prioritization Tier 2 – RF bridge between TGB’s and non-Po. P substations ◦ Wi. Max/Ethernet transport ◦ VLAN partitioning per application for separation

SONET Design Relay Protection Communications üParallel dual SONET ring configuration (OC 3 & OC 48) with Po. P’s at each substation ü No relay channel failure with loss of a ring üPath diversity – loop topology with fast switching to protected path üOC 3 ring – Primary Relay communications ü No other applications will use OC 3 ü Static environment üOC 48 ring – Backup Relay, TDM & Ethernet service ü Gig. E provisioned to support Ethernet services ü TDM circuits for relay protection, voice & serial communications as required

Substation SONET Design

Substation Communications Architecture Substation LAN ü Access switch – VLAN provisioned (Layer 2) ü No inter-application routing will be permitted ü Telemetry network access/authentication will be through core SCADA Firewall – NERC CIP compliant ü TGB’s and other substation IP devices will be connected to switch partitioned in their respective VLAN’s Substation WAN ü Router (layer 3) will interface with switch and will provision Virtual Route Forwarding Tunnels (VRF) ü 6 VRF tunnels will be created for logical separation ü VRF tunnels will be encrypted using Dynamic Multipoint VPN (DMVPN) ü IP addressing schema will be defined for entire substation population based on application requirements

Substation LAN – WAN Architecture Work Station Network Core VRF Tunnels Substation Telemetry Vo. IP VLAN extended to switch per Application Camera Card. Reader Switch RTU SCADA CIP Telemetry Firewall Router Gigabit Ethernet Field DA Enterprise Core Router Switch Security AMI Security DA TGB Incorporates Layer 3 VRF Tunneling and Dynamic Multipoint VPN AMI TGB Ethernet based devices Enterprise Firewall AMI/RNI

Middle Mile (Tier 2) Architecture Requirements Transport the Smart Grid application portfolio ◦ AMI backhaul – (200 kbps/TGB @ 70 Aggregation pts) ◦ Distribution Automation (100 kbps/TGB @ Aggregation pts) ◦ Substation Telemetry (56 kbps/substation) ◦ Voice/Video (~1 Mbps per video stream) Application Traffic Considerations ◦ ◦ Bandwidth consumption (5 -20 Mbps) Latency sensitivity (Qo. S tagging) Security (PKI) Logical provisioning of applications (VLAN tagging)

Middle Mile Design Considerations Spectrum Options – Licensed vs. Unlicensed (ISM) Licensed • Free • High cost – Spectrum Market • Limited Power • Strict FCC deployment rules • Uncontrolled Noise Floor • High Power Operation • Uncontrolled Interference • Low/controlled Noise Floor • 900 MHz – Hi Noise • Interference Remedy • 2. 4 GHz – Hi Noise • 700 MHz Public Safety • 3. 65 GHz (Lite License) • 900 MHz • 5. X GHz • 2. 3 GHz

What Spectrum to Use? What characteristics need to be considered? Free-space path loss is proportional to the square of the distance between the transmitter and receiver, and proportional to the square of the frequency of the radio signal. ◦ Higher the frequency – Lower the signal propagation ◦ What type of coverage are you planning for? Blanket umbrella (target lower frequencies with minimal interference characteristics) Surgical microcell (target higher frequencies) Urban (target lower frequencies with minimal interference characteristics) Suburban/rural (depends on the type of coverage, Blanket vs. Surgical)

Spectrum Evaluation Requirements Frequencies 700 Mhz 900 Mhz 2. 3 Ghz 3. 65 GHZ 5. 8 Ghz 6 -11 Ghz Risk High Medium Low Cost Low Low High Excellent Adequate Good Excellent Limited Good Growing Good √ √ √ No √ Unlicensed No √ √ No Lightly No No √ √ √ No No √ √ Point-to-Multi Point √ √ No Overall Ranking 2 6 5 1 3 4 Coverage Equipment Availability Licensed Availability – PECO area Point-to-Point Ranking: 1 high - 6 low

Tier II Integration (Conceptual) Design

Technology Standards Two prevailing backhaul Standards Wi. Max 802. 16 Wi. Fi 802. 11 • Long Distance 5 -10 Miles • Shorter range 1 -2 Miles • P 2 P & P 2 MP • Meshing capability • Time Slotted Access • Contention Access DSSS • Mobility (802. 16. e) • 22 MHz Channels • 5 -10 MHz Channels • 802. 1 Q (VLAN, Qo. S) • Security EAP/TLS/WPA 2 • Security EAP/TLS/AES

Bringing it together Backhaul 100 AMI/DA collector sites Provide backhaul of non-fiber substations Requires surgical deployment, not blanket coverage ◦ Point-to-point links ◦ Microcell canopies Decided Wi. Max using 3. 65 GHz Lite-License ◦ Minimal noise at this time ◦ Do not require full territory coverage ◦ Point-to-point links where necessary

Tier II Conceptual Design