Скачать презентацию CDX and the Exchange Network www epa gov cdx Скачать презентацию CDX and the Exchange Network www epa gov cdx

d0ef25c8ce92342b2f6708f0af0a4dac.ppt

  • Количество слайдов: 42

CDX and the Exchange Network www. epa. gov/cdx Connie Dwyer Environmental Protection Agency March CDX and the Exchange Network www. epa. gov/cdx Connie Dwyer Environmental Protection Agency March 6, 2007

Topics • • Background and Status Interoperability Specifications and Guidance Exchange Network Design Guidance Topics • • Background and Status Interoperability Specifications and Guidance Exchange Network Design Guidance SOA Service Ongoing and Future Work Questions 2

Background and Status Background and Status

CDX and the Exchange Network • The Exchange Network (Network) – promotes secure, standards-based CDX and the Exchange Network • The Exchange Network (Network) – promotes secure, standards-based information sharing and electronic data exchanges • The Central Data Exchange (CDX) – is the EPA exchange point (node) on the Exchange Network – provides common support services for the exchange of environmental data (shared services) • 4

What is the Exchange Network? An Internet and standards-based method for exchanging environmental information What is the Exchange Network? An Internet and standards-based method for exchanging environmental information between partners Key Components • Data Standards • Nodes • XML Schema/Registry • Trading Partner Agreements • Grant Program 5

Exchange Network • Objectives – Promote better environmental decisions through improved data quality and Exchange Network • Objectives – Promote better environmental decisions through improved data quality and data access – Provide a common method for automating, publishing and exchanging data among states, tribes, and EPA – Promote efficient business processes and standard technologies to reduce operational costs 6

CDX / Exchange Network SOA • Based on a Service Oriented Architecture – Security CDX / Exchange Network SOA • Based on a Service Oriented Architecture – Security Services – Discovery Services (UDDI) – Data Service • Publishing • Exchange • Transformation – Quality Assurance Services • Reduces Cost with Shared Services • Uses a Well-Tested Specification for Interoperability • Minimizes the Burden on Consumers – Universal Clients – Software Developer Kits – Open Source Implementations 7

Problem Solved by CDX / the Exchange Network Program Silo 1 Registries Program Data Problem Solved by CDX / the Exchange Network Program Silo 1 Registries Program Data Repositories & Data Warehouses Analysis and Access Systems Program Information Consumers Program Silo 2 Program Data Repositories & Data Warehouses Analysis and Access Systems Program Information Consumers Program Silo 3 Program Data Repositories & Data Warehouses Analysis and Access Systems Program Information Consumers Program Silo 4 Program Data Repositories & Data Warehouses Analysis and Access Systems Program Information Consumers Program Silo 5 Program Data Repositories & Data Warehouses Analysis and Access Systems Program Information Consumers Program Silo 6 Program Data Repositories & Data Warehouses Analysis and Access Systems Program Information Consumers Program Silo 7 Program Data Repositories & Data Warehouses Analysis and Access Systems Program Information Consumers Program Silo 8 Program Data Repositories & Data Warehouses Analysis and Access Systems Program Information Consumers Program Silo 9 Program Data Repositories & Data Warehouses Front End Data Collection Systems Analysis and Access Systems Program Information Consumers Program Silo 10 Registries Front End Data Collection Systems Industry Registries Front End Data Collection Systems Unmanageable Complexity Registries Front End Data Collection Systems States Registries Front End Data Collection Systems >150 data flows Program Data Repositories & Data Warehouses Analysis and Access Systems Program Information Consumers Program Silo 11 Program Data Repositories & Data Warehouses Analysis and Access Systems Program Information Consumers Program Silo 12 Program Data Repositories & Data Warehouses Analysis and Access Systems Program Information Consumers Program Silo 13 Program Data Repositories & Data Warehouses Analysis and Access Systems Program Information Consumers Program Silo 14 Program Data Repositories & Data Warehouses Analysis and Access Systems Program Information Consumers Program Silo 15 Program Data Repositories & Data Warehouses Analysis and Access Systems Program Information Consumers Program Silo 16 Program Data Repositories & Data Warehouses Analysis and Access Systems Program Information Consumers Program Silo 17 Program Data Repositories & Data Warehouses Analysis and Access Systems Program Information Consumers Program Silo 18 Program Data Repositories & Data Warehouses Analysis and Access Systems Program Information Consumers Program Silo 19 Program Data Repositories & Data Warehouses Analysis and Access Systems Program Information Consumers Program Silo 20 Program Data Repositories & Data Warehouses Analysis and Access Systems Program Information Consumers Program Data Repositories & Data Warehouses Analysis and Access Systems Registries Front End Data Collection Systems Local Govt Registries Front End Data Collection Systems 1000’s of reports Registries Front End Data Collection Systems Universities Legislators Dozens formats/ models Registries Front End Data Collection Systems Tribes Policy Makers Registries Front End Data Collection Systems Program Silo 50+ Registries Front End Data Collection Systems Program Information Consumers Citizens 8

Status of State Nodes - January 2007 WA MT OR MN ID AK WY Status of State Nodes - January 2007 WA MT OR MN ID AK WY NV SD CA AZ CO IA KS PA WV CT NJ DE MD DC NC SC AR MS TX VA KY TN HI In Development OH IN MO OK NM NM NY MI IL NH MA RI NH WI NE UT ME VT ND AL GA LA FL FL Operational Not Yet Started 9

Types of Data Network Exchanges State-to-EPA EPA-to-State • • • Facility Data to FRS Types of Data Network Exchanges State-to-EPA EPA-to-State • • • Facility Data to FRS Drinking Water Data to SDWIS Haz Waste Data to RCRAInfo Air Emissions Data to NEI Air Quality Data to AQS TRI Data Submissions Substance and Chemical Data Facility Data from FRS Air Quality Data - Coming Soon State-to-State Intrastate • • • Environmental Data to Health Departments • Drinking Water Labs to States • Homeland Security/Law Enforcement Data • County Water Data Water Quality Data Hazardous Waste Transporters Air Quality Data – Coming Soon Homeland Security Data 10

CDX & Exchange Network Partners Industry Partners Water Utilities & Power Plants Oil Refineries CDX & Exchange Network Partners Industry Partners Water Utilities & Power Plants Oil Refineries California Air Resource Board Chemical Producers Automobile Manufacturers Yurok St. Regis Mohawk TRI Internet RMP NEI ODS NOI Wind River e. IUR TSCA Grants. gov Central Data Exchange E-Authentication Federation Web Forms Web Services Security Services e. Gov Initiative Partners Data Quality Services Hosted & Distributed Integration Services SRS Enviro. Flash AIRNow VERIFY Pay. gov Indiana EMITS EPA Program Office Partner Systems Tribal Partners Eastern Band of Cherokees State Partners General Public Help Desk & Operations Support FRS AQS RCRAInfo BMS/ACRES RADNESHAPS ICTS IGMS SDWIS OTAQ WQX/STORET RADNET LT 2 EAB PCS EPA Regional Partners Region 4 - CAFO Region 5 - Geo. Exchange 11

Network Governance Exchange Network Leadership Council (ENLC) Policy/ Strategic Planning Executive Coordinator Network Operations Network Governance Exchange Network Leadership Council (ENLC) Policy/ Strategic Planning Executive Coordinator Network Operations Board (NOB) Operations Oversight Network Technical Group (NTG)* Network Technical Group (NTG )* Day to Day Operational and Technical Support Help Desk Registry Network Partnership and Network Policy and Resources Group (NPRG)* Day to Day Policy and Resource Activities Standards Teams* Standards Design and Development Etc. *Example Sub -Groups 12

Interoperability Interoperability

Interoperability Levels XML Schemas - Data Interoperability SOAP – Message Interoperability WSDL – Web Interoperability Levels XML Schemas - Data Interoperability SOAP – Message Interoperability WSDL – Web Service Interoperability DIME(MTOM) – Attachment Interoperability 14

Interoperability Components • • • Data Standards XML Design Rules and Conventions XML Schema Interoperability Components • • • Data Standards XML Design Rules and Conventions XML Schema Review Process W 3 C Web Service Standards Network Specifications Reference Implementations Interoperability Testing Interoperability Test Tools QA Services 15

Service Interoperability Guidelines • Promote interoperability through the use of Open Standards • Incorporate Service Interoperability Guidelines • Promote interoperability through the use of Open Standards • Incorporate Web Service Standards with Maximum Acceptance and Strongest Tool Support *Services are currently hosted / interoperate on every major application platform 16

17 17

CDX / Exchange Network Technology • • • SOAP v 1. 1 (1. 2): CDX / Exchange Network Technology • • • SOAP v 1. 1 (1. 2): Simple Object Access Protocol WSDL v 1. 1: Web Services Description Language UDDI v 3: Universal Description, Discovery and Integration W 3 C XML-Encryption W 3 C XML-Signature SAML v 1. 1: Security Assertion Markup Language WS-Security v 1. 0 XKMS v 2. 0: XML Key Management Specification DIME – Direct Internet Message Encapsulation (MTOM) – Message Transmission Optimization Mechanism BPEL 1. 1 – Business Process Execution Language Exchange Network Protocol and Specification 18

Specifications and Guidance Specifications and Guidance

Design Specifications § Network Node Functional Specification describes –Actions performed by the node –How Design Specifications § Network Node Functional Specification describes –Actions performed by the node –How node functions are invoked –Expected node output § Network Node Exchange Protocol defines –Types of valid messages a node should receive –The format for sending messages among nodes • These specifications ensure interoperability across platforms by clearly defining the process and expected behaviors 20

Design Specifications / Guidance • Network Authentication and Authorization Specification • Network Security Guidelines Design Specifications / Guidance • Network Authentication and Authorization Specification • Network Security Guidelines and Recommendations • Flow Configuration Documents – Business rules for conducting dataflow using network nodes • DET/XML Schema Guidelines • See WWW. EXCHANGENETWORK. NET 21

Exchange Network Guidance • DATA EXCHANGE DESIGN BEST PRACTICES – – – Best Practices Exchange Network Guidance • DATA EXCHANGE DESIGN BEST PRACTICES – – – Best Practices for Schema Design Best Practices for Handling Large Transactions Best Practices for Managing State Best Practices for Data Services Best Practices for Data Validation • DATA EXCHANGE MODELS – – – The Data Synchronization Model The Data Publishing Model Patterns in Authentication and Authorization Patterns in Requesting Data Patterns in Submitting Data Other Data Exchange Scenarios 22

XML Guidance • The Core Reference Model contains major groupings of environmental data and XML Guidance • The Core Reference Model contains major groupings of environmental data and their relationships in order to assist the development of Data Exchange Templates (such as XML schema), data standard development, and the creation of Shared Schema Components. • Shared Schema Components (SSC) - sharable schema components based on approved EDSC data standards and detailed guidance to XML schema developers on how they can incorporate the SSC into their XML schema. 23

XML Schema Development and Management Process Start Here 24 XML Schema Development and Management Process Start Here 24

SOA Services SOA Services

How Are Services Being Used? • • • Authenticate a User Authorize an Activity How Are Services Being Used? • • • Authenticate a User Authorize an Activity PKI Management Quality Assurance Data Transformation Submit Information to a Partner Status Notification Find a Web Service Publish Information Query Information 26

Security Architecture / Services 27 Security Architecture / Services 27

Network Authentication and Authorization Security Services • PKI related services – support CBI activities Network Authentication and Authorization Security Services • PKI related services – support CBI activities – XML Key Management Services (XKMS) Public Key Management • Allows users to locate, publish, and validate public keys – Network Certificate Authority • Issues and manages certificates used for secure socket layer (SSL) transactions over the EN – Certificate Validation • Provides general signature/encryption validation • Provides certificate revocation checking against e. Authentication Federation – Custom API interface to Mitre. Tek Certificate Arbitration Module (CAM) 28

Discovery Services • Universal Description, Discovery and Integration (UDDI) registry service for cataloging and Discovery Services • Universal Description, Discovery and Integration (UDDI) registry service for cataloging and publishing Agency services • UDDI registry service manages information on: • Service providers • Service implementations • Service metadata • Advertise services • Discover services • Interfaces • Browser • Web services https: //uddi. epacdxnode. net/uddi/bsc/web 29

Quality Assurance Services Web Service-based XML document validation • XML Schema Validation • Extended Quality Assurance Services Web Service-based XML document validation • XML Schema Validation • Extended business rules validation Uses Schematron technology Empower Data Stewards to Manage Data Quality 30

Lessons Learned • Develop an XML Management Approach Early • Use W 3 C Lessons Learned • Develop an XML Management Approach Early • Use W 3 C Standards Where Possible • Use a Coarse Grained Service Model • Provide Tools to Simplify Adoption • Deliver Shared Services for Common Functions 31

Ongoing / Future Work Ongoing / Future Work

Make It Faster and Easier! • Node 2. 0 • Node Client • Network Make It Faster and Easier! • Node 2. 0 • Node Client • Network Browser • Discovery Services • Dynamic Publisher 33

Network Node 2. 0 Specification • Integrating the latest technologies. – MTOM Message Transmission Network Node 2. 0 Specification • Integrating the latest technologies. – MTOM Message Transmission Optimization Protocol – Relevant WS specifications • Parallel support for existing and new specification for a smooth transition. • Creating a complete turn key solution on major platforms -. NET and JAVA-Open Source 34

Node Client 2006 – Wizard driven access to All Network Services 35 Node Client 2006 – Wizard driven access to All Network Services 35

36 36

Network Browser – Browse Meta Data and Query Any Network Data Services 37 Network Browser – Browse Meta Data and Query Any Network Data Services 37

Discovery Services What can I do with it? • • • Embed within an Discovery Services What can I do with it? • • • Embed within an application Surf with a browser Use in a PDA/Smart Phone 38

Simplified Data Service Publishing Empower Data Stewards to Publish their Data 39 Simplified Data Service Publishing Empower Data Stewards to Publish their Data 39

Keys to Success • • Standards Specifications Shared Services Exchange Agreements Exchange Templates Governance Keys to Success • • Standards Specifications Shared Services Exchange Agreements Exchange Templates Governance Communications and Outreach Strong Partnerships 40

Questions / Comments ? Questions / Comments ?

For More Information Connie Dwyer EPA Office of Environmental Information (202) 566 -1691 Dwyer. For More Information Connie Dwyer EPA Office of Environmental Information (202) 566 -1691 Dwyer. [email protected] gov www. exchangenetwork. net www. epa. gov/cdx 42