ESDIS NASA Sentinel Gateway Facilitating EOSDIS Mirroring of

ESDIS NASA Sentinel Gateway: Facilitating EOSDIS Mirroring of Sentinel Data Dawn Lowe, Project Manager Earth Science & Data Systems Project NASA/Goddard Space Flight Center September 29, 2015

Topics • NASA Sentinel Gateway Capabilities – Planned Capabilities – Data Flow Volumes – Technical Approach/Status • Alaska Satellite Facility (ASF) DAAC - archiving and serving Sentinel-1 SAR data ESDIS

Planned NASA Sentinel Gateway Capabilities • Serve as a single interface between the ESA International Data Hub and multiple NASA Distributed Active Archive Centers (DAACs) to minimize bandwidth on European networks • Initially sized for: – Sentinel-1 A and Sentinel-1 B for Level 0 – Sentinel-3 A and Sentinel-3 B for Level 1 B – Sentinel-5 P for Level 1 B • Provide access of Sentinel products to multiple DAACs • Provide operator tools for monitoring the Gateway’s health and status • Provide on-line data access for bulk data downloads by other US Government Agencies

Gateway Data Volume ESDIS

Gateway Interface to ESA Hub ESDIS • Mechanism – Use of OData interface • Ability to access the ESA Scientific Hub to automatically download available Sentinel 1 A data products using HTTP by running scripts in batch mode • Download Status – Ingested and archived ~328 TB of Sentinel 1 A data (as of 09/23/15) – Average transfer rate of ~22 MB/s per day with a data download volume of ~1. 3 to ~1. 5 TB/day

NASA Sentinel Gateway Heritage – Utilized the Suomi National Polar-orbiting Partnership (SNPP) Science Data Segment (SDS) Data Depository and Distribution Element (SD 3 E) design • Acquired data from multiple locations using FTP or HTTPS • Coalesced requests from six data processing centers into one request and made data available to the centers • Stored data temporarily in a rolling buffer for 32 -days • Ingested ~6 TB and distributed ~15 TB daily • Products were made available to data processing centers within 30 minutes of receipt

Current Status ESDIS • The Gateway provides the capability to: – Ingest and verify products downloaded from the ESA Scientific Data Hub – Verify checksum of SAFE files and manifest files – Provide data to ASF using the Polling with Product Delivery Record (PDR) mechanism and Grid. FTPLite – Capable of handling ingest, storage, and distribution of data from multiple missions – Detect missing data products and request retransmissions from the Scientific Data Hub – Provide a configurable 32 -day (TBD) rolling buffer

PDR Mechanism ESDIS

ASF DAAC Status ESDIS • NASA received permission from ESA after the Nepal earthquake to redistribute the Sentinel-1 data for the region through the ASF DAAC. S 1 A products over the Nepal region are available for download through Vertex and the API • ASF DAAC will be archiving and distributing all of the Sentinel-1 products produced by ESA • A data feed service has been implemented for the Nepal data, providing immediate notification to users who subscribe when new products are available from the DAAC. Other feeds will be implemented once the agreement for redistribution between the EC and the US has been signed • Geo. Server access and OPe. NDAP/Webification access to S-1 products will be investigated and level of interest/effort scoped