Preservation of NASA’s Earth Observation Data EOSDIS Science Operations, ESDIS Project Code 423 Goddard Space Flight Center, Greenbelt, MD 20771 ESIP Federation Meeting, Santa Barbara, CA. July 9, 2009
EOSDIS and NASA’s Earth Science Preservation Activities • NASA’s Earth Science Data and Information System Project will maintain distributed active archives to continue servicing the science and applications communities. –responsibilities for data management include, yet go beyond, the life of EOS missions and continue with missions recommended by Decadal Survey. –keep all data important to active science research and applications in place at the EOSDIS Data Centers. 3/17/2018 2
Preservation of Earth Observation Data • NASA has observational data that will need long term preservation Selected data sets will be organized for the National Archives and Records Retention (NARA) based on mission end of life and other critical data needs. Our data life cycle ends with a consolidated and organized permanent record which specifically means instrument data co-located with the product generation source code, allowing for regenerated products when necessary, documentation, submitted and accepted to NARA. 3/17/2018 3
Organization • A number of events need to occur with each instrument for a successful archive strategy, but in general: – ESDIS will coordinate joint long term archive activities with each EOS Instrument team through appropriate working groups. – The working group will agree on source of information, responsibility for inventory and content, standards to follow and any corresponding preparation tasks. – ESDIS will align the long term archive plan with current NASA’s records retention schedule rules. – The entire archive process will be a transparent activity to all involved, including the science community. – The working group will stay active through the entire archive process to ensure goals are met. 3/17/2018 4
Characterizing EOS Electronic Records • There are two primary types of EOS electronic records and 4 product categories – Science data needed for future national climate research and climate change programs and projects – not reproducible, clear need for long term preservation • Instrument data and information required for re-calibration to improve historical products • Observational data (e. g. , EOS Level 0 or 1) needed for long term climate records; the basis for establishing operational climate monitoring programs – Earth observations of national policy significance • Products (e. g. , EOS Level 2 and 3) used by researchers whose results are the basis for the formulation of national policies and continue to be used to determine effectiveness of national regulations and international treaties – E. g. ozone monitoring, ice monitoring • Research products (e. g. , EOS Level 2 and 3) used within operational monitoring programs for the public good – E. g. , weather satellites, land use, land cover, air quality EOS Data Product categories: Level 0 - Unprocessed instrument/payload data at full resolution. Level 1 - Instrument data with radiometric and geometric calibration and geo-references 3/17/2018 Level 2 - Derived geophysical variables at the same resolution and location as the Level 1 source data. 5 Level 3 - Variables mapped on uniform space-time grid scales
Science Mission Drivers • EP-TOMS and ICESat 1 where chosen as the first data sets to enter the long term archive process for the reasons below: • EP-TOMS – Data flow discontinued in Dec 2005. Currently near the end of the project, should be forming or have identified final records. – Team members should still be available to support a joint working group (OMI is the continuity mission – different team with some overlap in membership). – A critical national historical dataset of ozone records for NASA in support of Clean Air Act Amendments of 1990. • ICESat 1 – Instrument may fail soon and we may suddenly need to finalize records. – The instrument is a reasonable representation of the kind of information that needs to be organized for the archive, and the learning curve faced by most other flight and science projects concerning use of preservation standards. 3/17/2018 6
The value of the OAIS Ref. Model • A common language that enables coordinated planning and implementation by partnering agencies and institutions for permanent records retention – NOAA, USGS, NARA • A structure for linking representation information with the data – Example – MODIS LTA Handbook – Provides a logical structure, avoiding having to rethink what goes into an AIP 3/17/2018 7
Experience using OAIS RM • Several of the data centers have used the OAIS Reference Model when evolving, updating or re-designing their archive – NASA Langley (LARC) Atmospheric Sciences Data Center data system evolution – PO. DAAC (JPL) using OAIS Reference Model, ISO 19115 as design constraint – SEDAC and Columbia University using OAIS RM in implementation of COTS packages Fedora and VITAL 3/17/2018 8
Atmospheric Sciences Data Center Archive, Next Generation (or ANGē) • • • ANGē’s design is based on the Open Archival Information System (OAIS) Reference Model. ANGē development is organized by each of the primary OAIS model component. One of primary goals of ANGē’s design is to minimize the changes required for the interfaces to any current data providers. An additional translation layer will be developed to allow current interface protocols to interact with ANGē’s OAIS compliant services. However, current data providers may elect to modify existing interfaces to take advance of better services (e. g. automated notification of data receipt). The diagram depicts this approach using nomenclature from the OAIS reference model. 3/17/2018 9
Socioeconomic Data Center SEDAC Model for Web-Based Data Submission and Workflow Data Producer Authentication Login with ID & Password Notifications and Requests One or More Submission Sessions Communication Provide Files And Descriptions Describe Data Set Grant Intellectual Property Rights Data Deposit Data Description Submission Agreement Appraise And Approve Submission Information Package Transform Values to XML Metadata Review Transformation Archival Information Package In Digital Repository Ingest Source: Downs and Chen. Creating a Trustworthy Digital Repository for a Long-Term Archive of Interdisciplinary Data: A Case Study. 21 st International CODATA Conference, 5 -8 October, 2008 Kyiv, Ukraine.
backup
EOS Data and Information System • Earth Observing System (EOS) Data and Information System (EOSDIS) was conceived and built in the 1990’s as the spacecraft control, data acquisition, processing system for the EOS flight missions and the archive and distribution system for all NASA Earth science data • EOSDIS consists of several Distributed Active Archive Centers (DAACs), and Science Investigator-led Processing Systems (SIPSs), and a Core System – DAACs provide processing, archive and distribution services for EOS data. • Each DAAC holds different kinds of scientific data that includes atmospheric, oceanic, land use/cover, space geodesy, cryospheric, and biospheric. • The DAACs make EOS data publically available to all users, through online query, metadata, and retrieval systems directly to the user community. – SIPSs produce standard products from EOS instrument data and send them to the DAACs for archiving – Core System consists of components used to support major data flows at several DAACs and SIPSs 3/17/2018 12
EOS electronic records life cycle • Mission based Earth observing research programs – Many instruments and levels (maturity) of data – Many different activity timelines, retention is event driven • • Typical period for operating instrument (~3 -15 yrs) – Nominally the design life plus optimal performance period – Ongoing data acquisition, product generation, archive & distribution – Ongoing science research and applications for societal benefit – Algorithm adjustments and reprocessing from beginning of mission can occur – Provides inputs to next research & operational satellite programs Mission End-of-Life period, Decommissioning (~3 -5 yrs) – Final reprocessing for products from the entire mission – Final research results, inputs to next missions – Organization of mission data for permanent long term retention • Permanent electronic records are created during both periods 3/17/2018 13
Earth Science Missions 3/17/2018 14
EOSDIS Manages Data For all EOS Measurements Aqua (5/02) Terra (12/99) Energy Budget ACRIMSAT (12/99) Aura (7/04) Solar Irradiance AMSR-E MODIS AIRS/AMSU/HSB Trace Gases TIM, SIM, XPS SOLSTICE Atmospheric Surface Sounders Imaging CERES Lower Surface Albedo, Aerosols, Atmospheric Imaging Vegetation Chemistry MODIS CERES MOPITT ASTER MISR Energy Budget SORCE (1/03) TES Atmospheric Dynamics and Chemistry HIRDLS, MLS, OMI Solar Output Mesosphere ACRIM Stratosphere METEOR 3 M TRMM Quik. Scat (11/97) Energy Budget CERES, LIS (12/01) (6/99) Aerosol Trace Gases Sea Surface Winds ICESat Jason (12/01) SAGE III Ocean Altimetry Poseidon/ JMR/DORIS Sea. Winds O 3 Cl. O Br. O OH trace gases aerosols Cloud. Sat (4/06) (1/03) Cloud Properties Ice Topography and Altimetry CPR GLAS CALIPSO (4/06) Cloud, Aerosol Properties CALIOP Rain Troposphere O 3 precursor gases, aerosols Temperature Moisture Volcanology Sea Surface Winds Evaporation H 2 O Sea Ice Ocean Biology Land Ice and Snow Cover Land Biology 3/17/2018 Ecosystem Dynamics Fire Occurrence 15 Mission & Science 04102007. ppt
Mission Operations Flight Operations, Data Capture, Initial Processing, Backup Archive Data Acquisition EOS Spacecraft Data Transport to Data Centers/ SIPSs Science Operations Science Data Processing, Data Mgmt, Interoperable Data Archive, & Distribution and Data Access Tracking & Data Relay Satellite (TDRS) Research Education White Sands Complex (WSC) EOS Data and Operations System (EDOS) Data Processing EOSDIS and Related Data Centers EOS Operations Center (EOC) Mission Control Direct Broadcast (DB) (Search, order, distribution) Value-Added Providers Interagency Data Centers Earth System Models EOS Polar Ground Stations Direct Broadcast/ Direct Readout 3/17/2018 Stations Internet NASA Integrated Services Network (NISN) Mission Services Instrument Teams and Science Investigator-led Processing System (SIPS) International Partners Decision Support Systems 16
Скачать презентацию Preservation of NASA s Earth Observation Data EOSDIS Science
1a6ad19fe5805cc77fa1bf41bd66af38.ppt