SCD Research Data for Ocean Observatories Steering Committee

SCD Research Data for Ocean Observatories Steering Committee June 18, 2001 Steven Worley Scientific Computing Division Data Support Section

Outline • Archive Basics • Data Services • Three Examples

History • Began in 1960’s – Leadership by Roy Jenne • Grown for 35+ years – Virtually NO data has been lost • Dedicated stewards and reliable MSS – User community greatly expanded • UCAR, Gov. Agencies, National and International Projects

People • 9. 2 FTE today – Manager, Admin. , and 7. 2 general staff – All staff are educated in meteorology or oceanography, MS and Bachelor degrees

Philosophy • Get the required data • Organize, check, and preserve • Provide access – diverse collection – users skills, highly variable

Archive Collection • 500+ distinct datasets • 14 Terabytes on the MSS “All sizes, shapes, and formats”

Archive Collection • Atmospheric and Oceanic in situ Observations • Atmospheric and Oceanic Remotely Sensed Observations • Operational Weather Center Analyses • Global Atmospheric Renalyses • Oceanographic Reanalyses • Atmospheric Regional Model Output • Oceanic Model Output • High Altitude Scatter Radar Data • Ancillary Datasets

How do people find out about the archive? • Online information system – 1000+ web pages and FTP server – Each dataset has a web page • • • Discovery metadata File names for MSS files Links to other relevant WWW sites Software and descriptions Some datasets have data online Some datasets have order request forms – Other resources • Catalogs, software libraries, project descriptions, etc

Unique Individuals Getting Data Service, 2000 University users from the MSS 281 NCAR users from the MSS 110 DSS + others from the MSS 39 Web/FTP access to permanently online data ? ? Customized orders, via tape or FTP 362 CD-ROMS 124 Total 916

Data Relevant to Ocean Research • WODB and WOA 1998, Levitus et al. – Other products; high res. T and S, MLD, annual temperature and heat content anomalies 1945 -1998 • SST analyses – Reynolds et al. , weekly, monthly, climatology – Hadley Centre, GISST, and HADISST • Surface Forcing, air-sea interaction – Operational weather center analyses, NCEP, ECMWF – Reanalyses, NCEP, ECMWF (forthcoming ERA) – Heat Budgets, e. g. Josey, Oberhuber, da Silva, etc • Surface Observations – COADS – Surface winds; scatterometers

Data Relevant to Ocean Research • Special Collections – – – – JGOFS sites, Nutr. , Chlor. , PP etc TOGA COARE, atmosphere and ocean Sea Ice Tropical Pacific sea surface salinity, 1969 -1998 Coastal T and S time series - MEDS and Scripps Ocean Station Vessels, (A through Z) Pacific Ocean island rainfall and global precip. characteristics form ships.

Three Service Examples • Marine Surface Observations – COADS • QSCAT winds + NCEP Analyses • Ocean model output – RSMAS MICOM

COADS • Co-developer and Co-PI with NOAA since 1980’s • Marine surface dataset, 1794 -1997 • Includes, merchant ships, WODB, TOA, Pirata, drifting buoys, etc. – (both GTS and delayed data are used) • Funded upcoming improvements – NOAA NCDC, COADS real time ASCII data – Better quality control – Collect and organize ship and buoy metadata – Higher level products, e. g. monthly wave summaries

COADS • Future data additions – Retrospective data • Russian R/V data (1937 -1990) – 6 million records • U. S. Met. Journal Collection (1879 -1893) – 1. 8 million records – Modern data • ARGO float data – GTS real time and delayed QC’ed data

COADS • Data Distribution – All products from the MSS • Absolutely up to date – SCD distributes • Binary and ASCII formats – Automatic processes prepare the subsets • 80 outside requests in 2001 – NOAA distributes • net. CDF format

Scatterometer winds • ESA ERS-1 and ERS-2 – 1991 -1998 • NASA NSCAT – 1996 -1997, 9 -months, lost in space • NASA QSCAT, Level 2 B, 25 km resolution – July 1999, continuing – Two retrieval method product lines • JPL, official NASA release • RSS (Remote Sensing Systems), KU-2000 algorithm

Data handling and product development • Collaborative effort with Co. RA – – Get and prepare the data (SCD) Product comparisons (Co. RA) Product development (Co. RA) Archive products and redistribute (SCD) • Example, wind stress curl

NCEP Operational Analysis, 01/24/2000 1800 UTC Wind stress curl, + = red, - = blue

NCEP with QSCAT overlay, Wind stress curl, + = red, - = blue

NCEP QSCAT Blend, 1998 Wind stress curl, + = red, - = blue, Chin et al.

• Statistics are good – More details: www. coloradoresearch. com/~morzel/qscat. curl. miami 2 001. html • 18 -month time series, curl, U and V – 6 hourly interval –. 5 x. 5 resolution – available to all from the MSS – time series will be extended • “We like to help promote leading edge science in this way”

Ocean Model Output • High resolution runs of RSMAS MICOM model – wind forcing, two cases; COADS and ECMWF – Access for Outside users • Annual mean fields all online, web access • Raw data via request forms and automatic offline processing – Large collections, 300 GB, and 100 GB

MICOM Ocean Data • Metadata Page – – General description Links to online data (annual mean fields) Links to Authors websites Order request forms • Automated process accesses the MSS files and create subset. – Data, software, documentation all provided via FTP download by the user.

MICOM Ocean Data “ Help scientists preserve their archives and facilitate exchange with collaborators and public in general”

Finale • Traditional access • Additional access for the future “Community Data Portal” Real time display, subsetting, analysis, and data downloads