The i Ntegrated Space Weather Analysis System Barbara

The i. Ntegrated Space Weather Analysis System Barbara J. Thompson NASA Goddard Space Flight Center i. SWA Team: Marlo Maddox (PI), M. M. Maddox, D. H. Berrios, M. Hesse, M. M. Kuznetsova, P. Jain, P. J. Mac. Neice, M. L. Mays, R. E. Mullinix, A. Pulkkinen, L. Rastaetter, A. Taktakishvili http: //SWL. gsfc. nasa. gov http: //i. SWA. gsfc. nasa. gov http: //CCMC. gsfc. nasa. gov http: //twitter. com/NASAi. SWA

NASA Mission Data Energetic Proton Warning Non-NASA Commercial Mission Data Spacecraft Charging Forecast University / Educational Institution Data Martian Communica. Atmospheric tion Heating Outages International Data Energetic Particle Forecasts

Distributed Space Weather Resources CCMC Space Weather Model Resources Internet i. SWA Data Sorter Data/Tool Registry Tool Service Product Registry Widget Agent Cygnet Registry FRONT END Information Retrieval Robot Data Registry BACK END Resource Registry Configurable Web-Based Dissemination Service Internet IRR >40 K files per day • Routinely ingest and receive external data streams. DS • Automatically • Data is registered in configures / re-configures via a resource registry database, TS time-tagged, database sorted, categorized, and archived in a data • New data products are tree created using raw data WA and combinations of existing data products • Data products are registered and packaged for display in i. SWA system CWDS • i. SWA System Interface provides a highly configurable control panel to present operators with only the products and tools of interest User Configurable Displays • 335 Unique Data Feeds, 18. 5 Million Files Registered and Archived, 250 Consumable Display Products currently managed in i. SWA Cygnet Catalog

i. SWA Design Highlights BACK END • • • Access data products for any available time period Generate new tools and functionality using multiple existing data products Consistent Interface with uniquely identifiable product icons Customizable layout • • Minimizes need for actual code modifications Allows rapid additions and modifications to data feeds and display products Every granule of data is registered, cataloged, and archived • • FRONT END Comprehensive data model that drives the system automatically saved on browser exit can be bookmarked and shared Auto-updating products and tools Individual and global date search functionality for historical impact analysis Movie mode functionality for all image-based cygnets Tools to facilitate tracking and monitoring of SWx events

Layout & Global Controls Cygnet Control Panel Cygnet Date Controls Options Movie Mode Control

Cygnets: The Building Blocks of i. SWA Solar

Cygnets: The Building Blocks of i. SWA HEl. Io. SPHEr. E

Cygnets: The Building Blocks of i. SWA Ma. GNETo. SPHEr. E

Cygnets: The Building Blocks of i. SWA Io. No. SPHEr. E

Cygnets: The Building Blocks of i. SWA EVENT Tra. CKING

Interactive Products Interactive CME alert tool with chronological record of SWx Desk issued CME time of arrival predictions Interactive timeline tool with pan, zoom, mouseover, and quantity toggling functionality

Other tools: Widgets and Apps CCMC Widget System Requirements Dashboard: Mac OSX 10. 4 or later Yahoo Widget: Yahoo's Widget Engine 4. 5 or later

i. Phone App Google Earth SWx Service

Cygnet Streamer API

Summary / Future SWL, CCMC, & SWx Desk aim to advance space weather specification and forecasting capabilities… ü Implement new 1 D time-series database and interactive timeline capabilities in i. SWA ü Develop a Movie/Animation Mode for All Cygnets o Provide data export options directly from timeline cygnets o More data products: SDO/EVE, far-side imagery o More Alerts: flares, feature identification systems o Continue to: o develop custom/tailored tools based on customer feedback o bring in the most advanced models and data streams http: //i. SWA. gsfc. nasa. gov

i. SWA Impact NASA • i. SWA provides a new capability to quickly assess past, present, and expected space weather effects. • • Mission operators have a resource to assist in both anomaly resolution as well as potential space weather impacts. i. SWA has helped enable the Space Weather Laboratory to establish a new Space Weather Desk service providing alerts, anomaly reports, and weekly space weather summaries based on i. SWA tools and products. External Agencies • • Air Force Space Weather Agency can monitor the i. SWA system 24 x 7 for CME eruptions and notifies the CCMC as soon as an event is detected. A notification triggers a CME Cone Model calculation at CCMC that estimates the CME arrival time, duration, and expected impact on earth. i. SWA has enabled numerous collaborations with data, model, and product developers/providers who want their tools to be available in i. SWA. Science, Education, and Public Outreach • Researchers, universities, and “citizen scientists” have access to a comprehensive suite of real-time and historical space environment data products. http: //i. SWA. gsfc. nasa. gov

• Backup Slides

The i. Ntegrated Space Weather Analysis System Marlo Maddox 674 / Space Weather Laboratory 587 / Science Data Processing Branch Heliophysics Director’s Seminar May 20, 2011 http: //SWL. gsfc. nasa. gov http: //CCMC. gsfc. nasa. gov http: //i. SWA. gsfc. nasa. gov http: //twitter. com/NASAi. SWA NASA Goddard Space Flight Center

Community Coordinated Modeling Center Products & Services What the CCMC provides: • • • Model Coupling in collaboration with model owners Scientific Validation of Models Metrics implementations Model Runs on Request Real-Time Products Anchor for SWx Desk Services at GSFC ( Issue Alerts, Warnings, & Anomaly Reports ) SWx Support - develop tailored space weather analysis tools in support of NASA missions, Operations, and Forecasters Data Format Standardization Advanced Visualization

Model Simulation Runs-On. Request http: //ccmc. gsfc. nasa. gov CCMC Center at NASA Requests Results Super Computing Clusters ( 800 CPU’s ) CCMC 427 Terra-Bytes of Data Storage • • Dedicated Workstations 25+ Available Models ( covering from the Sun to Earth ) User Configurable Input Parameters Data Downloads Simulation Archive Searchable Database Online Visualization Tools Downloadable Analysis Software Automated Movie Generation Tools Online Analysis Tools

About The CCMC “A US multi-agency partnership to enable, support and perform the research and development for next generation space science and space weather models. ”

CCMC Goals CCMC Facilitate Community Research Address National Space Weather Needs NASA, Do. D and NOAA . . through partnering with the international community

High Availability Architectures • IP failover • Load Balancing proxy/virtual proxy front end servers • Database Replication • Data Tree Replication/Mirroring • Multi-site ( multi-building in our case ) backups systems • Redundant Storage Fabrics • Network Failover with Dual Homing

Runs-On-Request vs. Real-Time Processing CCMC Center at NASA Super Computing Clusters ( 800 CPU’s ) es qu ts Dedicated Workstations CCMC Re s ult s Re http: //ccmc. gsfc. nasa. gov 427 Terra-Bytes of Data Storage AUTOMATED RT PROCESSES http: //iswa. ccmc. gsfc. nasa. gov

Space Weather Models at the CCMC CMIT-LFM GUMICS UPOS RB BATSRUS PFSS Open GGCM LFM-MIX ANMHD Exospheric Solar Fok RC/RB Wind WSA PF+CS/WSA-IH Weimer 2 K Heliospheric SAMI 2 USU-GAIM Tomography CTIP Abby. Normal ENLIL MAS/CORHEL MAS/WSA/ENLIL EMMREM TIE-GCM SWMF SC/IH/BATSRUS+RCM/GITM http: //ccmc. gsfc. nasa. gov/models/ WINDMI

i. SWA Project Overview OCE Technical Excellence Initiative Project • • Partnership between NASA HQ OCE, SWL, CCMC, & AETD Address technical challenges in acquiring space weather environment information Began March 2008 Version 1. 0 deployed November 2009 Fundamental Challenges To Be Addressed • • Existing space weather resources are diverse and scattered Data accessibility Accurate real time now-casting & forecasting of the space environment Historical space weather impact analysis Initial Requirements Gathering • GSFC SSMO, JSFC SRAG

i. SWA Solution & Deliverables 1. Acquire, ingest, and produce relevant space weather information 2. Utilize both observational and simulation/model data 3. Categorize and archive data for historical impact analysis 4. Produce and provide real-time data streams 5. Provide customizable and highly configurable displays 6. Disseminate through the most widely deployed and accessible interface – the web

Data Management Challenges • Ingesting data streams from a variety of sources with varying: • • • Transfer Methods ( push and pull ) Levels of availability Access Protocols ( http, ftp, scp, mv ) Naming Conventions Update Intervals ( efficient polling for new data ) Date & Time Stamp Formats i. e. [ 2011 -01 -01_212500 ] or [ 2011 -1 -1_212500 ] or [ 20100101_212500 ] or [ 2011_001_212500 ] or [ 2010_Jan_01_212500 ] or [ latest ] or… • Sorting, Archiving, and Management • Persistent storage ( file system or database ) • Cataloging, How to keep track of what is where • Scalability, Additional storage • Changes ( urls, names, formats, extensions, etc. )