DIDBase Intelligent Interactive Archiving Technology for Ionogram Data

DIDBase: Intelligent, Interactive Archiving Technology for Ionogram Data B. W. Reinisch, G. Khmyrov, I. A. Galkin, and A. Kozlov Environmental, Earth, and Atmospheric Sciences Department, Center for Atmospheric Research, University of Massachusetts Lowell, USA

Our choice • RDBMS Server - Firebird (Interbase) • JDBC - Database Client • Language – Java – Applications – Applets – Servlets • Application Server - Tomcat

Ionogram processing software • DIDBase (ionograms, scaling data, ionospheric characteristics) • Ionogram software suite – SAO Explorer – DIDB Fill, Smart Backup – DIDB Request Processor (Cal. Val project) – Analyze Scaling Quality – Representative Ionospheric Characteristics – Visualization programs: Ion 2 Png, Drg 2 Png, Drg. Maker

Data Management Automation • • DIDBase data ingestion ADRES Smart Backup Database backup Extended data quality analysis • Bad data • Incomplete data • Future data

ADRES Digisondes ADRES Online archives Automated Data Request Execution System Requests Offline archive s DIDBase at UMLCAR DIDB Fill (REQ files) DIDBase Request Processor Reports (SAO files) USER Save scaled data SAO Explorer Query only data for requests

Ion 2 Png thumbnail mode

WEB-interface http: //car. uml. edu/DIDBase

Station list

Inventory for Station

Calendar list

One day

Ionogram example

Login Step 1 Step 3 Step 2

Manual scaling • Total manually scaled data – 144297 (more than 4 years of 15 min data)

DMSP F 16 weather satellite • DMSP (Defense Meteorological Satellite Program ) F 16 weather satellite was launched 18 October 2003 • Orbital parameters are period 101. 9 min , apogee 853 km, perigee 843 km, and inclination 98. 9°. • Two optical instruments onboard: – SSULI - limb scanning ultraviolet imager / spectrometer (built by the Naval Research Laboratory) – SSUSI - nadir scanning ultraviolet imager /spectrometer and photometer (built by the Applied Physics Laboratory at Johns Hopkins University)

Cal. Val campaign • SSULI and SSUSI sensors make measurements of far and extreme ultraviolet airglow, which are converted into electron and neutral density profiles by ground processing software. • Measurement calibrated and validated with ground truth – Digisondes – Incoherent Scatter Radars (ISR) – F 16 SSJ 5 Particle Detector Data for auroral measurements

Digisonde network • 50 Digisondes in the network • 27 Digisondes are participating in Cal. Val campaign • Products: – Ionospheric characteristics (fo. F 2, fo. E, hm. F 2, …) – Regular profiles – Auroral profiles

Cal. Val Requests • Nominally 4 requests per Station per Day when overpass happen for limb and surface measurements on ascending and descending part of orbit • Each Request has one hour time interval (± 30 min from overpass time) • Cal. Val is planned for period from Dec 15 2002 to Mar 2005 • Some “dry run” data for 2001

Statistics Request status Total requests Request data loaded to DIDBase Manually scaled and reported requests 12230 10826 10027 Manually scaled and reported ionograms Total, as of Oct 2004 50598

Interactive Ionogram Processing • Ionogram Data Visualization – ionogram display with zoom-in and details-on-demand – ionogram surveys (using “thumbnails”) – ionogram movies • Interactive Ionogram Scaling • Profile Inversion • Time series of Scaled Data – – Ionospheric characteristics Plasma density contour/profilogram Directogram Text tables for ASCII export

Data Formats Supported • Ionograms – – – MMM BEM SBF RSF-flex PGH RSF • Scalings – SAO 3. 0 - 4. 3 – ART – ADP binary

Welcome to SAO-X Profilogram Ionogram Editor Char Table Ionogram surveys Directogram Characteristics Plot Contours

Main screen Scaler (DIDB only) List of records Ionospheric characteristics set. Drag and drop to change order.

Ionogram frame Mode controls Acton buttons Context menu (mouse right button) Details on mouse position

Database connection • Read-only connection to DIDB over the Internet • Remembers last connection information

Database queries • List of available data with the station name and the start/end times • DIDB inventory available • Use of ionospheric characteristics as search criteria • Query only manual data • By default, the queries bring the data of the highest available quality Manually scaled Select measurements with auroral layer

Inventory tree (DIDB only) • Simple navigation • Easy to check what is stored in DIDB • Comprehensive information about data • “One click” to set station/date in the Query dialog

DIDB write access • Scaler password protected login • Submit current record • Auto submit option

SAO-X homepage

Installation Install. Anywhere: commercial strength installers for various platforms. Windows, Solaris: installers with Java VM included. Others: JVM has to be installed first. http: //car. uml. edu/Installation/SAO-X_3/install. htm

Digisonde and Internet • Web Publishing (via homepage) – Latest displays – Retro displays – SAO archive • Dissemination (by FTP deliveries) – Near real-time – Works from behind a firewall

1995 1996 1997 1998 Digisonde Homepage

Digisonde Homepage (2) 1999 2001 2000 2002

Digisonde Homepage (3) 2003 - 2004

2004 Digisonde Homepage

Digisonde Data Tree Raw Ionograms Housekeeping BIT, ERR DIGISONDE MMM, BEM, PGH, SBF, RSF 16 channel D-256 DRG: Directograms SAO: Scaled data DFT: Raw Drift Ionogram displays Time Series Contours Profilograms DVL: Velocities SKY: Skymaps TLT: Tilt MUF Old Formats ION, IHT, IOS, TEC, ADP, ART online pictures

References • UMLCAR home page http: //ulcar. uml. edu • Digisonde home page http: //ulcar. uml. edu/digisonde. html • SAOExplorer home page http: //ulcar. uml. edu/SAO-X. html • DIDBase home page http: //ulcar. uml. edu/DIDBase/

Publications • Reinisch, B. W. , I. A. Galkin, G. Khmyrov, A. Kozlov, and D. F. Kitrosser, Automated collection and dissemination of ionospheric data from the digisonde network, Adv. Radio Sci. (2004), 2: 241 -247.