GIFS-TIGGE Working Group Autumn 2005 IPO update David

GIFS-TIGGE Working Group Autumn 2005 IPO update David Burridge Manager IPO

Ø Science Plan peer-reviewed; Ø Implementation Plan 2004 -2015 approved; Ø Approved annual expenditure $ 1. 2 M through a trust fund; Ø First Symposium (Montreal, 2004) Ø Regional Committees - RAII, IV, VI Ø First TIGGE workshop (report issued) Ø Three TIGGE data Centres - phase 1 developments at CMA, ECMWF & NCAR 2

THORPEX within the WMO structure 3

ØBoards, working groups and key groups and meetings (continued) Ø The EB met in Geneva in September 2005 Ø MEDEX (4 October 2005) Ø GEOSS (links developed and support for THORPEX included in plans Ø The GIFS-TIGGE WG is meeting in Boulder on 15 & 16 November 2005 Ø A technical plan for the first phase of the TIGGE data bases is under development and will be discussed at the Boulder meeting Ø Southern Hemisphere Planning Meeting in Melbourne (late November 2005) Ø ICSC 5 meeting in Melbourne (November/December 2005) Ø SEA WG 1 – January 2006 Ø There will be a THORPEX/WCRP meeting on the MJO, organised by Julia Slingo, Mel Shapiro and the PDP WG which will be held at ICTP (Trieste – 13 -17 March 2006). Ø There will a “kick off” workshop for all working groups which will be held in the University of Reading (20 -22 March 2006; this will be followed by meetings of the SAB and the TAB (23 -24 March 2006). 7

THORPEX Interactive Grand Global Ensemble (TIGGE) Ø Framework for international collaboration in development and testing of ensemble prediction systems Ø Resource for THORPEX research projects Ø Component of THORPEX Forecast Demonstration Projects (FDPs) Ø A prototype future Global Interactive Forecast System Ø Initially develop database of available ensembles, collected in near-real time Ø Co-ordinate research using this multi-model ensemble data, including interactive aspects 8

THORPEX Regional Campaigns Ø ATRe. C (2003) - many groups are actively working with the data – a summary of current views will be available for the ICSC meeting in Melbourne Ø European ETre. C – D-Phase (MAP), COPS supported by the European regional committee Ø Stronger links are being developed with AMMA for observing system experiments, modelling & predictability and societal and economic applications Ø Links with TWP – ICE are being investigated Ø Pacific Asian Regional Campaign (PARC 2008) – on tropical cyclone tracks, extra-tropical transitions, tropical warm-pool physics and down-stream propagation (link to, Beijing Olympics & IPY) Ø Winter Olympics (2010) Ø Tropical convection (2012) 9

TIGGE Implementation Meeting Report ECMWF 9 -10 November 2005 Slide 19 ECMWF

List of products: single level Parameter Level Unit Output frequency Comment Mean sea level pressure MSL Pa 6 h instantaneous Surface Pressure surface Pa 6 h inst 10 m U-velocity 10 m m s**-1 6 h inst 10 m V-velocity 10 m m s**-1 6 h inst 2 m temperature 2 m K 6 h inst 2 m dew point temperature 2 m K 6 h inst 2 m max temperature 2 m K 6 h 6_h 2 m min temperature 2 m K 6 h 6_h Total precipitation (liquid + frozen) surface m 6 h acc_st Snow fall surface m of water equivalent 6 h acc_st Snow depth surface m of water equivalent 6 h inst 6_h: accumulated over previous 6 hours acc_st: accumulated from start of forecast 9 -10 November 2005 Slide 24 ECMWF

List of products: single level fields Parameter Level Unit Output frequency Comment Total cloud cover surface 0 -100% 6 h instantaneous Total column water surface kg m**-2 6 h inst Surface latent heat flux surface W m**-2 s 6 h acc_st Surface sensible heat flux surface W m**-2 s 6 h acc_st Surface solar radiation surface W m**-2 s 6 h acc_st Surface thermal radiation surface W m**-2 s 6 h acc_st Sunshine duration surface s 6 h acc_st Convective available potential energy surface J kg**-1 6 h inst Orography (Geopotential height at the surface) surface m inst Land-sea mask surface 0 -1 inst acc_st: accumulated from start of forecast Orography and Land-sea mask to be provided for the Control for each output step 9 -10 November 2005 Slide 25 ECMWF

List of products: upper air fields Parameter Unit Output frequency Comments Temperature K 6 h instantaneou s Geopotential height m 6 h inst U-velocity m s**-1 6 h inst V-velocity m s**-1 6 h inst Specific Humidity kg kg**-1 6 h inst 5 parameters on 9 pressure levels, i. e. 45 fields. The 9 levels are 1000, 925, 850, 700, 600, 500, 300, 250 and 200 h. Pa. 9 -10 November 2005 Slide 26 ECMWF

TIGGE Phase 1 – A summary 3 Archive Centres CMA, NCAR, ECMWF 8 Data providers (? ) NCEP, ECMWF, UKMO, JMA, BMRC, CPTEC, KMA, MSC Each Archive Centre will receive data from all the Data Providers In near realtime Users will be able to get the same data from any of the Archive Centres No extra resources! Use existing infrastructure 9 -10 November 2005 ECMWF

9 -10 November 2005 ECMWF

Definition of a core dataset A field is uniquely identified within the TIGGE dataset by the following tuple: (base date, base time, time step, origin centre, ensemble number, level, parameter) When using fields to create a “grand ensemble”, i. e. when considering all members from several origin centres as a super ensemble, we must make sure that they share the same values for the tuple: (base date, base time, time step, level, parameter) Therefore, a core dataset must be defined in terms of these attributes All Data Providers must adhere to the core dataset definition. 9 -10 November 2005 ECMWF

Network Bandwidth Is a major risk Bilateral connections need testing Between Archive Centres Data Provider to Archive Centres Requires a lot of tuning/tweaking Get vs. put Number of parallel streams Buffer sizes TCP window sizes Target aggregate bandwidth: 100 GB per 12 hours Gives a chance to resend everything on the same day 9 -10 November 2005 ECMWF

9 -10 November 2005 ECMWF

9 -10 November 2005 ECMWF

WMO file naming convention Files to be exchanged must follow the WMO naming convention: Z_TIGGE_C_CCCC_yyyy. MMddhhmmss_SSSS_LL_VVVV. bin[. compressi on] where: CCCC Originator yyyy. MMdd base date of the run hhmmss base time of the run (UTC) SSSS forecast time-step in hours (0006, …) VVVV version (0001 for operational) LL type of level, (sl: single level, …) compression optional (e. g. . gz for gzip) 9 -10 November 2005 ECMWF

WMO file naming convention Example: time-step 24 from NCEP for the run of 1 st September 2005 12 Z operational version, single level parameters, all ensemble members, including the control, No compression Z_TIGGE_C_KWBC_20050901120000_0024_sl_0001. bin 9 -10 November 2005 ECMWF

File structure Files will be exclusively GRIB messages. No record padding. No supplementary headers or trailers. Non-compliant files will not be accepted by the Archive Centres. It is acknowledged that will add development work at each centre, but: Will make data management tractable at the Archive Centres Will be beneficial to the users. 9 -10 November 2005 ECMWF

Metadata and naming conventions Used to create of a homogenous catalogue user data discovery Used to specify retrieval requests. Most of the Data Providers have their own ways to name variables, use different abbreviation and GRIB code tables. The TIGGE partners will have to agree on a common vocabulary of terms. Use existing names defined by WMO See work done by the group that created the Climate and Forecast (CF) metadata convention 9 -10 November 2005 ECMWF

User access : Registration The TIGGE dataset is available to the research community A “registration authority” must be set up that should verify each registration request and establish if they are linked to a genuine research activity Access to valid data is not permitted apart from specific field experiments. “Valid data” is defined as: base date + base time + time step + 24 hours >= now 9 -10 November 2005 ECMWF

Data retrieval ECMWF will utilise the MARS system NCAR will build upon its Research Data Archive and Community Data Portal. CMA is still in the development process of their data delivery system. Over time and with additional project support, it is expected that there will be opportunities to further unify the user interface by leveraging developments from the WMO Information System (WIS) effort. 9 -10 November 2005 ECMWF

Data retrieval : field order Fields will be returned to the users in the following order: (outer loop) Date Time Step Origin Ensemble member Level (for multi-level variables) Parameter (inner loop) This allows users to process fields from different origins as if they were members of the same ensemble 9 -10 November 2005 ECMWF

Data retrieval Archive Centres will prioritize and limit requests according to size. Because users’ requests will generate high data volumes, This will make sure that no user can monopolise the system by submitting an unreasonable request. Very large requests may require delivery by tape media. 9 -10 November 2005 ECMWF

Implementation plan : GRIB 2 ECMWF will consult with NCEP and WMO in order to make sure we agree on the proper encoding of the fields in GRIB 2. ECMWF will provide a sample model output to the Data Providers. ECMWF will provide a series of example programs to create these files. These tools may have to be adapted by Data Providers in order to handle their own data and metadata mapping. 9 -10 November 2005 ECMWF