WIS Services Software A New Global

WIS Services & Software – A New Global Infrastructure for Meteorology Chris Little, Met Office, Co-chair OGC Met. & Oceanography Domain WG © Crown copyright Met Office

Why me? • Member of VGISC ITT Drafting & Project Teams • (current and previous) • WMO Regional Association VI Co-Rapporteur for Information Systems & Services • (with Leonid Bezruk, Russia) • WMO Focal Point for RTH Exeter & GISC Exeter • Been around a long time • (I am partly to blame for GRIB, BUFR & CREX)

Contents • WIS Background • WIS Progress • Immediate Future • Questions and Answers © Crown copyright Met Office

WIS Background © Crown copyright Met Office

Global Telecommunication System Global Telecommunications System (GTS) – Managed by WMO - World Meteorological Organization Use to exchange – Observations – Forecasts – Warnings Private Network – Node to Node network – NOT an Internet – ‘Store and Forward’ – Resilient and inflexible © Crown copyright Met Office

Oslo Reykjavik 32 48 48 64 ECMWF FR 256 (CIR: 64) 128/64 16 Toulouse 32/64 16 32 8 64/8 9. 6 Belgrad e 8/32 9. 6 16 Rome 9. 6 0. 05 Algiers Nairobi RMDCN Committed Information Rate Athens Tripoli 0. 1 N/O Ankara Larnaca 8 2. 4 Tunis NI N/O 8 0. 05 64 Baku NI 64/8 0. 05 N/O Yerevan Sofia 8/16 Tirana Malta 64 Interregional circuit 9. 6 Tbilisi Zagreb 9. 6 2. 4 MTN circuit Regional circuit Cairo Bucharest 9. 6 NI 9. 6 0. 2 19. 2 NI Budapest Nairobi 64 RTH Centre in other region Ljubljan a 32/8 Hanoi Tehran Kishenev 16/8 Skopje 128 Dakar NI Jeddah 0. 05 NMC 64 48/16 Almaty 0. 1 Bratislava 64/8 16/8 Madrid Casablanca 64 Minsk 16/8 Tashkent Kiev Vienna 64 Novosibirsk 19. 2 Prague Zurich Melbourne Vilnius Warsa w 64 32/96 64 19. 2 16/8 8/16 256/128 64 Lisbon 32 Offenbach Brussel s Moscow Riga 16/64 16 Washington 16/8 Khabarovsk 7. 2 -28. 8 Beijing De. Bilt Exeter 8 Tallinn 24/8 Norrköping 64 8 Dublin 9. 6 Copenhagen 16 24 64 64 Beijing NI Helsinki 16 32 New Delhi 64/8 Sondre Stormfjord Beirut 16 Bet Dagan NI Damascus 16/8 * The RMDCN circuit Helsinki - Tallinn is not yet in the RTMN plan, but replaces the former GTS connection of Tallinn Regional Meteorological Telecommunication Network for Region VI (Europe) Figure 1 - point-to-point circuits implementation (transmission speed in kilobit/s) Amman NI XII. . 2004

Global Telecoms System • It works! • Developed in early 1960 s • National, regional & international exchange • Terrestrial & satellite links • Mainly point-to-point circuits, also Multi-point circuits • X. 25, IP & asynchronous links, Mixture of speeds • Relatively expensive, legacy technologies • Secure Extranet: limited use of Internet • No overall system manager • Store & Forward • No explicit addressing, based on distributed routeing directories • Very robust, loosely coupled • Very slow to change, ad hoc development • Not used much for non-operational WMO data

WMO Background Problem GTS stop Universities stop Regional/Specialized Meteorological Centres WMO World Data Centres stop National Meteorological Centres Meteorological and R&D Satellite Operator Centres World Meteorological Centres stop Commercial Service Providers stop 5 GAW World Data Centres GCOS Data Centres Global Run-off Data Centre Climate research institutes International Organizations (IAEA, CTBTO, UNEP, FAO. . ) Regional Climate Centres

WIS Background CBS-Ext (2002) Cairns: Recommended (F)WIS Congress Cg-XIV (2003) – Multiplicity of systems of different Programmes causes incompatibilities, inefficiencies, duplication of efforts and higher overall costs. – Congress approves the concept of the future WMO Information System (FWIS), to provide a single coordinated global infrastructure for the collection and sharing of information in support of all WMO and related international programmes. Executive Council EC-LVII (2005) – Renamed FWIS to WIS – Accelerated the development and implementation of WIS – Evolution not revolution, but faster than usual WMO

Why move to WIS • Technology is changing ever faster • Redress the balance between: – Leading edge – expensive, difficult problems – Mainstream – tried, tested & trusted – Trailing edge – obsolete is expensive • Long history of tailoring technology: – – Operating systems Programming languages Telecoms protocols Data formats • WMO should have very few specific technologies: – Observing and Q/A procedures, – Controlled vocabularies and lists – Visualization/presentation styles for meteorologists • Customers want to use their own technologies!

WIS Progress © Crown copyright Met Office

Demo links: GISCs, DCPCs UK Met Office user portal http: //wis. metoffice. gov. uk/openwis-user-portal/srv/en/main. home Search and find, then self registration for delivery Météo-France user portal http: //wisp. meteo. fr: 8080/openwis-user-portal/srv/en/main. home DWD Deutscher Wetter Dienst http: //gisc. dwd. de CMA China Meteorological Administration 中国气象局 http: //wisportal. cma. gov. cn/wis/ JMA Japan Meteorological Agency 気象庁 http: //www. wis-jma. go. jp/cms/ EUMETSAT EO Portal http: //www. eumetsat. int/Home/Main/Data. Products/Product. Navigator/index. htm Norway IPY http: //arcticdata. met. no/ © Crown copyright Met Office

WIS Services • GISCs & DCPCs have searchable catalogues of all data & products • DCPCs offer a variety of services and retrievals for data & products • GISCs have 24 hour Cache of operational WWW data & products • NCs create catalogue records for their data • GTS and Internet

WIS Technologies - 1 Global Catalogue • Metadata: ISO 19115 + 19139 – WMO Profile 1. 2 (1. 3 agreed 2012 -09) – Services could be ISO 19119 • • • Search with ISO 23950 + SRU 1. 3 (+ CSW? ) Harvesting: OAI-PMH Prototype: Geonetwork Catalogue access for all Default access policy, others supported • No more than 24 hours out of date © Crown copyright Met Office

WIS Technologies - 2 Subscriptions • Subscriptions & ad-hoc retrievals for authenticated and authorised users including self registered (Interoperability not agreed) • Open. WIS uses Open. AM/SAML 2 security (Interoperability not agreed) • Backup between GISCs and between GISC and its NCs (Interoperability not agreed) (OGC Pub. Sub? ) © Crown copyright Met Office

WIS Technologies - 3 Cache • 24 hours worth of all ‘Essential’, critical, data • Cache to Cache direct replication (Interoperability not agreed) (Bit. Torrent? ftp? ) • Stringent global performance standards (2 min latency end-to-end maximum for Warnings)

WIS Interoperability Standards WMO Data Formats WMO Telecoms protocols + WMO Extranet + ‘Push’ WMO processes WMO Data Formats WMO Extranet + Internet Global Catalogues synchronized around the world – ISO 19115+ISO 19139+WMO profile V 1. 2 +ISO 19119 – ISO 23950+SRU 1. 3 – OAI-PMH Global Cache replicated around the world ‘Push & Pull’ Dissemination Ad Hoc & Subscription

Immediate Future © Crown copyright Met Office

Future RA-VI/European Telecoms ECMWF planned, Council approved 2011 -12 Issued ITT in 2012 Decision on winning vendor ratified next month Migrate RMDCN 2013 Technology probably: MPLS, managed, any-to-any Options: – ‘Like for like’ one ‘physical’ network – Separate AMDCN and MTN – IP 6, Multicast? Built in ‘Cloud’? ? More members: CMC, SAWS, INMET, rest of RA-VI? Impact of WIS traffic © Crown copyright Met Office

Future WMO Telecoms More Regional/Areal Managed networks – GISCs have responsibility Remove old technologies (X. 25, Frame Relay) Migrate from point-to-point links Maintain safety critical aspects Migrate away from Message Switches? ? Underpins much wider variety of traffic and services

WMO Financial Period XVI (2012 -2015) Expected Result 4 FULL IMPLEMENTATION OF THE WMO INFORMATION SYSTEM as a priority area of activity necessary to support other priority initiatives of WMO Strategic Thrust 1: Science and Technology Development and Implementation

Questions & Answers © Crown copyright Met Office

Spare slides, to be used only if required © Crown copyright Met Office

WMO Future activities Lots of WMO Technical work: – Agree cache replication mechanism (Open. WIS proposes Bit Torrent over RMDCN) – Tighten WMO Core ISO 19115 Metadata interoperability – “Business as Usual” operating procedures with CMA, JMA, … Back-up between UK & France Open. WIS and DWD IBL Improve connectivity of GTS/RMDCN/MTN (ITT in 2012/13) Rollout: – more countries in RA-VI and MTN WMO ET work – metadata, registries Open source release of Open. WIS, community building VCP and project activities (e. g. Algeria, …, Zambia) © Crown copyright Met Office

WIS Summary • WIS defined in outline in 2000: – – GISCs, DCPC, NCs 6 -10 Global Information System Centres >> 20 Data Collection & Production Centres > 189 National Centres (not just NMHSs) • Pilot projects explore technologies & concepts • Build on GTS and Internet – GTS changed in Europe, changing elsewhere – MTN changed, and changing • Evolution not revolution, but faster than usual WMO – Project and results orientated • First operational systems in 2011 – UKMO using Open. WIS for v. GISC, DCPC, NC functions

Other Stuff • WOW: Met Office ‘Crowd sourcing’ of weather obs http: //www. metoffice. gov. uk/climate/uk/wow. html – Met Office stores and shares, and Quality Controls – No OGC standards, only WMO data formats • EGOWS European Meteorological Graphical Operational Workstations meeting two weeks ago in Toulouse http: //www. knmi. nl/samenw/egows/ and http: //www. meteo. fr/cic/meetings/2011/EGOWS/ – Informal (non-OGC) Interoperability Experiment with WMS – A variety of Servers and Clients – No feedback from Marie-Françoise Voidrot and others yet – Main issue is “non-responses” from servers rather than errors © Crown copyright Met Office

New WMO Profile ISO 19115 • Version 1. 2 -> 1. 3 • Preparing for ISO 19115: 2015 • ISO 8601: 2000 strict: – No End Date = ‘now’ – End Date+update frequency+maintenance=active • Tweaks to legal and usage constraints • Two versions allowed: current + last

Improved Main Telecommunication Network (IMTN) New Delhi RA VI Prague Jeddah Sofia RA II Tokyo Beijing Moscow Washington Exeter MTN cloud Offenbach RA IV Toulouse Brasilia Buenos Aires RA III Cairo Dakar Nairobi © Crown copyright Met Office RA I Algiers Melbourne RA V