SMOS Data Processing Ground Segment DPGS SMOS SAG

SMOS Data Processing Ground Segment (DPGS) SMOS SAG, November 2 -3, 2006

SMOS Ground Segment Function Payload planning, TC generation, and monitoring X-band acquisition and Level 0 generation Processing infrastructure: inventory, storage, data distribution, monitoring and control ESRANGE (Kiruna) SPGF, PLPC-PXMF - XBAS Analysis Tools Archiving Product Ordering via User Services PDPC-Core MMFI L 1 OP, L 2 OP, SPQC, MF Reprocessing Centre IATs Processing and monitoring CEC ESAC (Villafranca) - - MMFI SMOS SAG, November 2 -3, 2006 MMFI New

SMOS Ground Segment SMOS SAG, November 2 -3, 2006

SMOS Ground Segment Indra Espacio responsibility SMOS SAG, November 2 -3, 2006

SMOS Ground Segment Datamat responsibility SMOS SAG, November 2 -3, 2006

SMOS Ground Segment CNES responsibility SMOS SAG, November 2 -3, 2006

SMOS Ground Segment ESA responsibility Also: § Site § External network § GSOV § Operations SMOS SAG, November 2 -3, 2006

SMOS Data Flow Instrument Planner SPGF CNES Operations Telecommands PLPC SOGS Instrument plan S Band uplink Reports On-board SW updates Post-launch Support SPQC Quality Stamp X Band downlink XBAS Level 0 products PXMF Aux Data Providers Auxiliary Data PDPC Core L 1 OP Aux Data Handling SMOS Auxiliary Data Files L 2 OP ESAC Operations SMOS SAG, November 2 -3, 2006 Expert Team Products and Aux Data

SMOS Data Flow Time Critical Users Other Users Products, Reports and Aux Data via FTP ESRIN Help Desk Distribution configuration Products, Reports and Aux Data via media PDPC Core L 1 OP Products, Reports and Aux Data L 2 OP LTA Reports MF Reports IATs Products and Aux Data ESAC Operations SMOS Auxiliary Data Files Aux Data Generation Updated algorithms and/or formats SMOS SAG, November 2 -3, 2006 Expert Team Improvements identified and evolutions recommended Problems identified and corrections recommended Maintenance Team Evolution Team

Reprocessing Campaign Data Flow Time Critical Users Reprocessed Products, Reports and Aux Data via media Reprocessed Products, Reports and Aux Data via FTP Quality Stamp Reprocessed Products, Reports and Aux Data ESRIN Help Desk MMFI Distribution configuration Distribution Requests Catalogue Updates SMOS Auxiliary Data Files Reprocessed Products Aux Data Handling Reprocessing Campaign Authorisation Users Mission Manager SPQC Reports MF Expert Team Improvements identified and evolutions recommended Products and Aux Data LTA User Services Product Orders Reprocessing Centre Other Users Level 1 Processing Level 2 Processing Maintenance Team Updated algorithms and/or formats Auxiliary Data Aux Data Providers Problems identified and corrections recommended ESRANGE Operations SMOS SAG, November 2 -3, 2006 Evolution Team

SMOS High Level Schedule DPGS Aug. 05 Oct. 06 KO CDR Dec. 06 March 07 June 06 June 07 Dec. 07 DPGS V 1 Accepted MF and SPQC Accepted SPGF and PLPC LTA May 07 DPGS V 2 Accepted L 1 (V 1) and L 2 (V 1) Processors Feb. 07 KO CDR GSOV SMOS SAG, November 2 -3, 2006 Complete DPGS except: • L 1 OP = DPM of mid 2006 • L 2 OP = prototype of late -2006 • MF and SPQC = specific functionality of spring 2007 Sept. 07 OSAT • L 1 OP = DPM of spring 2007 • L 2 OP = prototype of mid-2007 • MF and SPQC = specific functionality of late 2007

ESAC Calibration Tower You are here SMOS SAG, November 2 -3, 2006

ESAC SMOS SAG, November 2 -3, 2006

ESAC North SMOS SAG, November 2 -3, 2006

ESAC Calibration Tower Future SMOS Antenna SMOS SAG, November 2 -3, 2006

Trees Street light Trees Vil-1 antenn a Calibration Tower (93. 8 degrees) Assumes removal of the TS-1 antenna. SMOS SAG, November 2 -3, 2006 Castle Vil-2 antenn a

Status ESAC Site • OPS-1 ready; subsystem installation underway; furniture for early 2007 • Network installation underway; external access at end of 2006 PLPC-PXMF/SPGF • Accepted at ESAC in October; ready for GSOV XBAS • Front end processing system from SMP very late; acceptance expected in November • Antenna ready at Indra; Demeter tracking before year’s end; acceptance at ESAC expected in February • FEP-AIT to be delivered to CASA in November for first SMOS space-toground compatibility testing • Analysis shows that for full polarisation descending (evening) passes at ESAC are not sufficient for X-band download; some ascending (morning) passes will need to be used SMOS SAG, November 2 -3, 2006

Level 1 Processor Status L 1 OP (Operational Processor) Sept. 06 Jan. 07 CDR April 07 Sept. 07 Delta. CDR V 1 V 2 V 1 cross-verification V 2 cross-verification DPM V 1 DPM V 2 TDD V 1 TDD V 2 TDS V 1 Oct. 06 Dec. 06 TDS V 2 April 07 June 07 • 8 dual processor dual core CPU machines required to meet 2. 5 NRT requirement for dual polarisation • G/J matrix software from L 1 PP reused • aux data handling in the CEC • consolidation of file formats Aug. 07 L 1 PP (Prototype Processor) • regular updates available • on-going work on calibration issues, NIR processing, … SMOS SAG, November 2 -3, 2006

Level 2 Processor Status SM ESLs SM L 2 PP SM L 2 OP and open prototype OS L 2 PP Algo validation: phase 1 July 06 KO Dec. 06 CDR Apr. 07 Algo validation: phase 2 Algo validation: phase 1 OS ESLs Nov. 07 Algo validation: phase 2 DPGS V 2 delivery LTA delivery • regular updates of prototype available • operational processor is largely re-use of the prototype • operational service from ECMWF for the end of 2006 • 8 dual processor dual core CPU machines required to meet 2. 5 NRT requirement for dual polarisation • aux data handling in the CEC • consolidation of file formats versus the prototypes SMOS SAG, November 2 -3, 2006

CEC SMOS SAG, November 2 -3, 2006

SPQC SW system that operationally controls the quality of all SMOS products and auxiliary data before they are released to their final users April 06 KO July 06 Nov. 06 FAT V 1 CDR ESA detailed specification of checks Mar. 07 FAT V 2 DPGS V 1 LTA and DPGS V 2 Example checks resulting in no wide distribution to users: • File internal consistency: size, structure, coherence • Product confidence data generated by processor is bad • Too many unrealistic values in product • Product cannot be processed to next level SMOS SAG, November 2 -3, 2006

MF SW system that 1) monitors performance of instrument, platform, and ground segment, and 2) performs automated data synthesis to help with calibration and product quality assessment ESA detailed specifications April 06 July 06 Nov. 06 Mar. 07 KO CDR FAT V 0 July 07 FAT V 1 Dec. 07 FAT V 3 FAT V 2 DPGS V 1 and LTA DPGS V 2 Example reports: • • Daily monitoring of on-board temperatures Daily monitoring of DPGS production versus planning Monitor aux data usage Monitor temporal and spatial distribution of anomalous values Continuous collection of statistics per pixel Monitoring of SMOS product values versus external sources Monitor archiving and distribution completeness SMOS SAG, November 2 -3, 2006

SMOS Data Viewer For all SMOS products and auxiliary data, the SDV 1) aids in the viewing of the contents, and 2) provides specific visualisation functions to help in the detailed analysis of the contents Mar. 06 June 06 Oct. 06 Feb. 07 KO CDR FAT V 1 FAT V 2 L 1 A, L 1 B only L 1 C, L 2 added Generic visualisation (scatter plot, temporal plot, spectrum plots, histograms) Specific visualisation: • L 1 A: Correlator matrix (I, Q, amplitude and phase) for science and calibration products • L 1 B: Visibilities in the star domain • L 1 B: Fourier transformation of BT components in the star domain June 07 FAT V 3 Specific visualisation: • L 2: TBD • L 1 C: Projection on to a map (selection of incidence angle range) The SDV V 1 version will be made available to all, along with a set of sample products, in early December. SMOS SAG, November 2 -3, 2006

SMOS Data Viewer SMOS SAG, November 2 -3, 2006

XML R/W API Test Data File Formats XML Read/Write API • XML schema (Bin. X language for binary data sets) • subsystem/system acceptance • algorithm verification/validation • documents L 0 Processor MF SPQC Aux. Data Handling L 1 Processor L 2 Open Processor Prototype A first coherent set (XML R/W API, schemas, test data) will be available to all in December up to L 1 C. Level 2 should be available by March. All of these tools will evolve with the processor developments throughout 2007. SMOS SAG, November 2 -3, 2006

Data Distribution Time Critical User Nominal User Eoli Interface (eoli. esa. int) • internet browser based ordering (L 1 B, L 1 C, L 2 user, SMOS ECMWF only) of small volumes (<50 products) • intended for users new to SMOS • subscription configuration • on-call support during working hours Data Dissemination ESAC User Services Help Desk New User • all fast processing files • time critical users via network, everyone else via media • subscriptions: time range, geographic area, ascending/descending • likely >> 10 Mbps for SMOS ESRANGE • all fast processing and reprocessing files • time critical users via network, everyone else via media • subscriptions: time range, geographic area, ascending/descending • likely >> 50 Mbps for SMOS SAG, November 2 -3, 2006

Coming Attractions ECMWF Data Assimilation Study • Prepare for the operational assimilation of SMOS data with a goal to reduce the start-up time • Provide inputs to aid in SMOS validation activities • KO by January with a 27 month duration Surface TB Processor • On-going project with CLS will deliver an ATBD for spring 2007 • This project takes the ATBD and produces an operational processor that will go in the CEC at launch and in the operational fast processing chain by the end of commissioning • Open ITT to go out in early 2007 with a KO by May SMOS SAG, November 2 -3, 2006

Coming Attractions Reprocessing Study • Current processor implementation addresses only the fast processing scenario and not a reprocessing campaign: no allowance for improved aux. data or calibration processing • Take current L 1 and L 2 DPMs and modify these to apply to the case of a reprocessing campaign • Open ITT to go out in early 2007 with a KO by May and a completion at the end of 2007 • There will be a follow-on activity to implement this DPM in the Reprocessing Centre of the LTA for the first reprocessing campaign (expected to follow shortly after the end of the commissioning phase) SMOS SAG, November 2 -3, 2006

Coming Attractions NRT Service • Decision will be made at the next PB-EO (November 23 -24) • Proposal is to acquire during each of the 10 non-ESAC orbits and deliver the data (one file per APID) to ESAC for processing using a separate NRT processing chain and then distribution to NRT users via the baseline ESAC data distribution infrastructure • Procurement will be by two open ITTs: 1) acquisition of the 10 non. ESAC orbits and delivery to ESAC, and 2) implementation of a NRT processing chain largely independent of the existing DPGS infrastructure • Not the optimal solution financially or technically but meets all the political constraints for acceptance SMOS SAG, November 2 -3, 2006

Summary • It is subsystem acceptance and integration season and this will likely continue for the next four-six months • The Fast Processing and LTA developments are both experiencing delays but this is no longer launch critical; a decision will have to be made in summer regarding which system is more likely to be ready and stable at launch • Level 2 operational processor non-start is the biggest fire today • CEC is starting to take shape; although granted it is yet to be visible outside ESA • By next SAG there should be more to show you then these slides and some empty offices at ESAC SMOS SAG, November 2 -3, 2006