EURO-VO DCA GRID and the VO Lofar Information

EURO-VO DCA GRID and the VO Lofar Information System Design Omega. CEN Kapteyn Institute TARGET- Computing Center University Groningen Garching, 10 April 2008 Edwin A. Valentijn EURO-VO: GRID and VO

LOFAR @ (20 -)30 -80 MHz and 120 -240 MHz - Eo. R - transients - Survey EURO-VO: GRID and VO - astroparticles

EURO-VO: GRID and VO

E-Lofar: from experiment to observatory EURO-VO: GRID and VO

LOFAR in short • Large distributed radio telescope – In NL 2008: initial roll out 20 stations – In NL 2009: 18 central (24 Gbps) + 18 remote (2 Gbps) phased array antenna stations each ~4 soccerfields size – Full scale aperture synthesis array, extends 100 km • Two main bands – High Band ~ 7, 500 tiles 120 – 240 MHz – Low Band ~ 7, 500 dipoles 20 – 80 MHz • Digital Radio 40 MHz processing bandwidth – Extreme tunability in time/space/frequency – Large instantaneous sky coverage • Fibre network, Software Correlator • Run as a broad common-user observatory – Making the transition now from “project” to “observatory” EURO-VO: GRID and VO

E-LOFAR Participants GLOW: -- Effelsberg station delivered -- Garching, Potsdam, Tautenburg stations ordered --Jülich station federal funding proposal submitted • LOFAR-UK: – Chilbolton, Cambridge, Jodrell, Edinburgh – 1 station funded, site to be chosen --3 more stations • Sweden: – Onsala station funded • • + Poland, Italy, Austria, Bulgaria, Ireland, France EURO-VO: GRID and VO

Wires in the field EURO-VO: GRID and VO

Station based processing Input data rate: ~ 460 Gbps Output data rate: ~ 2 Gbps Processing capacity: ~ 1. 5 Tmul/s Storage capacity: 96 Gbyte –Used for 1 beam & station cross correlation –Beamformer –Buffer – 10 Gb. E –Buffer – 1 Gb. E –Beamformer –Filter –Receiver EURO-VO: GRID and VO

Lofar: Data Stream EURO-VO: GRID and VO

Lofar Storage EURO-VO: GRID and VO

Lofar Long term (>2 weeks) archive and user enabling ADD EURO-VO: GRID and VO

STREAM of Meta. Data • Design: data driven vs. compute driven • from the field to central processor • Distributed – p 2 p / federated – Communities – Dataservers – own + EGEE GRID – Compute servers – own+ EGEE GRID • Astro. WISE • EURO - VO EURO-VO: GRID and VO

Lo. WISE design EURO-VO: GRID and VO

Lofar-WISE: Data Storage –Groningen –SARA Amsterdam EURO-VO: GRID and VO

• IBM – GPFS filesystem • Connect to Astro. WISE – Storage table EURO-VO: GRID and VO

Lo. Wise- concepts • All Tier 1 s on an equal footing • Centrally operated GPFS distributed filesystem • File retrieval – – Db viewer (web) Prompt (db query) Pathname – data server g. Lite – Grid ftp • Single distributed db- with all Meta and source data – Valid --Quality -- ready for publication flags • Visibility of data – Owner –Project –Archive --EURO-VO • Authentication / Assigned resources – Astro. WISE Oracle system EURO-VO: GRID and VO

Processing - options • Tier 0 – CP • Tier 1 – re-processing – Local clusters – EGEE GRID • Tier 2 – On Tier 1 – Local anarchy EURO-VO: GRID and VO

Astro. WISE-Up EURO-VO: GRID and VO

–VST - Virtual Survey Telescope EURO-VO: GRID and VO

– www. astro-wise. org EURO-VO: GRID and VO

EURO-VO: GRID and VO

Astro-WISE: Services EURO-VO: GRID and VO

TARGET diagram EURO-VO: GRID and VO

QC - calibration scientist monitoring EURO-VO: GRID and VO

Extreme data lineage EURO-VO: GRID and VO

Astro-WISE: Grid Computing –selection of Target in Astro-Wise –storage element defined a priori EURO-VO: GRID and VO –EGEE computing

EURO-VO: GRID and VO

Lo. Wise and Euro-VO EURO-VO: GRID and VO

GRID- Euro. VO –Awe visualization EURO-VO: GRID and VO

– AI – Cultural Heritage EURO-VO: GRID and VO

http: //omegate. astro. rug. nl: 9001 /Monk EURO-VO: GRID and VO