1 GRIDCC A realtime interactive GRID to integrate

1 GRIDCC A realtime interactive GRID to integrate instruments, computational and information resources widely spread on a fast WAN Status Report e Richieste 2007 Silvano Squizzato Istituto Nazionale di Fisica Nucleare Laboratori Nazionali di Legnaro Italy GM, 06. 09. 2006, CNAF

2 GRIDCC main goals • . . . the GRIDCC project extends the state of the art of computing Grid technologies, by introducing the handling of real-time constraints and interactive response into the existing Grid middleware • Our goal is to build a widely distributed system that is able to remotely control and monitor complex instrumentation …These new applications introduce requirements for real-time and highly interactive operation of GRID resources. • One of the main objectives of the project is to verify the feasibility of a Grid-based remote control of systems requiring real-time response with real applications running on existing Grid test beds over both national and international network infrastructures (e. g. GEANT). • GRIDCC integrates a “grid of instrumentation” into existing Grid infrastructures that provide the computational power and storage needed for the applications …. GM, 06. 09. 2006, CNAF

3 General on the Grid. CC Project • • • It is a 3 years project. Started the 1 st September 04 INFN is the partner coordinator of the project Funded by EU in FP 6, 4 MEuro 10 Partners from 3 EU Countries + Israel About 40 people engaged Participant name Country Istituto Nazionale di Fisica Nucleare Italy Institute of Accelerating Systems and Applications Greece Brunel University UK Consorzio Interuniversitario per Telecomunicazioni Italy Sincrotrone Trieste S. C. P. A Italy IBM (Haifa Research Lab) Israel Imperial College of Science, Technology & Medicine UK Istituto di Metodologie per l’Analisi Ambientale – Consiglio Nazionale delle Ricerche Italy Università degli Studi di Udine • www. gridcc. org GM, 06. 09. 2006, CNAF Italy Greek Research and Technology Network S. A. Greece

Working Package List • WP 1: System Architecture (Imperial) – Overall system architecture. Definition of the Qo. S parameters needed for a network infrastructure where real time and interactive services are used. • WP 2: Real-time and Interactive web services middleware (Brunel) – Extending web service based middleware into interactive and real time computing. • WP 3: Grid-Enabled Instrumentation (INFN) - Development of generic Virtual Instrument Service (VIS). Development of the all Supporting Services needed to catalog, configure, monitoring, analyze errors, fixing automatically problems and finally read out the Grid-enabled instrument resources. • WP 4: Brokering access to existing Grid resources (Imperial) - Controlling access to gridified resources according agreed levels of service and providing mechanisms for determining and organising complex workflows. • WP 5: Cooperative Environment (Elettra) - Design and development of a multiuser cooperative environment (i. e. a groupware software) that will be a common component of the various GRIDCC applications. • WP 6: Integration and Pilot Applications (IASA) - System integration and deployment of a small number of pilot applications on existing Grid testbeds. GM, 06. 09. 2006, CNAF 4

5 Working Package List • WP 7: Information dissemination and exploitation (CNIT) – To ensure that the results of the project are widely disseminated and that the results are exploited by existing (e. g. EGEE) and future Grid development projects • WP 8: Management (Brunel) - To ensure all objectives are realised and all deliverables are completed according to schedule and within budget. Management and resolution of conflict within the project, including the redefinition of WP deliverables. Protection and exploitation of the IP arising from the project. GM, 06. 09. 2006, CNAF

6 Grid. CC Architecture Overview Instrument Element Virtual Control Room Web Service Interface Computing Element Exec. Wf. MS Service WMS Storage Elements Element Agr. S Existing Grid Infrastructures GM, 06. 09. 2006, CNAF

7 Partecipants vs WPs Person per month IASA BRNL CNIT ELETTRA IBM Imperial INFN 6 IMAA UNIUD 6 GRNET TOTAL PARTNERS 6 30 Research/innovation activities WP 1: System Architecture 6 WP 2: Real time Web Service 38 WP 3: Grid Enabled Instrumentation 106 42 6 36 20 24 149 WP 5: Cooperative Env. GM, 06. 09. 2006, CNAF 107 154 WP 4: Real-time workload WP 6: System integ. & deployment 33 149 101 136 50 62 54 48 44 346 80 75 149 30 531

8 Main Milestones Q 1 Architecture document Web Service evaluation Q 2 Q 3 Q 4 Q 5 Q 6 Q 7 Q 8 Q 9 Q 10 Q 11 X X Collaborative Environment core Security plan implementation X X VIGS, Resource, Info&Mon, Problem Solver Service prototypes X X Coll. Envir. Final X Installation of the applications X VIGS, RS, IMS, PS final X Application tests complete GM, 06. 09. 2006, CNAF Q 12 1 st September 2004 X 1 st Annual Rvw Roll-on Rvw 2 nd Annual Rvw

9 CMS , Main Pilot Application di Grid. CC middleware in use to control the CMS Magnet Test and Cosmic Challenge (MTCC) worked over the summer GM, 06. 09. 2006, CNAF

10 CMS Prototype: IE at work - Grid. CC middleware used for CMS MTCC (Magnet Test and Cosmic Challenge) CMS Instrument Element TOP Det 1 Detector GTP - 11 Instrument Managers with a hierarchical topology 1 DAQ - Instruments are, in this case, Linux hosts where the cms on-line software is running 8 DAQ Instrument Managers DAQ - More than 100 controlled hosts - First MTCC phase successfully completed Trigger TTS Filter. Farm Fed. Builder GM, 06. 09. 2006, CNAF Ru. Builder

11 Main Grid. CC Pilot Applications: Remote Operation of an Accelerator Demo foreseen For the next Annual Review Elettra Synchrotron October 2006 GM, 06. 09. 2006, CNAF

Main IE Pilot Applications: Power Grid Demo foreseen 12 For the next Annual Review October 2006 Virtual Control Room Instrument Manager Power Grid V. O . . Power Generators GM, 06. 09. 2006, CNAF Instrument Element Solar Panel

13 The other Grid. CC pilot applications • IDS Intrusion Detection System. Demo at the roll-on review • Meteorology (Ensemble Limited Area Forecasting). In progress • Device Farm for the Support of Cooperative Distributed Measurements in Telecommunications and Networking Laboratories. In progress • Geo-hazards: Remote Operation of Geophysical Monitoring Network. In progress GM, 06. 09. 2006, CNAF

14 Status Grid. CC • 1 st Annual Review (29 October 2005) – “In general, the project is well on its way. A few recommendations to further strengthen the success of the project are given in Section 9 of this report. ” – “All project partners except IBM, have performed well in the first year of the project and mainly achieved their objectives. Corrective actions for IBM have been discussed and agreed which will allow effective integration of this partner in the second and third year of the project. ” – “Overall, the project consortium has worked efficiently and is encouraged to continue with their future planned activities and increase the coordination among partners. ” • Roll On Review (28 April 2006) – “The most outstanding achievement is the progress with the Instrument Element which is considered to be the flag ship of the project, in particular since several basci Grid definitions state that “a Grid combines storage and computing resources as well as scientific instruments”. Therefore the project has good potential in the coming years” • 2 nd Annual Review (18 October 2006) – Deployment of the Instrument Element on the main applications – Integration with g. Lite (WMS, CE, SE). Use of g. Lite/Cream. Use of Storm as SRM – Agreement Service and Quality if Service. GM, 06. 09. 2006, CNAF

15 Motivazioni Trasferte Interne per LNL • Trasferte Interne • Grid. CC – Servono principalmente per meeting tra i partner italiani e attività di integrazione del middleware. INFN infatti sviluppa nel WP 3 il middleware di GRIDCC che va poi integrato nelle applicazioni pilota previste. Ci sono infatti tre applicazioni italiane che richiederanno un’attività di integrazione sul campo da parte dell’ INFN: 1. Controllo strumentazione per telecomunicazione (Device Farm CNIT); 2. Controllo remoto di un acceleratore (Elettra); 3. Controllo remoto e monitoraggio di un territorio ad alto rischio sismico (IMAA/CNR). • Vengono richiesti: 15 Keuro GM, 06. 09. 2006, CNAF

16 Motivazioni Trasferte Estero per LNL - I • • Trasferte Estero Grid. CC: – sviluppo del middleware in collaborazione con gli altri partner del progetto e con CMS/CERN non partecipa direttamente al progetto, ma collabora attivamente allo sviluppo del middleware e di un’applicazione (vedi sotto). – sviluppo e integrazione del Run Control dell’esperimento CMS, una delle principali applicazioni pilota del progetto. Questa parte del progetto viene sviluppata in stretta collaborazione con CMS/CERN (gruppo Tri. DAS – S. Cittolin) e abbisogna di un rapporto costante con il CERN. – integrazione del software di WP 3 nelle altre applicazioni pilota (per UK e Grecia). – INFN-LNL e’ coordinatore del progetto. – intensa attività di “dissemination” a livello internazionale (conferenze, workshop, etc. . . ) visto che si tratta dell’ultimo anno di progetto. GM, 06. 09. 2006, CNAF

17 Motivazioni Estero per LNL - II • Vengono richiesti: – 90 Keuro per trasferte di lavoro estero + conferenze internazionali Previsti poco più di 10 FTE per l’intero progetto GRIDCC In media si stima per queste attività: 2 mesi / FTE Costo medio per 2 mesi di trasferta: ~ 9 Keuro Totale: 9 * 10 Keuro – 10 Keuro per il coordinamento del progetto Grid. CC a livello europeo GM, 06. 09. 2006, CNAF

18 Richieste per 2007 FTE/pe rson Missioni Estere (Keuro) Consumo Totale (Keuro) LNL 10. 3/12 15 100 10 125 CNAF GM, 06. 09. 2006, CNAF Missioni Interne (Keuro) 0. 2/1 2 4 6