EU FP 6 Project GRIDCC Project at Industry

EU FP 6 Project GRIDCC Project at Industry Silvano Squizzato silvano. squizzato@lnl. infn. it Istituto Nazionale di Fisica Nucleare – Laboratori di Legnaro (PD), Italy

Outline n n n GRIDCC project: goals & objectives Architecture overview Strategic targets Pilot applications Focus on new provided capabilities ¨ Instrument Element ¨ RMM-JMS as fast publishing system ¨ Virtual Control Room GRIDCC and Industry www. gridcc. org (EU FP 6 Contract 511382) Grid Industry Day, 26 -27 October, Catania 2

GRIDCC project Grid Enabled Remote Instrumentation with Distributed Control and Computation n It is a 3 -years EU FP 6 project started in September 2004 n Web site: www. gridcc. org Participant name Country Istituto Nazionale di Fisica Nucleare Italy Institute Of Accelerating Systems and Applications Greece Brunel University UK Consorzio Interuniversitario per Telecomunicazioni Italy Sincrotrone Trieste S. C. P. A Italy IBM (Haifa Research Lab) Israel Imperial College of Science, Technology & Medicine UK Istituto di Metodologie per l’Analisi ambientale – Consiglio Nazionale delle Ricerche Italy Universita degli Studi di Udine Italy Greek Research and Technology Network S. A. Greece www. gridcc. org (EU FP 6 Contract 511382) Grid Industry Day, 26 -27 October, Catania 3

GRIDCC: Goals & Objectives 1. Remote control and monitoring of complex and distributed instrumentation 2. Tight integration between instrument grid and classical computational grid 3. Human interaction with Grids via Virtual Control Room (collaborative environment) 4. Enactment of complex workflows www. gridcc. org (EU FP 6 Contract 511382) Grid Industry Day, 26 -27 October, Catania 4

GRIDCC: Architecture Computational Grid Instruments Grid CE IE IE DATA Instrument Element CE Information & Monitoring System SE Problem Solver VCR Workflow ES VCR Collaborative Environment www. gridcc. org (EU FP 6 Contract 511382) Execution Services Grid Industry Day, 26 -27 October, Catania 5

Architecture: New “instruments grid” Component Name Description Instrument Element (IE) This is a unique concept to GRIDCC. It consists of a coherent collection of services which provide all the functionalities to configure, partition and control the physical instruments Information & Monitor Service (IMS) It gathers from GRIDCC resources information and monitor data to be disseminated through a publish / subscribe systems or to be stored in persistent repositories. Problem Solver (PS) It offers automated problem solving in a Grid environment at two levels. A local PS, within a given Instrument Element, allows to solve local problems related to functionalities of a given instrument. A global PS, allows to solve system-wide problems. Virtual Control Room (VCR) It provides a common set of collaboration tools and allows users to build complex workflows, which are then submitted to the Execution Services, and to directly monitor and control remote instruments in real-time. Execution Services (ES) They control the execution of the workflows defined by the user in the VCR, maintaining the status of the tasks that make up the workflow. They also support the advance reservation of resources. Security Services (SS) GRIDCC uses a split security system. When interacting with components of other Grids the GSI security will be used and the users identified by their X. 509 proxy certificate. When interacting with the IE the user will be identified by a Kerberos ticket. www. gridcc. org (EU FP 6 Contract 511382) Grid Industry Day, 26 -27 October, Catania 6

Strategic plan: 3 main target areas Remote process control Accelerator control (Tele-) Biomedicine Robotics Automotive Electronic microscopes (Large-scale) scientific experiments High energy particle physics (Radio-) Telescopes GRIDCC Middleware Widely Sparse Instrumentation Power Grids Monitoring of the territory Monitoring of the sea Geo-hazard prediction Distributed laboratories Transportation monitoring Sensor network www. gridcc. org (EU FP 6 Contract 511382) Grid Industry Day, 26 -27 October, Catania 7

GRIDCC pilot applications Power Grid Particle Accelerator High Energy Physics CMS Meteorology Device Farm Geohazard Monitoring www. gridcc. org (EU FP 6 Contract 511382) Grid Industry Day, 26 -27 October, Catania 8

Pilot applications: CMS n n The Grid. CC middleware has been deployed to control the run of the CMS (Compact Muon Solenoid), one of the four high energy experiments in LHC (Large Hadron Collider) at CERN laboratory. CMS Magnet Test and Cosmic Challenge (MTCC), a milestone in the CMS construction, positively carried out. CMS Detector CMS Control User Top IE Interface Structure CSC Tracker HCAL IE IE IE DAQ IMS FB RB RPC IE Trigger IE DT IE ECAL IE DAQ RS FF xdaq www. gridcc. org (EU FP 6 Contract 511382) Grid Industry Day, 26 -27 October, Catania 9

Pilot applications: Power grid GRIDCC deployed to monitor: • A 50 k. W generator • A 1 kw Photo-Voltaic array Virtual Control Room Instrument Manager Power Grid V. O. Gas . . . www. gridcc. org (EU FP 6 Contract 511382) Instrument Element Solar Panel Grid Industry Day, 26 -27 October, Catania 10

Pilot applications: Remote Operation of an Accelerator Elettra Synchrotron www. gridcc. org (EU FP 6 Contract 511382) Grid Industry Day, 26 -27 October, Catania 11

GRIDCC: other applications n Meteorology (Ensemble Limited Area Forecasting) ¨ n Device Farm for the Support of Cooperative Distributed Measurements in Telecommunications and Networking Laboratories ¨ n Weather forecasting system to detect hazardous weather The Device Farm consists of a pool of Measurement Instruments for Telecommunication Experiments Geo-hazards: Remote Operation of Geophysical Monitoring Network The monitoring net will be characterized by different levels of activity: stand-by, pre-alert, plus a control modality ¨ An event worth to be monitored is for example the evolution of a “landslip” ¨ www. gridcc. org (EU FP 6 Contract 511382) Grid Industry Day, 26 -27 October, Catania 12

Focus on new capabilities provided by GRIDCC n Instrument Element ¨ Complete integration of Instruments into grid ¨ High virtualization and abstraction of diverse physical devices ¨ A very scalable and platform-independent component ¨ A versatile multi-input / multi-output component n Fast Data Publishing System ¨ High-performance reliable multicast via RMM-JMS n Virtual Control Room ¨ Allows effective human interactions with the grid ¨ Provides a homogeneous collaborative environment www. gridcc. org (EU FP 6 Contract 511382) Grid Industry Day, 26 -27 October, Catania 13

Instrument Element: instruments into grid n n The Instrument Element (IE) is one of the novel elements of the GRIDCC architecture. It offers a standard web service interface to integrate scientific and general purpose instruments and sensors within the grid. An IE can control a set of instruments with the possibility to decide on which sub-set to operate. The IE is the key decoupling element between real instruments and the grid GRID Web Services Instrument Element Any Protocol or physical connection Sensor Network www. gridcc. org (EU FP 6 Contract 511382) Instrumentation Instrument Grid Industry Day, 26 -27 October, Catania 14

Instrument Element: Instrument Virtualization n The IE grid instruments representation is basically based on: ¨ Parameters: they hold configuration information ¨ Attributes: they hold instrument variables ¨ XML description of the instrument ¨ Finite State Machine: the core highly customizable part of the IE Voltmeter Parameters: Attributes: Commands: www. gridcc. org (EU FP 6 Contract 511382) Instrument Parameters Attributes Control Mode XML Based Language maximum and minimum voltage measured voltage start / stop measuring Grid Industry Day, 26 -27 October, Catania 15

Instrument Element: Scalable on embedded systems Custom Board IE Xilink Virtex IV FPGA Standalone Axis Linux Custom Logic Java. VM Web Service Grid. CC IM PPC 405 Instrument Manager on a chip … … towards a grid on a chip Custom Electronics 1 Gbps Ethernet Montavista www. montavista. com USER INTERFACE Jam. VM http: //jamvm. sourceforge. net www. gridcc. org (EU FP 6 Contract 511382) Grid Industry Day, 26 -27 October, Catania 16

Instrument Element: Versatile I/O multichannel n The IE permits ¨ grid accessible operations to control and monitor the instruments (via VIGS), such as: • • ¨ execute a command get / set parameters different data outputs: • • • data mover to/from a grid Storage Element (via SRM) high bandwidth channel for data publishing (via IMS). low bandwidth channel for logs, states etc. (via IMS). Data S ubsc riber s IMS VCR ES VIGS IMS SRM Status Parameters Virtual Instrument Grid Service Information and Monitor Service Storage Resource Management www. gridcc. org (EU FP 6 Contract 511382) IE SRM Commands VIGS Grid Interaction IMS Storage Element (SE) s, rror tors , E i ogs , Mon L tes Sta Grid Industry Day, 26 -27 October, Catania 17

IE Data Subscribers IE Data Producer Fast Data Publishing: RMM-JMS www. gridcc. org (EU FP 6 Contract 511382) Same data are sent to several subscribers. Multicast protocols can have a benefic impact on performances • JMS provides a standard set of APIs for the communication • Many commercial and academic JMS implementations both in C/C++ and Java (Narada. Brokering, Sun, IBM) • GRIDCC (IBM Haifa lab) has implemented a Reliable Multicast protocol (RMM) JMS compliant • RMM-JMS works within a LAN but an efficient bridge technology has been developed to allow inter-LAN multicast communication Grid Industry Day, 26 -27 October, Catania 18

Fast Data Publishing: Some results Message Rate: Case many-to-one • 32 Dual Xeon 2. 4 GHz 1. 5 GB RAM machines, 1 GB Ethernet switch • At most 1 publisher, subscriber, or broker- (Sun MQ 3. 6) per machine • No message lost • RMM throughput: 75 -90 Mbytes/sec. (for 5 and more publishers) www. gridcc. org (EU FP 6 Contract 511382) Grid Industry Day, 26 -27 October, Catania 19

Virtual Control Room n n The VCR is a collaborative web portal Enable the user to run, aggregate and display plug-ins that act as “mini applications” www. gridcc. org (EU FP 6 Contract 511382) Grid Industry Day, 26 -27 October, Catania 20

Why could GRIDCC fit industry world? - I n High modular and flexible solution ¨ The software installation is NOT monolithic, but organized in pluggable independent components ¨ The IE architecture is not tied to specific technologies or third party software ¨ Multiple and independent I/O interfaces: Commands and Controls directed to Instruments, IMS, Fast Data Publishing, Data Movement to/from the GRID n High scalability ¨ GRIDCC is portable to different platforms ¨ Target environment ranges from large farms to embedded devices n GRIDCC middleware is meant to be used in production environments ¨ Mature middleware has been used, whenever possible, to assure robustness and stability www. gridcc. org (EU FP 6 Contract 511382) Grid Industry Day, 26 -27 October, Catania 21

Why could GRIDCC fit industry world? - II n Fine customization of the Instrument Element ¨ The IE is easily adaptable to diverse scenarios and needs n High level of abstraction in GRIDCC component interfaces ¨ Service Oriented Architecture ¨ Adherence to standards: WS-I compliant services Ø Standardized and uniform access to GRIDCC components Ø Services loosely coupled Ø Many different clients can interact with an IE, adopting WS-I compliant technologies (such as Java, Lab. View, Perl, C++, . NET etc. ) Ø High interoperability n EGEE (g. Lite) compatibility ¨ EGEE platform is one of the widely adopted solution for production grids ¨ A frequent and diffused interaction of GRIDCC modules with production grids (WMS, CEs, SEs) is envisaged ¨ Many grid facilities and tools can be reused (for instance Grid. FTP or SRM interface for data movement) www. gridcc. org (EU FP 6 Contract 511382) Grid Industry Day, 26 -27 October, Catania 22

How to proceed and receive feedback. . . n The dissemination activities MUST be continued and increased ¨ New test-beds are to be set-up ¨ Further training events and publications are envisaged ¨ Large public companies and industrial stakeholders will be addressed more closely in the third year of the project life www. gridcc. org (EU FP 6 Contract 511382) Grid Industry Day, 26 -27 October, Catania 23

Thank you for your attention n Any Questions? www. gridcc. org (EU FP 6 Contract 511382) Grid Industry Day, 26 -27 October, Catania 24

Spare www. gridcc. org (EU FP 6 Contract 511382) Grid Industry Day, 26 -27 October, Catania 25

Pilot applications: CMS - I CMS Detector In collaboration with the CERN CMS/Tri. DAS group www. gridcc. org (EU FP 6 Contract 511382) Grid Industry Day, 26 -27 October, Catania 26

Pilot applications: CMS - II 2 107 electronics channels 40 MHz O(104 ) distributed Objects to be ¨ controlled CMS Detector ¨ configured ¨ monitored n n n www. gridcc. org (EU FP 6 Contract 511382) Highly interactive system (human reaction time fractions of second) n 100 Hz On-line diagnostics and problem solving capability World Wide distributed monitor and control Grid Industry Day, 26 -27 October, Catania 27

Instrument Element – Interconnections II Fast Data Publishing Fast Data Display Existing Grid Elements Work. Flow Mng. System IE Control and Status VCR Control Panel Data Consumer IE Computing Element (CE) Storage Element (SE) IE Log Display Information and Monitor System www. gridcc. org (EU FP 6 Contract 511382) Log Persistency Grid Industry Day, 26 -27 October, Catania 28

References n n n n - WS-I, http: //www. ws-i. org - Java Message Service (JMS), http: //java. sun. com/products/jms - RMM-JSM, http: //www. haifa. ibm. com/projects/software/rmsdk/gridcc. html - g. Lite, http: //glite. web. cern. ch/glite/ - SRM, http: //sdm. lbl. gov/srm-wg - Sto. RM, http: //grid-it. cnaf. infn. it/storm - Montavista, http: //www. montavista. com - Jam. VM, http: //jamvm. sourceforge. net www. gridcc. org (EU FP 6 Contract 511382) Grid Industry Day, 26 -27 October, Catania 29

Acknowledgments The INFN team working in Legnaro, in collaboration with CERN at Geneva: n n n E. Frizziero M. Gulmini F. Lelli G. Maron A. Petrucci S. Traldi www. gridcc. org (EU FP 6 Contract 511382) Grid Industry Day, 26 -27 October, Catania 30