Скачать презентацию 1 GRIDCC A realtime interactive GRID to integrate Скачать презентацию 1 GRIDCC A realtime interactive GRID to integrate

678af27ed7cba97042b8660fd0ac0288.ppt

  • Количество слайдов: 31

1 GRIDCC A realtime interactive GRID to integrate instruments, computational and information resources widely 1 GRIDCC A realtime interactive GRID to integrate instruments, computational and information resources widely spread on a fast WAN Gaetano Maron Istituto Nazionale di Fisica Nucleare Laboratori Nazionali di Legnaro Italy Gaetano Maron, ANW, Halifax, November 2004

2 Outline • Brief introduction to the project • Main Pilot Applications • The 2 Outline • Brief introduction to the project • Main Pilot Applications • The GRIDCC Services • Technologies and performances • Conclusions Gaetano Maron, ANW, Halifax, November 2004

3 GRIDCC main goals • . . . the GRIDCC project extends the state 3 GRIDCC main goals • . . . the GRIDCC project extends the state of the art of computing Grid technologies, by introducing the handling of real-time constraints and interactive response into the existing Grid middleware • Our goal is to build a widely distributed system that is able to remotely control and monitor complex instrumentation …These new applications introduce requirements for real-time and highly interactive operation of GRID resources. • One of the main objectives of the project is to verify the feasibility of a Grid-based remote control of systems requiring real-time response with real applications running on existing Grid test beds over both national and international network infrastructures (e. g. GEANT). • GRIDCC integrates a “grid of instrumentation” into existing Grid infrastructures that provide the computational power and storage needed for the applications …. Gaetano Maron, ANW, Halifax, November 2004

4 Partecipants Participant name Country Istituto Nazionale di Fisica Nucleare Italy Institute Of Accelerating 4 Partecipants Participant name Country Istituto Nazionale di Fisica Nucleare Italy Institute Of Accelerating Systems and Applications Greece Brunel University UK Consorzio Interuniversitario per Telecomunicazioni Italy Sincrotrone Trieste S. C. P. A Italy IBM (Haifa Research Lab) Israel Imperial College of Science, Technology & Medicine UK Istituto di Metodologie per l’Analisi ambientale – Consiglio Nazionale delle Ricerche Italy Universita degli Studi di Udine Italy Greek Research and Technology Network S. A. Greece Gaetano Maron, ANW, Halifax, November 2004

The Origin of the Project The control of CMS Experiment Gaetano Maron, ANW, Halifax, The Origin of the Project The control of CMS Experiment Gaetano Maron, ANW, Halifax, November 2004 5

The CMS Data Acquisition 2 107 electronics channels 40 MHz • • Highly interactive The CMS Data Acquisition 2 107 electronics channels 40 MHz • • Highly interactive system (human reaction time fraction of second) • Gaetano Maron, ANW, Halifax, November 2004 On line diagnostics and problem solving capability • 100 Hz O(104 ) distributed Objects to – control – configure – monitor World Wide distributed monitor and control 6

From the CMS Control and Monitor System. . Supporting Services Virtual Control Room Standard From the CMS Control and Monitor System. . Supporting Services Virtual Control Room Standard comm. protocols Diagnostic Tools Interface to the “Instrumentation” Gaetano Maron, ANW, Halifax, November 2004 7

8 . . to the GRIDCC project Use of the Grid technology, as extension 8 . . to the GRIDCC project Use of the Grid technology, as extension of the Web Service Technologies, to develop a a widley distributed control system with access to grid enabled computing and data storage facilities Virtual Cntr. Room Supporting Services Instrument 1 Instrument 2 Diagnostics Virtual Cntr. Room Gaetano Maron, ANW, Halifax, November 2004 Processing Farm Instrument 3 Processing Farm Data Storage

es Elettra Video Conf. & Chat Service Diagnostic Service Test Bed Grid Infrastructure (Web es Elettra Video Conf. & Chat Service Diagnostic Service Test Bed Grid Infrastructure (Web Service Infr. ) BRUNEL Existing GRID facilities DBs Services Problem Solver Service Data Mining Tool W P Ins 3: G tru rid me En nt ab ati le on W User Interface Virtual Control Room er Rea WP ac tiv l-tim 2: e. W e eb and Se rv ic Virtual Control Room Int User Interface Storage Imperial INFN P 5 En : Co vir op on era me tiv nt e User Interface Farm Services W Instr. prsnce Virtual Instrument Grid Services P 4 : To RT Gr ex Ac id c i se stin ess rv g ice Instr. s Instr. Farm W P 3 Ins : G tru rid me En nt ab ati le on Instr. GRIDCC Layout Instr. Tele Knowledge based Services Gaetano Maron, ANW, Halifax, November 2004 Security & login Service Information Service (Monitor) INFN Work Flow Engine Service Resource Service Cooperative Environment 9 Job Control Supporting Services

10 Application Fields • • Experimental Sciences – Take control of a experiment from 10 Application Fields • • Experimental Sciences – Take control of a experiment from a distance (remote operation and control, data taking and data analysis): • High Energy, Nuclear and Solid State Physics • Electronic Microscopes • Telescopes Monitoring and analysis of the territory (e. g. disaster analysis) – Meteorology – Geophysics Bio medics – Integration of remote operation, data taking, data analysis and data storage of sophisticated instruments like: • Mammography • Pet, TAC, NMR etc. Industrial Applications – widely distributed controls • Electrical power grid • Public transportation • …… Gaetano Maron, ANW, Halifax, November 2004

Pilot Application I Power Grid – In electrical utility networks (or power grids), the Pilot Application I Power Grid – In electrical utility networks (or power grids), the introduction of very large numbers of ‘embedded’ power generators often using renewable energy sources, creates a severe challenge for utility companies. – Existing computer software technology for monitoring and control is not scalable and cannot provide a solution for the many thousands of generators that are anticipated. – Grid. CC technology would allow the generators to participate in a VO, and consequently to be monitored and scheduled in a cost effective manner – Embedded power generator is still in developing phase. Grid. CC project has access to its full computer emulation. So the Power Grid application will consist of a network (O(100)) of emulated embedded power generators and their full control and monitor operation Gaetano Maron, ANW, Halifax, November 2004 11

Pilot Application II (Far) Remote Operation of Accelerator Facility – Far remote operation of Pilot Application II (Far) Remote Operation of Accelerator Facility – Far remote operation of an accelerator facility (i. e. the Elettra Control Room in Italy) involves the planning of accelerator operations, the maintenance of the accelerator and its trouble shooting, the repair of delicate equipment, understanding and pushing performance limitations, performing studies, performing commissioning and set ups and routine operations. – All these activities are based on large amounts of information, which are at present accessible only at the accelerator site. Remote control of an accelerator facility has the potential of revolutionising the mode of operation and the degree of exploitation of large experimental physics facilities. – This pilot application will combine elements of immersive (i. e. providing the feeling to be present at the remote location) communication and cooperation technology. This includes video and audio presence, allowing the simultaneous operation of the same instruments, having access to the same accelerator controls and the relevant data, meeting easily and spontaneously and providing full awareness of the presence of the collaborators. Gaetano Maron, ANW, Halifax, November 2004 12

Pilot Application III Control and monitor of high energy experiments – This application involves Pilot Application III Control and monitor of high energy experiments – This application involves the use of the Grid in a real time environment to control and monitor remote large scale detectors. – This application will make use of a High Energy Physics (HEP) experiment, the CMS detector which is currently under construction at the future LHC collider at CERN. Data taking is foreseen by 2007, but several pre production activities are planed. – (See previous slides for some more details about CMS detector. ) – This application will be developed along the CMS on line software developing and will have same time schedule and delivery terms. Gaetano Maron, ANW, Halifax, November 2004 13

14 The other Grid. CC pilot applications • Meteorology (Ensemble Limited Area Forecasting) • 14 The other Grid. CC pilot applications • Meteorology (Ensemble Limited Area Forecasting) • Analysis of neuro physiological data (migraine attacks treatments) • Device Farm for the Support of Cooperative Distributed Measurements in Telecommunications and Networking Laboratories • Geo hazards: Remote Operation of Geophysical Monitoring Network Gaetano Maron, ANW, Halifax, November 2004

15 The GRIDCC Services – Supporting Services • Security Service – login and user 15 The GRIDCC Services – Supporting Services • Security Service – login and user account management; security issues • Resource Service (RS) – GRIDCC resources (including instrumentation controller nodes) handling and their partitioning; GRIDCC resources configuration • Informartion And Monitor Service (IMS) – Collectes messages and monitor data from the GRIDCC resources; distributes them to the subscribers • Job Control – Starts, monitors and stops the software elements of GRIDCC, including the Instrument components • Problem Solver – Uses information from the RS and IMS to identify mulfunctions and attempts to provide automatic recovery procedures where applicable – Virtual Instrument Controllers (VIGS) • Instrument controllers, hierarchy of controllers • Transform requests from the UI to proper actions to be sent to the instrumentation Gaetano Maron, ANW, Halifax, November 2004

General Requirements for the Grid. CC Services • About 104 nodes/instruments to be controlled General Requirements for the Grid. CC Services • About 104 nodes/instruments to be controlled and monitored (for the more demanding application) – The nodes/instrument are controlled by VIGSs. – Round trip time to reach all the nodes must be in the order of human reaction time. A hierarchy of VIGS allows to reduce such time. – Concurrent partitions should be possible (Resource Service) – Information collection from all the node to reach a “single point” of storage. Collection time fast enough to allow monitoring , error detection , alarms, etc. Aggregate throughput in the order of 104 message/s (IMS) – On line diagnostics and problem solving fast enough to be useful (from seconds to minutes) (Problem Solver) • Real time requirement – This requirement affects both network and Web Service Qo. S definitions including parameter for : • Delivery certezza • Response to a request in a give amount of time Gaetano Maron, ANW, Halifax, November 2004 16

Instruments sc Instruments V I G S de ts n me V I G Instruments sc Instruments V I G S de ts n me V I G S Instruments The GRIDCC Services Resource Service ription 17 u str In Ins tru me nt co n fig ura tio n DAQ description • • • The Resource Service (RS) handles all the GRID resources and manages their partition (if any). A resource can be any hardware or software component involved in the GRID. Resources can be discovered, allocated and queried. Partitions can only use available resources. It is the responsibility of the RS to check resource availability and contention with other active partitions when a resource is allocated for use. A periodic scan of the registered resources will keep the configuration database up to date. Gaetano Maron, ANW, Halifax, November 2004

SUBSCRIBERS • • PUBLISHERS (Instruments nodes) Instruments V I G S Errors Log info SUBSCRIBERS • • PUBLISHERS (Instruments nodes) Instruments V I G S Errors Log info Monitor State V I G S Instruments Information and Monitor System V I G S Instruments 18 The Information and Monitor Service (IMS) collects messages and monitor data coming from GRID resources and supporting services and stores them in a database. There are several types of messages collected from the sub systems. The messages are catalogued according to their type, severity level and timestamp. Data can be provided in numeric formats, histograms, tables and other forms. The IMS collects and organizes the incoming information in a database and publishes it to subscribers. These subscribers can register for specific messages categorized by a number of selection criteria, such as timestamp, information source and severity level. Gaetano Maron, ANW, Halifax, November 2004

19 Problem Solver Step 1 Step 2 Step 3 This Service identifies malfunctions of 19 Problem Solver Step 1 Step 2 Step 3 This Service identifies malfunctions of the GRICC system and determines possible recovery procedures. It subscribes to the IMS to receive the information it is interested in. The information is processed by a correlation engine and the result is used to determine a potential automatic recovery action, or to inform the user providing any analysis results it may have obtained. Gaetano Maron, ANW, Halifax, November 2004

20 Virtual Instrument Grid Service VIGS is a set of services that enables the 20 Virtual Instrument Grid Service VIGS is a set of services that enables the remote control, monitoring and overall operation, via GRID protocols, of a set of real instruments Controls, Status IMS Virtual Instrument Grid Service Control Gateway Instrument Manager Errors, Log Info, Monitor, State Info. Serv Proxy Data Mover To Grid Farms, Data storage, Visualization, etc. Virtual Control Room Gaetano Maron, ANW, Halifax, November 2004 Real Instruments or Set of Instruments

21 Hierarchy of VIGSs Virtual Control Room IMS VIGS CE/SE VIGS Control Flow Errors 21 Hierarchy of VIGSs Virtual Control Room IMS VIGS CE/SE VIGS Control Flow Errors Flow Data Flow Real Instruments Gaetano Maron, ANW, Halifax, November 2004 VIGS

Years Gaetano Maron, ANW, Halifax, November 2004 1 Project Timing 2 22 3 Years Gaetano Maron, ANW, Halifax, November 2004 1 Project Timing 2 22 3

23 Project Time Schedule Gaetano Maron, ANW, Halifax, November 2004 23 Project Time Schedule Gaetano Maron, ANW, Halifax, November 2004

24 Preliminary Service Prototypes – Resource Service, IMS and a reduced version of VIGS 24 Preliminary Service Prototypes – Resource Service, IMS and a reduced version of VIGS exist as preliminary study prototypes. The aim is to gain experience with the technologies and provide a preliminary test bed for our appliccations. – The following technologies have been used: • Tomcat based (Java servlet container) • SOAP/XML (Jaxm) • Castor • My. SQL and Oracle DB, JDBC • Sun Message Queue (JMS) for IMS – An integrated version of the above mentioned services and VIGS is now in operation to control a 128 nodes (instruments) system Gaetano Maron, ANW, Halifax, November 2004

Performance Issues of the prototype: Round Trip Time VIGS Soap/XML Gaetano Maron, ANW, Halifax, Performance Issues of the prototype: Round Trip Time VIGS Soap/XML Gaetano Maron, ANW, Halifax, November 2004 25

Performance Issues of the prototype: Info Pub/Sub Performance Msg BROKER Msg Filter PUBLISHERS SUBSCRIBERS Performance Issues of the prototype: Info Pub/Sub Performance Msg BROKER Msg Filter PUBLISHERS SUBSCRIBERS Persistency Tomcat Based Broker SOAP/XML msg Gaetano Maron, ANW, Halifax, November 2004 Dual Xeon 1. 8 GHz M. Q. JMS Based Broker JMS msg 26

Comments on the performance requirements and guess for the Grid. CC technologies • Single Comments on the performance requirements and guess for the Grid. CC technologies • Single VIGS routing capability should be in the order of 102 msg/s. Due to the topology of the application (hierarchical) this number is a reasonable compromise. The prototype (Tomcat + Soap) fits with this number. Web Service based VIGS should fit easily with this figure. • IMS message broker capability. Due to the nature of the messages collected by this service (asynchronous error messages, state changes, monitor information, etc. ) we require at least 1000 msg/s per broker. The prototype shows some limitation with Tomcat + Soap scheme. JMS approach behaves properly. Gaetano Maron, ANW, Halifax, November 2004 27

28 Web Service Performances • Sun J 2 EE AS • Dual Xeon 1. 28 Web Service Performances • Sun J 2 EE AS • Dual Xeon 1. 8 GHz • 10 tag XML doc • remote method invocation • only ack as answer • Glue Web Service • Dual Xeon 1. 8 GHz • 10 tag XML doc • remote method invocation • only ack as answer Gaetano Maron, ANW, Halifax, November 2004

29 Grid Technologies for the project • Specifications we are looking at: – WS 29 Grid Technologies for the project • Specifications we are looking at: – WS Agreement • to define the Qo. S affecting the real time behaviour (as defined at the beginning) of the web service – WS Resource Framework • State full web service – WS Addressing – WS Notification – WS Federation Gaetano Maron, ANW, Halifax, November 2004

30 Technology review in progress • Web/Grid Service – WS I and/or WS I+ 30 Technology review in progress • Web/Grid Service – WS I and/or WS I+ based platforms • OMII • Java Sun ? • Web Sphere ? • JBoss ? – IBM emerging toolkit • WS RF, WS Resource. Prop, WS Resource. Lifetime, WS Notification, WS Service. Group, WS Bae. Faults – Globus Toolkit 4 – EGEE g. Lite • Message pub/sub systems – Narada. Brokering – Sun Messages Queue 3. 5 – Web. Sphere MQ Series Gaetano Maron, ANW, Halifax, November 2004

31 Conclusions Gaetano Maron, ANW, Halifax, November 2004 31 Conclusions Gaetano Maron, ANW, Halifax, November 2004