Grid Computing at Intel current Status and Outlook

Grid Computing at Intel current Status and Outlook Ralf Ratering Senior Software Engineer Intel Parallel and Distributed Solutions Division (PDSD)

Agenda What is the Grid? Overview of Grid Community A real-world example: UNICORE Outlook on Grid Programming Environment 2

What is the Grid? sharing distributed resources single sign-on security The Grid is a new infrastructure that addresses the industry`s need for computing power and data storage. load balancin g reliability hardware& software 3 open standards

The Grid Community Grid End Users Grid Solutions Enterprise Grid Alliance (EGA), Globus Alliance, IBM, HP, Platform, etc. Grid Building Blocks Intel, Globus Toolkit, UNICORE, Platform, Oracle, Data. Synapse, IBM, HP, Dell, etc. Grid Standards Global Grid Forum (GGF), W 3 C, IETF, OASIS, etc. *Other names and brands may be claimed as the property of others 4

Grid Software Taxonomy Grid Software Development Applications Middleware Tools Userware Science Enterprise Collaboration Globus UNICORE Legion Cactus LSF PBSPro SGE Condor. . . Web Services HPC Grid Tools CA Tools. . . Web Portals Client Apps. . . HE Physics Biology Chemistry Meteorology CFD FEA. . . Oracle 10 g United Devices Data. Synapse Avaki Platform. . . Access Grid *Names and brands may be claimed as the property of others 5

Service Oriented Architecture (SOA) SOA is the Grand Synthesis Grid Computing (scheduling and coordinating multiple/diverse compute and information resources) Virtualization Web Services (aggregation, and physical: logical mgnt) (std app interaction, publish, discover, invoke) SOA Utility Computing P 2 P (metering, accounting, billing) (Internet edgeresource interaction) Autonomic Computing (self-aware, self-optimizing, selfhealing, self-managing) “The Insight Research Corporation, Grid Computing: a Vertical Market Perspective 2003 -2008” 6

Grid Standards The Grid will not succeed without open standards defined by the community Define which Grid Services and functionalities are needed Messaging, security, transport, tooling Applications Open Grid Service Architecture OGSA WS Resource Framework WSRF Wrappers around existing applications or completely new Grid applications Mechanisms to manage Grid Services Web Services OGSA enabled Server Components 7 Interface to different servers, storages or networks

UNICORE Grid Computing is real and available now! UNICORE connects Supercomputers and Clusters to a Computing Grid Developed in German research projects by Pallas (now Intel PDSD) and Fujitsu Heavily used in European and Asian Grid projects Available as Open Source from UNICORE Forum (www. unicore. org) 8

UNICORE Architecture in a Nutshell Specify platformindependent job signed with user certificate Client Gateway Adresses XML File Firewall INTERNET SSL Firewall Gateway Run platform specific script Target System Interface Firewall Gateway Firewall Network Job Supervisor (NJS) . . . User Incarnation Database INTRANET Certificate-Login Mapping Platform-specific information 9 INTRANET

Intel PDSD Grid Nizhny Novgorod, Russia Champaign, Illinois 4 Node Xeon™ Cluster Cologne, Germany 2 Node Xeon™ Cluster 4 x Itanium® 2 DEMO 10

The next step: Grid Programming Environment (GPE) Bringing applications to the Grid. . . Visual Grid Applications Client Grid. Beans SDK Framework Grid Programming Language High Level Grid API Language independent definition Java reference implementation Open Grid Service Architecture OGSA WS Resource Framework WSRF Web Services OGSA enabled Server Components 11 GPE

Use Case: Expert User Application GS Grid Client Grid Broker GS WSRF Application GS Application Database GS Grid Service Information GS User Keystore Fully-fledged Java Application Run multiple applications in complex workflows Get all information from the Grid 12

Use Case: Application User Application Client Application Grid Service WSRF User Certificate Lightweight Java Application Grid Only one application Get only application specific information Run lightweight client on mobile devices 13

Use Case: Unaware User DB Web Browser JSP Server Register Request/ Response Server Certificate Service Provider User Authenticate using server certificate WSRF Application Grid Service Grid Presentation oriented user interface What is a "Grid"? Service provider offers a service on the web 14

The Grid Developer Visual Grid SDK Deploy Application Plug-in Database GS Application Client Grid Information GS Web Client Broker GS G-API Deploy Application GS WSRF Application GS Grid. Bean=Grid Service+Client Plug-in Wrap existing applications Write new Grid applications Plug-in for Eclipse 15

Grid Service Backends Globus GS DRMAA GS Native Protocols Application GS WSRF UNICORE GS UNICORE Network Job Supervisor Globus Job Manager Condor Sun Grid Engine GPE will provide Grid services to wrap different server types 16

GPE: The Big Picture Visual Grid SDK Eclipse Plugin Deploy Plug-Ins Developer Workstation Deploy GS Plugins Plug-Ins G-API Grid Client Keystore Application GS User Workstation WSRF Plug-In G-API Application Client UNICORE User Certificate Mobile Device Plug-In Globus DRMAA G-API Web Browser JSP Database GS Application Service Web Client Grid Broker GS Information GS Service Certificate Service Provider 17

Intel Development Tools Level of Parallelism Serial/Node Medium Grain Coarse Grain Job Level SMP/Cluster Level Parallel-Grid Level Compilers Open. MP MPI-2. 0 Cluster OMP Performance Analysis VTune Thread Profiler Trace Collector Trace Analyzer Debugging IDB Programming Model Development Tools Intel already has industry leading node tools UNICORE DRMAA G-API GPE Thread checker IDB-MPP Enhancing here 18 Engage here

Summary The Grid is a new infrastructure that addresses the industries need for computing power and interoperability It will not succeed without open standards defined by the community Grid Computing is real and available now! – Download at www. unicore. org The Grid Programming Environment (GPE) enables developers to deploy applications on the Grid 19

BACKUP 20

Using Grid Services in UNICORE Client Registry Handle XML File HTTPS Request UNICOR E Job GSFactory Handles Service Factory Registry Passes through firewalls Gateway Service Handle Register Service Factory Create Gateway Service OGSI UNICORE Server 21