Open Grid Services as an Enabler of Future Networked Applications Ian Foster Argonne National Laboratory University of Chicago http: //www. mcs. anl. gov/~foster October 2, 2002 Grid, Globus Toolkit, and OGSA TERENA Networking Conference, May 20, 2003
Partial Acknowledgements l 3 Open Grid Services Architecture design – Carl Kesselman, Karl Czajkowski @ USC/ISI – Steve Tuecke @ANL – Jeff Nick, Steve Graham, Jeff Frey @ IBM l Grid services collaborators at ANL – Kate Keahey, Gregor von Laszewski – Thomas Sandholm, Jarek Gawor, John Bresnahan l Globus Toolkit R&D also involves many fine scientists & engineers at ANL, USC/ISI, and elsewhere (see www. globus. org) l Strong links with many EU, UK, US Grid projects l Support from DOE, NASA, NSF, IBM, Microsoft foster@mcs. anl. gov ARGONNE öCHICAGO
4 Overview l Problem solving in the 21 st century l Open Grid Services Architecture l Globus Toolkit v 3 l Summary foster@mcs. anl. gov ARGONNE öCHICAGO
Problem Solving in the 21 st Century l 5 Teams organized around common goals – Communities: “Virtual organizations” l With diverse membership & capabilities – Heterogeneity is a strength not a weakness l And geographic and political distribution – No location/organization possesses all required skills and resources l Must adapt as a function of the situation – Adjust membership, reallocate responsibilities, renegotiate resources foster@mcs. anl. gov ARGONNE öCHICAGO
For Example: Global Knowledge Communities foster@mcs. anl. gov 6 ARGONNE öCHICAGO
New Opportunities Demand New Technology 7 “Resource sharing & coordinated problem solving in dynamic, multiinstitutional virtual organizations” “When the network is as fast as the computer's internal links, the machine disintegrates across the net into a set of special purpose appliances” foster@mcs. anl. gov (George Gilder) ARGONNE öCHICAGO
8 Taking Sharing to the Next Level l Sharing of communication – Telephones, mailing lists, collaboration tools l Sharing of data and knowledge – Web, semantic web l What about the rest of the infrastructure? – Services, computers, programs, sensors, … foster@mcs. anl. gov ARGONNE öCHICAGO
Existing Technologies are Helpful, but Not Complete Solutions l 9 Peer-to-peer technologies – Limited scope and mechanisms l Enterprise-level distributed computing – Limited cross-organizational support l Databases – Vertically integrated solutions l Web services – Not dynamic l Semantic web – Limited focus foster@mcs. anl. gov ARGONNE öCHICAGO
10 What’s Missing is Support for … l Sharing & integration of resources, via – Discovery – Provisioning – Access (computation, data, …) – Security – Policy – Fault tolerance – Management l In dynamic, scalable, multi-organizational settings foster@mcs. anl. gov ARGONNE öCHICAGO
11 Enter the Grid l Infrastructure (“middleware”) for establishing, managing, and evolving multi -organizational federations – Dynamic, autonomous, domain independent – On-demand, ubiquitous access to computing, data, and services l Mechanisms for creating and managing workflow within such federations – New capabilities constructed dynamically and transparently from distributed services – Service-oriented, virtualization foster@mcs. anl. gov ARGONNE öCHICAGO
12 Increased functionality, standardization The Emergence of Open Grid Standards Managed shared virtual systems Computer science research Open Grid Services Arch Web services, etc. Internet standards Custom solutions 1990 foster@mcs. anl. gov Real standards Multiple implementations Globus Toolkit Defacto standard Single implementation 1995 2000 2005 2010 ARGONNE öCHICAGO
13 Overview l Problem solving in the 21 st century l Open Grid Services Architecture l Globus Toolkit v 3 l Summary foster@mcs. anl. gov ARGONNE öCHICAGO
14 Open Grid Services Architecture l Service-oriented architecture – Key to virtualization, discovery, composition, local-remote transparency l Leverage industry standards – Internet, Web services l Distributed service management – A “component model for Web services” l A framework for the definition of composable, interoperable services “The Physiology of the Grid: An Open Grid Services Architecture for Distributed Systems Integration”, Foster, Kesselman, ARGONNE öCHICAGO Nick, Tuecke, 2002 foster@mcs. anl. gov
15 Web Services l l l XML-based distributed computing technology Web service = a server process that exposes typed ports to the network Described by the Web Services Description Language, an XML document that contains – Type of message(s) the service understands & types of responses & exceptions it returns – “Methods” bound together as “port types” – Port types bound to protocols as “ports” l A WSDL document completely defines a service and how to access it foster@mcs. anl. gov ARGONNE öCHICAGO
16 OGSA Structure l A standard substrate: the Grid service – Standard interfaces and behaviors that address key distributed system issues – A refactoring and extension of the Globus Toolkit protocol suite l … supports standard service specifications – Resource management, databases, workflow, security, diagnostics, etc. – Target of current & planned GGF efforts l … and arbitrary application-specific services based on these & other definitions foster@mcs. anl. gov ARGONNE öCHICAGO
17 Open Grid Services Infrastructure Client Introspection: • What port types? • What policy? • What state? Lifetime management • Explicit destruction • Soft-state lifetime Grid. Service (required) Grid Service Handle handle resolution Grid Service Reference Data access Service data element Other standard interfaces: factory, notification, collections Service data element Implementation Hosting environment/runtime (“C”, J 2 EE, . NET, …) foster@mcs. anl. gov ARGONNE öCHICAGO
18 Open Grid Services Infrastructure GWD-R (draft-ggf-ogsi- gridservice-23) Open Grid Services Infrastructure (OGSI) http: //www. ggf. org/ogsi-wg Editors: S. Tuecke, ANL K. Czajkowski, USC/ISI I. Foster, ANL J. Frey, IBM S. Graham, IBM C. Kesselman, USC/ISI D. Snelling, Fujitsu Labs P. Vanderbilt, NASA February 17, 2003 Open Grid Services Infrastructure (OGSI) foster@mcs. anl. gov ARGONNE öCHICAGO
Example: Reliable File Transfer Service Client 19 Client Request and manage file transfer operations Notf’n Policy File Grid Service Transfer Source Fault Monitor Perf. Monitor Query &/or subscribe to service data Pending Performance Policy Faults interfaces service data elements Internal State Data transfer operations foster@mcs. anl. gov ARGONNE öCHICAGO
20 Open Grid Services Architecture OGSA services: registry, authorization, monitoring, data access, management, etc. Open Grid Services Infrastructure Web Services Host. Env. Other OGSA schemas More specialized & domain-specific services & Protocol Bindings Hosting Environment l Data access and integration l Security l SLA negotiation l Manageability l … Transport Protocol GWD-R (draft-ggf-ogsa-platform-3) Open Grid Services Architecture Platform http: //www. ggf. org/ogsa-wg foster@mcs. anl. gov Editors: I. Foster, Argonne & U. Chicago D. Gannon, Indiana U. CHICAGO ARGONNE ö
21 Grid Security Services Requestor's Domain Trust Service Attribute Service Audit/ Secure-Logging Service Provider's Domain Authorization Service Privacy Service Trust Service Attribute Service Audit/ Secure-Logging Service Privacy Service Credential Validation Service Bridge/ Translation Service Requestor Application WS-Stub Secure Conversation WS-Stub Credential Validation Service Provider Application Credential Validation Service Authorization Service Attribute Service Trust Service VO Domain foster@mcs. anl. gov ARGONNE öCHICAGO
22 OGSA Manageability l Management is a high-priority OGSA effort – GGF Common Management Model (CMM) WG – Ellen Stokes (IBM) co-chair l Goal: – Define standard schema and interfaces for a manageable resource (modeled as a service) l And also: – Allow existing models to be used & exposed – Leverage CIM schema when applicable – Define how CMM interfaces can integrate with higher-level interfaces (e. g. , provisioning) foster@mcs. anl. gov ARGONNE öCHICAGO
23 Common Management Model l A manageable resource is a Grid service, thus – Global resource names: Grid service handles – State data modeling + access: SDEs – Lifetime management – Service Group for grouping resources – Interface definition language: WSDL l Plus additional schema & operations – Standard manageable resource SDE schema – Interfaces for extensible lifecycle and relationship management Þ Base. Manageable. Resource interface foster@mcs. anl. gov ARGONNE öCHICAGO
24 Base Manageable Port Types OGSA port types Grid. Service Locate Handle. Resolver Service. Group Relationship Lifecycle. Model CRM port types Base. Manageable. Resource foster@mcs. anl. gov ARGONNE öCHICAGO
25 CMM Schema l l WSDL (open content model) & XSD describe resource’s manageable attributes (as SDEs) Models are CIM-based where applicable – Re-factored for service efficiency; appropriate for higher-level management applications – Additional XML attributes: change control, measuring, lifecycle – Additional XML data types l CIM as basis for schemas: but may modify – E. g. use constructs from XML/XSD where similar ones exist in CIM foster@mcs. anl. gov ARGONNE öCHICAGO
26 “Use CIM Models Where Applicable” l Class is port type, properties of class are port type service data, methods of class are port type operations – Some refactoring of classes -> port. Types l Express in WSDL/GSDL as grid service – Managed resource port type from which other resource port types are derived – Mix in the base Grid. Service port type – Mix in other CMM port types as needed (Identity, relationship, lifecycle. State) foster@mcs. anl. gov ARGONNE öCHICAGO
27 OGSA Misconceptions l OGSA means you have to code in Java – No: C client bindings now, C server side eventually (but not needed for current apps) l OGSA means all programs must be services – No: You can write services if you want, but other behaviors are supported: e. g. , GT 3 supports GT 2 GRAM, Grid. FTP, …, … l OGSA is a silver bullet for distributed and collaborative computing – No, it makes some things easier, but it’s only interfaces and behaviors, after all! foster@mcs. anl. gov ARGONNE öCHICAGO
28 Overview l Problem solving in the 21 st century l Open Grid Services Architecture l Globus Toolkit v 3 l Summary foster@mcs. anl. gov ARGONNE öCHICAGO
Globus Toolkit v 3 (GT 3) Open Source OGSA Technology l Implements OGSI interfaces l 29 Supports primary GT 2 interfaces – GRAM, Grid. FTP, GSI – High degree of backward compatibility l Multiple platforms & hosting environments – J 2 EE, Java, C, . NET, Python l New services – SLA negotiation, service registry, community authorization, data management, … l Broad & growing adoption and contributions foster@mcs. anl. gov ARGONNE öCHICAGO
30 Globus Toolkit Contributors: GT 2 l Grid Packaging Technology (GPT) l Persistent GRAM Jobmanager Condor l GSI/Kerberos interchangeability Sandia l Documentation l Ports l MDS stress testing l Support l Testing and patches Many! l Interoperable tools Many! l $$ DARPA, DOE, NSF, NASA, Microsoft, EU foster@mcs. anl. gov NCSA NASA, NCSA IBM, HP, Sun, SDSC, … EU Data. Grid IBM, Platform, UK e. Science ARGONNE öCHICAGO
31 Globus Toolkit Contributors: GT 3 l Replica location service l Python hosting environment l Data access & integration l Data mediation services l Tooling, Xindice, JMS l . . . foster@mcs. anl. gov EU Data. Grid LBNL UK e. Science SDSC IBM ARGONNE öCHICAGO
32 GT 2 Evolution To GT 3 l What happened to the GT 2 key protocols? – Security: Adapting X. 509 proxy certs to integrate with emerging WS standards – GRIP/LDAP/MDS: Abstractions integrated into OGSI as service. Data – GRAM: Managed. Job. Factory and related service definitions – Grid. FTP: Unchanged in 3. 0, but will evolve into OGSI-compliant service in 2003 l Also rendering collective services in terms of OGSI: RFT, RLS, CAS, etc. foster@mcs. anl. gov ARGONNE öCHICAGO
Example: Reliable File Transfer Service Client 33 Client Request and manage file transfer operations Notf’n Policy File Grid Service Transfer Source Fault Monitor Perf. Monitor Query &/or subscribe to service data Pending Performance Policy Faults interfaces service data elements Internal State Data transfer operations foster@mcs. anl. gov ARGONNE öCHICAGO
The Grid Technology Repository l l l http: //gtr. globus. org 34 Community repository Clearing house for service definitions, code, documentation Encourage collaboration & avoid redundant work International advisory committee: Ian Foster (Chair), Malcolm Atkinson, John Brooke, Fabrizio Gagliardi, Dennis Gannon, Wolfgang Gentzsch, Andrew Grimshaw, Keith Jackson, Gregor von Laszewski, Satoshi Matsuoka, Jarek Nabrzyski, Bill St. Arnaud, Jay Unger foster@mcs. anl. gov ARGONNE öCHICAGO
35 Overview l Problem solving in the 21 st century l Open Grid Services Architecture l Globus Toolkit v 3 l Summary foster@mcs. anl. gov ARGONNE öCHICAGO
36 The Need for Open Infrastructure l Broadly deployed services in support of fundamental collaborative activities – Formation & operation of virtual organizations – Authentication, authorization, discovery, … l Services, software, and policies enabling ondemand access to critical resources – Computers, databases, networks, storage, software services, … l l Operational support for 24 x 7 availability Integration with campus and commercial infrastructures foster@mcs. anl. gov ARGONNE öCHICAGO
Open Infrastructure 37 Edinburgh Glasgow DL Belfast Newcastle Manchester Cambridge Oxford Cardiff RAL Hinxton London Soton Tier 0/1 facility Tier 2 facility Tier 3 facility 10 Gbps link 2. 5 Gbps link 622 Mbps link Other link foster@mcs. anl. gov ARGONNE öCHICAGO
38 Summary l OGSA: standards-based dist. sys. middleware – From Web services: standard IDL, discovery, binding independence, other desirable features – From Grid/Globus Toolkit: naming, state, lifetime management, etc. l Rapid progress on definition & implementation – OGSI is defined, GT 3 implements it (and other things), multiple groups coding to it – Much more happening, much more to be done! l No silver bullet, but a good incremental step towards meeting user requirements foster@mcs. anl. gov ARGONNE öCHICAGO
39 For More Information l Open Grid Services Arch. – www. ggf. org/ogsa-wg – www. globus. org/ogsa l Global Grid Forum – www. ggf. org l The Globus Project™ – www. globus. org l Technical articles – www. mcs. anl. gov/~foster@mcs. anl. gov 2 nd Edition to appear November 2003 ARGONNE öCHICAGO
Скачать презентацию Open Grid Services as an Enabler of Future
e5ef9e5b56a88ff72dda7a26cb77390a.ppt