Скачать презентацию Southeastern Universities Research Association SURA NMI Utility Grid Скачать презентацию Southeastern Universities Research Association SURA NMI Utility Grid

82a999085ae23c1ab175c5cd0ce9dcce.ppt

  • Количество слайдов: 33

Southeastern Universities Research Association SURA NMI Utility Grid: Sharing Resources, Sharing Results SURA Cyberinfrastructure Southeastern Universities Research Association SURA NMI Utility Grid: Sharing Resources, Sharing Results SURA Cyberinfrastructure Workshop: Grid Application Planning & Implementation January 5 -7, 2005 Art Vandenberg Avandenberg@gsu. edu Director, Advanced Campus Services Georgia State University

Southeastern Universities Research Association The NMI Integration Testbed NMI Participation USERS Implementers CONTRIBUTORS NMI Southeastern Universities Research Association The NMI Integration Testbed NMI Participation USERS Implementers CONTRIBUTORS NMI Integration Testbed Sites Target Communities DEVELOPERS NMI Integration Testbed SUPPORTERS UAB UAH UFL FSU GSU UMich TACC UVA (USC) • Managed by SURA under NSF ANI-0123937 • Testbed Sites evaluate NMI components • Real life research and enterprise contexts • www. nsf-middleware. org/testbed SURA Cyberinfrastructure Workshop January 5 -7, 2005 REU Students Testbed Grid future expansion ?

Southeastern Universities Research Association SURA NMI Testbed Grid • Initiated as a sub-project in Southeastern Universities Research Association SURA NMI Testbed Grid • Initiated as a sub-project in September 2003 • Captured dispersed activity into meaningful deliverables • Integrate NMI grid components into the enterprise • Leverage the NMI Testbed experience • Identified leads for key areas: • Georgia State University – “Grid-building” (identifying participants, resources) – application development (cataloging, exploration) • University of Virginia – Scaling the Grid – Technology & policies for cross-certification – Secure inter-institutional access SURA Cyberinfrastructure Workshop January 5 -7, 2005

Southeastern Universities Research Association SURA NMI Testbed GRID: vision & action • Vision – Southeastern Universities Research Association SURA NMI Testbed GRID: vision & action • Vision – build a model of future grid • Address interoperation - Bridge CA • Persistent, available resources • Applications run transparently • Policy is one of cooperative computing • SURA NMI Testbed Grid • Continuing NMI Integration Testbed work • Persistent resources for research and education • Research, learning, outreach SURA Cyberinfrastructure Workshop January 5 -7, 2005

Southeastern Universities Research Association What we’ll review… • Catalog of Grid Applications: data • Southeastern Universities Research Association What we’ll review… • Catalog of Grid Applications: data • SURA NMI Testbed GRID: participants & resources • Applications: value proposition / outreach • Portals: eye of the beholder • Authentication: Bridge. CA • Policy: boundary conditions • Current status SURA Cyberinfrastructure Workshop January 5 -7, 2005

Southeastern Universities Research Association Catalog of Grid Applications: data • Information is a resource Southeastern Universities Research Association Catalog of Grid Applications: data • Information is a resource – researchers, grids, applications (existing & potential) – 20 Universities, 475 researchers as of Oct 28, 2004… http: //art 12. gsu. edu: 8080/grid_cat/index 5. jsp SURA Cyberinfrastructure Workshop January 5 -7, 2005

Southeastern Universities Research Association Query: computational fluid dynamics • Search by name, institution, keywords Southeastern Universities Research Association Query: computational fluid dynamics • Search by name, institution, keywords SURA Cyberinfrastructure Workshop January 5 -7, 2005

Southeastern Universities Research Association Possible collaboration, information exchange • Computational fluid dynamics + parallel Southeastern Universities Research Association Possible collaboration, information exchange • Computational fluid dynamics + parallel computing SURA Cyberinfrastructure Workshop January 5 -7, 2005

Southeastern Universities Research Association Grid Catalog: Coming up • Online submission of information • Southeastern Universities Research Association Grid Catalog: Coming up • Online submission of information • Additional search function: clustering around target info • Information on resources SURA Cyberinfrastructure Workshop January 5 -7, 2005

Southeastern Universities Research Association SURA NMI Testbed GRID: participants… UMICH GMU UAH UARK UVA Southeastern Universities Research Association SURA NMI Testbed GRID: participants… UMICH GMU UAH UARK UVA GPN DUKE USC SC TTU Ga. Tech TACC UAB Tulane LSU SURA Cyberinfrastructure Workshop January 5 -7, 2005 GSU

Southeastern Universities Research Association SURA Cyberinfrastructure Workshop January 5 -7, 2005 Southeastern Universities Research Association SURA Cyberinfrastructure Workshop January 5 -7, 2005

Southeastern Universities Research Association Applications: multiple genome alignment Multiple Genome Alignment Grid-enabled algorithm Nova Southeastern Universities Research Association Applications: multiple genome alignment Multiple Genome Alignment Grid-enabled algorithm Nova Ahmed, Masters CS (Ph. D. student as of Jan 2005); Dr. Yi Pan, Computer Science UAB Clusters and collaboration Computation time of multiple sequence alignment program - varying number of elements per processor in different configurations - using 9 processors in each config (cluster, grid cluster, multi-grid cluster) NOTE improvement using MPICH-G 2 across multiple clusters (research follow up…? ) SURA Cyberinfrastructure Workshop January 5 -7, 2005

Southeastern Universities Research Association Task Farming & Cross Certification • LSU: Center for Computation Southeastern Universities Research Association Task Farming & Cross Certification • LSU: Center for Computation & Technology • Supercomputing 2004 –demonstration • Explore parameter space for black hole simulation • Task farming • Submit tasks to grid • Tasks run on various available nodes • Tasks can be transitioned to another node “if needed” • Cross certification at SURA NMI Testbed Grid Bridge. CA • Enables transparent authentication SURA Cyberinfrastructure Workshop January 5 -7, 2005

Southeastern Universities Research Association Information Technology & Systems Center Global Hydrology Resource Center http: Southeastern Universities Research Association Information Technology & Systems Center Global Hydrology Resource Center http: //datapool. nsstc. nasa. gov DISCOVER - Distributed Information Services for Climate and Ocean Products and Visualizations for Earth Research • Interactive data search by product, instrument, platform, and date • Multiple views of data, e. g. search, ftp or calendars • Automated order packaging for FTP delivery • Direct FTP access to online data sets • Subsetting capability • Shopping cart style order creation • DODS/OPe. NDAP data access SURA Cyberinfrastructure Workshop January 5 -7, 2005 14

Southeastern Universities Research Association Georgia State Cosmic Ray Lab Muon-detector Grid – Georgia high Southeastern Universities Research Association Georgia State Cosmic Ray Lab Muon-detector Grid – Georgia high schools, middle schools • Dr. Xiaochun He, Georgia State, Physics – research, outreach. . . SURA Cyberinfrastructure Workshop January 5 -7, 2005

Southeastern Universities Research Association University of Arkansas • Dr. Amy Apon – Grid Education Southeastern Universities Research Association University of Arkansas • Dr. Amy Apon – Grid Education • International Workshop on Grid Education – Grid. Edu 2004 (April 2004) • NSF CCLI: Adaptation of GT 3 Tutorials for undergrad CS – Collaborative with Jens Mache, Lewis & Clark College – http: //csce. uark. edu/~aapon/courses/gridcomputing/ • Member TCSC subcommittee on grid computing education • Great Plains Network Consortium, Extending the Reach Project • Goal: region-wide collaboration • Goal: middleware infrastructure to share resources • Deployment of Shibboleth (model for Grid Auth. N/Auth. Z? ) • http: //archie. csce. uark. edu/gpn/ • Grid resources for graduate education SURA Cyberinfrastructure Workshop January 5 -7, 2005 16

Southeastern Universities Research Association And more application potentials… • University of Alabama – BLAST Southeastern Universities Research Association And more application potentials… • University of Alabama – BLAST • Texas Tech – math and statistics, approximation theory • George Mason University – geospatial data services • Texas Advanced Computing Center – computational fluid dynamics • Tulane – computational fluid dynamics • UMich – ATLAS, G 4 Sims • Georgia State – particle simulation • Georgia Tech – network end-to-end performance SURA Cyberinfrastructure Workshop January 5 -7, 2005 17

Southeastern Universities Research Association Portals: eye of the beholder • OGCE – http: //www. Southeastern Universities Research Association Portals: eye of the beholder • OGCE – http: //www. collab-ogce. org/nmi/index. jsp SURA Cyberinfrastructure Workshop January 5 -7, 2005

Southeastern Universities Research Association UTGrid: http: //www. utgrid. utexas. edu/ SURA Cyberinfrastructure Workshop January Southeastern Universities Research Association UTGrid: http: //www. utgrid. utexas. edu/ SURA Cyberinfrastructure Workshop January 5 -7, 2005

Southeastern Universities Research Association Mgrid: http: //www. mgrid. umich. edu/ SURA Cyberinfrastructure Workshop January Southeastern Universities Research Association Mgrid: http: //www. mgrid. umich. edu/ SURA Cyberinfrastructure Workshop January 5 -7, 2005

Southeastern Universities Research Association U. Alabama at Birmingham: http: //uabgrid. uab. edu/ SURA Cyberinfrastructure Southeastern Universities Research Association U. Alabama at Birmingham: http: //uabgrid. uab. edu/ SURA Cyberinfrastructure Workshop January 5 -7, 2005

Southeastern Universities Research Association Georgia State: http: //acsgridhead. gsu. edu SURA Cyberinfrastructure Workshop January Southeastern Universities Research Association Georgia State: http: //acsgridhead. gsu. edu SURA Cyberinfrastructure Workshop January 5 -7, 2005

Southeastern Universities Research Association U. of Southern California: http: //www. usc. edu/uscgrid SURA Cyberinfrastructure Southeastern Universities Research Association U. of Southern California: http: //www. usc. edu/uscgrid SURA Cyberinfrastructure Workshop January 5 -7, 2005

Southeastern Universities Research Association Portal considerations… • Common portal for SURA NMI Testbed Grid Southeastern Universities Research Association Portal considerations… • Common portal for SURA NMI Testbed Grid or • Portal of Portals • Integration with Authentication • “Just give me a command line!” • Identity for SURA NMI Testbed Grid • Our policy • Our members • Our resources • Our applications SURA Cyberinfrastructure Workshop January 5 -7, 2005

Southeastern Universities Research Association Authentication: Bridge CA Typical Hierarchical PKI Typical Bridge PKI SURA Southeastern Universities Research Association Authentication: Bridge CA Typical Hierarchical PKI Typical Bridge PKI SURA Cyberinfrastructure Workshop January 5 -7, 2005

Southeastern Universities Research Association Auth. N: Bridge. CA it works! • Jim Jokl, UVA, Southeastern Universities Research Association Auth. N: Bridge. CA it works! • Jim Jokl, UVA, supports Bridge. CA • LSU Center for Computation & Technology – Task farming demo Supercomputing 2004 • Tasks submitted to various grid-enabled clusters • LSU submitted to UVA cluster with cross-certification • LSU credential accepted by UVA cluster via Bridge. CA • Current Status cross-certification with Bridge. CA: • UVA, UAB, LSU (completed) • TACC, USC are nearly done • UAH, UARK, GSU, UMICH next phase • Next: automatic provisioning of Globus Grid Mapfile SURA Cyberinfrastructure Workshop January 5 -7, 2005

Southeastern Universities Research Association Auth. N: additional links • SURA NMI Testbed cross certification Southeastern Universities Research Association Auth. N: additional links • SURA NMI Testbed cross certification process https: //www. pki. virginia. edu/nmi-bridge/ • PKI-Lite policy, practices, profiles http: //middleware. internet 2. edu/hepki-tag/#PKI_Lite • CA Software (Options for Enterprise CA) http: //middleware. internet 2. edu/hepki-tag/opensrc. html • SURA “Thinking Group” report: SURA Certificate Authority Jan. 26 – Mar 29, 2004 See Appendix A at: http: //www 2. gsu. edu/~wwwacs/GRID_Group/min 2 Dec 2004. htm SURA Cyberinfrastructure Workshop January 5 -7, 2005

Southeastern Universities Research Association Policy: from Formal… • Policies vary around the Testbed • Southeastern Universities Research Association Policy: from Formal… • Policies vary around the Testbed • Formal policy – USC (http: //www. usc. edu/hpcc/) • • • “The use of rcf-01 and hpc is controlled by the HPCC Allocations Committee, under the authority of the HPCC Steering Committee. You must fill out an application and submit it to the Allocation Committee to obtain permission to use these facilities. HPCC Allocation Policy HPCC Allocation Request Forms” • See also http: //www. usc. edu/isd/services/accounts/ • Formal policy – Grid 3 (http: //www. ivdgl. org/grid 3/userinfo/) • Project specific (ATLAS, LIGO, i. VDGL…) • General Grid 3 user registration (1 page guide) SURA Cyberinfrastructure Workshop January 5 -7, 2005

Southeastern Universities Research Association Policy: … In-process, informal, none… • In-Process Policy – UAB Southeastern Universities Research Association Policy: … In-process, informal, none… • In-Process Policy – UAB • “UABGrid is currently available to members of the UAB community and we are working on extending its availability across partner institutions and beyond. ” http: //uabgrid. uab. edu/ • No Grid specific policy – default user account policies • No formal policy, but may have consequences: SURA Cyberinfrastructure Workshop January 5 -7, 2005

Southeastern Universities Research Association Policy: evolving model… • What is SURA NMI Testbed Site Southeastern Universities Research Association Policy: evolving model… • What is SURA NMI Testbed Site policy? • Observation on Policy for Grid based resources • Must address assumption of local use only • Absent Grid policy, default to “computer usage” policy • Cross-boundary use of local credentials not norm • Social factors (Sharing resources – Yours? vs. Mine? ) • Current SURA NMI Testbed Model • Contribute some, use some • Cross certify via Bridge. CA • Allow over-subscribing and then address how to handle • Cooperative Computing – self-organizing/regulating? • Demonstrate value… SURA Cyberinfrastructure Workshop January 5 -7, 2005

Southeastern Universities Research Association Post-NMI Integration Testbed Award • SURA “Grid Think” Working Groups Southeastern Universities Research Association Post-NMI Integration Testbed Award • SURA “Grid Think” Working Groups (Jan 2003) • Authentication/CA recommendations • Grid application analysis • Workshop planning (Like this event!) • NMI Submission for “Utility Grid” (May 2004) • Grids for broad, shared use across institutions (not just “big science”) • Focus on education, research, outreach • No award, but important development of concepts • Foundational resource for SURA HPC-Grid Planning Group SURA Cyberinfrastructure Workshop January 5 -7, 2005

Southeastern Universities Research Association SURA Testbed Grid: Basic approach… • Dedicated cluster • Persistence Southeastern Universities Research Association SURA Testbed Grid: Basic approach… • Dedicated cluster • Persistence is important • Number of nodes: whatever you can manage • Linux • Globus • Compiler • Cross certification with Bridge. CA preferred (other options ok) • SURAGrid@sura. org list • Biweekly conference calls • Minutes: http: //www 2. gsu. edu/~wwwacs/GRID_Group/NMI. html • Join US SURA Cyberinfrastructure Workshop January 5 -7, 2005 32

Southeastern Universities Research Association Q&A? Art Vandenberg Avandenberg@gsu. edu Director, Advanced Campus Services Georgia Southeastern Universities Research Association Q&A? Art Vandenberg Avandenberg@gsu. edu Director, Advanced Campus Services Georgia State University SURA Cyberinfrastructure Workshop January 5 -7, 2005 33