MCNC Grid Computing and Networking Services GCNS Western

MCNC Grid Computing and Networking Services (GCNS) Western Carolina University North Carolina Statewide Grid John Killebrew Director - NCREN

GCNS UNIVERSE Universities UNC-OP RENCI Internet 2 Duke. Net SURA Services and Relationships NLR General Assembly MCNC GCNS ERCWC SERNet e-NC ITS RTI RDI Winston. Net Industry

NCREN Video Services MCNC GCNS • Broadcast quality interactive video conferencing • 20 sites continuous presence audio and video • Full bridging interoperability among Broadcast Quality video sites H. 320 private line sites H. 320 dial (ISDN) sites H. 323 Video-over-IP sites MPEG 2 Video-over-IP sites • Live monitoring of all scheduled Conferences • Satellite Links • Downlinks for any/all campuses • Uplinks via Microspace from any/all campuses

MCNC Network Access and Services • Direct Access to – NCREN – Internet 2 (Abilene) – Research networks (NLR, NCNI) – National Labs – NC Grid, MCNC Enterprise Grid • Grid and Data Center Offerings – Co-location hosting services – Managed WAN hosting – Use of Grid Compute & Data resources – NEW! Grid Technology Evaluation Cntr • benchmarking, interoperability, integration, and training

What is a Grid ? I don’t know, but… “Context, Not Products, Defines Grid Computing” Gartner, 2004 “Resource sharing & coordinated problem solving in dynamic, multi-institutional virtual organizations” Ian Foster & Carl Kesselman, 2002

This is a Grid ! An IT Utility A Grid Middleware (the glue) And Networked Distributed Resources

The North Carolina Economy Challenge Employment by North American Industry Classification System (NAICS) Source: The Employment Security Commission of NC, Labor Market Information

Grid Benefits Department, Enterprise, and Global Grids • • • Access: transparent, remote, secure, wireless Sharing: enable collaboration over the network Failover: migrate/restart applications automatically On Demand: get resources, when you need them Productivity: more work done in shorter time Virtualization: access compute services, not servers Heterogeneity: platforms, OSs, devices, software Resource Utilization: increase from 20% to 80+% Virtual Organizations: build & dismantle on the fly

Grid Computing: Competitive Advantage for N. C. • Education, Research, Government, Industry • • • Reduce IT costs Access disparate data across multiple domains Enhance Education, R&D and Business processes Create innovative products and services Reduce design time and time to market Increase quality (reduce defects) Accelerate product development (e. g. drugs) Rapidly process and solve problems beyond an individual organization's capacity Leverage very powerful but inexpensive networked resources Connect and share computing resources seamlessly - regardless of system type or physical location Technology

However, There is Still a Long Way to Go ! § Grids are over-hyped: currently, they promise much more than they can really offer. § Grid technology is far from mature and complete. § Grid standards are (mostly) still missing. § Grids are very complex IT infrastructures. § Grids bring new challenges: sharing resources, loosing direct control, security, intellectual property, legal, social, political issues. . . Therefore, MCNC - GCNS !

Our Foundation for Grid: NCREN Internet 4 -7 MCNC-owned Clusters 2 distributed throughout the state NLR Locations still under evaluation Cisco Internet Existing: Blend of owned and leased fiber and circuits moving toward resilient rings powered by Cisco routers Planned: Strong focus on owned and leased fiber, Lambda, and few circuits, in resilient rings powered by Cisco routers and Wave Division Multiplexers EPA

The Grid The next IT Infrastructure of North Carolina • Proving ground for Grid • Successful prototype apps • Catalyst for collaboration • International recognition NC Bio. Grid 2002 2003 2004 2005

The Grid The next IT Infrastructure of North Carolina • Cluster and SMP resources • Research platform for GTEC • Core component in NCGrid • Revenue generation MCNC Enterprise Grid NC Bio. Grid 2002 2003 2004 2005

The Grid The next IT Infrastructure of North Carolina • State-wide partnership • Leverage lessons learned • Grid education & training resource • Enable first mover applications NC Grid Initiative MCNC Enterprise Grid NC Bio. Grid 2002 2003 2004 2005

MCNC & The Grid Infrastructure for North Carolina NC Statewide Grid Initiative MCNC Enterprise Grid MCNC NC Bio. Grid NCREN North Carolina Research & Education Network Microelectronics Center of North Carolina - Founded in 1980 - Independent, private, non-profit organization - Operates NCREN since 1984 - Past: Supercomputer Center for universities - Now: Grid Service Provider, offering Video, Network, Grid, and Datacenter Services - 50+ employees

MCNC-GCNS Roadmap Grid Service Provider Easy Access Awareness Creation

Our Vision : The Three Waves of Grid Computing The Research Wave Technology, Prototypes Virtual Organizations Standards GGF, IETF, OASIS GCNS: “Awareness Creation” The Industry Wave Grid-Enabled Products Enterprise Solutions Interoperability GGF, EGA, IETF, OASIS GCNS: “Easy Access” The Consumer Wave Commodity IT Utility Integration Legal, Ethical, Political Orgs GCNS: “Grid Service Provider”

GCNS Mission Advance education, innovation and economic development throughout North Carolina by delivering next generation information technology that enables the academic, research, government and business communities to discover, create, share and apply knowledge.

Higher Education Grid Constituencies • Chancellors/Presidents: University Outreach • CIO’s: Providing and running IT infrastructure • CRO’s, Deans, Key faculty: Education and Research • Students

Chancellors/Presidents • Play key important role in NC further education and economic development • Improve global competitive position of NC universities • Offer the best infrastructure for research and education • Become early part and active participant in the next-gen Advanced Internet

CIO’s • Offer service-oriented IT architecture (hide complexity) • Enable much more efficient resource management • Balance resource utilization within and across Campuses

CRO’s, Deans, Key Faculty • Offer and use larger and richer set of resources • Develop, provide, and use more powerful tools for joint research collaborations • Enable researchers to concentrate on research (and not on the resources)

Core Strategy Components • • Briefing key constituencies about Grid Computing Train key IT and research staff Develop joint Graduate/Ph. D program Build and use NC Grid as foundation (think globally, start locally) Grid-enable existing resources and join the NC Grid Offer training to users to grid-enable applications Work with users to port applications to the NC Grid Start Quad. A project with partners

Grid Technology Evaluation Center The Epicenter for Accelerating Grid Adoption Influential Network of Key-Players From Innovation to Deployment Independent Lab: Eval & Testing Grid Training & Education Socio-Economical Mission Joint Biz. Dev, PR & Marketing Customer Briefing Center

So, are there really any working Grids out there? • Yes!…. In North Carolina even… + Wachovia + NC Bio. Grid + SCOOP + EPA

NC Bio. Grid One of the nation’s first grid test beds for computing, data storage and networking resources for life sciences research Established to research and implement new grid computing technologies that will enable researchers and educators throughout North Carolina to take full advantage of the genomic revolution • Installed in Summer 2002, heterogeneous. hardware and OS platforms • More than 80 organizations • Dedicated systems for testing grid middleware and developing grid applications for bioinformatics • Spans multiple administrative domains with systems located at MCNC, NC State, UNC-CH & Duke • Established a Certificate Authority

SURA SCOOP South-eastern Coastal Ocean Observing Program The Challenge: - More than half of the nation's tidal shores home to 80 million people - coastal zone is undergoing environmental and ecological changes - threaten the sustainability of the region's economies and marine resources The Solution: - develop a Grid of sensors and linked computers - fully integrating several observing systems in the southern region - provide data, in real-time and at high speed, for more reliable, accurate and timely information To help guide effective coastal stewardship, plan for extreme events, facilitate safe maritime operations, and support coastal military security.

• And, how about other states? • Grid Development efforts announced in • Colorado • West Virginia • Louisiana • Texas • Virginia Plus…. the following are also working….

Access Grid for Education and Training • Builds on our proven and advanced video infrastructure • Utilizes Multicast Backbone • Real time, continuous presence audio, video, data • Purpose-built sites encourage natural, seamless interaction – • Desktop implementation available H. 323 Multi-Platform: including Win X, Linux/Unix – Mac OS X support coming soon H. 320 Voice & Video Over IP (V 2 o. IP), Ubiquitous 352 x 288 @ 128 kbps - 2 Mbps, Multipoint capable Multipoint via third-party MPEG-2 720 x 480 @ 5. 5 Mbps NCREN Video Network supports multipoint

Earth System Grid Goal: address technical obstacles to the sharing & analysis of high -volume data from advanced earth system models

Network for Earthquake Eng. Simulation Remote Users (Faculty, Students, Practitioners) Instrumented Structures and Sites Simulation Tools Repository Laboratory Equipment Field Equipment Curated Data Repository Leading Edge Computation Global Connections Remote Users: (K www. neesgrid. org Laboratory Equipment -12 Faculty and Students)

Butterfly. net: Enterprise Optimization • • • A scalable, resilient infrastructure for creating & running massive multiplayer games Developers avoid upfront costs Improved end-user experience Demonstrated 8 x increase in profitability over centralized model Dynamic provisioning & on demand capacity Uses Globus Toolkit & runs on IBM Global Services hosting environment

• Metropolitan Grid across the Universities • Stable, well-managed HPC resources • Supporting multi-disiplinary research • And local industries (e. g. Rolls Royce) Slides: Courtesy James Coomer

Grid Collaboration MCNC - Universities 1+1=3 Common Interests Grid Computing Higher Education Economic Development Thought Leadership Universities Top Research Education Vertical Applications Middleware MCNC Deployment Infrastructure Horizontal Complementary Focus

Time Machines The Innovation Engine Thank You ! jtk@mcnc. org http: //www. mcnc. org

GCNS Enterprise Grid Avaki Data Grid Global Grid Resource DB (GIIS) Users Campus Grids Data Grid Access Servers (8 total, i. e. 1 per 8 nodes) Grid Gatekeeper / Interactive Nodes LSF Master Job Scheduler 32 -CPU SGI Altix Linux SMP Server 128 -CPU IBM Linux Cluster (64 nodes) 8 -TB Storage

Network, Grid and Data Center Services GTEC, NLR, ANR and other Innovation Initiatives DEPLOYMENT Self-serve Data Center Services Value-add Information Systems Services Hosting & Infrastructure Enterprise Grid Services State-wide Grid Services Grid Computing DATA CENTER NCREN Data Archival Services Information Security Services Information Assurance

Co-location Services • GCNS supplies server cabinets – – – • 19” EIA, 42 -RU, 4 -post APC-brand enclosures Perforated, lockable doors 84” high x 24” wide x 40” deep Additional APC cabinet accessories available $1, 200 per cabinet one-time setup fee Base monthly rate of $500* per cabinet – – – Includes two 20 -Amp, 110 -VAC power circuits One 100 -Mbps network uplink Four public IP addresses 30 -day average network utilization of up to 0. 5 -Mbps • Additional network utilization options are available *20% discount available for educational customers

Data Mirroring and Archival Virtual Filers Customer 1 Grid Users Data Grid Interface Customer 2 Linux Servers Net. App Snap. Vault NCREN Customer 3 Net. App Servers Net. App Snap. Mirror Customer 4 Net. App Servers Net. App Snap. Mirror Network Appliance R 200 Nearstore Filer 8 -TB initially (scales up to 96 -TB)

Duke (Gb. E) NCREN NCSU (Gb. E) NCCU RTP Level 3 (Gb. E) Raleigh 7609 Qwest Internet (Oc 12 Po. S) Abilene (Internet 2 OC 48 Po. S) Greenville Greensboro UNC-CH (Gb. E) ECU ECSU CMST UNC-G NCAT ASU Winston-Salem OC 48 SRP Ring counter-rotating ring <=50 ms reroute Fully active redundancy WFU WSSU NCSA Fayetteville FSU UNCP OC 12 SRP Ring Hickory counter-rotating ring <=50 ms reroute Fully active redundancy UNC-C Charlotte Wilmington UNCW Asheville UNCA WCU ERC OC 12 SRP Ring counter-rotating ring <=50 ms reroute Fully active redundancy Qwest (OC 12 Po. S) Level 3 (Gb. E) Greenville

GTEC Projects Driving Grid Adoption MCNC Grid SP Grid Col. Lab Kids Grids Gaming Grid School Grids Grid-Info Grid Download-The-Grid AAAA Project Grid Training Courses Startup Grid Appliance Grid Portal GGF & EGA NC Statewide Grid MCNC Enterprise Grid NC Bio. Grid MCNC Supercomputing 20004 2008

MCNC: 3 -Year GCNS Grid Roadmap Grid Service Provider: Network, Computing, Data, Video Partner with SC Sites Build GTEC Service Portfolio Start Grid Consulting Easy Access: Annual GSP Workshop Training, Web Courses Access Grid Node Grid Appliance Quad. A Awareness Creation: Conferences, Workshops, PR MCNC Enterprise Grid NC Bio. Grid NC Statewide Grid CY 03 CY 04 CY 05 CY 06