Building a Cyber Infrastructure at Clemson Sebastien Goasguen

Building a Cyber. Infrastructure at Clemson… Sebastien Goasguen School of Computing and Clemson Computing Information Technology (CCIT) March 7 th 2007 OSG All Hands March 2007

Clemson Computing DNA • Clemson has put computing at the core of its mission – New CIO: Jim Bottum – New CTO: Jim Pepin – New School of Computing, search in progress for a school director, three division leaders and couple months later six assistant professors • Building traditional HPC from scratch – No prior involvement in HPC support – No trained staff for either system administration or application • Infrastructure and hardware there or coming – 20, 000 sqft of raised floor, new power coming straight from the nuclear plant – Above 10 Tflops in the works through various sources. Automotive research center (Micheling, BMW…), Faculty community cluster and Provost support • All hands on deck to build the CI campus of tomorrow OSG All Hands March 2007

21 st Century Science User Applications Collective services (application service) Resource protocols (application instantiation) Computing / Storage / Networks / Sensors Fabric • “…the most successful communities are likely to be those that succeed in assembling and making effective use of appropriate grid infrastructure” Ian Foster, The Grid: A new infrastructure for 21 st Century Science. • “…it is our belief that VOs have the potential to change dramatically the way we use computers, much as the web has changed the way we exchange information” -Ian Foster, Carl Kesselman, Steven Tuecke. Anatomy of the Grid OSG All Hands March 2007

Building CI at Clemson • The Fabric layer – HPC resources – Campus Grid – Sharing of resources • The middleware layer – Deploy services interface to our resources – Increase identity management capabilities for sharing • The application layer – New environments for students – New environments for researchers • A social layer OSG All Hands March 2007

Randy Martin, David Atkinson, Matt Rector OSG All Hands March 2007

Setting up Condor: Experience 1. Permission denied errors due to negotiate or and collector being started by the windows condor installation. This problem was resolved by installing condor 6. 8. 4. 2. All of the PCs had the same windows xp computer name. This caused the sudden drop offs in our condor view stats. To fix this problem, we added MASTER_NAME = $(IP_ADDRESS) and SCHEDD_NAME = $(IP_ADDRESS) configuration values to the PC condor config files. 3. We added DNS names for all of the lab PCs. OSG All Hands March 2007

Condor Experience bis Additional Steps taken while learning and debugging: -potential issue with hyperthreading effecting totals -numerous condor config changes -possibility of dropped UDP packets -possiblity of invalid credentials on lab images -changes in kernel parameters regarding buffer sizes for the OS “Most of these had little to no effect on the actual problem but they were still steps we had to go through in the process” - David Atkinson OSG All Hands March 2007

Potential Users • Mike Freye, EE, computational electromagnetics, FDTD matlab code -> Up and Running • David Bruce, CE, Molecular Dynamics, GROMACS >Running tests, pushing Cygwin libraries to compute nodes • Clemson Genetics: BLAST, testing • Stephen Moysey: School of Environment LIDAR analysis, ground penetrating radar analysis, Matlab code • Damon Woddard, Biometrics, analysis of images • Feng Luo, Bioinformatics, Text mining. OSG All Hands March 2007

Open Science Grid OSG All Hands March 2007

Getting on OSG • Set up a Gatekeeper • Get a server certificate • Get a personal certificate to register the resource ” The only issues I had getting up on OSG was the time it took to get the osggate hardware and the short delay in getting my personal certificate that was needed to register us. I had no issues installing and configuring the VDT. ” -Randy Martin OSG All Hands March 2007

Firewall Issues • Couple years ago after Blaster and Co, Clemson put every machine behind a firewall. • Globus ephemeral ports closed – Cannot send Globus job from my desktop osggate Condor-c ssh desktop OSG All Hands March 2007

Grid. Shib • While working on TG, realized issues with CA – Multiplication of CA – Need for mutual trust, federation – Relative difficulty to obtain a cert • Universities are best suited to vouch for users identity – Use local campus credentials to access grid services – Tie local Identity Management to a system that issues proxies • Clemson joined In. Common Federation • Deployed Gridshib. CA • Goal is to access OSG and TG and other Grids with Clemson’s credentials. "/C=US/O=Clemson/OU=Shibboleth User/CN=SEBGOA@clemson. edu" sebgoa OSG All Hands March 2007

OSG All Hands March 2007

Shibboleth and the Grid Barry Johnson, Kyle Peacock OSG All Hands March 2007

Clemson E-communities • Virtual Organizations have been known for scientific work • But VOs are also standard group of people sharing a common goal, collaborating and interacting to achieve that goal – Classroom as a VO “Bridging Research and Education” – Clemson creative inquiry courses – E-communities on campus as small VO • Need a social networking support as well as standard grid infrastructure. OSG All Hands March 2007

Service Oriented Science WS WS Services OSG All Hands March 2007

Existing CI at Clemson Dr. Chris Post Sam Esswein • Environmental sensor deployment • Gathering of data • Data curation • Making data available to others OSG All Hands March 2007

Holling Marine Lab in Charleston http: //www. marinegenomics. org Marine Genomics “Portal” hosted at MUSC CCIT OSG All Hands March 2007 Access to CUGI resources (Cluster) in progress for gene sequencing

Conclusions • Clemson is building a HPC infrastructure and future CI environment from scratch. • Faculty and CCIT are partnering to make this happen. • First interesting resource at Clemson is a “ 1, 200 machine” Condor pool. New clusters are also being deployed as we speak. • Supporting users and supporting VOs • Building the Fabric, deploying and developing the middleware and the application environments is already underway…we recruit : ) OSG All Hands March 2007