Installing and using Grid client software Colombia Grid

Installing and using Grid client software Colombia Grid School – October, 2009 Marco Mambelli – University of Chicago marco@hep. uchicago. edu

Pacman Package manager developed by Saul Youssef of Boston University Good for personal installations Installations are self contained Not requiring root privilege Main OSG software delivery method 4/9/09 Grid Resources and Job Management M. Mambelli 2

Pacman and OSG Client Pacman is a packet manager that we use in OSG to install our software OSG-Client is a package that includes a lot of applications to interact with the grid (all the ones that you have been using in the past days) The workshop machine has this software already installed for you (/opt/client) but here I’ll show you how to start from zero for a personal installation 4/9/09 Grid Resources and Job Management M. Mambelli 3

What to do Get Pacman Install and setup pacman make osg-client directory Install OSG-Client Answer installation questions Post install setup (installing CA certificates) 4/9/09 Grid Resources and Job Management M. Mambelli 4

Installation wget http: //atlas. bu. edu/~youssef/pacman/sample_cache/tarballs/pacmanlatest. tar. gz tar –xzfpacman-latest. tar. gz cd pacman-3. 29 source setup. sh cd. . mkdir osg-client cd osg-client pacman –get OSG: client [installation starts] yall [when asked if you trust the software caches] [some time later] y [when asked if you accept licenses] l [‘L’ when asked if you want to install locally the certificates] 4/9/09 Grid Resources and Job Management M. Mambelli 5

Installation (cont) [at the end of the installation you need to install the CA certificates. VDT is warning about it. This is done to allow you to choose which CA (Certification Authority) you trust. You do that editing $VDT_LOCATION/vdt/etc/vdt-updatecerts. conf, e. g. uncomment the line about OSG CA-bundle in the following steps] source setup. sh source. /setup. sh vdt-ca-manage setupca --location local --url osg [Now you can repeat the exercises if you like. You need first to get a grid certificate] 4/9/09 Grid Resources and Job Management M. Mambelli 6

OSG and Environment So far you have been guided on the commands to use Now you’ll have to use OSG on your own You can use Information Systems to discover and describe resources (see earlier talks today) You can use high level tools (Match. Maker, Panda, …) to make your task easier (very useful in production!) For simple tests and basic commands here are : Guidelines on how to execute jobs Guidelines on how to use available disk spaces Jobs find an uniform standard environment in OSG 4/9/09 OSG_AAA variables Grid Resources and Job Management M. Mambelli 7

Grid/OSG components All have standard installation They provide a set of services or resources containing data and providing processing power They are: Computing elements (CE) Storage elements (SE) Information systems Clients LRM Gatekeeper Door WN Disk SE How can you interact? 4/9/09 Discovering information With active use (submitting jobs, transferring files) CE Information system Grid Resources and Job Management M. Mambelli Auxiliary systems 8

In an OSG Site Everything has a place OSG_APP OSG_GRID shared directory OSG_SITE_READ, OSG_SITE_WRITE local working directory OSG_DATA directory to find grid clients (OSG: WN) OSG_WN_TMP directory to install applications optimized for efficient read/write DEFAULT_SE 4/9/09 storage element close to this computing element Grid Resources and Job Management M. Mambelli 9

Possible configurations Follow a couple of pages with possible site configurations and the names used to indentify the components A simple site and a more complex one are presented 4/9/09 Grid Resources and Job Management M. Mambelli 10

CE View CE SE WN SE (SRM, gridftp) DEFAULT_SE CE-SE bindings CEStorage (POSIX acc) OSG_WN_TMP CEStorage (read, write) OSG_APP OSG_DATA … 4/9/09 Grid Resources and Job Management M. Mambelli SE 11

Outside View CE SE(SRM, gridftp) DEFAULT_SE CE-SE binding SE WN Gatekeeper Host SE SE(SRM, gridftp) CE-SE binding 4/9/09 Grid Resources and Job Management M. Mambelli 12

CE View (OSG_WRITE, OSG_READ) CE SE WN SE CEStorage (read only) OSG_SITE_READ SE CEStorage (write only) OSG_SITE_WRITE 4/9/09 SE Grid Resources and Job Management M. Mambelli SE(SRM, gridftp) CE-SE binding Used for the remaining accesses, from outside or inside Host 13

Good luck interacting with the Grid! You will need a grid certificate! https: //twiki. grid. iu. edu/bin/view/Documentation/Certifi cate. Get Ask to your VO or to OSG-EDU The client you installed will allow to repeat all the examples seen during the week In the next page is a rough example similar to the commands at the end of the job management session. You have a client and a valid certificate. You want to use the MWT 2_UC (uct 2 -grid 6. uchicago. edu) 4/9/09 Grid Resources and Job Management M. Mambelli 14

Rough example voms-proxy-init […] globus-job-run uct 2 -grid 6. uchicago. edu /bin/env | grep OSG_ [You can find OSG_APP, OSG_DATA, OSG_WN_TMP, . . . OSG_APP is “/osg/app” and will be used in the following commands] globus-job-run uct 2 -grid 6. uchicago. edu /bin/mkdir -p /osg/app/osgedu/marco globus-job-run uct 2 -grid 6. uchicago. edu /bin/ls -l /osg/app/osgedu/marco [ total 0 ] globus-url-copy file: ///sw/national_grids/primetest gsiftp: //uct 2 -grid 6. uchicago. edu/osg/app/osgedu/marco/prim globus-job-run uct 2 -grid 6. uchicago. edu /bin/ls -l /osg/app/osgedu/marco/ [ total 8 -rw-r--r-- 1 osgedu osgvo 7914 Oct 23 12: 22 primetest ] globus-job-run uct 2 -grid 6. uchicago. edu /bin/chmod a+x /osg/app/osgedu/marco/primetest [ you need this, else you'll have "GRAM Job failed because the executable file permissions do not allow execution (error code 72)"] globus-job-run uct 2 -grid 6. uchicago. edu /bin/ls -l /osg/app/osg [total 8 -rwxr-xr-x 1 osgedu osgvo 7914 Oct 23 12: 22 primetest] globus-job-run uct 2 -grid 6. uchicago. edu /osg/app/osgedu/marco/primetest 51 [ NO - 3 is a factor ] 4/9/09 Grid Resources and Job Management M. Mambelli 15

Some references A Twiki page with OSG-Client installation instructions: OSG Support on Campfire (chat room): https: //twiki. grid. iu. edu/bin/view/Site. Coordination/Grid Client. Tutorial https: //integrationcloud. campfirenow. com/e 5714 Workshop mailing list for questions: 4/9/09 GRIDCO-WS 09@FNAL. GOV Grid Resources and Job Management M. Mambelli 16