Introduction to the Cross Grid Testbed George Tsouloupas

Introduction to the Cross. Grid Testbed George Tsouloupas UCY HPCL

– What is the “Cross. Grid testbed” ? ● ● – A collection of distributed computing resources Supporting a “Grid environment” Objectives Development, Testing and validation ● Emphasis on interoperability with EU-Data. Grid (EDG) • Extension of GRID across Europe ●

● Testbed Overview A collection of distributed computing resources – 16 sites (small & large) in 9 countries, connected through Géant + NRN ● ● – ● 115 CPUs (Worker Nodes) 4 TB (Storage Elements) + Grid Services: Middleware (based on Globus) RB, VO, RC… A group of people and resources make up the Cross. Grid Virtual Organization (VO) and trust each other through national Certification Authorities.

Testbed resources Network

The Local Testbed We currently have: ● 1 CE (apelatis. grid. ucy. ac. cy) 2 x. PIII 1. 2 GHz 1 GB ● 1 SE (se 001. grid. ucy. ac. cy) 2 x. PIII 1 GB 40 GB ● 1 UI (thales. grid. ucy. ac. cy) P 4 2 GHz 1 GB 40 GB ● 4 WN (wn 001 -004. grid. ucy. ac. cy) P 4 2 GHz 1 GB 40 GB ● CA ● LCFG Installation server

CURRENT local testbed status local testbed CE Submit apelatis SE nf (installation server) s WN WN P 4 2 GHz 1 GB RAM 40 GB 1000 Mbit P 4 2 GHz 1 GB RAM 40 GB scsi 1000 Mbit /home NFS 2 x. PIII 800 MHz 1 GB RAM 128 GB scsi LCF G thales 2 x. PIII 1. 2 GHz 1 GB RAM 18 GB scsi 100 Mbit nfs UI CA (certificate generation)

Grid Security ● ● ● Security is a primary concern when it comes to Grids. The Grid Security Infrastructure is based on Public Key Infrastructure. A user is authenticated based on possession of a private key (known only to the user). Authorization depends on whether the user's certificate is signed by an accepted Certification Authority (In our case the Cy. Grid CA) The gridmap-file at the target resource will determine the if a resource will accept a specific

Crossgrid CA's

Obtaining a certificate 1)Create a certificate request file: Under Globus use command: grid-cert-request Or using openssl command: openssl genrsa -des 3 -out user. key; openssl req -new -x 509 -days 365 -key user. key -out user-req. crt DN Format : person: "/C=CY/O=Cy. Grid/O=HPCL/CN=user name" machine: "/C=CY/O=Cy. Grid/O=HPCL/CN=host/machinename. ucy. ac. cy" 2)Send by email your request file to: cygrid-ca@ucy. ac. cy and your RA: hpcl@ucy. ac. cy DO NOT delete either the key file or the request file. It is the sole copy of your private key, Most importantly: keep it secure! 3)You will receive your certificate which is good for one year. 4)Install your certificate on the User Interface machine.

Job Submission ex: globus-job-submit CE A machine with globus client CE ex: dg-job-submit A machine installed as a EDG UI Resource Broker Cross. Grid/Datag rid Services CE

Running a Job ● User logs in on the UI User issues a grid-proxy-init and enters his certificate's password, getting a valid Globus proxy ● ● User sets up his JDL file. Example: JDL of the “hello world” job Executable = "/bin/echo"; Arguments = "Hello World"; Std. Output = "Messagge. txt"; Std. Error = "stderr. log"; Output. Sandbox = {"Message. txt", "stderr. log"};

Running a job ● User issues a: dg-job-submit Hello. World. jdl and gets back from the system a unique Job Identifier (Job. Id) ● User issues a: dg-job-status <Job. Id> to get logging information about the current status of his Job ● When the “Output. Ready” status is reached, the user can issue a dg-job-get-output Job. Id and the system returns the name of the temporary directory

Introduction to LCFG George Tsouloupas UCY HPCL

What is LCFG? ● ● ● Local Con. Fi. Guration system A tool for installation and configuration of large scale, diverse, dynamically changing systems. Installs an RPM based Linux system and configures it. Config of entire site held in source files on central server Each machine defined by exactly one profile. “Profile” constructed for each machine – Utilise inheritance – Based on RPM lists, key-value pairs

LCFG Server Components DHCP Server Software (LCFG) NFS Server Web Server Provides network information. Manages the rpm repository and machine profiles. Serves RPM repository. Server XML machine profiles.

How LCFG Works in One Slide. Config. XML profiles /etc/shadow LCFG Config Files /etc/services /etc/group HTTP /etc/inetd. conf /etc/passwd. . /etc/hosts. allow mickey: x: 999: 20: : /home/Mickey: /bin/tcsh in. telnetd : 192. 168. , 192. 135. 30. . . in. rlogind : 192. 168. , 192. 135. 30. Make XML Profile in. ftpd : 192. 168. , 192. 135. 30. sshd : ALL Read rdxprof Profile Load ldxprof Profile +inet. services telnet login ftp <inet> +inet. allow telnet login ftp sshd <allow cfg: template="allow_$ tag_$ daemon_$"> +inet. allow_telnet ALLOWED_NETWORKS <allow_RECORD cfg: name="telnet"> Profile Generic Object Component +inet. allow_login ALLOWED_NETWORKS <allow>192. 168. , 192. 135. 30. </allow> +inet. allow_ftp ALLOWED_NETWORKS </allow_RECORD> Web Server XML Profile +inet. allow_sshd ALL. . . +inet. daemon_sshd yes </auth> Local cache inet auth . . . <user_RECORD cfg: name="mickey"> LCFG Objects +auth. users myckey <userhome>/home/Mickey. Mouse. Home</userhome> Server Abstract configuration parameters for all nodes stored in a central repository +auth. userhome_mickey /home/mickey <usershell>/bin/tcsh</usershell> Client nodes +auth. usershell_mickey /bin/tcsh </user_RECORD> A collection of agents read configuration parameters and either generate traditional config files or directly manipulate various services

LCFG Installation ● Custom install Red Hat 6. 2 including – ● ● ● NFS, web server Install LCFG RPMs and directory tree Configure web server Populate RPM repositories Make root filesystem available over NFS Configure DHCP server Create client profiles

Profiles ● ● ● A profile contains a list of RPMs to be installed and configuration data Located in /var/obj/conf/profile/source. Edit site-cfg. h => globus. conf , info-mds. conf, gdmp. conf and others. Files testbed 001 -testbed 004 are sample UI, CE, SE and WN. Rename one, e. g. apelatis. Edit apelatis; hostname and hardware. #include "AIC_Computing. Element-cfg. h". . . +update. modlist eepro 100 +update. mod_eepro 100 alias eth 0 eepro 100 +update. rootpwd hj%4 a. Jkfk 45

Profiles (cont) Contents of "AIC_Computing. Element-cfg. h" ● #include "Computing. Element-cfg. h" +update. rpmcfg CE_AIC 7 xxx-rpm +update. disks sda +update. bootdisk sda +update. dopartition_sda yes +update. partitions_sda 2 sda 1 sda 3 +update. pdetails_sda 1 64 /boot +update. pdetails_sda 2 free / +update. pdetails_sda 3 1000 swap

Questions ? . . . then more examples on prometheus. grid. ucy. ac. cy (our LCFG server)