USER ORIENTED GRID TESTING Gábor Hermann and M

USER ORIENTED GRID TESTING Gábor Hermann and M. Kozlovszky, K. Karóczkai, I. Márton, A. Schnautigel, P. Kacsuk, R. Harrington, D. Martin, C. Winsnes, T. Strodl MTA SZTAKI, Hungary / Worcester Polytechnic Institute, US DAPSYS 2006 - 6 th AUSTRIAN-HUNGARIAN WORKSHOP ON DISTRIBUTED AND PARALLEL SYSTEMS, Innsbruck, Sept. 21 -23

Grid test challenge Grids are distributed n Grids are dynamic n Grids are unreliable n Grid software is heterogeneous n Grid software is multilayered n Grid technology is rapidly evolving n DAPSYS 2006 - 6 th AUSTRIAN-HUNGARIAN WORKSHOP ON DISTRIBUTED AND PARALLEL SYSTEMS, Innsbruck, Sept. 21 -23

Main actors of the Grid environment as sources and observers of errors: ? Grids - Distributed large scale system with many potential problems n n Hardware Software (technologies, blocking services (certificates, catalogues, information systems), improper updates ( of Grid Map files, Credential Revocation lists etc ) Network Infrastructure ? Portals - with many potential problems n n n Software implementation Network infrastructure Expiration of host certificates Exhausting of own resources ? Users - with many potential problems n n “Hardware” Buggy applications Lack of knowledge In an unacceptable high number of cases the user is unable to distinguish own errors from the ones of the Grid environment DAPSYS 2006 - 6 th AUSTRIAN-HUNGARIAN WORKSHOP ON DISTRIBUTED AND PARALLEL SYSTEMS, Innsbruck, Sept. 21 -23

Error frequency distribution of layers Layer Function Error frequency Application Launchability high Application –Inter application, communication MPI etc Extremely high Application- Job requirements CPU, Memory, Processors high (MPI) , SW Security layer of User certificates, VO membership high Security layer of Middleware Infrastructure security issues (Host certificates) fairly low Site Services Access of CE and SE high Service (Central) Myproxy, Broker, Information Services rather high Network Communication availability low DAPSYS 2006 - 6 th AUSTRIAN-HUNGARIAN WORKSHOP ON DISTRIBUTED AND PARALLEL SYSTEMS, Innsbruck, Sept. 21 -23

Portal Workflow Test Categories on the P-GRADE Portal n Infrastructure Test n (IT) Application class category test (ACCT) Targeted users: Grid Administrators Portal Administrators Grid Application Developers / “normal” User DAPSYS 2006 - 6 th AUSTRIAN-HUNGARIAN WORKSHOP ON DISTRIBUTED AND PARALLEL SYSTEMS, Innsbruck, Sept. 21 -23

Features and Advantages of the Infrastructure Test n User Specific n n n The user tests own certificates (and its validity in a given Virtual Organization) The test can be modified by the user as the Infrastructure changes The test can be easily migrated by the user to a new Infrastructure (VO) The test can be submitted at any time by the user The test investigates the most relevant basic functionality features of the Infrastructure (Security, Broker, CE, SE, Grid File Catalogue, Information System) DAPSYS 2006 - 6 th AUSTRIAN-HUNGARIAN WORKSHOP ON DISTRIBUTED AND PARALLEL SYSTEMS, Innsbruck, Sept. 21 -23

Features and Advantages of the Application Class Category test n n n With its extendable knowledge base (Workflow repository) it may contain a rich set of test Workflows. The high variety of Workflows may be adopted to investigate the multi-grid feature of the P-Grade Portal as well. Community specific: n n The content of the repository is submitted by a distinguished Test user (with the certificate of the Test user) and the success/failure of the tests can be observed by all users. The workflows are submitted periodically finding a proper compromise between the need to be up to date informed and the self restriction refraining from flooding the Portal and Grid Infrastructure DAPSYS 2006 - 6 th AUSTRIAN-HUNGARIAN WORKSHOP ON DISTRIBUTED AND PARALLEL SYSTEMS, Innsbruck, Sept. 21 -23

n Implemented Infrastructure Test: The VO functionality test built Aim to check all the sites within one Virtual Organization upon the LCG_2 (EGEE) middleware (Broker support): n n n Accessibility Base functionalities Test targets: n n Computing Elements (all) (CE) Proper setting of the Grid file catalogue Default access to the storage elements (SE) Job submission process n Available online: http: //www. lpds. sztaki. hu/pgportal/v 23/includes/VO_functionality_test. html DAPSYS 2006 - 6 th AUSTRIAN-HUNGARIAN WORKSHOP ON DISTRIBUTED AND PARALLEL SYSTEMS, Innsbruck, Sept. 21 -23

Administrative job extending the read/write permissions of the established Grid file for any different user – This job makes it possible, that any user –not only the owner of the referenced file catalogue may use the test WF Executes a simple mathematic (multiplication) operation where one input operand is local file in tothe Copies a the Grid File an other isundefined SE referencedthe a local file delivered by by Sandbox service of the Broker. symbolical NAME: These jobssubmission process, Tests test whether the Executes simple can dedicateda. CE sitesmathematic personal certificate usage and (multiplication)other elements communicate withcatalogue settings Grid file the operation where one input operand is the Grid File of the infrastructure. the other is a local file delivered by the Sandbox service user Broker. Using this template, theof thecan The ability of Graph as to select easily modify the Broker CE-s a CE to an from) the VO come in (or go out. SE will be tested! DAPSYS 2006 - 6 th AUSTRIAN-HUNGARIAN WORKSHOP ON DISTRIBUTED AND PARALLEL SYSTEMS, Innsbruck, Sept. 21 -23

Job "Budapest" aborted: Status: Aborted. Stat us code: 1 Reason: Job Retry. Count (3) hit. Destination: eszakigrid 66. inf. elte. hu: 2119/jobmanage r-lcgpbs-voce. Job aborted by LCG 2 grid execution Job "Posen 2" system. Job "Budapest" aborted: Status: Aborted. Sta failed (exit code was 255)! tus code: 0 Reason: Cannot plan: Broker. Helper: no compatible resources. Destination: Job aborted by LCG 2 grid execution system. Job "Posen 2" failed (exit code was 255)! Result of the VO functionality test DAPSYS 2006 - 6 th AUSTRIAN-HUNGARIAN WORKSHOP ON DISTRIBUTED AND PARALLEL SYSTEMS, Innsbruck, Sept. 21 -23

Application Class Category Test Details: What we need? A taxonomy to define the imaginable application task categories n A central storage where the tasks (implemented as workflows and uploaded by trained administrators) belonging to these categories are maintained. n A scheduler to submit the tasks automatically n A table to show the results n DAPSYS 2006 - 6 th AUSTRIAN-HUNGARIAN WORKSHOP ON DISTRIBUTED AND PARALLEL SYSTEMS, Innsbruck, Sept. 21 -23

Application Class Category Test Taxonomy is implemented as Naming convention U - Unique B - Broker C - Defined Computing Element S - Defined Storage Element Q - Sequential X - Complex D - Direct F - Free Choice N - No Defined Storage Element M - MPI DAPSYS 2006 - 6 th AUSTRIAN-HUNGARIAN WORKSHOP ON DISTRIBUTED AND PARALLEL SYSTEMS, Innsbruck, Sept. 21 -23

Example Lets define a single MPI job task submitted by the broker accessing dedicated SE “AAA” and running on any Computing Element: U_B_F_S_AAA_M_ U_B_F_S_AAA_ U_B_F_ U_B_ U_ DAPSYS 2006 - 6 th AUSTRIAN-HUNGARIAN WORKSHOP ON DISTRIBUTED AND PARALLEL SYSTEMS, Innsbruck, Sept. 21 -23

Common Area for Grid Information Last run Status of the tests Type and target of the tests Naming conventions DAPSYS 2006 - 6 th AUSTRIAN-HUNGARIAN WORKSHOP ON DISTRIBUTED AND PARALLEL SYSTEMS, Innsbruck, Sept. 21 -23

References n Official portal of n n HUNGRID infrastructure n n SEE-GRID infrastructure VOCE https: //n 45. hpcc. sztaki. hu: 8443/gridsphere https: //n 41. hpcc. sztaki. hu: 8443/gridsphere https: //n 42. hpcc. sztaki. hu: 8443/gridsphere P-GRADE portal is available as service for: n n n UK National Grid Service GILDA Croatian Grid EGrid (Italy) Turkish Grid Bio. Info. Grid DAPSYS 2006 - 6 th AUSTRIAN-HUNGARIAN WORKSHOP ON DISTRIBUTED AND PARALLEL SYSTEMS, Innsbruck, Sept. 21 -23

Final conclusions n P-GRADE portal provides: User friendly interface to wide range of Grid infrastructures n Easy-to-use workflow concept for solving complex testing problems n Fast development of test application n Color coded feedback about infrastructure status n Automatic SFT-like and manual (user level) test solutions n Workflow repository for the user community n Created test workflows are highly portable on User/Portal/VO scale n DAPSYS 2006 - 6 th AUSTRIAN-HUNGARIAN WORKSHOP ON DISTRIBUTED AND PARALLEL SYSTEMS, Innsbruck, Sept. 21 -23

Thank you. LPDS SZTAKI: http: //www. lpds. sztaki. hu DAPSYS 2006 - 6 th AUSTRIAN-HUNGARIAN WORKSHOP ON DISTRIBUTED AND PARALLEL SYSTEMS, Innsbruck, Sept. 21 -23

Result of the VO functionality test DAPSYS 2006 - 6 th AUSTRIAN-HUNGARIAN WORKSHOP ON DISTRIBUTED AND PARALLEL SYSTEMS, Innsbruck, Sept. 21 -23