The ETICS Service Configuration Building and Testing Elisabetta

The ETICS Service Configuration, Building and Testing Elisabetta Ronchieri, ETICS Project, INFN CNAF www. eu-etics. org INFSOM-RI-026753

Contents • • • Project Goals Achievements Work packages Status Summary Deliverables INFN Manpower INFN testbed INFSOM-RI-026753 INFN - 7 March 2007 – Bologna, Italy 2

Project Goals • A professionally managed, integrated system of services and resources for running automated builds and test suites for distributed software projects • A repository of packages, test reports and interoperability information that development projects can use to develop, validate and certify their products • A forum where to discuss and promote software quality initiatives and collect common software engineering tools and processes, software configuration information and documentation. INFSOM-RI-026753 INFN - 7 March 2007 – Bologna, Italy 3

The ETICS Partners Build system, software configuration, service infrastructure, dissemination, EGEE, g. Lite, project coord. The Condor batch system, distributed testing tools, service infrastructure, NMI Software configuration, service infrastructure, dissemination Web portals and tools, quality process, dissemination, DILIGENT Test methods and metrics, unit testing tools, EBIT INFSOM-RI-026753 INFN - 7 March 2007 – Bologna, Italy 4

Project Structure WP 1 PROJECT ADMINISTRATIVE AND TECHNICAL MANAGEMENT • CERN (Lead) WP 2 • Uo. W (Lead) • CERN, INFN INFRASTRUCTURE WP 3 SOFTWARE CONFIGURATION, BUILD, INTEROPERABILITY WP 4 SOFTWARE TESTING WP 5 DISSEMINATION, TRAINING, USER INTERFACES INFSOM-RI-026753 • INFN (Lead) • CERN • 4 DSoft (Lead) • Uo. W • CERN (Lead) • Engineering INFN - 7 March 2007 – Bologna, Italy 5

What has ETICS delivered? • Infrastructure – Three resource sites at CERN, INFN and Uo. W with more that 150 CPUs and more than 15 platforms • Services – A set of web services and tools for configuring, building and testing software – Web and multiplatform CLI clients – An initial repository of build/test reports and packages • Community Support – Build and test support for more than 10 projects and in particular EGEE (g. Lite, mpi, Grid. Way), DILIGENT and OMII-Europe • Dissemination and Training – Three major training events (EGEE’ 06, DILIGENT TCOM, INFN-CNAF) – A Build &Test Community Group in OGF INFSOM-RI-026753 INFN - 7 March 2007 – Bologna, Italy 6

The ETICS Timeline April 2006 ETICS Alpha programme started (first g. Lite components registered) July 2006 ETICS Beta programme started (g. Lite 3. 1 managed only with ETICS), DILIGENT using for testing, OMIIEurope project created February 2007 ETICS Service v 1. 0 Released • 1 st Review All-hands meeting (Bologna) All-hands meeting (Budapest) • Kick-off Jan 06 INFSOM-RI-026753 Jun 06 September 2006 ETICS Pre-release programme started, first major training event in Geneva Dec 06 Mar 07 INFN - 7 March 2007 – Bologna, Italy 7

WP 2: Infrastructure and Service Management • Goals – To set up and maintain the grid services and computing resources where ETICS testing, integration and validation activities are performed across the resource centres – To set up and maintain the software repository, possibly in collaboration with other resource providers and implement the packages management strategies during build/test execution INFSOM-RI-026753 INFN - 7 March 2007 – Bologna, Italy 8

WP 2: Infrastructure and Service Management • Major Achievements – Deployment and maintenance of the three resource sites at CERN, INFN and University of Wisconsin with more than 150 CPUs running a variety of more than 15 different platforms – deliverable D 2. 1, documented deployment procedures for all ETICS services D 2. 2, state of services D 2. 3 – Set up of the ETICS repository infrastructure and procedures for deploying the ETICS service components INFSOM-RI-026753 INFN - 7 March 2007 – Bologna, Italy 9

WP 3: Software Configuration Tools and Methodologies • Goals – To provide a configuration information schema able to capture the configuration information of software developed by research project and allowing coherent storage of such information in the ETICS database – To provide a configuration, build and integration system based on existing or adapted tools able to perform build/integration tasks to be executed by the ETICS facility – To define metrics in order to evaluate the interoperability, portability and standardization of the software using the ETICS system INFSOM-RI-026753 INFN - 7 March 2007 – Bologna, Italy 10

WP 3: Software Configuration Tools and Methodologies • Major Achievements – Definition of a data model to describe configuration information and build/test operation in a secure, multiplatform environment. Implementation in a relational database system (My. SQL) – Design and development of a web service to coordinate the work between the database and the various build/test tools and clients – Integration and extension of build tools and clients from EGEE and other projects to work in the distributed, multiplatform environments that ETICS must support (as described in D 3. 1) – Initial analysis of interoperability and compliance requirements (deliverable D 3. 2) INFSOM-RI-026753 INFN - 7 March 2007 – Bologna, Italy 11

Relations with Other Projects • ETICS has spent considerable effort in establishing relationships with other projects: – – – – EGEE: SA 3 (certification), JRA 1 (development), NA 4 (applications) DILIGENT: integration and testing OGF: co-chair of a Community Group on Build, Test and Certification of grid software OMII-Europe: provider of the build and test infrastructure EUChina. Grid: implementation of plugins for IPv 6 compliance tests ICEAGE: participation to the Grid Computing School 2006 CERN openlab: co-organizer with EGEE of the HP workshop on g. Lite industrial readiness Goldrake: build system at CNAF • ETICS has actively taken part to the EC/IST activities: – e. IRG Workshops (Linz, Espoo) – IST Workshops and Concertation Meetings (Bordeaux, Helsinki) INFSOM-RI-026753 INFN - 7 March 2007 – Bologna, Italy 12

Deliverables and milestones • All deliverables/milestones (PM 1 -12) done – 15 deliverables and 8 milestones in 12 months INFSOM-RI-026753 INFN - 7 March 2007 – Bologna, Italy 13

Deliverables List Del. no. Deliverable name D 2. 1 D 3. 1 D 2. 2 D 2. 3 Service Level Agreement document Configuration, build and integration specifications Infrastructure installation and usage documentation Status of certification, integration and validation test bed setup (prototype) D 3. 2 Interoperability reports specifications, configuration, build and integration system INFSOM-RI-026753 WP no. Lead Delivery Actual participant date delivery date (PM) 2 3 2 2 Uo. W INFN Uo. W PM 03 PM 06 PM 12 12/05/2006 14/08/2006 24/01/2006 3 INFN PM 12 24/01/2006 INFN - 7 March 2007 – Bologna, Italy 14

Conferences • RISE 2006 conference, Bégin, M. , et al. , 2006, “Build, Configuration, Integration and Testing Tools for Large Software Projects: ETICS”, Proceedings of RISE 2006 International Workshop on Rapid Integration of Software Engineering techniques, 13 -15 September, 2006, University of Geneva, Switzerland. • IDPT 2007 conference, Bégin, M. , et al. , 2007, “ANALYSIS OF REQUIREMENTS FOR AUTOMATED INTEROPERABILITY TESTING”, submitted INFSOM-RI-026753 INFN - 7 March 2007 – Bologna, Italy 15

INFN Manpower Saverio Da Ronco Mattia Gentilini Funded, co. pro Elisabetta Roncheri Funded, art. 23 Matteo Selmi Funded, art. 23 Cristina Vistoli INFSOM-RI-026753 Funded, co. pro Unfunded INFN - 7 March 2007 – Bologna, Italy 16

INFN Testbed ladyoscar ETICS development etics-01 ETICS production server etics-02 WN, SLC 3, 32 bit etics-03 WN, SLC 3, 64 bit etics-04 WN, SLC 4, 32 bit etics-05 WN, CENTOS 3 etics-06 ETICS preproduction server etics-07 WN, Mac OS 10 • Received 5 K euro for new machines (1 WN slc 4 64 bit) INFSOM-RI-026753 INFN - 7 March 2007 – Bologna, Italy 17

Transfer Plan until June 2007 March April CERN 2/3 days 2 people May INFSOM-RI-026753 CERN 2 days 2 people All Hands ETICS meeting, Madison, USA 2 people INFN - 7 March 2007 – Bologna, Italy 18

Thanks http: //www. eu-etics. org INFSOM-RI-026753 INFN - 7 March 2007 – Bologna, Italy 19