Software Integration and Test Techniques in a Large

Software Integration and Test Techniques in a Large Distributed Project: Evolution, Process Improvement, Results Paola Sivera - ESO ICALEPCS 2007, 15 -19 Oct 2007, Knoxville TN

ALMA Geographical distribution Univ. Calgary ALMA ATF c DRAO Penticton MPI Bonn ATC Edinburgh Jodrell Bank ESO c DAMIR/IEM Madrid NAOJ NRAO ALMA Santiago Obs de Paris IRAM Grenoble Brera Observatory Arcetri Observatory ICALEPCS 2007, 15 -19 Oct 2007, Knoxville TN 2

Trilateral Computing IPT Organisation Total Bilateral staff now: 40 FTEs ALMA Management B. Glendenning G. Raffi K. Tatematsu Science Software Requirements R. Lucas Executive P. Grosbol Control A. Farris High Level Analysis J. Schwarz Software Eng M. Zamparelli Correlator J. Pisano Scheduler A. Farris Integration P. Sivera Total Bilateral staff now: 65 FTEs trilateral staff now: 40 FTEs Total trilateral staff now: 65 FTEs Common SW G. Chiozzi Observation Preparation A. Bridger Pipeline L. Davis Archiving A. Wicenec Offline J. Mc. Mullen ICALEPCS 2007, 15 -19 Oct 2007, Knoxville TN ACA M. Watanabe Operations Support M. Chavan Telescope Calibration R. Lucas 3

ICALEPCS 2007, 15 -19 Oct 2007, Knoxville TN 4

ICALEPCS 2007, 15 -19 Oct 2007, Knoxville TN 5

ALMA System Dataflow ICALEPCS 2007, 15 -19 Oct 2007, Knoxville TN 6

Standards and Tools • Alma Common Software • Environment • CVS organization • Makefile • Standard Test Environment • Tool for automated testing • Bug tracking tool (JIRA) ICALEPCS 2007, 15 -19 Oct 2007, Knoxville TN 7

ALMA Release Cycle ICD Freeze = 15 th of the month Monthly integration = last day of the month Minor Release: Mar 31 • • • Major Release: Sep 30 • • • Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec ICALEPCS 2007, 15 -19 Oct 2007, Knoxville TN 8

Function-based Teams ICALEPCS 2007, 15 -19 Oct 2007, Knoxville TN 9

FBTs organization Z Shared. Simulator-2006 -02 -B (branch) Shared. Simulator-2006 -02 -Root. Of. Branch (tag of the HEAD) A Shared. Simulator-2006 -02 -Before. Merge B TRUNK-Shared. Simulator-2006 -02 -Before. Merge C TRUNK-Shared. Simulator-2006 -02 -After. Merge (tag of the HEAD) Shared. Simulator-2006 -02 -After. Merge-B (branch) F Shared. Simulator-2006 -02 -FINAL ICALEPCS 2007, 15 -19 Oct 2007, Knoxville TN 10

Summing it up • FBTs advantages: – Improve communication – More effective involvement of testers • Testing end-to-end since the beginning – Good for object-oriented software – A lot of maintenance on the test cases ICALEPCS 2007, 15 -19 Oct 2007, Knoxville TN 11

Where we are Testing maturity (according to Boris Beizer) 1. there is no difference between testing and debugging 2. the purpose of testing is to show that the software works 3. the purpose of testing is to show that the software does not work 4. the purpose of testing is not to prove anything, but to reduce the perceived risk of not working to an acceptable value ICALEPCS 2007, 15 -19 Oct 2007, Knoxville TN 12

Future developments • Make software more testable from its inception • adoption of the test maturity model (TMM) ICALEPCS 2007, 15 -19 Oct 2007, Knoxville TN 13