Excellence in Software Engineering Optimized Level Manage d

Excellence in Software Engineering Optimized Level Manage d Level Defined Level SE 470 - Other Software Engineering Processes Repeatable Level Initial Level Excellence in Software Engineering Optimizing Level Managed Level Defined Level Repeatable Level Initial Level Larry Dribin, Ph. D. - De. Paul University Phone: (847)807 -7390 - Fax: (847)459 -1650 Email: dribin@cs. depaul. edu Copyright Ó 2001 - Larry Dribin, Ph. D. - v 1 10 -29 -01 Copyright Ó 2001 - Larry Dribin, Ph. D. SE 470_Other. SEProc_v 1. pp SE 470 Other SE Processes - 1

Excellence in Software Engineering Optimized Level Manage d Level Defined Level Software Engineering Institute (SEI) Repeatable Level Initial Level · Organization funded by the Department of Defense (DOD) to improve software in DOD operations. · Established in December 1984. · Located at Carnegie Mellon University. · Research and publications oriented. · Most publications available to public. The SEI Mission is to improve the state of the practice of software engineering. Copyright Ó 2001 - Larry Dribin, Ph. D. SE 470_Other. SEProc_v 1. pp SE 470 Other SE Processes - 2

Excellence in In 1991 SEI Developed the Capability Maturity Model - CMMSW Software Engineering Optimized Level Manage d Level Defined Level Repeatable Level Initial Level The SEI developed the CMM to characterize the capabilities of software organizations and help them improve. Each of the five levels of the CMM defines a set of processes which determine an organization’s capability to develop software. Each level provides a foundation for the levels above. • Organized collections of best practices • Based on work by Crosby, Deming, Juran, Humphrey. . . • Systematic ordered approach to process improvement • Means of measuring organizational capability and maturity • Have proven to bring significant return on investment in productivity and quality • Provide easy to use models for process improvement Copyright Ó 2001 - Larry Dribin, Ph. D. SE 470_Other. SEProc_v 1. pp SE 470 Other SE Processes - 3

Excellence in Software Engineering Optimized Level Manage d Level Defined Level CMMSW - Software Level Process Maturity Model Repeatable Level Initial Level Characteristic • Optimizing • Process optimization using continuous process improvement. Cost and schedule under control with very high quality. • Managed • Process metrics gathered automatically and analyzed. Problem prevention processes in place. Cost, schedule and quality in control. • Defined • Development process defined and followed by staff. Process group established. Reliable cost and schedules, but quality varies. • Repeatable • Basic project controls in place, reasonable control over schedules, but cost and quality vary widely. • Initial • Chaotic, Ad Hoc, each project run differently, missed schedules, over budget and low quality. Provided a framework for better management. Copyright Ó 2001 - Larry Dribin, Ph. D. SE 470_Other. SEProc_v 1. pp SE 470 Other SE Processes - 4

Excellence in Software Engineering Optimized Level Manage d Level Defined Level CMMSW - Capability Maturity Model v 1. 1 Repeatable Level Initial Level R I S K Copyright Ó 2001 - Larry Dribin, Ph. D. SE 470_Other. SEProc_v 1. pp SE 470 Other SE Processes - 5

Excellence in Software Engineering Optimized Level Manage d Level Defined Level SEI CMMSW Level 2 Key Process Areas Repeatable Level Initial Level · Requirements Management - the practices associated with managing requirements between the software developer and the user · Software Quality Assurance - the practice of providing quality assurance for the software development projects · Software Project Planning - the practices associated with planning and estimation software projects · Software Project Tracking - the practices associated with tracking a software development project throughout its life · Configuration Management - the practices associated with managing the composition of and version numbering of a software product release · Subcontractor Management - the practices associated with managing software subcontractors such as Operating Level Agreements Copyright Ó 2001 - Larry Dribin, Ph. D. SE 470_Other. SEProc_v 1. pp SE 470 Other SE Processes - 6

Excellence in Software Engineering Optimized Level Manage d Level Defined Level Prerequisites for Success Repeatable Level Initial Level · Project Team - processes in place & followed · Management - commitment and support · Users - willingness to change Copyright Ó 2001 - Larry Dribin, Ph. D. SE 470_Other. SEProc_v 1. pp SE 470 Other SE Processes - 7

Excellence in Software Engineering Optimized Level Manage d Level Defined Level CMMSW - Related Software Process Models Repeatable Level Initial Level CMM - Capability Maturity Model - CMM Focuses on organizational performance. Team Software Process - TSP Focuses on team performance. Personal Software Process PSP - Focuses on individual performance. Copyright Ó 2001 - Larry Dribin, Ph. D. SE 470_Other. SEProc_v 1. pp SE 470 Other SE Processes - 8

Excellence in CMMSW - CMM Issues in the Commercial World Software Engineering Optimized Level Manage d Level Defined Level Repeatable Level Initial Level · Too many companies focus on CMM level and not “real” process improvements such as: Fewer defects, more productivity, faster time to market · CMM process focus is on software development and it doesn’t cover some key Commercial IT areas: Þ Business Strategy and its linkage to IT Þ Front End - Project Selection Þ Back End - Operations, support, help desk, maintenance Þ Organization structures and staff capabilities Þ Applications portfolio · We often need to supplement the CMM in areas it does not cover · Often implement a CMMLite with less stringent process definitions Copyright Ó 2001 - Larry Dribin, Ph. D. SE 470_Other. SEProc_v 1. pp SE 470 Other SE Processes - 9

Excellence in Software Engineering Optimized Level Manage d Level Defined Level CMMSW - State of Practice 1998 vs. 1988 Repeatable Level Initial Level 1998 1988 807 (261) Organizations • 54% (29%) Commercial • 29% (41%) Do. D/Fed Contractor • 13% (23%) Military • 4 %(07%) Other “The State of Software Engineering Practice: A Preliminary Report” , Watts Humphrey, et. al. , SEI, February 1989. Copyright Ó 2001 - Larry Dribin, Ph. D. SE 470_Other. SEProc_v 1. pp SE 470 Other SE Processes - 10

Excellence in Software Engineering Optimized Level Manage d Level Defined Level CMMSW 3. 5 Results - Project Cost vs. CMM Level Repeatable Level Initial Level Ratio of Actual to Estimated Cost 3 2. 5 2 1. 5 1 0. 5 0 0 1 2 3 CMM Maturity Level Source: Software a Challenge for Management, Watts Humphrey, Cspin Presentation, November 7, 1996 Copyright Ó 2001 - Larry Dribin, Ph. D. SE 470_Other. SEProc_v 1. pp SE 470 Other SE Processes - 11

Excellence in Software Engineering Optimized Level Manage d Level Defined Level CMMSW Results - Master Business Systems Repeatable Level Initial Level Those organizations at high CMM levels produce traditional applications well and also produce Internet, Web and e. Business applications well. Copyright Ó 2001 - Larry Dribin, Ph. D. SE 470_Other. SEProc_v 1. pp SE 470 Other SE Processes - 12

Excellence in Software Engineering Optimized Level Manage d Level Defined Level CMMSW Results - The CMMSW Works Repeatable Level Initial Level The CMMSW enables organizations to develop software: · Faster - Reduces development time · Better - Produces products with fewer defects and which better satisfy user requirements · Cheaper - Lower development costs The CMM works well for those organizations that implement it effectively. Not all organizations do! Copyright Ó 2001 - Larry Dribin, Ph. D. SE 470_Other. SEProc_v 1. pp SE 470 Other SE Processes - 13

Excellence in Software Engineering Optimized Level Manage d Level Defined Level How to get more information on the SEI CMM: Repeatable Level Initial Level Research Access Incorporated or Customer Relations 800 Vinial Street Software Engineering Institute Pittsburgh, Pa 15213 Carnegie Mellon University Pittsburgh, PA 15213 Phone: (800)685 -6510 (412)268 -5800 Fax: (412)321 -2992 http: //www. rai. com http: //www. sei. cmu. edu and ask for documents: CMU/SEI-93 -TR 24 (ESD-TR-93 -24) CMU/SEI-93 -TR 25 (ESD-TR-93 -25) Copyright Ó 2001 - Larry Dribin, Ph. D. SE 470_Other. SEProc_v 1. pp SE 470 Other SE Processes - 14

Excellence in Software Engineering Optimized Level Manage d Level Defined Level ISO 9000 - The Global Quality Standard Repeatable Level Initial Level · Adopted in 1987. · A minimum set of quality system standards. · Over 50 Nations have adopted ISO 9000 as their own national standard for Quality · The United States has Adopted ISO 9000 as ANSI/ASQC Q 90 Series. · Each of the 12 member nations of the EC has adopted ISO. · Voluntary standard, but in some cases required by the EC and other governments. Copyright Ó 2001 - Larry Dribin, Ph. D. SE 470_Other. SEProc_v 1. pp SE 470 Other SE Processes - 15

Excellence in Software Engineering Optimized Level Manage d Level Defined Level ISO 9000 Series Repeatable Level Initial Level ISO # Description ANSI# ISO 9000 (Q 90) – Quality Management and Quality Assurance Standards - Guidelines for Selection and Use. – Quality Systems - Model for Quality Assurance in Design and Development, Production, Installation and Servicing. ISO 9001 (Q 91) – Production and Installation only. – Final Inspection and Test only. ISO 9002 (Q 92) – Quality Management and Quality System Elements - Guidelines (Q 93) – Guidelines for the Application of ISO 9001 to the development, supply and maintenance of software. ISO 9003 ISO 9004 Copyright (Q 94) Ó 2001 - Larry Dribin, Ph. D. SE 470_Other. SEProc_v 1. pp SE 470 Other SE Processes - 16

Excellence in Software Engineering Optimized Level Manage d Level Defined Level ISO 9000 Requirements 0. 0 1. 0 2. 0 3. 0 4. 0 Introduction Scope References Definitions Quality System Requirements 4. 1 Management Responsibility 4. 2 Quality System 4. 3 Contract Management 4. 4 Design Control 4. 5 Document Control 4. 6 Purchasing 4. 7 Purchaser Supplied Product 4. 8 Product Identification & Traceability 4. 9 Process Control 4. 10 Inspection and Testing Copyright Ó 2001 - Larry Dribin, Ph. D. SE 470_Other. SEProc_v 1. pp Repeatable Level Initial Level 4. 11 Inspection, Measuring and Test Equipment 4. 12 Inspection and Test Status 4. 13 Control of Nonconforming Product 4. 14 Corrective Action 4. 15 Handling, Storage, Packaging and Delivery 4. 16 Quality Records 4. 17 Internal Quality Audits 4. 18 Training 4. 19 Servicing 4. 20 Statistical Techniques SE 470 Other SE Processes - 17

Excellence in Software Engineering Optimized Level Manage d Level Defined Level ISO 9000 Registration Repeatable Level Initial Level ISO 9001 Registration: · Registration is by specific site and a specific “scope of work. ” · Provides for a consistent repeatable process. · Could be registered and still have poor products - concrete life jackets. · Requires an audit by a third party like UL. Why Register for ISO 9001? · Reasons for a company to pursue Registration: · The European Community has embraced ISO 9000. · Many other governments are requiring ISO 9000 registration of their suppliers. · Many large global customers are beginning to require ISO 9000 registration of their suppliers. · Adherence to ISO 9000 can improve quality. Copyright Ó 2001 - Larry Dribin, Ph. D. SE 470_Other. SEProc_v 1. pp SE 470 Other SE Processes · ISO 9000 can provide a foundation for a quality 18

Excellence in Software Engineering Optimized Level Manage d Level Defined Level ISO 9000 Registration Process: 1. 2. 3. 4. 5. 6. 7. 8. 9. 10. Copyright Repeatable Level Initial Level Make decision to register. Train staff and evaluate quality systems. Develop a compliance plan. Implement compliance plan. Document quality system. File Quality Manual with Agency Audit. Correct discrepancies. Registration Certificate. Must be renewed each year. Ó 2001 - Larry Dribin, Ph. D. SE 470_Other. SEProc_v 1. pp SE 470 Other SE Processes - 19

Excellence in Software Engineering Optimized Level ISO 9000 -3 Guidelines for Software Development Manage d Level Defined Level Repeatable Level Initial Level · ISO 9001 (1987) is a requirements document Þ Was written in hardware terms Þ Software means TV Media, Publications and Computer programs in general. · ISO 9000 -3 (1993) is a set of guideline (not a requirement) to help interpret 9001 for computer software development. Þ A company would still register for ISO 9001 Þ Custom software development between two parties Þ Entire life-cycle model (irrespective of life-cycle) Þ Quality Plan Þ Development Plan Þ Verification - The process of evaluating the products of a given phase to ensure correctness and consistency with respect to the process standards for that phase Þ Validation - the process of evaluating software to ensure compliance with specified requirements Copyright Ó 2001 - Larry Dribin, Ph. D. SE 470_Other. SEProc_v 1. pp SE 470 Other SE Processes - 20

Excellence in ISO 9000, the SEI CMM and Other Quality Standards Manage d Level Defined Level Repeatable Level Initial Level ISO 9001* No Quality System Software Engineering Optimized Level SEI’s CMM 3 Continuously Malcolm Improving Baldridge Quality Award System Deming Prize * ISO 9001 for software development using ISO 9000 -3 Copyright Ó 2001 - Larry Dribin, Ph. D. SE 470_Other. SEProc_v 1. pp SE 470 Other SE Processes - 21

Excellence in Software Engineering Optimized Level Manage d Level Defined Level The SEI CMM and ISO 9000 Repeatable Level Initial Level · DOD funds SEI but also looking at ISO 9000. · An SEI level 3 should allow an organization to be registered for ISO 9001. · SEI tells you where you are at and how to get to the next level. · ISO 9000 more focused on verifying your quality process. · Both standards are driving companies to improve the level of their software development processes. · Prediction: ISO 9000 will spread rapidly and in 3 -5 years will be a significant distinguishing factor among companies. · Will start with big and medium companies and will spread to the smaller ones. Copyright Ó 2001 - Larry Dribin, Ph. D. SE 470_Other. SEProc_v 1. pp SE 470 Other SE Processes - 22

Excellence in Software Engineering Optimized Level Manage d Level Defined Level Full Life Cycle Software Engineering Processes Repeatable Level Initial Level IT Value Chain Needs • Project Evaluation & Prioritization (Work Request) Analysis • Requirements Management • Software Product Engineering Design • Software Product Engineering Build • Software Product Engineering Operate • Systems Management • Call Management • Tech. Support & Maintenance Organization Process Function Performance Measurement Configuration Management & Documentation Standards Quality Assurance Subcontractor Management Project Tracking & Oversight Project Planning Technology Organization Copyright Ó 2001 - Larry Dribin, Ph. D. SE 470_Other. SEProc_v 1. pp Technology Strategy SE 470 Other SE Processes - 23

Excellence in Software Engineering Optimized Level Manage d Level Defined Level Other Software Engineering Processes SE Processes Reviewed in Class: · Rational Unified Process · Extreme Programming · Capability Maturity Model · ISO 9001 Repeatable Level Initial Level Other SE Processes: · Crystal · SCRUM · DSDM · Adaptive Software Development · Feature-Driven Development · Pragmatic Programming Bob Martin’s Framework: S t a r t u p Copyright High Level Analysis & Architecture Iter#1 Analysis Iter#2 Analysis Iter#3 Analysis Iter#4 Analysis Design Implement . . . Iter#N Analysis Design Implement Project Management Ó 2001 - Larry Dribin, Ph. D. SE 470_Other. SEProc_v 1. pp SE 470 Other SE Processes - 24

Excellence in Software Engineering Optimized Level Manage d Level Defined Level Extra Slides on Rayleigh Manpower Curve Repeatable Level Initial Level · Norden developed a theory of project problem solving processes. · He viewed a project as a set of unsolved problems. · A decision converts an unsolved problem into a solved problem. · Initially the number of unsolved problems grows as the project team uncovers additional problems. · New problems call for more problem solvers and the project grows. Copyright Ó 2001 - Larry Dribin, Ph. D. SE 470_Other. SEProc_v 1. pp SE 470 Other SE Processes - 25

Excellence in Software Engineering Optimized Level Extra Slides on Rayleigh Manpower Curve Manage d Level Defined Level Repeatable Level Initial Level Effort (MM) Copyright Ó 2001 - Larry Dribin, Ph. D. SE 470_Other. SEProc_v 1. pp SE 470 Other SE Processes - 26

Excellence in Software Engineering Optimized Level Extra Slides on Rayleigh Manpower Curve Effort (MM) Manage d Level Defined Level Repeatable Level Initial Level y’ td Where: y’ = 2 Kate-at 2 K = 1. 0 a = 0. 02 Copyright Which can be rearranged: y’ = (K/td 2)te(-t 2/2 td 2) K = E/. 39 td = (1/2 a)1/2 Ó 2001 - Larry Dribin, Ph. D. SE 470_Other. SEProc_v 1. pp SE 470 Other SE Processes - 27

Excellence in Software Engineering Optimized Level Extra Slides on Rayleigh Manpower Curve Manage d Level Defined Level Repeatable Level Initial Level · The key group (problem solvers) determines the pace at which problems are solved and further problems identified and appears to drive the manpower loading curve. · The group can add people only when it has sorted out tasks to assign to new people. · The number of people involved is proportional to the number of problems ready for a solution at a given time. · After a time the number of new problems discovered begins to decline and the manpower needed begins to fall. Copyright Ó 2001 - Larry Dribin, Ph. D. SE 470_Other. SEProc_v 1. pp SE 470 Other SE Processes - 28