Accelerating Product and Service Innovation Rational IBM

Accelerating Product and Service Innovation | Rational IBM Dev. Ops: Continuous Testing with Virtualized Services Steve Weaver, IBM Rational Marketing Manager, Cloud & Devops May 20 th, 2013 © 2013 IBM Corporation

Accelerating Product and Service Innovation | Rational Organizations that effectively leverage software innovation outperform their competitors. . . yet few are able to deliver it effectively 86 % of companies believe software delivery is important or critical But only… 25 % of those who leverage software delivery today 69 % outperform those who don’t leverage software delivery effectively today 2 Source: “The Software Edge: How effective software development drives competitive advantage, ” IBM Institute of Business Value, March 2013 © 2013 IBM Corporation

Accelerating Product and Service Innovation | Rational And a lack of continuous delivery impacts the entire business CHALLENGES Costly, error prone manual processes and efforts to deliver software across an enterprise Customers Software glitch costs trading firm Knight Capital $440 million in 45 minutes 3 Slow deployment Upgrade risk due to to development and test managing multiple application environments leave teams configurations and versions waiting and unproductive across servers Business Owners Development/ Test New Zealand’s biggest phone company, Telecom paid out $2. 7 million to some 47, 000 customers who were overcharged after a software glitch Operations/ Production A bad software upgrade at RBS Bank left millions unable to access money for four days © 2013 IBM Corporation

Accelerating Product and Service Innovation | Rational Dev. Ops Enterprise capability for continuous software delivery that enables clients to seize market opportunities and reduce time to customer feedback Dev. Ops Lifecycle Development/ Test Operations/ Production Monitor and Optimize Customers Business Owners Develop and Test Release and Deploy Continuous Innovation, Feedback and Improvements Accelerate Software Delivery Expanding collaboration to include customers, LOB and others to eliminate organization silos Balance speed, cost, quality and risk Automating manual processes across delivery lifecycle to eliminate waste/delays and compliance tracking Reduce time to customer feedback Enabling a customer feedback loop for continuous improvement 4 © 2013 IBM Corporation

Accelerating Product and Service Innovation | Rational New capabilities to enable a Dev. Ops approach Enterprise capability for continuous software delivery that enables clients to seize market opportunities and reduce time to customer feedback Dev. Ops Lifecycle Customers Business Owners Development/Test Operations/Production Plan and Measure Develop and Test Release and Deploy Monitor and Optimize Best Practices Ecosystem Continuous Innovation, Feedback and Improvements Dev. Ops Foundation Open Lifecycle and Service Management Integration Platform OSLC Accelerate Software Delivery Balance speed, cost, quality and risk Reduce time to customer feedback 5 DRAFT: IBM Confidential until June 2, 2013 © 2013 IBM Corporation

Accelerating Product and Service Innovation | Rational IBM announces the acquisition of Urban. Code Inc. Complementing our Dev. Ops solution, combining IBM and Urban. Code, will enable clients to more rapidly deliver mobile, cloud, big data analytics and traditional applications. Complements our Dev. Ops solution: § Deliver a differentiated and engaging customer experience by reducing time to customer feedback § Quicker time-to-value of software-based innovation with improved predictability and success Deployment § Increased capacity to innovate by reducing waste and rework in order to shift resources to high-value activities Enhancing Continuous Release and Deployment: § Drive down cost by automating manual tasks, eliminating wait-time and rework § Speed time to market by increasing the frequency of software delivery § Reduce risk through increased compliance of application deployments. 6 © 2013 IBM Corporation

Accelerating Product and Service Innovation | Rational Urban. Code fills gaps Expand Dev. Ops capabilities and accelerate plans Dev. Ops Lifecycle Customers Business Owners Development/Test Operations/Production Plan and Measure Develop and Test Release and Deploy Monitor and Optimize Best Practices Ecosystem Continuous Innovation, Feedback and Improvements Dev. Ops Foundation Open Lifecycle and Service Management Integration Platform © 2013 IBM Corporation

Accelerating Product and Service Innovation | Rational Providing Integrated Test Environments is hard Challenges • Lack of Availability and access of dependent components & systems • Managing complexity multitude of environments and configurations Dev Dev FVT FVT PVT Build 10 times / day UAT Week 8 • Mismatch in speed of dev changes and ability to provide environments • Cost, Skills and Complexity to setup 1 hour / day Week 4 Impact: Fewer environments available limiting integrated testing to late in the lifecycle © 2013 IBM Corporation

Accelerating Product and Service Innovation | Rational Goals to improve Quality – Continuous Testing - The practice of testing across the lifecycle with progressively increasing test environments. FVT Dev Integration test sand-box Performance Test QA FVT Env User Acceptance Test QA Performance Test Env Need: Providing integrated test environment @ scale © 2013 IBM Corporation

Accelerating Product and Service Innovation | Rational Dev. Ops Tool Chain Application Release Management

Accelerating Product and Service Innovation | Rational Dev. Ops Tool Chain Current Implementations Jenkins Rational Build Forge Application Release Management Application Deployment Automation Rational Collaborative Lifecycle Management Solution Rational Test Workbench Rational Functional Tester Rational Performance Tester Cucumber Cloud Provisioning IBM Smart. Cloud Orchestrator IBM Pure Application System © 2013 IBM Corporation

Accelerating Product and Service Innovation | Rational Demo Scenario: JK Enterprises § We’re developing a stock quote feature on our banking website – pulling the info from an internet service. § The demo will build, deploy, and test the new version of our application. 12 © 2013 IBM Corporation

Accelerating Product and Service Innovation | Rational Building the JK Enterprises Project § We begin in Rational Team Concert, where our project is defined. § We’re going to build our app with Jenkins, so we have a build definition for each component, in this case, the web app. IBM Rational solution for Collaborative Lifecycle Management 13 © 2013 IBM Corporation

Accelerating Product and Service Innovation | Rational Build artifacts can be managed by u. Deploy Jenkins § Once the artifacts are built, we can take advantage of u. Deploy’s Jenkins plugin to automatically publish the components into the artifact repository, which tracks each version for us. u. Deploy 14 © 2013 IBM Corporation

Accelerating Product and Service Innovation | Rational Continuous Delivery with RTC § So, that’s Continuous Integration, but what about Continuous Delivery? § For that, we’re going back to RTC, and defining an Ant script that will enable us to deploy and test the application automatically after building. § We can easily build a script that will deploy and validate the application for us – both functional tests, and tests that validate virtual services, like the stock quote service, that we need to stub out. . 15 IBM Rational solution for Collaborative Lifecycle Management © 2013 IBM Corporation

Accelerating Product and Service Innovation | Rational Using Ant to orchestrate Continuous Delivery Jenkins § We go back to Jenkins, where, instead of publishing directly to u. Deploy, we can invoke our Ant script instead. § The script will in turn call u. Deploy, Cucumber for functional tests, and Rational Integration Tester for testing of virtualized services. Ant 16 © 2013 IBM Corporation

Accelerating Product and Service Innovation | Rational Deploying the application build § In u. Deploy, we’ve defined an environment for our application, the components that need to be deployed, the tasks required to deploy them, and the process for the deployment onto our target infrastructure. u. Deploy © 2013 IBM Corporation

Accelerating Product and Service Innovation | Rational Defining the Deployment Process § In u. Deploy, we graphically create our deployment process, defining each task in a flow chart that ends with application deployment. § We can install and configure middleware and applications across multiple nodes. § The resulting deployment process can be called from our build. xml ant script via the u. Deploy CLI. u. Deploy 18 © 2013 IBM Corporation

Accelerating Product and Service Innovation | Rational Functional Testing with Cucumber § Here’s a cucumber script that we’re going to use for some basic functional testing. It can be called directly from our build. xml ant script after Jenkins has built the app, and u. Deploy has deployed it into our target environment. 19 © 2013 IBM Corporation

Accelerating Product and Service Innovation | Rational Continuous testing with virtualized services Avoid testing bottlenecks due to dependencies on external services IBM Smart. Cloud Orchestrator IBM Rational Test Workbench IBM Pure. Application System App deploy SIT FVT Application changes being tested u. Deploy • • • Automate setup and management of test virtualization server Automates configuration of virtualized services for an application under test Automate setup of production-like test environments with low cost Databases Mainframe applications Third-party Services virtualized services IBM Rational Test Virtualization Server © 2013 IBM Corporation

Accelerating Product and Service Innovation | Rational What is Test Virtualization? Public Cloud Private Cloud Third-party Services Archives Portals Directory Identity Data Warehouse File systems Mainframe EJB Business Partners Shared Services Messaging Services Enterprise Service Bus App Under Test Capture & Model App Under Test Routing Content Service Collaboration Providers Databases Mainframe applications Third-party Services Packaged apps, messaging services, etc. Virtual Services Heterogeneous Environments System dependencies are a key challenge in setting up test environments: 4 Unavailable/inaccessible: Testing is constrained due to production schedules, security restrictions, contention between teams, or because they are still under development 4 Costly 3 rd party access fees: Developing or testing against Cloud-based or other shared services can result in costly usage fees 4 Impractical hardware-based virtualization: Systems are either too difficult (mainframes) or remote (third-party services) to replicate via traditional hardware-based virtualization approaches 21 Test Virtualization enables to create “virtual services”: –Virtual Services simulate the behavior of an entire application or system during testing –Virtual Services can run on commodity hardware, private cloud, public cloud –Each developer, tester can easily have their own test environment –Developer and testers continue to use their testing tools (Manual, Web performance, UI test automation) © 2013 IBM Corporation

Accelerating Product and Service Innovation | Rational IBM Rational Test Virtualization Solution A smarter solution to better quality § Rational Test Workbench is a desktop solution that enables testers/developers to: Developers & Testers – Capture and model virtual services – Test services and applications long before their user interfaces becomes available and do integration testing (SOA, BPM) § Rational Test Virtualization Server is a server solution that: Rational Test Workbench Rational Performance Test Server – Provides a central environment to virtualize heterogeneous hardware, software and services to provide 24 x 7 testing capabilities – Reduces infrastructure costs of traditional testing environments App Under Test – Virtual Services can be built from the interface definition of the system for a wide variety of protocols, including HTTP, web services, SOA, JMS, TIBCO, IBM Web. Sphere MQ, Oracle, etc. § Rational Performance Test Server enables Rational Test Workbench users to reuse test scripts to drive performance testing Databases Mainframe applications Third-party Services Packaged apps, messaging services, etc. – Can be used in combination with Virtual Services – Probe for identification of system bottlenecks Rational Test Virtualization Server © 2013 IBM Corporation

Accelerating Product and Service Innovation | Rational IBM Rational Test Virtualization Solution provides benefits across the software delivery life cycle Developer uses virtual services to unit test code on their workstation – no elaborate environment required Define constrained systems and services for virtualization Unit Integration Development and Test teams uses virtual services for early stage advanced testing System Integration User Acceptance Operability Performance The full system or components of the system can be performance tested early in the cycle. Virtual services can be used when components are not available Later in the cycle, final preproduction versions of services are swapped in as they become available. Final testing is done against real services © 2013 IBM Corporation

Accelerating Product and Service Innovation | Rational IBM Rational Test Virtualization Solution is a key enabler for Continuous Integration Testing üTest Virtualization is an enabler for continuous Integration Testing Actual Service/App Virtual Service/App üServices, applications, systems are introduced into the continuous integration cycle in a prioritized, controlled fashion. Incremental Integration Testing © 2013 IBM Corporation

Accelerating Product and Service Innovation | Rational Validating Virtual Services § Here’s our deployed app, with the stock quote service. In our scenario, the service is not accessible to our tester, so it must be virtualized. § IBM Rational Test Virtualization Server can duplicate (“stub”)the service so that we can test it. § Then, using IBM Rational Test Workbench, we can build a test that can ensure our new capability is working. 25 IBM Rational Test Workbench © 2013 IBM Corporation

Accelerating Product and Service Innovation | Rational Building Validation Tests § It’s simple to define the test steps, and we can run the test directly from Integration Tester to make sure it works. IBM Rational Test Workbench 26 © 2013 IBM Corporation

Accelerating Product and Service Innovation | Rational Viewing the results § Once the script is run, we can access the results through an integrated dashboard in Rational Team Concert, which includes multiple links to dive into the data for a complete view of each process. IBM Rational solution for Collaborative Lifecycle Management 27 © 2013 IBM Corporation

Accelerating Product and Service Innovation | Rational Viewing our results § Each step of the process is captured. § In our case, we did a complete application build, deployment, functional test suite and virtualized service test suite inside 6 minutes. § Without the continuous delivery automation, these steps could have taken days or weeks. IBM Rational solution for Collaborative Lifecycle Management 28 © 2013 IBM Corporation

Accelerating Product and Service Innovation | Rational The Continuous Delivery Pipeline § But that’s only one step along the pipeline. § We can use the results of our validation tests in u. Deploy to define approval gates. § By setting statuses, we can build gates in u. Deploy that the application needs to pass in order to move on to the next step along the pipeline. u. Deploy 29 © 2013 IBM Corporation

Accelerating Product and Service Innovation | Rational Ensuring Quality deployed applications § For each environment we define - dev, QA, UAT, staging or production, we can set these approval gates to ensure that our application is meetin quality criteria at each step of the way. u. Deploy 30 © 2013 IBM Corporation

Accelerating Product and Service Innovation | Rational Develop and Test solutions Measureable results and business value Communications Service Provider Revamp manual approach to decrease testing time and increase quality § Solution: Rational Test Workbench with IBM Green Hat § Results: Increased team efficiency by 300%, and decreased test time 25 -40% Major U. S. insurer Recognized manual test efforts insufficient for complex SOA and web services § Solution: Agile middleware solution created to match the legacy systems’ functionality § Results: Reduced testing by 95% to 2 hours; reduced ‘rate filing’ validation by 94% to 320 hours 31 A leading global financial services firm with assets of over $2 trillion Many disparate legacy format to be migrated to next gen payments system § Solution: Virtualized third-party systems otherwise unavailable for testing § Results: Reduced manual testing from 10 days to 10 minutes, saving over $7 million to date Global manufacturer acquires competitor Migrate off rented infrastructure onto company’s standardized middleware platform § Solution: Virtualized critical, unavailable systems during migration § Results: Fully integrated in 6 months – 2 months ahead of schedule; saved significant rental costs and dependencies on third-party systems © 2013 IBM Corporation

Accelerating Product and Service Innovation | Rational Release and Deployment solutions Deliver measureable business results International Investment Firm Online Retailer Driving Down Costs Speeding Time-to-Market Release process required considerable effort and delayed by manually-introduced errors Significant delays getting application changes to production § Solution: Automated release process § Solution: Scaled up continuous deployment § Results: Cost avoidance of over $2. 3 M/year, reduced release time from 2 -3 days to 1 -2 hours and virtually eliminated test team “down-time” § Results: Deployment time reduced by over 95% with easy scale and deploying to over 250 servers within 2 months of implementation Higher Education Saa. S Software Provider Speeding Time-to-Market Reducing Risk Agile development teams constrained by slow deployment to dev. and test environments Difficulty managing multiple customer configurations and versions of software deployed across servers § Solution: Accelerate deployment by enabling development teams to self deploy with automation § Results: Deployments cut from hours to minutes and a greater number of servers with fewer resources 32 § Solution: Automate managing configuration and version deployment § Results: Execute customer specific releases, reduced deployment outages by over 90% © 2013 IBM Corporation

Accelerating Product and Service Innovation | Rational www. ibm. com/software/rational © Copyright IBM Corporation 2013. All rights reserved. The information contained in these materials is provided for informational purposes only, and is provided AS IS without warranty of any kind, express or implied. IBM shall not be responsible for any damages arising out of the use of, or otherwise related to, these materials. Nothing contained in these materials is intended to, nor shall have the effect of, creating any warranties or representations from IBM or its suppliers or licensors, or altering the terms and conditions of the applicable license agreement governing the use of IBM software. References in these materials to IBM products, programs, or services do not imply that they will be available in all countries in which IBM operates. Product release dates and/or capabilities referenced in these materials may change at any time at IBM ’s sole discretion based on market opportunities or other factors, and are not intended to be a commitment to future product or feature availability in any way. IBM, the IBM logo, Rational, the Rational logo, Telelogic, the Telelogic logo, and other IBM products and services are trademarks of the International Business Machines Corporation, in the United States, other countries or both. Other company, product, or service names may be trademarks or service marks of others. 33 © 2013 IBM Corporation