Automated Testing Test Tools Apirada Thadadech 1

Automated Testing & Test Tools Apirada Thadadech 1

Contents o The Benefits of Automation and Tools o Test Tools o Software Test Automation o Random Testing: Monkeys and Gorillas o Realities of Using Test Tools and Automation Apirada Thadadech 2

The Benefits of Automation and Tools • The code test fix loop get repeat several times before the software is released. • Might need Many time to run the tests and check the bugs that found in previous test runs were indeed fixed and no new bugs. Software test tool and automation can help to solve those problem Apirada Thadadech 3

The principle attributes of tools and automation: Ø Speed. Might average test case every 5 seconds. Ø Efficience. During running test case by test tool, have time for test planning and thinking up new test. Ø Accuracy and Precision. A test tool will perform the same test and check the result perfectly. Ø Relentlessness. Test tools and automation never tire or give up Apirada Thadadech 4

reminder Software test tools are not a substitute for software testers, but they just help software testers perform their jobs better. Apirada Thadadech 5

Test Tools o Test tool work as Black- box testing. They could perform software tests without having to set up a real-real scenario, they don’t need to understand how the tool works. o Test tool could be set up the monitor and modify the raw communications that occurs among those million computers(testing networking software) o Test tool could be set up to monitor and modify the raw communications that occurs among those million computer seem white-box skills and knowledge of the low-level protocol to effectively use the tool. Apirada Thadadech 6

Types of test tool o Invasive A tool is used only to monitor and examine the software without modifying Apirada Thadadech o Non-invasive A tool modifies the program code or manipulates the operating environment 7

Test Tool Type o Viewers and Monitors Test tool allow tester to see details of software’s operation that they wouldn’t normally be able to see. o Drivers are tools used to control and operate the software being tested, such as batch file, software that testing requires large amounts of data to be entered for test. o Stubs is like driver, but stubs are essentially the opposite of driver in that they don’t control operate the software being tested. Such as sent data to printer, you can test it is to enter data, print it and look at the result paper printout. Apirada Thadadech 8

Viewers and Monitors Software under test Communications line Computer #1 Computer #2 Tapped line Computer #3 Viewer test tool Apirada Thadadech 9

Stress and Load Tools There are problems about available memory and disk space when the system run many programs in the same time, such as running word processing and copy file to fill up…. and so on. Stress Tool is The Stress program allows you to individually set the amounts of memory. Disk space, files and other resources available to the software running on the machine. Apirada Thadadech Load Tool is similar to stress tool but it run on Web servers to load them down by simulating a set number of connections. Such as it check that 10. 000 simultaneous users and 1 million hits a day can be handled without showing response times. 10

Software Test Automation Software test automation is software that could be combined, started, and run with little or no intervention from tester. Apirada Thadadech 11

Types of automation o Macro recording and payback o Programmed Macros o Fully Programmable Automated Testing Tools Apirada Thadadech 12

Macro recording and payback o The Most basic type of test automation is recording your keyboard and mouse actions as you run your tests for first time and then playing them back when you need to run them again Apirada Thadadech 13

The Option in Macro recording and playback o Name : Macro name provides a way to identify it later. o Repetitions: Great way to find bugs. You can set the Repetitions number of times the macro will repeat or loop when it runs. o Trigger : you can set how the macro is started, can be by a hot key. o What’s captured: you can select to capture as ketstrokes captured or mouse action. o Play back speed: it can set play back from 20 % slower to speed 500% o Playback position: determines when mouse movements position and clicks should be absolute or relative to a certain window onescreen Apirada Thadadech 14

Note: Recording and playing back macros is a popular means to automate simple testing tasks. Its also a good place to start for testers learning how to automate their. Apirada Thadadech 15

Programmed Macros Programmed macros are a step up in evolution from the simple record and playback variety. Apirada Thadadech 16

Simple macro program 1: calculator test #2 2: <> 3: <> 4: 123 – 100 = 5: << prompt : the answer should be 23 >> 6: << close: calculator>> A Simple Macro that performs a test on the Windows Calculator Apirada Thadadech 17

Random Testing: Monkeys and Gorillas Test Monkey : The idea that you had a million monkeys typing on a million keyboards for a million years. The use of test monkey to simulate how your customers will use your software in no way insinuates that computer users are related to apes. Apirada Thadadech 18

Test monkeys o Dump monkeys o Semi-Smart monkeys o Smart Monkeys Apirada Thadadech 19

Dump Monkeys A dump monkey doesn’t know anything about the software being tested; it just clicks or types randomly. 1: randomize timer 2: for I = 1 to 10000 3: play “{click “+str$(int(RND*640))+”, “+STR$(RND*480))+”}” 4: play CHR$ (RND*256( : 5 Next i Apirada Thadadech 20

Remember The monkey is doing absolutely no verification. It just clicks and types until one of two things happenseither it finishes its loop or the software or the operating system crashes. Apirada Thadadech 21

Note If you don’t believe that a dumb monkey can possibly find a serious bug, try running one on your favorite computer game or multimedia program. Apirada Thadadech 22

It doesn’t seem to make sense that simple random clicking and typing could find a bug, but it does for a couple reasons: o Given enough time and attempts. o With its continuous repetition and use. Apirada Thadadech 23

Semi-Smart Monkeys Apirada Thadadech 24

Realities of Using Test Tools and Automation • The Software changes. Specifications are never fixed. • There’s no substitute for the human eye and intuition. • Verification is hard to do • It is easy to rely on automation too much. • Don’t spend so much time working on tools and automation that you fail to test the software. • If you’re writing macros, developing a tool, or programming a monkey, you are doing development work. • Some tools are invasive and can cause the software being tested to improperly fail. Apirada Thadadech 25