Automatic Test Suite For AVAYA Communication Project by

Automatic Test Suite For AVAYA Communication Project by Yaniv Levy Guided by Dr. Nissim Tzuri Mr. Mordechai Goldis

Agenda • • • About Avaya Alpha tests today Motivation Tools System structure IGMP snooping test Policy test Running the tests Results A glance to the future 2

Avaya Communication Avaya provides solutions in the following areas: • Converged Voice and Data Networks • Customer Relationship Management • Unified Communication • Israel – Data Networks (Lannet) 3

Avaya’s Devices 4

Alpha Tests Today • Three Types of Test: – Thorough Tests – Sanity Tests – Setups of real life scenarios • All test are done manually • All test are repeated for each version • Many versions and features require large, qualified manpower 5

Motivation • Accelerating the verification of a new version • Overnight running • Improve the defect reproducing capabilities • Free more time for special tests • Systematic tests improve qualityno human factor 6

Motivation – Test Times Test Name Full cyclemanual Automatic Sanity cycle manual Automatic BUG closing. 2 2 RIP I test. 2 Auto 0. 5 Auto RIP II test. 2 Auto 0. 5 Auto OSPF test Redistribute test. 3 Auto 0. 5 Auto 2 Auto 0. 5 Auto Multi protocol test. 2 + setup 2 2 0. 5 ARP test. 2. 5 Auto 0. 5 Auto TOTAL 17. 5 6 7 4. 5 VRRP test. 7

Tools • Visual Basic • Tool Command language • Pro. Comm Scripts • Ixia – Traffic Generator 8

Tools 9

The Ixia system • • • Ix. Explorer – windows-based software Create and transmit packet and streams Control all the data parameters Statistic counters (frames receivedsent etc. ) Capture Buffer Tcl – programming language - Provides full access to the Ixia hardware platform. Faster then the GUI application (Ix. Explorer) Configurations can be sent to the hardware through the network. 10

System Structure 11

IGMP Snooping • Multicast Traffic applications • Creating Multicast Groups – IGMP queries – IGMP reports • Layer 2 handling of Multicast traffic – learning and filtering (Router ports , Client Ports) 12

IGMP Snooping Tests • Basic Filtering • New group filtering delay • New clients and router to an existing group • Recognizing router ports • Two Groups with the same MAC Address • Timeouts (client timeout, router timeout) • UC, MC and BC between groups • Topology changes 13

IGMP Snooping Basic Flow • Transmit IGMP Query and Reports • Transmit Multicast Data streams • Check filtering and time intervals • Make relevant changes • Recheck filtering and time intervals 14

Policy - Qo. S & Access Control • What is Policy? – Each routed packet is assigned a policy and gets the right Qo. S from the router. (Critical for voice application - IP Phone) – Enforcing Security at the edge of the network 15

Policy Rules Example • • • • ! policy list configuration !--------------ip access-list-name 100 "list #100" ip access-list 100 10 deny-and-notify ip 192. 168. 16. 0 0. 0. 0. 255 any ip access-list 100 20 deny ip any 192. 168. 16. 0 0. 0. 0. 255 ip access-list 100 30 permit ip host 1. 10. 0. 10 192. 168. 16. 0 0. 0. 0. 255 ip access-list 100 40 fwd 5 ip any 1. 10. 0. 255 ip access-list 100 50 permit ip 1. 10. 1. 0 0. 0. 0. 255 any ip access-list 100 60 deny ip host 131. 113. 10 any ip access-list 100 70 fwd 1 ip host 131. 113. 1 host 1. 20. 1. 1 ip access-list 100 80 deny ip host 131. 113. 1 host 1. 20. 1. 1 ip access-list 100 90 deny-and-notify ip 131. 113. 1 0. 0. 15. 254 any ! access-group 100 ! set qos policy-source local 16

Policy – Packet Handling Flowchart First Matching Rule Deny & Notify Discard Send Trap Permit Discard 17 Forward 0 -7 Forward (use trust) Deny Forward With the Priority

Qo. S Support with Policy Management 1. The Qo. S information is read from the packet 2. The information is processed locally according to the defined policy rules 3. The IEEE 802. 1 p priority is assigned MAC DA MAC SA 802. 1 p Tag IP SA IP DA Diff Serv/ To. S TCP/ UDP Source. IP Dest. IP Policy Rules 18

Access Control with Policy Management n. Access control based on • Source IP Address • Destination IP Address • Protocol type • UDP/TCP Port • Any combination of the above MAC DA MAC SA IP SA 802. 1 p Tag Permit Deny 19 IP DA Diff Serv/ To. S TCP/ UDP Source. IP Policy Rules TCP/ UDP Dest. IP

Policy Tests • General test IP based including Access Control and QOS • Protocol Based Policy Test • Trust rules Tests 20

Policy Tests –General Flow • Download policy and Layer 3 configuration to device. • Transmit streams • Verify that all streams passed • Activate policy • Transmit streams • Verify results according to policy 21

MMI • Centralize all user controls (Device, Traffic Generator, Tests( • Provide debug and reproducing capabilities • History maintenance 22

MMI- Environmental Parameters 23

MMI-Device Under Test Configuration 24

MMI- Traffic Generator Configuration 25

MMI- Test Selection 26

MMI- Test Selection 27

MMI- Test Selection 28

Results • • • SUMMARY of IGMP Snooping: IGMP Snooping Client Timeouts and Router Timeouts Test PASSED IGMP Snooping Group filtering Delay Time Test PASSED IGMP Snooping Zero filtering Delay Time Test PASSED IGMP Snooping Special Address Filtering Test PASSED IGMP Snooping 2 groups with the same MAC Test PASSED IGMP Snooping Learning Max MC Groups Test FAILED IGMP Snooping Learning Behavior Test PASSED IGMP Snooping UC, BC & MC streams between ports Test PASSED IGMP Snooping Toppology changes igmp snooping Test FAILED IGMP Snooping Resets Test FAILED • • • NUMBER of SUBTOPICS: 10 PASSED: 7 FAILED: 3 ***** END of TEST: IGMP Snooping FAILED ***** SUMMARY of The Session: IGMP Snooping FAILED >>>>>End time: Monday - 17, Jun 2002 02: 29: 11 PM TOTAL TEST DURATION: 01: 15: 54 seconds TOTAL TESTS: 1 TOTAL PASSED: 0 TOTAL FAILED: 1 29

A Glance To The Future • Support all Device Families (P 130 , P 480 and future families) • Implementing more test • Adding other test types (Setups , multi feature) • Improve Self Learning Capabilities (mapping ports , learning the stack) • Integrate the system in preliminary development stages 30

THE END 31