CJK NGN Test-bed Activities Phase I II

CJK NGN Test-bed Activities Phase I & II Testing Result • 2008. 3. 31 • • • Taesang Choi choits@etri. re. kr On behalf of CJK NGN Test-bed Ad-hoc Group The 12 th CJK NGN Working Group Meeting March 31 ~ April 2, 2008 Okinawa, Japan

Topics • • Terms of Reference Testing Schedule Testing Scenarios Testing Items Testing Network & Service Configurations Testing Activities Testing Results Next Steps 12 th CJK NGN Working Group Meeting 2

Terms of Reference The 12 th CJK NGN Working Group Meeting March 31 ~ April 2, 2008 Okinawa, Japan

TOR: NGN Testbed Objectives • • • Interconnecting CJK NGN Testbeds and building a common NGN technology testing infrastructure Feasibility testing prior to NGN commercial deployment Interoperability testing for Standard-based NGN components developed by CJK Providing NGN service development platform especially focusing on inter-country issues Reflection of testing results into corresponding standardization activities periodically Cooperation with other international NGN related testbeds and their activities such as MOONv 6, Plugtests, GMI, etc. (Note: This issue will be revisited in the future meeting) 12 th CJK NGN Working Group Meeting 4

TOR: Work Plan • Phase 1 (March 2005 ~ March 2006): Preparation Stage – – – – • Pick up the study items which include our target services for the evaluations on the test bed Check the participants who are interested in the studies again Plan the schedule of the implementation and evaluation of the test bed Prepare the testbed in each SDO Establish each administration’s NOC for each SDO’s testbed Agree on first and second set of target services and components and test scenarios Build test case suits for the agreed target services including a specific milestone Phase II (April 2006 ~ December 2007): First Interoperability Testing Stage – Construct CJK NGN testbed – common operation and management infrastructure – Test agreed first set of target services, especially focusing on transport functionality such as Qo. S, adimission control, traffic monitoring, etc. – Especially main interest is in inter-domain/inter-operator issues • Phase III (January 2008~ December 2010): Second Interoperability Testing Stage – Test agreed second set of target services, especially focusing on application/service functionality and its binding with transport functionality – Test other advanced NGN services yet to be defined 12 th CJK NGN Working Group Meeting 5

TOR: Action Plan for Phase I • • • Define Objectives of the CJK interoperability tests for NGN (4 th Meeting) Define Roadmap (4 th Meeting) Define Network Architecture (Physical, Transport and Service Topologies and underlying technologies (e. g. , MPLS, etc. )) of the testbed both intra- and inter-domain scope (4 th Meeting) – In Intra-domain case, each administration decides its own network (e. g. , KOREN or APII in case of Korea) and enhances its functionalities to conform to NGN • • Define Implementation Agreements for inter-domain connectivity (5 th Meeting) Define target services, target components, test scenarios and test case suits (5 th Meeting) Recruit participants for equipment and services at each testbed site (5 th Meeting) Establish a dedicated reflector for detailed discussion 12 th CJK NGN Working Group Meeting 6

Testing Schedule The 12 th CJK NGN Working Group Meeting March 31 ~ April 2, 2008 Okinawa, Japan

Testing Schedule • Phase I: 2006 3 rd/4 th Quarter – Network Connectivity – Senario 1 only (Feb. 26 ~ Mar. 2) – First Report/Demo during 9 th CJK NGN Meeting (April 2007) • Phase II: 2007 1 st/2 nd Quarter – Scenario 2 ~ 4 (Feb. 26 ~ Mar. 2) – Second Report/Demo during 9 th CJK NGN Meeting (April 2007) • Phase III: 2007 3 rd/4 th ~ 2008 1 st/2 nd Quarter – Scenario 5 ~ 7 – Testing details will further be defined depending on the technology availability status – Third Report/Demo 11 th CJK NGN Meeting 12 th CJK NGN Working Group Meeting 8

Testing Scenarios The 12 th CJK NGN Working Group Meeting March 31 ~ April 2, 2008 Okinawa, Japan

Test Scenarios • • • Scenario 1: Single Call Server within a single NGN Network Domain without PSTN Scenario 2: Call Servers across multiple IP Network Domains without PSTN Scenario 3: Single Call Server within a single NGN Network Domain with PSTN Scenario 4: Call Servers across multiple NGN Network Domains with PSTN Scenario 5: Call Servers across multiple NGN Network Domains with PSTN & Value Added Services – This scenario adds Value Added Services to scenario 4 using Media Servers and Application Servers • • Scenario 6: Performance Evaluation Scenario 7: Call Servers across multiple NGN Network Domains with PSTN, Value Added Services and RACF Involvement 12 th CJK NGN Working Group Meeting 10

Scenario 1: Single Call Server within a single IP Network Domain without PSTN IP Network Domain Call Server SIP H. 323 MGCP H. 248/Megaco* SG SIP(-T), H. 323 AG SIP H. 323 MGCP H. 248/Megaco* SIP(-T), H. 323 SG AG Enterprise Access Residential Access Country 1 12 th CJK NGN Working Group Meeting Country 2 11

Scenario 1 - Testing Cases • Basic Call with the following combinations – – – Access Gateway SIP phone – SIP phone Subscriber Gateway – Access Gateway Subscriber Gateway – SIP phone Subscriber Gateway – Subscriber Gateway • Protocols to test – – SIP H. 323 MGCP H. 248/Megaco • Testing Residential & Business Features – Call Transfer, Call Waiting, Call Diversion, Calling Numbering and Name Delivery, Three-party conference – Centrex, Private numbering plan, DDI/DDO 12 th CJK NGN Working Group Meeting 12

Scenario 2: Call Servers across multiple IP Network Domains without PSTN IP Network Domain 1 IP Network Domain 2 Call Server 1 SIP-T H. 323 BICC SIP H. 323 MGCP H. 248/Megaco* SIP(-T), H. 323 Call Server 2 SIP H. 323 MGCP H. 248/Megaco* SIP(-T), H. 323 Enterprise Access SG AG Residential Access Country 1 12 th CJK NGN Working Group Meeting AG Residential Access Country 2 13

Scenario 2 - Testing Cases • Basic Call with the following combinations – Same cases with scenario 1 • Protocols to test – – – SIP H. 323 MGCP H. 248/Megaco SIP-T or BICC • Testing Residential & Business Features – Call Transfer, Call Waiting, Call Diversion, Calling Numbering and Name Delivery, Three-party conference – Centrex, Private numbering plan, DDI/DDO 12 th CJK NGN Working Group Meeting 14

Scenario 3: Single Call Server within a single NGN Network Domain with PSTN IP Network Domain SG PSTN Sigtran Call Server (SCTP/M 3 UA) MGCP H. 248/Megaco Class 4/5 SW TG SIP H. 323 MGCP H. 248/Megaco* SIP(-T), H. 323 Enterprise Access SG AG Residential Access Country 1 12 th CJK NGN Working Group Meeting SG AG Residential Access Country 2 15

Scenario 3 - Testing Cases • Basic Call with the following combinations – – Same cases with scenario 1 Access Gateway – Class 4/5 SW Subscriber Gateway – Class 4/5 SW SIP Phone – Class 4/5 SW • Protocols to test – – – SIP H. 323 MGCP H. 248/Megaco SIGTRAN • Testing Residential & Business Features – Call Transfer, Call Waiting, Call Diversion, Calling Numbering and Name Delivery, Three-party conference – Centrex, Private numbering plan, DDI/DDO 12 th CJK NGN Working Group Meeting 16

Scenario 4: Call Servers across multiple NGN Network Domains with PSTN Class 4/5 SW IP Network Domain 1 SG SG TG Call Server 1 IP Network Domain 2 PSTN Call Server 2 TG SIP-T H. 323 BICC SIP H. 323 MGCP H. 248/Megaco* SIP(-T), H. 323 Enterprise Access SG SG AG AG Residential Access Country 1 12 th CJK NGN Working Group Meeting Residential Access Country 2 17

Scenario 4 - Testing Cases • Basic Call with the following combinations – – Same cases with scenario 1 Access Gateway – Class 4/5 SW Subscriber Gateway – Class 4/5 SW SIP Phone – Class 4/5 SW • Protocols to test – – – SIP H. 323 MGCP H. 248/Megaco SIP-T or BICC SIGTRAN • Testing Residential & Business Features – Call Transfer, Call Waiting, Call Diversion, Calling Numbering and Name Delivery, Three-party conference – Centrex, Private numbering plan, DDI/DDO 12 th CJK NGN Working Group Meeting 18

Scenario 5: Call Servers across multiple NGN Network Domains with Value Added Services & PSTN Back-End Servers MS SIP Application Server Class 4/5 SW SIP Diameter MGCP RADIUS H. 248/Megaco SIP(-T) Proprietary IP Network Domain 1 Back-End Servers SG SG TG PSTN MS SIP Diameter MGCP RADIUS H. 248/Megaco SIP(-T) Proprietary TG Call Server 2 Call Server 1 SIP-T H. 323 BICC SIP H. 323 MGCP H. 248/Megaco* SIP(-T), H. 323 Enterprise Access SIP H. 323 MGCP H. 248/Megaco* Enterprise Access AG AG Residential Access Country 1 12 th CJK NGN Working Group Meeting IP Network Domain 2 SIP(-T), H. 323 SG SG Application Server Residential Access Country 2 19

Scenario 5 - Testing Cases • Basic Call with the following combinations – – • Protocols to test – – – • Same cases with scenario 1 Access Gateway – Class 4/5 SW Subscriber Gateway – Class 4/5 SW SIP Phone – Class 4/5 SW SIP H. 323 MGCP H. 248/Megaco SIP-T or BICC SIGTRAN Application Servers Feature Testing – SIP Application Server Features: IP conferencing, Voice mail, etc. – Media Server Features: Generic conference bridge, Voice mail media processing, etc. • Testing Residential & Business Features – Call Transfer, Call Waiting, Call Diversion, Calling Numbering and Name Delivery, Three-party conference – Centrex, Private numbering plan, DDI/DDO 12 th CJK NGN Working Group Meeting 20

Scenario 6 – Performance Evaluation – Network Performance Testing cases • • • E 2 E Call Setup Delay Call Completion Rate Each Segment & E 2 E IPTD/IPDV/IPLR/Path unavailability Call Traffic Accounting Harmonization Testing of Service Qo. S class differences among CJK – User Terminal Performance Testing cases • Various User Terminal Performance Testing 12 th CJK NGN Working Group Meeting 21

Scenario 7: Call Servers across multiple NGN Network Domains with Value Added Services, PSTN, and RACF Involvement Back-End Servers MS SIP Back-End Servers Application Server Class 4/5 SW SIP Diameter MGCP RADIUS H. 248/Megaco SIP(-T) Proprietary SG TG IP Network Domain 1 Call Server 1 RACF SIP H. 323 MGCP H. 248/Megaco* SG SIP(-T), H. 323 Enterprise Access PSTN MS SIP Diameter MGCP RADIUS H. 248/Megaco SIP(-T) Proprietary TG SIP-T H. 323 BICC IP Network Domain 2 Call Server 2 RACF SIP H. 323 MGCP H. 248/Megaco* SIP(-T), H. 323 Enterprise Access SG SG AG AG Residential Access Country 1 12 th CJK NGN Working Group Meeting Application Server Residential Access Country 2 22

Scenario 7 - Testing Cases • Basic Call with the following combinations – – – • Protocols to test – – – – • SIP Application Server Features: IP conferencing, Voice mail, etc. Media Server Features: Generic conference bridge, Voice mail media processing, etc. RACF Feature Testing – – • SIP H. 323 MGCP H. 248/Megaco SIP-T or BICC SIGTRAN Rq Application Servers Feature Testing – – • Same cases with scenario 7 SIP phone – RACF Access Gateway – RACF Subscriber Gateway – RACF Application Server - RACF Resource Admission Control Performance NAT/Gate Control Performance Testing Residential & Business Features – – Call Transfer, Call Waiting, Call Diversion, Calling Numbering and Name Delivery, Three-party conference Centrex, Private numbering plan, DDI/DDO 12 th CJK NGN Working Group Meeting 23

Testing Items The 12 th CJK NGN Working Group Meeting March 31 ~ April 2, 2008 Okinawa, Japan

Detailed Test Items Number Service Combination Test case Basic voice call MGCP IAD–H. 248 AG or IAD Not Available by ETRI Normal call Abnormal call- the called party is busy Abnormal call- no answer Abnormal call- the number does’t exist MGCP IAD–SIP phone Available only for SIP phone in ETRI side Normal call Abnormal call- the called party is busy Abnormal call- no answer Abnormal call- the number does’t exist SIP phone–H. 248 AG or IAD Available only for SIP phone in ETRI side Normal call Abnormal call- the called party is busy Abnormal call- no answer Abnormal call- the number does’t exist 12 th CJK NGN Working Group Meeting 25

Detailed Test Items PSTN user – SIP phone Available by ETRI Normal call Abnormal call- the called party is busy Abnormal call- no answer Abnormal call- the number doesn’t exist Multimedia call SIP phone – SIP phone Available by ETRI Fax IAD/AG–IAD/AG Not Available by ETRI 12 th CJK NGN Working Group Meeting Including G. 711 and T. 38 26

Testing Network & Service Configurations The 12 th CJK NGN Working Group Meeting March 31 ~ April 2, 2008 Okinawa, Japan

RTNet’s CS Lab Configuration SCP IOSS Soft. X 3000 SIP/MGCP /H. 248/H. 323 FTP/FTAM Lanswitch SIGTRAN INAP USAU STP ISUP N RA T SIG MGCP SNMP STUN FE E 1 MRS 6100 IP Network SG 7000 ISUP PSTN SIP U-NICA SIP UMSN 2000 Eudemon Lanswitch H. 248 H. 323 SIP MGCP UMG 8900+UA 5000 POTS / BRI/ADSL … 12 th CJK NGN Working Group Meeting Vedio. Phone Open. Ey e Soft. Phone IAD 28

ETRI’s CS Lab Network Configuration Japan CERNET 155 M POS Internet Border Router 2 G Ethernet GBE, 100 BT, 10 BT 100 BT SBC Support Facility Management/ Monitoring System, GW, SIP phones, … Meeting Room 100 BT(VLAN) L 2 스위치 100 BT AS/MS 100 BT CS SG/TG E 1 TDM PSTN 모델망 12 th CJK NGN Working Group Meeting 100 BT RACF Packet Monitor Signaling Link Bearer Link 100 BT 29

Testing Services, Venders & Terminals • Interworking services: – • Interworking venders: – • CATR (Huawei) and ETRI (Xener) Interworking terminals: – • voice and video ETRI SIP phone and CATR SIP, MGCP IAD and PSTN terminal(H. 248 TG) 25 test items 12 th CJK NGN Working Group Meeting 30

Testing Activities The 12 th CJK NGN Working Group Meeting March 31 ~ April 2, 2008 Okinawa, Japan

Testing Processes and Schedules • • Started at Sept. 25, 2006 Four Phases – – Network connection: Sept. 25 -30, 2006 Data configuration: Jan. 30 -Feb. 1, 2007 Test: Feb. 26 -March 2 Test: March 5 -9 12 th CJK NGN Working Group Meeting 32

Failed Testing Example 1 12 th CJK NGN Working Group Meeting 33

Failed Testing Example 2 12 th CJK NGN Working Group Meeting 34

Successful Testing: Normal 12 th CJK NGN Working Group Meeting 35

Successful Testing: Busy 12 th CJK NGN Working Group Meeting 36

Testing Results The 12 th CJK NGN Working Group Meeting March 31 ~ April 2, 2008 Okinawa, Japan

Testing Results 12 th CJK NGN Working Group Meeting 38

Testing Results 12 th CJK NGN Working Group Meeting 39

Testing Results 12 th CJK NGN Working Group Meeting 40

Next Steps The 12 th CJK NGN Working Group Meeting March 31 ~ April 2, 2008 Okinawa, Japan

Upcoming Testing Phases • Phase I: 2006 3 rd/4 th Quarter (Completed) – Network Connectivity – Scenario 2 and 4 only (2 CS and 2 domains) – Status Report during 8 th CJK NGN Meeting (January 2007) • Phase II: 2007 1 st/2 nd Quarter (Completed) – Scenario 1 and 3, (simpler version of 2 and 4, single domain) – Status Report at the 12 th CJK NGN Meeting (March 2008) Goal of the CJK NGN Test-bed • Phase III: 2008 1 st/2 nd Quarter – Performance Evaluation of RTP/RTCP-based Mo. IP （Multimedia（Voice/Audio/Video) over IP） service – Network connective for Performance evaluation and Performance Monitoring Scenarios 6 -1 and 6 -2 – Status report at the 13 th CJK NGN Meeting in 2008. 9 or 10 • Phase IV: 2008 3 rd ~ 2009 2 nd Quarter – Performance Evaluation of RTP/RTCP-based Mo. IP and IPTV services – Performance Monitoring Scenarios 6 -3 and 6 -4 – Initial RACF Interoperability testing : Scenario 7 – Testing of RACF and RTP/RTCP-based MPM Interactions – IPTV Interoperability testing th – Status report at the 14 th and 15 CJK NGN Meetings 12 th CJK NGN Working Group Meeting 42

Scenario 6 is under Study Now “Scenario 6: Performance Evaluation with RTP/RTCP-based Measurement extensions” could be fractionated as follows: • Scenario 6 -1: Performance evaluation of Network Segments • Scenario 6 -2: Performance evaluation of Mo. IP service among CPEs • Scenario 6 -3: Performance evaluation of Mo. IP service with two MPMs • Scenario 6 -4: Performance evaluation of Mo. IP service with three MPMs – – – Measure Network Performance Metrics among CJK independent from services Measured results can be cross referenced by subsequent tests for accuracy Periodic and constant measurement Measurement intervals and other details to be defined IPTD, IPDV, IPLR of C-K, C-J, J-K, J-C, K-J – Measure RTP/RTCP performance of Mo. IP（Multimedia（Voice/Audio/Video) over IP） service based on CS and/or IMS – CPE-to-CPE performance evaluation – Measure RTP/RTCP performance of Mo. IP service based on CS and/or IMS – CPE – MPM 1 – MPM 2 – CPE performance evaluation – Measure RTP/RTCP performance of Mo. IP service based on CS and/or IMS – MPMs send/append evaluated performances – CPE – MPM 1 – MPM 2 – MPM 3 – CPE performance evaluation 12 th CJK NGN Working Group Meeting 43

Scenarios 6 & 7 Details Scenario No. IP Network Service Platform Services CPE terminals and other equipment 6 -1 6 -2 6 -3 Metrics Y. 1543 C-K: R&D Network C-J: Commercial Network K-J: Commercial Network SIP RTP 　　　　 Streams (Mo. IP: Multimedia over IP) Voice/ Audio/ Video) >>IPTV 6 -4 7 Evaluations SIP/ IMS-SIP 12 th CJK NGN Working Group Meeting CPE (Vo. IP/Video): J (Soft/Hard), K, C Call Server: K, C, J（Emulator) MPM: J (Soft/Hard), K Countries Connections － Local test C, J, K RTCP (CPE-CPE) CPE-CPE RTCP (CPEMPM 1 MPM 2 CPE) CPE-MPM RTCP (CPEMPM 1 MPM 2 MPM 3 CPE) RACF: K, J（1 st: ACF, 　　　　　　 2 nd: RCF) Report MPM-RACF 13 th CJK meeting 2008. 09 Two MPMs　　 C-J, K-J, C-K Three MPMs C-J-K 14 th or 15 th CJK meeting 44

Next Steps • ETRI will upgrade our CS platform so that other tests can be available including PSTN interworking, IAD, AG support, etc. • Qo. S consideration for transport • Preparation for Phase 3 testing • What about IMS-based Interop testing? • Need budget support for more meaningful tests • Collaboration opportunities with other Testing Programs? (In Korea, we have Bc. N test-bed. What about others? ) 12 th CJK NGN Working Group Meeting 45

Thanks You CJK NGN Test-bed Ad-hoc Group The 12 th CJK NGN Working Group Meeting March 31 ~ April 2, 2008 Okinawa, Japan