APAN 10 Gbps End-to-End Performance Measurement July 19, 2006 Network Engineering Workshop APAN 2006 Singapore Masaki Hirabaru (NICT), Takatoshi Ikeda (KDDI/NICT), and Yasuichi Kitamura (NICT)
10 G Capable Machines Ready in Japan No Host H/W 10 G NIC 1 nms 5 RAM 3100 2 nms 6 Chelsio T 210 (TOE) 3 nms 7 4 nms 8 5 x 366 a 6 x 366 b 7 genkaiia 64 8 ia 64 a 9 opta -CPU Opteron 248 2. 2 GHz x 2 -Memory PC 3200 LC 2 512 ME x 2 IBM x 366 -CPU Xeon MP 3. 66 GHz x 2 -Memory ECC RDIMM Chipkill 8 GB IBM x 366 -CPU Xeon MP 3. 66 GHz x 2 -Memory ECC RDIMM Chipkill 2 GB HP RX 2620 -CPU Itanium 2 1. 6 GHz x 1 -Memory 1 G HP DL 145 G 2 -CPU Opteron 254 2. 8 GHz x 2 - Memory 1 GB 10 optb -CPU Opteron 285 2. 6 GHz x 1 - Memory 2 GB Bus OS TCP Stack Iperf TCP PCI-X 1. 0 a (64 bit, 133 MHz) Red Hat AS 4 up 3 (Kernel 2. 6. 9 -5) Chelsio TOE N/A Netrion Xframe. II PCI-X 2. 0 (64 bit, 266 MHz) Red Hat AS 4 up 3 (Kernel 2. 6. 9 -5) New Reno +Bic 8. 6 G Neterion Xframe. II PCI-X 2. 0 (64 bit, 266 MHz) Red Hat WS 4 (Kernel 2. 6. 9 -11) New Reno +Bic 5. 0 G Chelsio N 210 PCI-X 1. 0 a (64 bit, 133 MHz) Red Hat AS 3 up 4 (Kernel 2. 4. 2127) New Reno 6. 8 G Myricom 10 G-PCIE 8 A-R PCI-E x 8 (250 MB/s x 8) Fedora Core 5 (Kernel 2. 6. 17 -1) New Reno +Bic 7. 2 G
Network Configuration for 10 G Experiment 10 G-LR line 10 G-LW line Genkai. XP JGN 2 L 2 path L 3 device(Router) L 2 device(Switch) Server genkai-ia 64 A. 227 sumit 400 (summit 400) kfok (GS 4 k) oym (GS 4 k) osa (GS 4 k) note (GS 4 k) Neterion Xframe-II Chelsio N 210 Chelsio T 210 note (GS 4 k) VID: 1036 Mericom 10 GPCI-E Tokyo. XP Koganei VID: 38 NICT (GS 4 k) opta NICT (GS 4 k) VID: 24 B. 132 optb B. 133 x 366 a B. 130 MS 6 (BI 15 k) NICT (MG 8) x 366 b B. 131 Juniper T 320 ia 64 B. 134 MS 7 (AX 7808 S) tpr 5 nms 8 B. 202 nms 5 VID: 39 B. 210 nms 6 B. 214 VID: 40 tpr 4 Procket Trans. PAC 2 nms 7 C. 193
Initial Result (under congestion) RTT: 20 ms Genkai. XP Tokyo. XP JGN 2 Congestion! genkai-ia 64 tpr 5 ------------------------------Server listening on TCP port 5001 TCP window size: 60. 0 MByte (WARNING: requested 30. 0 MByte) ------------------------------[ 4] local 203. 181. 249. 134 port 5001 connected with 203. 181. 248. 227 port 32830 [ 4] 0. 0 - 1. 0 sec 587 MBytes 4. 92 Gbits/sec [ 4] 1. 0 - 2. 0 sec 728 MBytes 6. 10 Gbits/sec [ 4] 2. 0 - 3. 0 sec 721 MBytes 6. 04 Gbits/sec [ 4] 3. 0 - 4. 0 sec 186 MBytes 1. 56 Gbits/sec [ 4] 4. 0 - 5. 0 sec 74. 2 MBytes 623 Mbits/sec [ 4] 5. 0 - 6. 0 sec 83. 7 MBytes 702 Mbits/sec [ 4] 6. 0 - 7. 0 sec 90. 2 MBytes 756 Mbits/sec [ 4] 7. 0 - 8. 0 sec 93. 1 MBytes 781 Mbits/sec [ 4] 8. 0 - 9. 0 sec 93. 8 MBytes 787 Mbits/sec [ 4] 9. 0 -10. 0 sec 94. 9 MBytes 796 Mbits/sec nms 8 6 Gbps Bandwidth is 0. 8 Gbps Koganei ia 64 nms 7 ------------------------------Server listening on TCP port 5001 TCP window size: 20. 0 MByte (WARNING: requested 10. 0 MByte) ------------------------------[ 4] local 203. 181. 195. 194 port 5001 connected RTT: 0 ms with 203. 181. 195. 226 port 32810 [ 4] 0. 0 - 1. 0 sec 880 MBytes 7. 38 Gbits/sec [ 4] 1. 0 - 2. 0 sec 1012 MBytes 8. 49 Gbits/sec [ 4] 2. 0 - 3. 0 sec 1023 MBytes 8. 58 Gbits/sec [ 4] 3. 0 - 4. 0 sec 1. 00 GBytes 8. 63 Gbits/sec [ 4] 4. 0 - 5. 0 sec 1. 01 GBytes 8. 64 Gbits/sec [ 4] flow taken by new 5. 0 - 6. 0 sec 1. 00 GBytes 8. 63 Gbits/sec [ 4] 6. 0 - 7. 0 sec 1. 00 GBytes 8. 62 Gbits/sec [ 4] 7. 0 - 8. 0 sec 1. 00 GBytes 8. 62 Gbits/sec [ 4] 8. 0 - 9. 0 sec 1. 00 GBytes 8. 62 Gbits/sec [ 4] 9. 0 -10. 0 sec 1. 00 GBytes 8. 61 Gbits/sec Total 9. 4 Gbps 8. 6 Gbps
Experiment Plan with Large BWDP • Performance measurement in JP with 10 G delay box – Performance measurement by using several 10 G NICs – Evaluation of the several congestion avoidance algorithms on the 10 G Ethernet congested at a bottleneck. (e. g. fast, highspeed, scalable, , , ) • Performance measurement between JP and US – Performance measurement Between JP and US machines, if US colleague has machines. (A) – Performance measurement the path go around the Pacific Ocean and the US domestic. (B) B A A
Скачать презентацию APAN 10 Gbps End-to-End Performance Measurement July 19
4d8c9de6081336902e0e9972c481fee6.ppt