SDSS Data Transfer Jing-Jou Yen Division Manager National

SDSS Data Transfer Jing-Jou Yen Division Manager National Center for High-Performance Computing (August 26, 2005)

OUTLINE q q q Project Background Introduction to NCHC/TWAREN Sloan Digital Sky Survey (SDSS) Overview Network Architecture and Configuration Network Performance Monitoring Future Plan 2

SDSS Data Transfer Project q It is a joint program NCHC with the Fermi Laboratories to mirror the SDSS data. q The goal is to speed up the SDSS information sharing for physicists working in R&E institutes in Taiwan. q NCHC computing, storage and networking resources enhance functions in the astronomical research. q NCHC uses Tai. Wan Advanced Research and Education Network (TWAREN) for the SDSS data transfer. q NCHC’s Operations teams will ensure the quality for all efforts. Taipei Computing Center Knowledge Center Network Operation Center Hsinchu Taichung Tainan Core node equipment 3

National Center for High-performance Computing NCHC q NCHC is Taiwan’s only National Lab Dedicated to § High-Performance Computing & Applications § Storage, Networking & the Applications Development q NCHC Mission § Provide resources and services § Do research and development § Offer education, training, and outreach Resources and Services High-performance Computers TANet 2/TWAREN PC Clusters Storage/Databases Application SW High-performance Computing & Networking Education, Training and Outreach Research and Development Industrial, Government, Academic Projects International Collaborations Conferences Consultation Training Workshops Lectures Exhibits 4

Tai. Wan Advanced Research and Education Network TWAREN q TWAREN - Successor of TANet 2 q TWAREN - One of the Most Advanced Networks/Operations in the World q TWAREN Goals • To provide a network infrastructure for academic and R&E community. • To stimulate creativity and foster talents q TWAREN Architecture • A hybrid network with 20 G POS and DWDM technologies at its core. • Hierarchical topology: 3 layers (core, Giga. Po. Ps, end nodes) • Eleven Giga. Po. Ps - each links to the core SINICA • • node at 20 Gbps and 1 dark fiber. Highly scalable and flexible Providing multiple services International links to the USA Integrated NMS Architecture NCU NTU NCTU Taipei NTHU Hsinchu NCHU NCNU NDHU Taichung CCU NCKU NSYSU Tainan 5

TWAREN Network topology Pacific Wave CANARIE Star. Light NTU NCU *S T 3* M 4+ 3*S Hsinchu NTU STM -4 +2 NCHU Taichung 2. 5 G NTHU NETHER Land Sinica Taipei 3 NCTU CANARIE TM -1 1. *S TM -1 25 G 2 G 2. 5 G 1. 25 G 1. 8 G 1. 25 G NCNU MAN LAN Tainan CCU LALALAN NCKU NSYSU 6

TWAREN NMS Architecture NOC Apps BMS Apps EMS Network Elements Apps Remedy Help Desk (Trouble Ticket System) SMS NMS Service Desk HP Open. View Service Information Portal (SIP) Cisco Info Center (Micromuse) Cisco Secure ACS Cisco IP Solution Center HP Open. View Operation Manager HP Open. View Extend Topology & Multicast HP Open. View Performance Insight & Report Pack for Cisco MPLS VPN / IP Qo. S / Cisco Ping / SA/ Netflow / IPT / CAR / RMON & Customize Report Raw Data Carrier OSS/ NMS Alarm SLA Reports HP Open. View Network Node Manager (NNM) & Cisco. Works 2000 for LAN/WAN & CTM WAN/LA N IPv 6 MPLS IP Telephony Multicast Multimedia 7

Sloan Digital Sky Survey (SDSS) Overview q It is an very ambitious astronomical survey project. q The goal is to image one-half of the northern celestial hemisphere, and a smaller portion of the southern sky. q It determines the positions and absolute brightnesses of more than 100 million celestial objects. q The SDSS Southern Coadd project combines all images to detect very faint and distant astronomical objects. q Fermi National Accelerator Laboratory (FNAL) uses Grid 3 to carry out a full coadd of all available data. 8

TWAREN Connections to Fermi Lab Pacific Wave CANARIE Star. Light NTU NCU NETHER Land Sinica Taipei 3 NCTU CANARIE NTHU Hsinchu NCHU M 4+ 3* 3*S NTU ST 2. 5 G *S T TM -1 M -4 +2 *S TM 1. -1 Taichung 25 G 2 G 2. 5 G 1. 25 G 1. 8 G 1. 25 G NCNU MAN LAN Tainan CCU LALALAN NCKU NSYSU 9

Network Topology 198. 49. 208. 10 140. 110. 240. 10/24 [FNAL measurement server for CDF] [SDSS client] 131. 225. 7. 156 [SDSS-server] FNAL-SW 211. 79. 63. 59/29 NCHC-SW 1 211. 79. 63. 57/29 TWAREN International Optical Network 211. 79. 63. 58/29 ONS in Sartlight NCHC ONS (HC) HC-7609 P (NCHC-SW 2) 15600 HC 211. 79. 59. 250 15600 TP 1 15454 TP 2 15454 SF 15454 CH 211. 79. 59. 252 [NCHC measurement server] [FNAL measurement client for CDF] 10

Network Connections 198. 49. 208. 10 140. 110. 240. 10/24 [FNAL measurement server for CDF] [SDSS client] 131. 225. 7. 156 [SDSS-server] FNAL-SW 211. 79. 63. 59/29 NCHC-SW 1 211. 79. 63. 57/29 TWAREN International Optical Network 211. 79. 63. 58/29 HC NCHC ONS in Chicago Sartlight HC-7609 P (NCHC-SW 2) 211. 79. 59. 250 211. 79. 59. 252 [NCHC measurement server] [FNAL measurement client for CDF] 11

Network Set-ups q Use Cisco 7609 & ONS (15454/15600) for connection q Use CTC, CTM or UCLP for lightpath set-up q Layer 1 international link for Hsin-Chu – Chicago q 622 Mbps lightpath (Hsin-Chu – Taipei – S. F. – Chicago) q 7 ONS’s included in the lightpath q Rsync: 2 MB/s 8 MB/s FNAL q Data Fragmentation q Policy Route q 5. 0 TB Storage TWAREN International Network ONS Hsin-chu NCHC ONS Starlight 12

Network Performance Monitoring • • • IPERF. MBPS: Max= 228. 78 Mbps Reverse IPERF. MBPS: Max= 213. 27 Mbps Available BW(Mbps): Max= 600. 00 Mbps RTT: 182 ms No. of Hops: 3 13

Network Monitoring Topology at Fermilab 14

Future Plan q Resources (Computing + Storage+ Network) q Partnership with Universities and Institutes q Production Certificate Authority q Processing Functions q Applications Definition q International Collaborations 15