Super JANET 5 Enabling Education and Research Roland

Super. JANET 5 Enabling Education and Research Roland Trice r. trice@ukerna. ac. uk Super. JANET 5 HEAnet National Networking Conference 2006

Introduction to JANET • The Education Internet in the UK • HE, FE, Schools (via LEA networks) Research Institutes, and others • Over 1000 institutions • Complete Internet connectivity • Super. JANET 4 • 10 Gbit/s SDH backbone • Delivers service to 20 regional networks • Regional networks connect individual institutions Super. JANET 5 HEAnet National Networking Conference 2006 2

The Requirement: Key issues • Network reliability and resilience • RNs connected by single link remained a concern • Demand for bandwidth • • Power users Pent up demand from FE Enlarging the user base The usual growth • Protect the interests of diverse communities • Flexible provisioning • Enhance network monitoring services Super. JANET 5 HEAnet National Networking Conference 2006 3

SJ 5 must deliver • RELIABILITY • SCALABILITY END-TO-END • SEPARABILITY • FLEXIBILITY Achievable with a flexible transmission platform built on optical fibre • VISIBILITY Super. JANET 5 HEAnet National Networking Conference 2006 4

Infrastructure procurement • Negotiated Procedure • We know what we want • Flexible transmission system – Fibre and WDM equipment • Dedicated to Super. JANET • We didn’t know how we wanted it provided • Lease dark fibre & light it ourselves • Managed service from a Telco • We didn’t know if the market would deliver Super. JANET 5 HEAnet National Networking Conference 2006 5

Infrastructure procurement • Pre-qualification Q 4 2004 • Six suppliers short-listed • Negotiate form of ITT with all six Q 1/2 of 2005 • Launch ITT June 2005 • Only to short-listed suppliers • Contract awarded to Verizon (MCI) end of 2005 Super. JANET 5 HEAnet National Networking Conference 2006 6

Router procurement • Met with MCI in mid 2003 • Avici, Axiowave, Caspian, Chiaro, Hyperchip, Procket • Informal talks with suppliers in Q 3/4 2003 • RFI document issued in early 2004 • Evaluate features of carrier class routers • Hands-on testing of • Chiaro Enstara, Cisco CRS-1, Juniper T-640, Procket PRO 8000 Super. JANET 5 HEAnet National Networking Conference 2006 7

Router procurement • Open procurement launched in Sept 2005 • Awarded to Lucent Technology January 2006 • Juniper T-640 routers • Carrier Class • >1000 in service world wide • 40 Gbit/s demonstrated by Juniper and Verizon • Available as a product now • Very good deal, Driving down the cost of ownership Super. JANET 5 HEAnet National Networking Conference 2006 8

Router marketplace • To date • Axiowave, Chiaro & Hyperchip have ceased trading • Procket bought up by Cisco • A week before RFI test • Caspian has moved out of the carrier space Super. JANET 5 HEAnet National Networking Conference 2006 9

Core Infrastructure • Six C-Po. Ps • Like SJ 4 without Cosham and Edinburgh • Fibre network dedicated to Super. JANET 5 • Single pair of fibres • Protection at the IP layer • Dedicated WDM transmission equipment • Operated by Verizon initially • UKERNA may manage circuit provision later in the project Super. JANET 5 HEAnet National Networking Conference 2006 10

Core Infrastructure • Ciena Corestream DWDM equipment • 80 wavelenghts per fibre • 10 Gbit/s now, 40 Gbit/s in 2008 • Pilot on SJ 5 core in 2007 • Core circuits grouped into ten bands of eight • Bands add/dropped at C-Po. Ps or at OADM sites Super. JANET 5 HEAnet National Networking Conference 2006 11

Core Network Design • Core Network consists of three basic components: • Core Terminal sites – Six blue locations • Flexible OADM sites (Optical Add Drop) – Eight white locations • Optical Amplification sites – Eleven locations, not shown Super. JANET 5 HEAnet National Networking Conference 2006 12

Core Traffic Provision • • 10 Gbit/s circuits are provisioned using two transponders only No Regeneration needed • Each circuit would have to be regenerated separately • Expensive • • Optical amplification still needed every 80 KM or so Telehouse & Telecity part of the core • Peerings to UK and Global Internet Super. JANET 5 HEAnet National Networking Conference 2006 13

Connecting Regional Networks • Two IP production circuits delivered to each RN • Delivery to diverse locations in the RN • One 10 Gbit/s research circuit • Connected to UKLight SDH mux • Two connection methods • Collector Arc • Point-point fibre through RNEPs linking C-Po. Ps • Single point-to-point fibre • Fibre from RNEP into the core Super. JANET 5 HEAnet National Networking Conference 2006 14

Point to point fibre Glasgow C-Po. P Verizon Edinburgh NORMAN University of Newcastle Verizon Newcastle University of Northumbria Verizon Middlesbrough Leeds C-Po. P Super. JANET 5 HEAnet National Networking Conference 2006 15

Point to point fibre Verizon Glasgow Verizon Newcastle University Regional Network Carried over collector arc Core network Production 2. 5 Gbit/s circuit presented on muxponder cards at Newcastle Circuit is aggregated onto a 10 Gbit/s wavelength using an aggregation card The 10 Gbit/s wavelength is added into to the core network at the Verizon node in Newcastle and transported to the Glasgow C-Po. P over the Corestream equipment. It is dropped out of the Glasgow Corestram into another 4200 at the Glasgow C-Po. P The 2. 5 Gbit/s circuit is de-muxed by a muxponder card and presented to the core router 10 Gbit/s research circuit Super. JANET 5 HEAnet National Networking Conference 2006 16

Point to point fibre Glasgow C-Po. P Verizon Newcastle University Regional Network Carried over collector arc Core network Leeds C-Po. P Verizon Middlesbrough Northumbria University Core network Super. JANET 5 HEAnet National Networking Conference 2006 17

Collector Arc Network North West Verizon Preston YHMAN NNW Preston YHMAN Leeds NNW Manchester YHMAN Leeds Met Warrington C-Po. P Super. JANET 5 Leeds C-Po. P HEAnet National Networking Conference 2006 18

Collector Arc Warrington C-Po. P Manchester Leeds Met Leeds Uni Leeds C-Po. P Leeds Uni 10 Gbit/s Production and Research on 10 Gbit/s transponders to Leeds C-Po. P Leeds Met 10 Gbit/s Production on 10 Gbit/s transponders passing through Manchester to drop off at Warrington. Note pink amplifier cards at Leeds Uni and Manchester and the re-use of the green wavelength towards Warrington from Leeds Met. Manchester 10 Gbit/s Production and Research circuits on 10 Gbit/s transponders to drop off at Warrington. Super. JANET 5 HEAnet National Networking Conference 2006 19

NIRAN & HEAnet Newry Core Stream Subsea Span 203 KM (41 d. B) NTL Kennedy Way Queens 1 Queens 2 NTL Shore road Verizon Glasgow Super. JANET 5 HEAnet National Networking Conference 2006 20

NIRAN & HEAnet Verizon Dublin Clonshaugh Core Stream Subsea Span 235 KM (49 d. B) HEAnet Lytham Manchester Super. JANET 5 HEAnet National Networking Conference 2006 Warrington 21

HEAnet • Replacement of existing connection to JANET • GE circuit presented at ESAT-X • HEAnet provisioned dark fibre between ESAT-X and the HEAnet Po. P at Erne Street • Delivery due by 24 th November • UKERNA/HEAnet acceptance testing Super. JANET 5 HEAnet National Networking Conference 2006 22

Potential research collaboration • CERN Large Hadron Collider Project • HEP access to the UK Tier 1 centre • Network research • Future service development • Automated path provisioning • Control plane experiments Super. JANET 5 HEAnet National Networking Conference 2006 23

Migration • 1 st Regional Networks migrated on 31 st November • Aggressive timetable • Tuesdays and Thursday mornings • Due to complete before Christmas 2006 • Super. JANET 4 to continue until March 2007 • Contingency • Migrate research projects Super. JANET 5 HEAnet National Networking Conference 2006 24

Meeting the requirement: Reliability • Reduce single points of failure • Diverse fibre routing in the core • Dual connection of Regional Networks • Carrier class optical and routing equipment • SDH technology • In the core and out to the regional networks • Rapid failure detection and recovery • Detect latent problems Super. JANET 5 HEAnet National Networking Conference 2006 25

Meeting the requirement: Scalability • Ability to expand capacity • Where it’s needed • When it’s needed • 40 Gbit/s trial in early 2007 • Predictable cost • Marginal cost for transmission channels • Significant discount for router equipment • Not clawed back in maintenance charges Super. JANET 5 HEAnet National Networking Conference 2006 26

Meeting the requirement: Separability • Hard multiplexing of bandwidth channels • Production services firewalled from research infrastructures Super. JANET 5 HEAnet National Networking Conference 2006 27

Meeting the requirement: Flexibility • Deliver bandwidth quickly • In weeks rather than months • With a variety of interfaces and bandwidths • 10 and 2. 5 Gbit/s SDH • 10 and 1 GE (LAN-PHY and WAN-PHY) • Temporary arrangements may become practical Super. JANET 5 HEAnet National Networking Conference 2006 28

Meeting the requirement: Visibility • Ability to monitor network in more detail • Operational monitoring • Research projects • Optical taps • Monitor all router interfaces at Reading and London • Issues of confidentiality have been addressed Super. JANET 5 HEAnet National Networking Conference 2006 29

Questions? Super. JANET 5 HEAnet National Networking Conference 2006