Performance Update Eric L Boyd Director of Performance

Performance Update Eric L. Boyd Director of Performance Architecture and Technologies Internet 2

Vision: Performance Information is … • Available • People can find it (Discovery) • “Community of trust” allows access across administrative domain boundaries (AA) • Ubiquitous • Widely deployed (Paths of interest covered) • Reliable (Consistently configured correctly) • Valuable • Actionable (Analysis suggests course of action) • Automatable (Applications act on data) 2 Eric L. Boyd

Getting There: Build & Empower the Community Decouple the Problem Space: • Analysis and Visualization • Performance Data Sharing • Performance Data Generation Grow the Footprint: • Clean APIs between each layer • Widespread deployment of measurement infrastructure • Widespread deployment of common performance measurement tools 3 Eric L. Boyd

Result: No more mystery … • Increase network awareness • Set user expectations accurately • Reduce diagnostic costs • Performance problems noticed early • Performance problems addressed efficiently • Network engineers can see & act outside their turf • Transform application design • Incorporate network intuition into application behavior 4 Eric L. Boyd

BWCTL (Bandwidth Controller) • What is it? A resource allocation and scheduling daemon for arbitration of iperf tests • Typical Solution • Run “iperf” or similar tool on two endpoints and hosts on intermediate paths • Typical road blocks • Need permissions on all systems involved • Need to coordinate testing with others • Need to run software on both sides with specified test parameters 5 Eric L. Boyd

BWCTL: 3 -Party Flow Diagram 6 Eric L. Boyd

NDT: Network Diagnostic Tool • Web 100 enhanced server handles testing and diagnostic services • Java based and command line clients allows testing from any client (local or remote) • Performance and configuration faults reported back to client • Drill-down functions provide more details & error reporting capabilities • Grant from NIH/NLM to explore duplex mismatch detection 7 Eric L. Boyd

NDT Flow Diagram Well Known NDT Server NDT - Server Web Server We b. R Red ir ect Web Page Request equ msg est Client Web Browser Web page response Testing Test Request Engine nnel l Cha o Contr els hann est c cific t pe Spawn child Child Test Engine 8 Java Applet S Eric L. Boyd

OWAMP: One-Way Active Measurement Protocol • What is it? • Measures one-way latency: 1 -way ping • Control connection used to broker test request based upon policy restrictions and available resources. (Bandwidth/disk limits) • Specification • http: //tools. ietf. org/wg/ippm/draft-ietf-ippmowdp/draft-ietf-ippm-owdp-14. txt 9 Eric L. Boyd

OWAMP Flow Diagram 10 Eric L. Boyd

Thrulay Overview • Network capacity and delay tester • Same class of tools as iperf, nettest, nuttcp, etc. • Unique features not found in other tools: • TCP: measures round-trip delay along with goodput • UDP: measures: • • One-way delay, with quantiles Packet loss Packet duplication Reordering • UDP: ability to send precisely positioned true Poisson streams (microsecond errors in sending times) • Human and machine-readable (ready to be fed to gnuplot) 11 Eric L. Boyd

Thrulay Update • • • New release v 0. 8 Tests with multiple TCP streams Set DSCP (a. k. a. first 6 bits of the TOS byte) Report MTU and/or MSS (whichever the OS makes available) More UDP statistics: duplication, reordering, quantiles of delay SPARC/Solaris support Mac OS X support IPv 6 support Non-busy-waiting UDP mode (less precise, but can run more concurrent tests) • Documentation: manual pages have been added • Basic client authorization based on IP address • Integration of TSC timekeeping projects for faster and more precise timestamping 12 Eric L. Boyd

Bulk Transport • Build a library / tool for bulk transport that does not require kernel level modifications yet achieves the performance of such • VFER library • Congestion control hooks • Implements loss-based congestion control • Working on delay-based version • File transfer utility • An initial version demoed 13 Eric L. Boyd

How can you use them? • Tools are open source, supported, welldocumented • BWCTL/Iperf, OWAMP, NDT are deployed across Abilene backbone and at many partners • You can: • See ongoing measurement results at the Abilene Observatory • Test to/from the Abilene backbone 14 Eric L. Boyd

Network Performance Measurement Workshops • Example Course Materials: • http: //e 2 epi. internet 2. edu/npw/presentations. html Goals: • Grow installed base of BWCTL/Iperf, OWAMP, and NDT at Giga. Po. P and regional campuses. • http: //e 2 epi. internet 2. edu/pipes/pmp-dir. html • Begin integration into IT support processes. • Create an installed base for perf. SONAR deployment. • Give each participant tool-specific cookbooks. 15 Eric L. Boyd

Network Performance Measurement Workshop Locations and Dates • Completed • • • 16 SOX / Ga. Tech (03/05) CENIC / UCLA (06/05) JT – Vancouver (07/05) OARNet / OSU (09/05) MAGPI / FMM (09/05) MAX / College Park (12/05) APAN (01/06) JT - Albuquerque (02/06) MERIT (02/06) Columbia / NYSERNet (04/06) • Planned • University of Virginia (04/06) • Under Consideration • Wisconsin, Alaska, … Eric L. Boyd

Additional Outreach • National Library of Medicine • Presentation on end-user tools at NLMcentric Network Performance Monitoring Pilot-project Workshop (March 2006) • New World Symphony • Presentation on end-user tools at NWS Master Class Workshop (January 2006) • On-going dialog on end-user needs 17 Eric L. Boyd

Collaboration • Working Groups • Bulk Transport (transport. internet 2. edu) • GGF Network Measurement (nmwg. internet 2. edu) • perf. SONAR (www. perfsonar. net) • Funded Research • “Bridging the Gap” (NSF) • Network Measurement for International Connections • Google Summer of Code • 2005 very successful • 2006 planned 18 Eric L. Boyd

perf. SONAR Overview • What: Measurement infrastructure for exchanging data under development • How: Webservices network performance framework • • • Network measurement tools Network measurement archives Distributed scheduling/authorization Multi-domain policy Common language (GGF NMWG Schema) • Where: Deployed / to be deployed across: • Network Backbones (Abilene, ESNet, GÉANT) • Regional Networks (NRENs, RONs, Gigapops) • Universities • When: First product release early summer ‘ 06 19 Eric L. Boyd

perf. SONAR Credits • perf. SONAR is a joint effort: • • • ESnet Fermilab GÉANT 2 JRA 1 Internet 2 RNP • Internet 2 includes: • University of Delaware • Georgia Tech • Internet 2 staff 20 • GÉANT 2 JRA 1 includes: • • • • Arnes Belnet Carnet Cesnet DANTE DFN FCCN GRNet ISTF PSNC Nordunet (Uninett) Renater Red. IRIS Surfnet SWITCH Eric L. Boyd

How can you use it? • perf. SONAR Link Utilization and Capacity data available from Abilene, ESnet, GÉANT (prototype) • Build your own components to integrate into open source framework 21 Eric L. Boyd

perf. SONAR: Project Activity Meter • • 22 1 -2 conf calls/week 1 new service/month (accelerating) 3 -4 development workshops/year 3 -4 paper submissions/year Eric L. Boyd

perf. SONAR: System Description • Domains represented by a set of services • Each domain can deploy services important to the domain • Analysis clients interact with service across multiple domains 23 Eric L. Boyd

perf. SONAR: Services (1) • Lookup Service • Allows the client to discover the existing services and other LS services. • Dynamic: services registration themselves to the LS and mention their capabilities, they can also leave or be removed if a service gets down. • Auth. N/Z Service • Internet 2 MAT, GN 2 -JRA 5 (edu. GAIN) • Authorization functionality for the framework • Users can have several roles, the authorisation is done based on the user role. • Trust relationships defined between users affiliated with different administrative domains. 24 Eric L. Boyd

perf. SONAR Services (2) • Transformation Service • Transform the data (aggregation, concatenation, correlation, translation, etc). • Topology Service • Make the network topology information available to the framework. • Find the closest MP, provide topology information for visualisation tools • Resource protector • Arbitrate the consumption of limited resources between multiple services. 25 Eric L. Boyd

Inter-domain perf. Sonar example Useful graph interaction Client Token MA I’d like to Here is who I am, I’d like to. MA A, AAHere is who I am, Token MBaccess MA B a, b, c : Network A, access MA A A Where Link utilisation along - Path a, b, c? Get Link utilisation a, b, c Get link Here you go utilisation c, d, e, f. AA AA A Here you go Network A –-LS A, a, b, c, d, e, f? B a, b, c: Where Link utilisation along Path c, d, e, f : Network B, MA B, AA B LS A a MA A b Network A MA B f e c 26 LS B d Network B Eric L. Boyd

perf. SONAR: Status Update • Production release of base package expected by June (code freeze next week) • Will include: • Single domain LS solution • RRD MA • (no AS) • Additional services and client applications supporting this version will soon follow: • BWCTL MP • perf. SONAR UI 27 Eric L. Boyd

perf. SONAR: Hot Topics • Multi-domain hierarchical LS • Auth. N/Z development plan with JRA-5 (edu. GAIN) • SSH MP (Looking. Glass) service • Topology Services • L 2 specific MA service 28 Eric L. Boyd

perf. SONAR: Current Developments • MPs • SSH/Telnet (Looking Glass) • ABW (bandwidth packet capture cards) • BWCTL • NMS (SDH status) • SNMP • Command line (OWAMP, Ping, Traceroute) 29 • MAs • • • RRD SQL Top. S BWCTL Hades (owd, jitter, owpl) Flow replicator • Visualization Clients • • CNM perf. SONAR UI Visual perfsonar Looking glass Eric L. Boyd

Questions? 30 Eric L. Boyd

perf. SONAR: auth. N/Z plans • perf. SONAR(JRA-1)/JRA-5 sub-group • Group tasked with determining how to leverage JRA-5 authentication system (edu. GAIN) in perf. SONAR infrastructure • Jeff Boote (Internet 2) • Diego Lopez (Red. IRIS) • Maurizio Molina (Dante) • Andreas Solberg (Uninett) 31 Eric L. Boyd

perf. SONAR: Background • Designed with Federated authentication in mind • AS becomes a ‘proxy’ for Authorization requests 32 Eric L. Boyd

edu. GAIN: Background • JRA-5 provided authentication “interface” • Provides “bridging” to other authentication systems • Shibboleth • PAPI • Others… • Designed mostly with web-browser interaction in mind 33 Eric L. Boyd

Current Status • Group has come to general consensus on how this should work • Paper is currently underway describing interaction of perf. SONAR with edu. GAIN API 34 Eric L. Boyd

perf. SONAR: Trust relationship entities • Client • id. P (identity provider) • p. SR (perf. SONAR resource “service”) • AS (perf. SONAR AS service) • HLS (Home Location Service) 35 Eric L. Boyd

Automated Client Interaction 36 Eric L. Boyd

Normal User Interaction 37 Eric L. Boyd

Implications for JRA-5 • Future extensibility for multiple X. 509 root CA certificates • Non-web profile for auth. N attribute request • Current identity provider servers (attribute stores) may need to hold attributes for non-human clients • Others? ? ? 38 Eric L. Boyd

Implications for JRA-1 • AS has slightly different role • Clients never directly interact with AS • AS is effectively a ‘proxy’ between services and the edu. GAIN ‘bridging elements’ • Attribute requests from services to RP’s and from RP’s to AS need to be made in a ‘boolean’ fashion to protect the privacy of clients • Automated clients MUST have X. 509 client certificates 39 Eric L. Boyd

Questions/Concerns • Let us know if you would like a copy of the ‘document’ when it is complete • Please feel free to send further questions/comments to Maurizio and Jeff boote@internet 2. edu maurizio. molina@dante. org. uk 40 Eric L. Boyd

41 Eric L. Boyd

Deployment • Network Performance Workshops • Hands-on tool deployment training • Giga. Po. P/campus involvement • 250+ participants/11 Workshops • Global Deployments • Infrastructure (GÉANT 2, RNP, Internet 2, & ESnet) • Individual Tools (e 2 epi. internet 2. edu/pipes/pmpdir. html) 42 Eric L. Boyd

Performance Tools (1) • OWAMP: One-Way Active Measurement Protocol • One-way Delay • BWCTL: Bandwidth Control • Wraps NLANR / DAST-created Iperf • Measures throughput 43 Eric L. Boyd

Performance Tools (2) • NDT: Network Diagnostic Tool • Diagnoses common performance problems between a server and your laptop • Downloaded java applet from the web runs the tests • Thrulay • Network capacity and delay tester • TCP: measures round-trip delay along with goodput • UDP: measures: one-way delay, with quantiles; packet loss; packet duplication; reordering 44 Eric L. Boyd