Internet2 End-to-End Performance Internet2 End-to-End Performance - - PowerPoint PPT Presentation

internet2 end to end performance internet2 end to end
SMART_READER_LITE
LIVE PREVIEW

Internet2 End-to-End Performance Internet2 End-to-End Performance - - PowerPoint PPT Presentation

Internet2 End-to-End Performance Internet2 End-to-End Performance Monitoring Initiative Update Monitoring Initiative Update Eric L. Boyd, Internet2 Eric L. Boyd, Internet2 May 21, 2003 May 21, 2003 23 June 2003 Agenda Motivation


slide-1
SLIDE 1

23 June 2003

Internet2 End-to-End Performance Monitoring Initiative Update Internet2 End-to-End Performance Monitoring Initiative Update

Eric L. Boyd, Internet2 May 21, 2003 Eric L. Boyd, Internet2 May 21, 2003

slide-2
SLIDE 2

6/23/2003 2

Agenda

  • Motivation
  • piPEs / AMI Overview
  • piPEs / AMI Deployment Plan
  • OWAMP Release
  • Demo
slide-3
SLIDE 3

6/23/2003 3

Context for E2E Performance

Even with high bandwidth network links, the Internet2 community often does not see expected performance.

slide-4
SLIDE 4

6/23/2003 4

The Wizard Gap

slide-5
SLIDE 5

6/23/2003 5

A Problem

Applications Developer System Administrator LAN Administrator Campus Networking Gigapop Gigapop Backbone Campus Networking LAN Administrator System Administrator Applications Developer

How do you solve a problem along a path?

Hey, this is not working right!

The computer Is working OK Talk to the other guys Everything is AOK No other complaints The network is lightly loaded All the lights are green We don’t see anything wrong Looks fine Others are getting in ok Not our problem

slide-6
SLIDE 6

6/23/2003 6

Good Work Already Going On

Many projects and research is underway by others investigating performance on portions of the end-to-end path. E2Epi seeks to bring these efforts together to look at the end-to-end path as a complete system.

slide-7
SLIDE 7

6/23/2003 7

Can You Go Direct to the Problem?

How can you tell where is the problem? Need a tool to tell you:

  • Where the problem is.
  • The type of problem
  • Who to contact to get it fixed

Terry Gray, University of Washington

“We Need a Finger Pointing Tool”

slide-8
SLIDE 8

6/23/2003 8

Gray Finger Pointing Tool

Applications Developer System Administrator LAN Administrator Campus Networking Gigapop Gigapop Backbone Campus Networking LAN Administrator System Administrator Applications Developer

Locate the Problem

Gray Finger Pointing Tool Terry Gray University of Washington

Finger Pointing Tool Time!

slide-9
SLIDE 9

6/23/2003 9

Gray Finger Pointing Tool

Applications Developer System Administrator LAN Administrator Campus Networking Gigapop Gigapop Backbone Campus Networking LAN Administrator System Administrator Applications Developer

Finger Pointing Tool Time

You ARE the Weakest Link!

OK, I’ll fix it

slide-10
SLIDE 10

6/23/2003 10

Agenda

  • Motivation
  • piPEs / AMI Overview
  • piPEs / AMI Deployment Plan
  • OWAMP Release
  • Demo
slide-11
SLIDE 11

6/23/2003 11

BNI AMI

  • Project: Backbone Network

Infrastructure Abilene Measurement Infrastructure

  • Goal: Instrument Next Generation

Abilene network with extensive performance measurement capabilities

  • Approach: Collaborative project among

BNI, Engineering, and E2E.

slide-12
SLIDE 12

6/23/2003 12

E2E piPES

  • Project: End-to-End Performance Initiative

Performance Environment System (E2E piPES)

  • Goal: To allow end-users and network
  • perators to determine performance

capabilities, locate problems, and contact the right person to get a problem resolved.

  • Approach: Collaborative project combining

the best work of many organizations.

slide-13
SLIDE 13

6/23/2003 13

The Measurement System

PMP PMP PMP PMP = Performance Measurement Point (at each Abilene Node)

The New Abilene will have measurement devices as part of its structure

Abilene

slide-14
SLIDE 14

6/23/2003 14

The Measurement System

PMP PMP PMP PMP at each Campus Border

Extend the System to Campuses

Abilene

PMP Campus X PMP Campus Y

slide-15
SLIDE 15

6/23/2003 15

Performance Reporting

PMP PMP PMP

Perform regular tests to provide web based Performance Reports across Abilene and for Campus-Abilene paths

Abilene

PMP Campus X PMP Campus Y

Campus-Abilene Capability Campus W – 155 Mbps Campus X – 612 Mbps Campus Y – 1000 Mbps Campus Z – 2 Mbps Abilene Capability SNVA/DNVR – 10 Gbps DNVR/IPLS – 10 Gbps IPLS/NYCM – 10 Gbps

slide-16
SLIDE 16

6/23/2003 16

Reaching the End-User

PMP PMP PMP

Provide a Testing Tool for the End-Users Computer to test across campus and beyond

Abilene

PMP Campus X PMP Campus Y Host A Host B The tool reports performance of the path to a specified destination by using active tests (like to the campus border) or using stored test results from regularly scheduled tests. It also performs tests on the host system to check host tuning parameters

slide-17
SLIDE 17

6/23/2003 17

Adding Path Information

PMP PMP PMP

Add PMP along paths to provide additional detail

Abilene

PMP Campus X PMP Campus Y Host A Host B Regular tests are performed between adjacent PMP and stored in a Data Repository. This information is used by the End-User tool to reduce the number or active tests needed. PMP PMP Regional Network J PMP PMP Regional Network M Gigapop S Gigapop T

slide-18
SLIDE 18

6/23/2003 18

Who You Gonna Call?

PMP PMP PMP

E2E piPES will provide contact information when a segment in the path appears to have a problem

Abilene

PMP Campus X PMP Campus Y Host A Host B The test results obtained by the End-User will be passed on to the contact person PMP PMP Regional Network J PMP PMP Regional Network M Gigapop S Gigapop T

piPES Test Analysis Looks like a problem In Gigapop T. Pass these test result to: Joe@gigapopT.net

slide-19
SLIDE 19

6/23/2003 19

E2E piPES Architecture

End User Interface Network Administrator Interface Culprit DB “Turn Yourself In” Culprit Interface ID Self AAA Query Culprit ID Culprit Specify end points & application family Request Test Result Testing Engine Analysis Engine Specify Test & End Nodes Send Conclusion Source Administrative Domain Interface Reply Ready, Rejected, Patience Virtual Performance Measurement DB (local to Domain) Target Administrative Domain Interface AAA and Tool Agreement Request Test Result Source PMC Target PMC AAA & Schedule Agreement Source PMP Target PMP AAA & Schedule Agreement Database Gatekeeper Web- based Display Engine Human Analysis Engine

slide-20
SLIDE 20

6/23/2003 20

Testing / Analysis Engine

Problem: Encode Matt Z.’s Brain Open Questions:

  • What are measurement results are

“acceptable” for a given application (family)?

  • What tools generate those results?
  • How do you handle incomplete data?
  • How do you rank multiple result-generators?
  • What is the iterative decision tree to

understand E2E problem?

slide-21
SLIDE 21

6/23/2003 21

Measurement Schema

Measurement Types? e.g. BW, Latency, Loss, Jitter Measurement Units? e.g. Seconds vs. Microseconds Map Tools to Measurements? e.g. OWAMP -> 1-way Latency Measurement Metadata? Database Table Design?

slide-22
SLIDE 22

6/23/2003 22

Access, Authentication, Authorization

Roles for Access

  • Standard End-User?
  • Near Neighbor (Test Buddy)?
  • NOC Staff / Network Engineer?

Shibboleth for Implementation

  • Each campus decides who in each role
  • Others trust campus designation
slide-23
SLIDE 23

6/23/2003 23

Other R&D Issues

Design system to scale (eliminate centralization)? How to “discover” PMPs? How to insert On-Demand tests into Regularly-Scheduled test set Balance centralization and distributed database requirements

slide-24
SLIDE 24

6/23/2003 24

Agenda

  • Motivation
  • piPEs / AMI Overview
  • piPEs / AMI Deployment Plan
  • OWAMP Release
  • Demo
slide-25
SLIDE 25

6/23/2003 25

E2E piPES Architecture v1.0

End User Interface Network Administrator Interface Culprit DB “Turn Yourself In” Culprit Interface ID Self AAA Query Culprit ID Culprit Specify end points & application family Request Test Result Testing Engine Analysis Engine Specify Test & End Nodes Send Conclusion Source Administrative Domain Interface Reply Ready, Rejected, Patience Virtual Performance Measurement DB (local to Domain) Target Administrative Domain Interface AAA and Tool Agreement Request Test Result Source PMC Target PMC AAA & Schedule Agreement Source PMP Target PMP AAA & Schedule Agreement Database Gatekeeper Web- based Display Engine Human Analysis Engine

slide-26
SLIDE 26

6/23/2003 26

piPEs / AMI Rollout

AMI PMP AMI PMP AMI PMP

OWAMP PERF DB

Visualization Package

OWAMP OWAMP OWAMP

slide-27
SLIDE 27

6/23/2003 27

piPEs / AMI Rollout

AMI PMP AMI PMP AMI PMP

OWAMP PERF DB

Visualization Package

OWAMP OWAMP OWAMP

Web Service

slide-28
SLIDE 28

6/23/2003 28

piPEs / AMI Rollout

AMI PMP AMI PMP AMI PMP

OWAMP PERF DB

Visualization Package

OWAMP IPERF Traceroute SNMP OWAMP IPERF Traceroute SNMP OWAMP, IPERF, Traceroute, SNMP

Web Service

Traceroute PERF DB IPERF PERF DB SNMP PERF DB

slide-29
SLIDE 29

6/23/2003 29

piPEs / AMI Rollout

AMI PMP AMI PMP AMI PMP

OWAMP PERF DB

Visualization Package

OWAMP IPERF Traceroute SNMP OWAMP IPERF Traceroute SNMP OWAMP, IPERF, Traceroute, SNMP

Web Service

Traceroute PERF DB IPERF PERF DB SNMP PERF DB Campus PMP Campus PMP

slide-30
SLIDE 30

6/23/2003 30

piPEs / AMI Rollout

AMI PMP AMI PMP AMI PMP

OWAMP PERF DB

Visualization Package

OWAMP IPERF Traceroute SNMP OWAMP IPERF Traceroute SNMP OWAMP, IPERF, Traceroute, SNMP

Web Service

Traceroute PERF DB IPERF PERF DB SNMP PERF DB Campus PMP Campus PMP

Scheduler Web Service Configuration Package

slide-31
SLIDE 31

6/23/2003 31

piPEs / AMI Development & Testing Environment

nmsX Server Server nmsX Server

Development Testing Tests Tests New Code Base Production Code

Measurement Node

New Production Code Master Measurement Node

Measurement Node Measurement Node Measurement Node

Abilene Measurement Nodes . . . . . . . . . . . . . . . . . . . . . . Base/New Production Code Tests Tests Tests

Server

Test Results Database Server Performance Visualization Tool

Measurement Node

Router Switch nms1 nms3 nms2 nms4 CDMA

slide-32
SLIDE 32

6/23/2003 32

piPEs / AMI Internal Resources

Eric Boyd – piPEs development, project coordination Jeff Boote – OWAMP, piPEs development Prasad Calyam – piPEs development Chris Heermann – AMI Matt Zekauskas - AMI Susan Evett - Documentation Russ Hobby – Campus Deployment George Brett – Schema, “Grid Service”

slide-33
SLIDE 33

6/23/2003 33

piPEs External Resources

Yee-Ting Li – UCL (50%) Paul Mealor – UCL (up to 100%) PhD Student – UCL (contingent on grant) Warren Matthews – SLAC Jim Ferguson et al – NLANR / DAST Nicolas Simar et al – DANTE Many early adopter volunteers

slide-34
SLIDE 34

6/23/2003 34

Agenda

  • Motivation
  • piPEs / AMI Overview
  • piPEs / AMI Deployment Plan
  • OWAMP Release
  • Demo
slide-35
SLIDE 35

6/23/2003 35

Latency Tests

Problem: Existing platforms are not interoperable (SURVEYOR,RIPE,…) Solution: Standards

slide-36
SLIDE 36

6/23/2003 36

OWAMP

One-Way-Active-Measurement-Protocol

  • Possible due to growing availability of good time

sources

  • Wide deployment of “open” servers would allow

measurement of one-way delay to become as commonplace as measurement of RTT using ICMP tools such as ping.

  • Current Draft: draft-ietf-ippm-owdp-05.txt

–Shalunov,Teitelbaum,Zekauskas

slide-37
SLIDE 37

6/23/2003 37

OWAMP Implementation

Basically:

NTP system call interface Multiple processes for recv/send loops Written as an API to allow one-off implementations

slide-38
SLIDE 38

6/23/2003 38

OWAMP implementation status

Sample implementation http://owamp.internet2.edu/

  • Beta Release:

–No “policy” –No authentication/encryption –FreeBSD only

slide-39
SLIDE 39

6/23/2003 39

Abilene OWAMP deployment

2 overlapping full meshes (IPv4 & IPv6)

  • 11 measurement nodes = 220 ongoing tests
  • UDP singletons
  • Rate: 10 packets/second*
  • Packetsize: (32 byte payload)*
  • Results are continuously streamed back to

“Measurement Portal” for long-term archive and data dissemination (Near real-time)

slide-40
SLIDE 40

6/23/2003 40

Agenda

  • Motivation
  • piPEs / AMI Overview
  • piPEs / AMI Deployment Plan
  • OWAMP Release
  • Demo
slide-41
SLIDE 41

6/23/2003 41

More Internet2 Information

On the Web

  • www.internet2.edu
  • e2epi.internet2.edu

Email

  • Info-e2epi@internet2.edu
slide-42
SLIDE 42

6/23/2003 42

Questions?

slide-43
SLIDE 43

www.internet2.edu