Development of perfSONAR-Measurement Archive (MA) Capability based - - PowerPoint PPT Presentation

▶
development of perfsonar measurement archive ma
SMART_READER_LITE
LIVE PREVIEW

Development of perfSONAR-Measurement Archive (MA) Capability based - - PowerPoint PPT Presentation

Sep 04, 2023 420 likes •565 views

perfSONAR workshop, 29th APAN Meeting 2010.2.11 Development of perfSONAR-Measurement Archive (MA) Capability based on PRESTA 10G NTT Network Innovation Labs. Kenji Shimizu, Katsuhiro Sebayashi 1 1 This work was partially supported by the

slide-1
SLIDE 1

1

perfSONAR workshop, 29th APAN Meeting 2010.2.11

Development of perfSONAR-Measurement Archive (MA) Capability based on PRESTA 10G

NTT Network Innovation Labs. Kenji Shimizu, Katsuhiro Sebayashi

This work was partially supported by the National Institute of Information and Communications Technology.

1

slide-2
SLIDE 2

2

perfSONAR workshop, 29th APAN Meeting 2010.2.11

Background

High-speed streaming application

Production quality Uncompressed HD video stream (i-Visto) Over one gigabit per second per stream

Network monitoring

Guarantee QoS for video stream Required micro-second order accuracy and

resolution

i‐Visto eXmedia server i‐Visto gateway (XG‐2) i‐Visto gateway (XG‐1)

1.5‐Gb/s

Uncompressed HD video stream

6‐Gb/s

Uncompressed 4K video stream

Optical IP Networks

PRESTA 10G

Network Interface Card and Network Monitoring Platform

PRESTA 10G

Network Interface Card and Network Monitoring Platform

slide-3
SLIDE 3

3

perfSONAR workshop, 29th APAN Meeting 2010.2.11 Winter 2010 ESCC/Internet2 Joint Techs, Feb. 2nd, 2010

Features of “PRESTA 10G Network Interface Card”

10-Gb/s network interface card with highly accurate traffic measurement capabilities

Supports 3 protocols for 10-Gb/s Ethernet LAN-PHY/WAN-PHY and OC-192c POS 10-Gb/s wire-rate packet capturing and generating capabilities 100-ns time-stamping for sending and receiving packets using external timing source Hardware-assisted inter-packet gap control function for packet generating Flexible traffic shaping function

Timing source input

(10 MHz, 1PPS)

PCI‐X/DMA

Packet processing engine

slide-4
SLIDE 4

4

perfSONAR workshop, 29th APAN Meeting 2010.2.11

Features of “PRESTA 10G Platform”

  • Consists of general purpose PC and PRESTA 10G network interface card
  • Can be applied for passive monitoring, active measurement and traffic

generator

Easy development of 10-Gb/s network monitoring software Easy migration of existing/open-source network monitoring tools into 10-Gb/s

networks using libpcap-compatible API library

PRESTA 10G Platform

includes PRESTA network interface card

Linux Kernel

PRESTA NIC device driver PRESTA API library

provides raw software interface

Libpcap‐compatible API library High‐end, advanced traffic monitoring tools

  • Open‐source monitoring tools
  • Existing monitoring software
  • Non‐sampling packet capturing,
  • NetFlow probe, traffic, statistics reporting
  • In‐service QoS monitoring
  • Pre‐service network testing
slide-5
SLIDE 5

5

perfSONAR workshop, 29th APAN Meeting 2010.2.11

TARGET

perfSONAR as a sharing infrastructure of our precise and

high-resolution measurement data taken from PRESTA

10G.

Currently, PRESTA 10G provides following measurement

capability.

I.

One-way delay: micro-second accuracy.

Using probe packets or application’s packets.

II.

Jitter: micro-second accuracy.

III.

Inter-packet gap: 100-nano-second resolution.

IV.

Available bandwidth estimation: by using packet train generation well-controlled by a hardware-assisted function.

V.

Flow records: using NetFlow/PSAMP protocols

VI.

Traffic bit-rate: 100-micro second resolution.

.... etc.

slide-6
SLIDE 6

6

perfSONAR workshop, 29th APAN Meeting 2010.2.11

FIRST STEP: IMPLEMENTATION OF MA

  • perfSONAR-MA on PRESTA 10G to show every-

micro-second traffic bit-rate.

cf.) Existing perfSONAR-SNMP MA, ABW based on RRD archives provides every-second/minute bit-rate

Exinsting RRD-based perfSONAR-MA high-resolution perfSONAR-MA on PRESTA 10G

We needs higher-resolution (up-to micro-second) measurement extensions to existing perfSONAR.

Long-tern Short-tern

slide-7
SLIDE 7

7

perfSONAR workshop, 29th APAN Meeting 2010.2.11

POINTS: MODIFICATION INTO PERFSONAR-PS_HRAMA

HRA (High Resolution Archive) file formats

Meta-data to accelerate the calculation of bit-rate. Fixed-length index.

Timestamps formats

sub-second expression: ISO-8601, UNIX timestamps.

Resolution definition in XML messages.

Unit of millisecond (“m”) and microsecond (“u”)

Compatibility with SNMP MA

RRDtools and backend HRA processor. The requests switches based on the resolution.

To take advantage of PRESTA 10G, we need to modify perfSONAR-PS to

support

  • 1. high-resolution timestamps (100-nanosecond resolution.)
  • 2. accelerating to calculate a large amount of data from 10-Gbps high-

speed networks.

slide-8
SLIDE 8

8

perfSONAR workshop, 29th APAN Meeting 2010.2.11

OVERVIEWS

8 What we made. Existing codes.

High-resolution archive (HRA) patches

  • A daemon captures and stores in the

HRA formats by using PRESTA 10G.

  • A processor reads the stored data and

calculate traffic bit-rate in requested resolution.

  • perfSONAR requests are switches based
  • n the resolution.

Switch based on requested resolution

Existing perfSONAR-PS SNMP MA(ver. 3.1.8) + HRA patch HRA IF SNMP IF

  • Res. > 1s
  • Res. <= 1s

HRA Viewer Existing perfSONAR- UI

  • Res. <= 1s

request.

  • Res. > 1s

request.

RRDtools HRA processor RRD archive HRA archive or pcap archive HRA daemon

PRESTA-enabled libpcap

PRESTA 10G provides:

  • 10-Gbps wire-rate capturing.
  • Accurate and high-resolution

timestamps.

slide-9
SLIDE 9

9

perfSONAR workshop, 29th APAN Meeting 2010.2.11

DEMONSTRATION

Virtual Machine (CentOS 5.4 x86_64) HRA-enabled perfSONAR MA local IF (lo)

HRA archives (captured with PRESTA 10G)

Apache TCPmon (*) Host-only virtual network

(*) http://ws.apache.org/commons/tcpmon/

HRA viewer

slide-10
SLIDE 10

10

perfSONAR workshop, 29th APAN Meeting 2010.2.11

HRA Viewer

bit-rate calculated every 1 seconds

0bps 350Mbps 160Mbps 140Mbps 150Mbps 125Mbps 250Mbps

bit-rate calculated every 10 milliseconds bit-rate calculated every 100 microseconds

It can make the bit rate visible by a high resolution as if the loupe.

slide-11
SLIDE 11

11

perfSONAR workshop, 29th APAN Meeting 2010.2.11

POINTS

in SetupDataRequest. sub-second timestamp expression is supported by ISO-8601, UNIX timestamps. microsecond unit (“u”) is new definition.

slide-12
SLIDE 12

12

perfSONAR workshop, 29th APAN Meeting 2010.2.11

CONCLUSION

We introduced PRESTA 10G platform for high-accuracy 10-Gb/s

network monitoring.

We showed our motivation and implementation of perfSONAR

measurement archive (MA) capability of PRESTA 10G.

Our perfSONAR-PS HRAMA takes advantage of our PRESTA 10G’s

high-resolution accurate timestamps and 10-Gbps wire-rate traffic capturing capability.

We needs comments on

Any pointers to high-resolution perfSONAR (ABW) ? GUI? (Should I merge to other UI?) Next steps (perfSONAR-PS BUOY?), we are planning to

share the results of hardware-assisted available bandwidth estimation.