Network Monitoring System with Scheduler Takatoshi Ikeda APAN-JP - - PowerPoint PPT Presentation

2005.8.25 The 20th APAN meeting in Taipei

Network Monitoring System with Scheduler

Takatoshi Ikeda

APAN-JP NOC, KDDI R&D Labs

The 20th APAN meeting in Taipei 2005.8.25

Outline

Background and Motivation Goal Outline of the System Specification of the Developed Environment Demonstration Issue List Roadmap

The 20th APAN meeting in Taipei 2005.8.25

Background and Motivation

Lessons Learned from SC2004

Traffic pattern in Bandwidth Challenge

Illinois UNIV. A I S T I l l i n

• i

s U N I V . & J A X A Tokyo UNIV.

A lot of demonstration that filled in almost all bandwidth of a link were conducted in very short

• term. (tens of minutes)

JGN2 circuit, Japan-US, OC-192c(10Gbps)

The 20th APAN meeting in Taipei 2005.8.25

Background and Motivation (cont.)

Lessons Learned

Schedule

The schedule of actual demos were under control, but preliminary experiments had to been arranged by applicant. In addition, these schedules ware not opened to an online, such as web.

Unexpected traffic

An unexpected traffic might be generated during the allocated time slot . However, we couldn’t identify the source of this traffic and couldn’t detect it either.

No expected traffic

Although the demo slot was allocated, the traffic was not generated at all. The allocated slot should be well used by applicants.

→We need tool that can manage the schedule of the demonstration and monitor the traffic along the schedule

The 20th APAN meeting in Taipei 2005.8.25

Goal

Efficiency of managing the schedule

The user and a operator can manage the schedule of demo through web, that makes the schedule management more efficient

Management of a resource

By managing the bandwidth of an international link,

• verbooking by multiple demos can be avoided.

Monitoring along the schedule

By monitoring the traffic on the international link along the schedule, unexpected or abused traffic will be alerted and the unused slot will be detected, too.

The 20th APAN meeting in Taipei 2005.8.25

Outline of the System

The 20th APAN meeting in Taipei 2005.8.25

Outline of the Operation

(example: detection a unexpected traffic) Network Network

Observatory data

1, register the schedule

• start time, end time
• required bandwidth
• Src IP , Dst IP
• …etc

user user user user

Get the network data Check the schedule 2, generate the huge traffic for experiment

Scheduler

• Manage the schedule

Monitoring tool

• Monitor the traffic
• Alert to unexpected user

Check the schedule manage the schedule

schedule

Unexpected user Unexpected user Unexpected user Unexpected user

congestion detect

Notification Alert

• perator
• perator

Network Monitoring System with Scheduler

The 20th APAN meeting in Taipei 2005.8.25

Outline of the Function

Scheduling

The system has web page for registering a demo. The user or operator can register information of demo into the system, such as start time, end time, bandwidth and the contact point. The system decide whether the demo can be accepted or not, based on the availability of the link.

Monitoring

The system monitors the traffic along the schedule on the link in full-time, and detects both unscheduled traffic and unused slot; the system alerts the contact point, if detected.

The 20th APAN meeting in Taipei 2005.8.25

System Architecture

• User Access Layer

Web Interface (for Management) Request Handler

• Schedule Management Layer

Demo scheduling manager Resource manager

• Monitoring Layer

monitoring Alert sender

• Service register

For multi domain (Plan)

P l a n

O p e r a t

• r

U s e r M

• n

i t

• r

i n gL a y e r S c h e d u l e M a n a g e m e n tL a y e r U s e rA c c e s sL a y e r

O b s e r v a t

• r

y

• w

D e m

• s

c h e d u l i n g m a n a g e r R e s

• u

r c e m a n a g e r

• u

M

• n

i t

• r

i n g A l e r t s e n d e r w h

• i

s s e r v e r E

• m

a i l

W e b i n t e r f a c e U s e r P a g e O p e r a t

• r

p a g e

R e q u e s t H a n d l e r

S e r v i c e r e g i s t

• r

y

I n t e r f a c e U s a g e N e t f l

• w

M a n a g e r

The 20th APAN meeting in Taipei 2005.8.25

User Access Layer

This Layer provides a web interface for management to a user and

• perator, and handle the request

that through the web interface

Component

Web interface Request Handler

Management information

User information Demo information (start and end

time, requested link and bandwidth, ,,,etc)

SML UAL MML

Network Monitoring system With Scheduler

The 20th APAN meeting in Taipei 2005.8.25

Schedule Management Layer

This Layer manages the schedule of demo and a resource of link, and process the request about the schedule from UAL and MML.

Component

Demo Scheduling Manager Resource Manager

Management information

Demo information (start and end time,

requested link and bandwidth, ,,,etc)

Link information (bandwidth, terminated

router and interface, ,,,etc)

Link reservation (start and end time,

bandwidth) SML UAL MML

Network Monitoring system With Scheduler

The 20th APAN meeting in Taipei 2005.8.25

Monitoring Layer

This Layer collects the traffic data from

• bservatory which is the system that

disclose the valuable network data. By using that data and schedule data, it monitor whether the traffic are generated along the

• schedule. If the traffic is not along the

schedule, it give notice to appropriate contact and operator.

• Component

Monitoring Alert sender

• Management information

Usage data of link Flow data

SML UAL MML

Network Monitoring system With Scheduler

The 20th APAN meeting in Taipei 2005.8.25

Specification of the Developed Environment

The 20th APAN meeting in Taipei 2005.8.25

Specification

Hardware for development

Supermicro 8013P+8

CPU : Dual Intel Xeon 3.2GHz Memory : DDR-226 2GB HDD : SCSI Ultra320 140GB

Software for development

OS

Redhat Fedora core 3 （

Kernel 2.6.11-1.27_smp）

Language

Perl (Version 5.8.5)

Free software

Apache （

web server)

rrdtool（

store the interface usage data)

Flow-tools (netflow collector & analyst tool) NFS (sync the measurement data)

The 20th APAN meeting in Taipei 2005.8.25

Specification (cont.)

Traffic Data

Usage Data

Usage data of router interface for international link. This data is gotten by SNMP every 10 seconds and stored into rrd file. The system fetch the data through NFS.

Flow Data

Netflow data which is exported by a router. The router which terminated target link exports it. The data is stored into file which is flow-tool format every one minute. The system fetch the data by replication function of flow-tools on Observatory server. Router (Juniper,Cisco,,,)

Network Monitoring System With Scheduler

Observatory

nms2 nms4 nmdb1

SNMP NFS NFS Netflow replication

The 20th APAN meeting in Taipei 2005.8.25

Demonstration

The 20th APAN meeting in Taipei 2005.8.25

Outline of the Demonstration

1.

register the demonstration

Register the demo information on the system (done beforehand)

2.

Generate the demo traffic

Generate the traffic from Tokyo to Los Angeles

3.

Show the graph

Show the graph of demo traffic

The 20th APAN meeting in Taipei 2005.8.25

Network configuration for the demo

Observatory nms2 nms4 Observatory nms1 nms1

Network Monitoring System with Scheduler

• perator
• perator

Monitoring Data Transfer

TransPAC2

US-JAPAN Link OC-192(10Gbps)

Los Angeles, US

Registration of schedule

iperf TCP Stream （ １ Gbps) Tokyo to LA nmdb1 Tokyo, Japan

The 20th APAN meeting in Taipei 2005.8.25

Issue List

Algorithm design for detection

In the current phase , the system can grasp the traffic on the link. For the next phase, the algorithm that detects unscheduled traffic or unused slot will be implemented.

Assessment of the performance

The CPU load of the router will be checked, and the performance of server will be estimated in the real environments.

The 20th APAN meeting in Taipei 2005.8.25

Issue List (cont.)

User profile

Manage the user login and prepare for the user and the operator’s web pages.

Security

The security of communication between layers will be implemented.

Other flow format

Switch or router has adapted the other flow technology such as sFlow. Its format will be supported.

The 20th APAN meeting in Taipei 2005.8.25

Road map

2005/8-9

Algorithm for the detection will be

• implemented. Also, some parameters for

detection are adjusted by using real-world data.

2005/9

use the system experimentally for iGrid2005.

2005/11

use the system for SC2005.

The 20th APAN meeting in Taipei 2005.8.25

Reference

• Lessoned Learned from 2004

http://www.jp.apan.net/meetings/0501-noc/tanaka.ppt

• Abilene Observatory

http://abilene.internet2.edu/observatory/

• Observatory at Tokyo XP

http://www.jp.apan.net/noc/Observatory/

• UCLP(User Controlled Light Path) Software

http://www.canarie.ca/canet4/uclp/

• University of Waterloo’s UCLP software

http://bbcr.uwaterloo.ca/~canarie/index.htm

• University of Ottawa & Communications Research

Centre’s UCLP software

http://phi.badlab.crc.ca/uclp/

The 20th APAN meeting in Taipei 2005.8.25

Thanks！