GRNET NOC network monitoring & visualization tools TF-NOC - - PowerPoint PPT Presentation

▶
grnet noc network monitoring visualization tools
SMART_READER_LITE
LIVE PREVIEW

GRNET NOC network monitoring & visualization tools TF-NOC - - PowerPoint PPT Presentation

Dec 15, 2023 141 likes •302 views

http://www.grnet.gr GRNET NOC network monitoring & visualization tools TF-NOC Zurich Alex Kosiaris (alex@noc.grnet.gr) Leonidas Poulopoulos (leopoul@noc.grnet.gr) Network monitoring Constant monitoring of network for components

slide-1
SLIDE 1

http://www.grnet.gr

GRNET NOC network monitoring & visualization tools

TF-NOC Zurich

Alex Kosiaris (alex@noc.grnet.gr) Leonidas Poulopoulos (leopoul@noc.grnet.gr)

slide-2
SLIDE 2

Network monitoring

  • Constant monitoring of network for components
  • Failing
  • Malfunctioning
  • Notification of users via mail, sms, web interface
  • Monitoring aids in
  • Preventing or limiting downtime
  • Effectively tracing errors and coping with them
  • Translating from machine errors to user friendly ones
  • Keeping performance, errors and faults archive

TF-NOC, Zurich 2 GRNET NOC network monitoring & visualization tools

slide-3
SLIDE 3

TF-NOC, Zurich 3 GRNET NOC network monitoring & visualization tools

Visualization

  • Network Topology
  • Clearer view of network topology
  • Easier reading of links and relations
  • Services
  • Better anticipation of service deployment
  • Effective and appealing “marketing”
  • Any network related set of data
  • Traffic, Errors, Service requests
  • Charts, Maps, Graphs, Tables
slide-4
SLIDE 4

Tools

  • What we do
  • 70% of the tools is developed

in-house

  • Python/Django: 70%, PHP: 30%
  • Use SNMP (99%) to harvest

network data

  • Release updates every 2-3

months

  • Use a MySQL database to bind

data

  • Avoid live SNMP queries to

devices

  • Tool Requirements
  • Developed (if possible) in-house
  • … using the same (if-

possible)development framework

  • …with a widely deployed and

accepted network mgmt middleware

  • Maintained in-house
  • Bound together – using a

common data source

  • With the least possible
  • verhead to the network

devices, services

TF-NOC, Zurich 4 GRNET NOC network monitoring & visualization tools

slide-5
SLIDE 5
  • In-house
  • grnetdb (~150 tables) MySQL
  • Topology, devices features discovery: SNMP,

PHP, custom RDBMS layer (4 times/day)

  • Visualization: Google Maps API, Django

framework, DOJO JS framework, JSON data serialization

  • Graphs: Django framework, jquery, rrd
  • Monitoring: Nagios with data feed from

grnetdb

  • NMS & Monitoring
  • Alcatel & Adva NMS
  • HP OV
  • Nagios, Munin, mrtg/rrd

Tools (2)

TF-NOC, Zurich 5 GRNET NOC network monitoring & visualization tools

slide-6
SLIDE 6

Architecture

GRNET

grnetdb MySQL

PHP SNMP getters Network discovery core functionality GRNET RDBMS

DJANGO framework

Device Graphs Network Topology Hostmaster H/W Inventory L1 topology builder Widgets Nagios Rancid Ticketing (Jira) CLI check scripts

TF-NOC, Zurich 6 GRNET NOC network monitoring & visualization tools

slide-7
SLIDE 7

Device Graphs

  • http://mon.grnet.gr/rg
  • Django (Python) templates - backend
  • jQuery & jQuery UI
  • Mobile flavour (jQuery mobile)
  • Network device configuration retrieved from grnetdb
  • Poll devices using a smart algorithm (minimize overhead)
  • RRD graphs (rrdtool Python)
  • Minor administrative interference
  • Devices and ifces discovered by PHP SNMP script automatically
  • Device graph types determined automatically
  • Personalization
  • Custom search engine
  • Version releases every 2-3 months
  • Not open sourced yet
  • Abstraction layer has to be implemented
  • Rewrite parts of code – get rid of GRNET-specific parts

TF-NOC, Zurich 7 GRNET NOC network monitoring & visualization tools

slide-8
SLIDE 8

Device Graphs (2)

Mobile flavor will be soon released

TF-NOC, Zurich 8 GRNET NOC network monitoring & visualization tools

slide-9
SLIDE 9

9 GRNET NOC network monitoring & visualization tools TF-NOC, Zurich

  • http://mon.grnet.gr/network/maps/
  • Google Maps API v2 (soon to be ported to v3)
  • Django Framework
  • DOJO Javascript Framework
  • Data serialized to JSON and fed to API
  • Topology (L1, L2, L3)
  • Network weathermap (live data from rrd files)
  • Points of presence – GRNET clients
  • Lightweight edition eases integration with other

apps

Network Topology

slide-10
SLIDE 10

10 GRNET NOC network monitoring & visualization tools TF-NOC, Zurich

Network Topology (2)

slide-11
SLIDE 11

TF-NOC, Zurich 11 GRNET NOC network monitoring & visualization tools

Alarming

  • Nagios based
  • Common Infrastructure
  • Network

– Django Python tool to query grnetdb and generate configuration

  • Servers/Services

– Populated through automation tool Puppet

  • An effort to maximize SNR
  • Notifications go to interested parties only
  • Web interface supports authorization so only relevant

information is available

  • Plans for Load Balancing/HA setup
slide-12
SLIDE 12

TF-NOC, Zurich 12 GRNET NOC network monitoring & visualization tools

Alarming (2)

  • Visualization
  • Standard interface not topology aware
  • Hates circular (aka rendundant) links
  • Nagios map cgi ugly
  • Information decimation difficult
  • Nagvis to the rescue
  • Supports multiple maps
  • Maps web editable
  • Visual and audible alarming
  • Still a work in progress
slide-13
SLIDE 13

TF-NOC, Zurich 13 GRNET NOC network monitoring & visualization tools

Alarming (3)

slide-14
SLIDE 14

Thank you

TF-NOC, Zurich GRNET NOC network monitoring & visualization tools 14

Questions ?