QoS Experience on European Backbone TNC 2003, Zabgreb (Croatia), - - PowerPoint PPT Presentation

▶
qos experience on european backbone
SMART_READER_LITE
LIVE PREVIEW

QoS Experience on European Backbone TNC 2003, Zabgreb (Croatia), - - PowerPoint PPT Presentation

Jul 28, 2023 176 likes •413 views

QoS Experience on European Backbone TNC 2003, Zabgreb (Croatia), 20-05-2003 Nicolas Simar, Network Engineer DANTE QoS Experience on European Backbone - TNC 2003 -- Nicolas Simar (Nicolas.Simar@dante.org.uk) Agenda GANT Services on

slide-1
SLIDE 1

QoS Experience on European Backbone - TNC 2003 -- Nicolas Simar (Nicolas.Simar@dante.org.uk)

QoS Experience on European Backbone

TNC 2003, Zabgreb (Croatia), 20-05-2003

Nicolas Simar, Network Engineer DANTE

slide-2
SLIDE 2

QoS Experience on European Backbone - TNC 2003 -- Nicolas Simar (Nicolas.Simar@dante.org.uk)

Agenda

  • GÉANT
  • Services on GÉANT
  • Premium IP
  • Less than Best Effort
  • Queuing on GÉANT and status
  • Next steps
slide-3
SLIDE 3

QoS Experience on European Backbone - TNC 2003 -- Nicolas Simar (Nicolas.Simar@dante.org.uk)

Multi-Gigabit pan-European Research Network Backbone Topology December 2002

  • Connecting 32

European Countries and 28 NRENs

  • Backbone capacity in

the range of: 34Mb/s-10Gb/s

slide-4
SLIDE 4

QoS Experience on European Backbone - TNC 2003 -- Nicolas Simar (Nicolas.Simar@dante.org.uk)

Backbone Access Speeds-August 2002

slide-5
SLIDE 5

QoS Experience on European Backbone - TNC 2003 -- Nicolas Simar (Nicolas.Simar@dante.org.uk)

GÉANT Services

  • Services available on GÉANT

– Best Effort (IPv4) – Multicast (IPv4) – Premium IP (IPv4) – Less than Best Effort (Scavenger) (IPv4). – IPv6 (Best Effort)

slide-6
SLIDE 6

QoS Experience on European Backbone - TNC 2003 -- Nicolas Simar (Nicolas.Simar@dante.org.uk)

IP QoS Services on GÉANT

  • Premium IP

– Upper-bounded one-way delay – Upper-bounded IPDV – Negligible packet loss – Guaranteed capacity.

  • Less than Best Effort

– Class of traffic using the unutilised Best Effort and higher classes of service bandwidth.

slide-7
SLIDE 7

QoS Experience on European Backbone - TNC 2003 -- Nicolas Simar (Nicolas.Simar@dante.org.uk)

Premium IP model

  • End-to-end service across multiple management

domains

– Using diffserv, ATM CBR or over-provisioning(transition). – Packet tagged DSCP 46 (EF - 101110). – Destination aware service. – Packet with other DSCP (from other service) are left untouched. – Premium IP bandwidth limited to 10% of the link capacity.

  • Can cope with 20% in case of circuit failure.
slide-8
SLIDE 8

QoS Experience on European Backbone - TNC 2003 -- Nicolas Simar (Nicolas.Simar@dante.org.uk)

Shape ONLY here Classify (IP pair prefixes) Police - Strict, Capacity Mark

Classify (DSCP) High priority queueing

  • n all nodes

Do not police on egress Do not shape

Policing can be avoided at ingress when receiving from a trusted backbone Police by (AS source,dest) aggregate capacity

  • n all border nodes
slide-9
SLIDE 9

QoS Experience on European Backbone - TNC 2003 -- Nicolas Simar (Nicolas.Simar@dante.org.uk)

Premium IP on GÉANT

  • Protection of authorised Premium IP traffic

– Under normal circumstances, the Premium IP traffic is limited at 10% of the circuit capacity.

  • 20% in case of another circuit failure

– Bullet-proofing of all GÉANT accesses against “un- authorised Premium IP” traffic (tagged DSCP 46) on all the ingress interfaces.

  • If DSCP 46 packet arrives on GÉANT and is part of an un-

authorised flow: the packet is not classify in the Premium IP queue and is re-tagged as Best Effort (DSCP 0).

  • if DSCP 46 packet arrives on GÉANT and is part of an authorised

flow: check against policer according capacity mentioned in the SLA (in-profile accepted, out-of-profile dropped).

slide-10
SLIDE 10

QoS Experience on European Backbone - TNC 2003 -- Nicolas Simar (Nicolas.Simar@dante.org.uk)

Premium IP on GÉANT

  • Protection of authorised Premium IP traffic [cont]
  • per next AS rate-limitation (implemented by Juniper for GÉANT)
  • can also do source-destination IP addresses when NREN don’t do it.
  • Trust the Premium IP traffic received from a

GÉANT backbone interface.

– Traffic checked at the GÉANT ingresses.

slide-11
SLIDE 11

QoS Experience on European Backbone - TNC 2003 -- Nicolas Simar (Nicolas.Simar@dante.org.uk)

Premium IP on GÉANT

  • Queuing mechanism are configured on the backbone

and access interfaces.

– 90% of the link capacity is allocated to the Premium IP queue (via WRR).

  • Don’t forget that the amount of Premium IP traffic expected in the

Premium IP queue is of 10% of the link capacity.

– 5% for the BE and 5% for the network control.

  • Monitoring of the metric is very important to provide

a proper service.

  • When a end-to-end problem arise, it is very difficult

to find out where the problem lies => PERT.

slide-12
SLIDE 12

QoS Experience on European Backbone - TNC 2003 -- Nicolas Simar (Nicolas.Simar@dante.org.uk)

Test result (end-to-end)

J itte r d is tribu tio n in VB R tra ffic - B E & P re m ium IP

0% 1 0% 2 0% 3 0% 4 0% 5 0% 6 0% 7 0% 0.00 0.19 0.38 0.56 0.75 0.94 1.13 1.31 1.50 1.69 1.88 2.07 2.25 2.44 2.63 2.82 3.01 3.19 3.38 3.57 3.76

P re m ium IP BE jitte r[m s ] percentage of packets

  • Avg. jitter vs . packet s ize - BE & Premium IP

2 4 6 8 10 12 14 7 8 1 7 1 2 2 2 6 2 4 4 3 5 2 7 4 7 8 5 3 9 8 5 1 2 3 4 1 3 3 1 3 5 5 1 3 8 2 1 3 8 4 1 4 1 1 4 2 6 1 4 4 5 1 4 5 1 4 8 1 4 9

P remium IP BE

  • avg. jitter [ms ]

packe t size [byte s]

  • Traffic sent between NRENs

end-sites and crossing GÉANT.

  • The packets were sent with a

variable bit rate.

  • Premium IP provisioned in

various way in the domains crossed. The Premium IP jitter is lower than the BE one and is indepen- dent of the packet size.

slide-13
SLIDE 13

QoS Experience on European Backbone - TNC 2003 -- Nicolas Simar (Nicolas.Simar@dante.org.uk)

Less than Best Effort

  • LBE is a class of traffic using the un-utilised Best

Effort and higher classes of service bandwidth.

– In case of competition for resources, the LBE traffic will de discarded before any Best-Effort or higher classes of traffic. – Use the DSCP 8 (001000) - same as Internet2 scavenger service.

  • Congestion on an interface due to LBE.

– Should be transparent to the BE or higher classes of services. – No BE or higher classes of services packet loss.

slide-14
SLIDE 14

QoS Experience on European Backbone - TNC 2003 -- Nicolas Simar (Nicolas.Simar@dante.org.uk)

Less than Best Effort

  • No end-to-end guarantees.

– No metric needed to quantitatively describe the service.

  • Can be supported on one interface.

– Anywhere else, the LBE tagging should be passed transparently.

  • Application scenarios:

– mirroring, test traffic, protection of research traffic from student dormitory one.

slide-15
SLIDE 15

QoS Experience on European Backbone - TNC 2003 -- Nicolas Simar (Nicolas.Simar@dante.org.uk)

LBE Queuing technique

  • For algorithm with bandwidth shared assignment,

as Weighted Round Robin and Weighted Fair Queuing, a very small bandwidth share is allocated to the LBE queue.

– Typically 0% or 1% (depending of scheduling implementation).

slide-16
SLIDE 16

QoS Experience on European Backbone - TNC 2003 -- Nicolas Simar (Nicolas.Simar@dante.org.uk)

M

  • O
n e
  • w
a y d e l a y

– Increase of LBE maximum one-way delay of 1.5ms. – Increase of BE maximum one-way delay of 400µs.

The traffic load (in %) express the amount of traffic generated by the SMB STM-16 interface.

slide-17
SLIDE 17

QoS Experience on European Backbone - TNC 2003 -- Nicolas Simar (Nicolas.Simar@dante.org.uk)

ER2002 Demo - VLBI - dataGRID

  • Normal Traffic
  • Normal Traffic +
  • Less Than Best Effort

(2.0 Gbit/s)

  • Normal Traffic +
  • Radio Astronomy Data

– 500 Mbit/s

  • Normal Traffic +
  • Radio Astronomy Data +
  • Less Than Best Effort

(2.0 Gbit/s) Traffic aggregate LBE traffic UK-NL STM-16 link utilisation

slide-18
SLIDE 18

QoS Experience on European Backbone - TNC 2003 -- Nicolas Simar (Nicolas.Simar@dante.org.uk)

QoS configuration on GÉANT

  • The configuration has completed on most of the

GÉANT routers, allowing Premium IP, BE and LBE to co-exist.

– The routers where the three services have been enable are represented as green on the following map. – The routers coloured yellow are Juniper routers where “old” FPCs have been re-used from TEN-155. These old FPC’s that do not allow for the full functionality of QoS.

  • As such BE is not ideally protected by LBE and the bandwidth is

effectively shared. Premium IP only is supported.

– The red routers are the Cisco 7k’s re-used from TEN-155. These routers don’t have VIP powerful enough to provide any QoS functionality. Premium IP and LBE not supported.

slide-19
SLIDE 19

QoS Experience on European Backbone - TNC 2003 -- Nicolas Simar (Nicolas.Simar@dante.org.uk)

QoS configuration on GÉANT

slide-20
SLIDE 20

QoS Experience on European Backbone - TNC 2003 -- Nicolas Simar (Nicolas.Simar@dante.org.uk)

Useful tool

  • Feature on the NANOG traceroute to allow the

discovery of the DSCP changes along a path.

– Very useful as it has allowed to discover most of the configuration problems on GÉANT and between GÉANT and NRENs.

[root]# ./traceroute -t 184 193.171.2.1 traceroute to 193.171.2.1 (193.171.2.1), 30 hops max, 40 byte packets 1 css7-ATM4-0-0-101-dmsk.man.poznan.pl (150.254.160.62) 1 ms 1 ms 1 ms 2 150.254.163.118 (150.254.163.118) 2 ms 2 ms 2 ms 3 z-pozmanu-oc3.poznan-gw.pol34.pl (212.191.127.49) 2 ms 2 ms 2 ms 4 pol-34.pl1.pl.geant.net (62.40.103.109) 2 ms 2 ms 2 ms 5 pl.cz1.cz.geant.net (62.40.96.45) 22 ms (TOS=0!) 22 ms 22 ms 6 cz.de1.de.geant.net (62.40.96.38) 30 ms 30 ms 30 ms 7 de1-1.de2.de.geant.net (62.40.96.130) 30 ms 30 ms 31 ms 8 de.at1.at.geant.net (62.40.96.5) 43 ms 43 ms 43 ms 9 aconet-gw.at1.at.geant.net (62.40.103.2) 43 ms 43 ms 43 ms 10 193.171.2.1 (193.171.2.1) 45 ms * 45 ms

slide-21
SLIDE 21

QoS Experience on European Backbone - TNC 2003 -- Nicolas Simar (Nicolas.Simar@dante.org.uk)

Next steps

  • Premium IP reservation tool

– Q4 2003, Premium IP requests will be done the NREN via a web-interface.

  • Inter-domain monitoring

– Performance monitoring activity http://www.dante.net/tf-ngn/perfmonit/ – Aim at monitoring delay, IPDV, packet loss (to start with) across several domains.

  • PERT

– Performance Enhancement Response Team http://www.dante.net/tf-ngn/pert/

slide-22
SLIDE 22

QoS Experience on European Backbone - TNC 2003 -- Nicolas Simar (Nicolas.Simar@dante.org.uk)

QoS implementation

  • Find the correct queuing parameters (for each

service)

  • “bullet proof” all ingresses for Premium IP
  • Once configure, pretty stable (no need to change

anything).

  • http://www.dante.net/nep/geantqos/
slide-23
SLIDE 23

QoS Experience on European Backbone - TNC 2003 -- Nicolas Simar (Nicolas.Simar@dante.org.uk)

Acknowledgements

  • Spirent for a loan of SmartBits 600s (STM-16

interfaces)

  • Juniper for the technical support