[PPT] - Network-Aligned content delivery through collaborative optimization PowerPoint Presentation

SLIDE 1

Titlepage

Network-Aligned content delivery through collaborative optimization

Dr.-Ing. Ingmar Poese ipoese@benocs.com

BENOCS GmbH Reuchlinstrasse 10 10553 Berlin, Germany

May 17th 2018

Poese (BENOCS) Network-Aligned content delivery through collaborative optimization May 17 2017 1

SLIDE 2

Problem Statement

Introduction

Lets assume there is a network...

Poese (BENOCS) Network-Aligned content delivery through collaborative optimization May 17 2017 2

SLIDE 3

Problem Statement

Introduction

Lets assume there is a network that is connected to CDN server...

CDN Server CDN Server

Poese (BENOCS) Network-Aligned content delivery through collaborative optimization May 17 2017 2

SLIDE 4

Problem Statement

Introduction

Lets assume there is a network that is connected to CDN server which delivers content to the network...

CDN Server CDN Server

Poese (BENOCS) Network-Aligned content delivery through collaborative optimization May 17 2017 2

SLIDE 5

Problem Statement

Introduction

Lets assume there is a network that is connected to CDN server which delivers content to the network via path 1...

CDN Server CDN Server

3 Hops

Poese (BENOCS) Network-Aligned content delivery through collaborative optimization May 17 2017 2

SLIDE 6

Problem Statement

Introduction

Lets assume there is a network that is connected to CDN server which delivers content to the network via path 1 or path 2 ?

CDN Server CDN Server

3 Hops 3 Hops

Poese (BENOCS) Network-Aligned content delivery through collaborative optimization May 17 2017 2

SLIDE 7

Problem Statement

Introduction

Lets assume there is a network that is connected to CDN server which delivers content to the network via path 1 or path 2 or maybe path 3 ?

CDN Server CDN Server

3 Hops 3 Hops 5 Hops

Poese (BENOCS) Network-Aligned content delivery through collaborative optimization May 17 2017 2

SLIDE 8

Problem Statement

Introduction

Routing cannot change the ingress source. But what if we could talk to the CDN ?

CDN Server CDN Server

3 Hops 3 Hops 5 Hops 1 Hop

Poese (BENOCS) Network-Aligned content delivery through collaborative optimization May 17 2017 2

SLIDE 9

Problem Statement

Example: Mapping Reality

Amsterdam Berlin Frankfurt Muenchen Server Locations

Offenburg Offenburg Offenburg Siegen Siegen Siegen Siegen Erfurt Erfurt Erfurt Erfurt Bochum Bochum Bochum Bochum Ulm Ulm Ulm Ulm Cottbus Cottbus Cottbus Cottbus Kaiserslautern Kaiserslautern Kaiserslautern Kaiserslautern Bayreuth Bayreuth Bayreuth Bayreuth Krefeld Krefeld Krefeld Krefeld Kempten Kempten Kempten Kempten Hannover Hannover Hannover Hannover Mannheim Mannheim Mannheim Mannheim Rostock Rostock Rostock Rostock Muenchen Muenchen Muenchen Muenchen Darmstadt Darmstadt Darmstadt Darmstadt Freiburg Freiburg Freiburg Freiburg Greifswald Greifswald Greifswald Greifswald Nuernberg Nuernberg Nuernberg Nuernberg Traunstein Traunstein Traunstein Traunstein Mainz Mainz Mainz Mainz Bremerhaven Bremerhaven Bremerhaven Bremerhaven Schwerin Schwerin Schwerin Schwerin Konstanz Konstanz Konstanz Konstanz Chemnitz Chemnitz Chemnitz Chemnitz Paderborn Paderborn Paderborn Paderborn Dresden Dresden Dresden Dresden Augsburg Augsburg Augsburg Augsburg Duesseldorf Duesseldorf Duesseldorf Duesseldorf Bremen Bremen Bremen Bremen Muenster Muenster Muenster Muenster Osnabrueck Osnabrueck Osnabrueck Osnabrueck Brandenburg Brandenburg Brandenburg Brandenburg Aachen Aachen Aachen Aachen Magdeburg Magdeburg Magdeburg Magdeburg Duisburg Duisburg Duisburg Duisburg Fulda Fulda Fulda Fulda Essen Essen Essen Essen Frankfurt Frankfurt Frankfurt Frankfurt Leer Leer Leer Leer Bonn Bonn Bonn Bonn Passau Passau Passau Passau Wuppertal Wuppertal Wuppertal Wuppertal Hamburg Hamburg Hamburg Hamburg Wuerzburg Wuerzburg Wuerzburg Wuerzburg Regensburg Regensburg Regensburg Regensburg Luebeck Luebeck Luebeck Luebeck Kiel Kiel Kiel Kiel Hof Hof Koeln Koeln Koeln Koeln FrankfurtOder FrankfurtOder FrankfurtOder FrankfurtOder Neubrandenburg Neubrandenburg Neubrandenburg Neubrandenburg Saarbruecken Saarbruecken Saarbruecken Saarbruecken Bautzen Bautzen Bautzen Bautzen Braunschweig Braunschweig Braunschweig Braunschweig Giessen Giessen Giessen Giessen Oldenburg Oldenburg Oldenburg Oldenburg Dortmund Dortmund Dortmund Dortmund Goettingen Goettingen Goettingen Goettingen Halle Halle Halle Halle Rottweil Rottweil Rottweil Rottweil Karlsruhe Karlsruhe Karlsruhe Karlsruhe Stuttgart Stuttgart Stuttgart Stuttgart Kassel Kassel Kassel Kassel Leipzig Leipzig Leipzig Leipzig Gera Gera Gera Gera Wesel Wesel Wesel Wesel Berlin Berlin Berlin Berlin Koblenz Koblenz Koblenz Koblenz Emsland Emsland Emsland Emsland Trier Trier Trier Trier Bielefeld Bielefeld Bielefeld Bielefeld Heilbronn Heilbronn Heilbronn Heilbronn Flensburg Flensburg Flensburg Flensburg Messingen Messingen Messingen Messingen

Poese (BENOCS) Network-Aligned content delivery through collaborative optimization May 17 2017 3

SLIDE 10

Problem Statement

Example: Mapping Reality vs. optimal

Amsterdam Berlin Frankfurt Muenchen Server Locations

Offenburg Offenburg Offenburg Siegen Siegen Siegen Siegen Erfurt Erfurt Erfurt Erfurt Bochum Bochum Bochum Bochum Ulm Ulm Ulm Ulm Cottbus Cottbus Cottbus Cottbus Kaiserslautern Kaiserslautern Kaiserslautern Kaiserslautern Bayreuth Bayreuth Bayreuth Bayreuth Krefeld Krefeld Krefeld Krefeld Kempten Kempten Kempten Kempten Hannover Hannover Hannover Hannover Mannheim Mannheim Mannheim Mannheim Rostock Rostock Rostock Rostock Muenchen Muenchen Muenchen Muenchen Darmstadt Darmstadt Darmstadt Darmstadt Freiburg Freiburg Freiburg Freiburg Greifswald Greifswald Greifswald Greifswald Nuernberg Nuernberg Nuernberg Nuernberg Traunstein Traunstein Traunstein Traunstein Mainz Mainz Mainz Mainz Bremerhaven Bremerhaven Bremerhaven Bremerhaven Schwerin Schwerin Schwerin Schwerin Konstanz Konstanz Konstanz Konstanz Chemnitz Chemnitz Chemnitz Chemnitz Paderborn Paderborn Paderborn Paderborn Dresden Dresden Dresden Dresden Augsburg Augsburg Augsburg Augsburg Duesseldorf Duesseldorf Duesseldorf Duesseldorf Bremen Bremen Bremen Bremen Muenster Muenster Muenster Muenster Osnabrueck Osnabrueck Osnabrueck Osnabrueck Brandenburg Brandenburg Brandenburg Brandenburg Aachen Aachen Aachen Aachen Magdeburg Magdeburg Magdeburg Magdeburg Duisburg Duisburg Duisburg Duisburg Fulda Fulda Fulda Fulda Essen Essen Essen Essen Frankfurt Frankfurt Frankfurt Frankfurt Leer Leer Leer Leer Bonn Bonn Bonn Bonn Passau Passau Passau Passau Wuppertal Wuppertal Wuppertal Wuppertal Hamburg Hamburg Hamburg Hamburg Wuerzburg Wuerzburg Wuerzburg Wuerzburg Regensburg Regensburg Regensburg Regensburg Luebeck Luebeck Luebeck Luebeck Kiel Kiel Kiel Kiel Hof Hof Koeln Koeln Koeln Koeln FrankfurtOder FrankfurtOder FrankfurtOder FrankfurtOder Neubrandenburg Neubrandenburg Neubrandenburg Neubrandenburg Saarbruecken Saarbruecken Saarbruecken Saarbruecken Bautzen Bautzen Bautzen Bautzen Braunschweig Braunschweig Braunschweig Braunschweig Giessen Giessen Giessen Giessen Oldenburg Oldenburg Oldenburg Oldenburg Dortmund Dortmund Dortmund Dortmund Goettingen Goettingen Goettingen Goettingen Halle Halle Halle Halle Rottweil Rottweil Rottweil Rottweil Karlsruhe Karlsruhe Karlsruhe Karlsruhe Stuttgart Stuttgart Stuttgart Stuttgart Kassel Kassel Kassel Kassel Leipzig Leipzig Leipzig Leipzig Gera Gera Gera Gera Wesel Wesel Wesel Wesel Berlin Berlin Berlin Berlin Koblenz Koblenz Koblenz Koblenz Emsland Emsland Emsland Emsland Trier Trier Trier Trier Bielefeld Bielefeld Bielefeld Bielefeld Heilbronn Heilbronn Heilbronn Heilbronn Flensburg Flensburg Flensburg Flensburg Messingen Messingen Messingen Messingen

Amsterdam Berlin Frankfurt Muenchen Server Locations

Magdeburg Frankfurt Greifswald Flensburg Emsland Bochum Cottbus Regensburg Passau Bautzen Schwerin Hannover Halle Leer Essen Essen Koblenz Kassel Mannheim Bremen Bayreuth Kiel Leipzig Offenburg Freiburg Darmstadt Muenchen Berlin Brandenburg Muenster Kaiserslautern Koeln Gera Dresden Augsburg Traunstein Hamburg Neubrandenburg Duesseldorf Braunschweig Duisburg Duisburg Luebeck Wuppertal Wuppertal Kempten Wesel Karlsruhe Krefeld Krefeld Dortmund Messingen Giessen Wuerzburg Rostock Osnabrueck Siegen Goettingen Bonn Aachen Hof Paderborn Nuernberg Bielefeld Erfurt Bremerhaven Mainz Ulm Chemnitz Rottweil Oldenburg Trier FrankfurtOder Konstanz Saarbruecken Fulda Stuttgart Heilbronn

Poese (BENOCS) Network-Aligned content delivery through collaborative optimization May 17 2017 3

SLIDE 11

Problem Statement

Example: Mapping Reality vs. optimal

Amsterdam Berlin Frankfurt Muenchen Server Locations

Offenburg Offenburg Offenburg Siegen Siegen Siegen Siegen Erfurt Erfurt Erfurt Erfurt Bochum Bochum Bochum Bochum Ulm Ulm Ulm Ulm Cottbus Cottbus Cottbus Cottbus Kaiserslautern Kaiserslautern Kaiserslautern Kaiserslautern Bayreuth Bayreuth Bayreuth Bayreuth Krefeld Krefeld Krefeld Krefeld Kempten Kempten Kempten Kempten Hannover Hannover Hannover Hannover Mannheim Mannheim Mannheim Mannheim Rostock Rostock Rostock Rostock Muenchen Muenchen Muenchen Muenchen Darmstadt Darmstadt Darmstadt Darmstadt Freiburg Freiburg Freiburg Freiburg Greifswald Greifswald Greifswald Greifswald Nuernberg Nuernberg Nuernberg Nuernberg Traunstein Traunstein Traunstein Traunstein Mainz Mainz Mainz Mainz Bremerhaven Bremerhaven Bremerhaven Bremerhaven Schwerin Schwerin Schwerin Schwerin Konstanz Konstanz Konstanz Konstanz Chemnitz Chemnitz Chemnitz Chemnitz Paderborn Paderborn Paderborn Paderborn Dresden Dresden Dresden Dresden Augsburg Augsburg Augsburg Augsburg Duesseldorf Duesseldorf Duesseldorf Duesseldorf Bremen Bremen Bremen Bremen Muenster Muenster Muenster Muenster Osnabrueck Osnabrueck Osnabrueck Osnabrueck Brandenburg Brandenburg Brandenburg Brandenburg Aachen Aachen Aachen Aachen Magdeburg Magdeburg Magdeburg Magdeburg Duisburg Duisburg Duisburg Duisburg Fulda Fulda Fulda Fulda Essen Essen Essen Essen Frankfurt Frankfurt Frankfurt Frankfurt Leer Leer Leer Leer Bonn Bonn Bonn Bonn Passau Passau Passau Passau Wuppertal Wuppertal Wuppertal Wuppertal Hamburg Hamburg Hamburg Hamburg Wuerzburg Wuerzburg Wuerzburg Wuerzburg Regensburg Regensburg Regensburg Regensburg Luebeck Luebeck Luebeck Luebeck Kiel Kiel Kiel Kiel Hof Hof Koeln Koeln Koeln Koeln FrankfurtOder FrankfurtOder FrankfurtOder FrankfurtOder Neubrandenburg Neubrandenburg Neubrandenburg Neubrandenburg Saarbruecken Saarbruecken Saarbruecken Saarbruecken Bautzen Bautzen Bautzen Bautzen Braunschweig Braunschweig Braunschweig Braunschweig Giessen Giessen Giessen Giessen Oldenburg Oldenburg Oldenburg Oldenburg Dortmund Dortmund Dortmund Dortmund Goettingen Goettingen Goettingen Goettingen Halle Halle Halle Halle Rottweil Rottweil Rottweil Rottweil Karlsruhe Karlsruhe Karlsruhe Karlsruhe Stuttgart Stuttgart Stuttgart Stuttgart Kassel Kassel Kassel Kassel Leipzig Leipzig Leipzig Leipzig Gera Gera Gera Gera Wesel Wesel Wesel Wesel Berlin Berlin Berlin Berlin Koblenz Koblenz Koblenz Koblenz Emsland Emsland Emsland Emsland Trier Trier Trier Trier Bielefeld Bielefeld Bielefeld Bielefeld Heilbronn Heilbronn Heilbronn Heilbronn Flensburg Flensburg Flensburg Flensburg Messingen Messingen Messingen Messingen

Amsterdam Berlin Frankfurt Muenchen Server Locations

Magdeburg Frankfurt Greifswald Flensburg Emsland Bochum Cottbus Regensburg Passau Bautzen Schwerin Hannover Halle Leer Essen Essen Koblenz Kassel Mannheim Bremen Bayreuth Kiel Leipzig Offenburg Freiburg Darmstadt Muenchen Berlin Brandenburg Muenster Kaiserslautern Koeln Gera Dresden Augsburg Traunstein Hamburg Neubrandenburg Duesseldorf Braunschweig Duisburg Duisburg Luebeck Wuppertal Wuppertal Kempten Wesel Karlsruhe Krefeld Krefeld Dortmund Messingen Giessen Wuerzburg Rostock Osnabrueck Siegen Goettingen Bonn Aachen Hof Paderborn Nuernberg Bielefeld Erfurt Bremerhaven Mainz Ulm Chemnitz Rottweil Oldenburg Trier FrankfurtOder Konstanz Saarbruecken Fulda Stuttgart Heilbronn

Proposed Solution: We achieve this mapping change by communicating summarized network preferences based on ISP-Grade network knowledge to the CDN

Poese (BENOCS) Network-Aligned content delivery through collaborative optimization May 17 2017 3

SLIDE 12

BENOCS Processing

Gathering Data

Poese (BENOCS) Network-Aligned content delivery through collaborative optimization May 17 2017 4

SLIDE 13

BENOCS Processing

Gathering Data

ISIS, OSPFv2/v3, MPLS LDP Currently tracking ∼3,000 nodes in 13 areas

IGP

Poese (BENOCS) Network-Aligned content delivery through collaborative optimization May 17 2017 4

SLIDE 14

BENOCS Processing

Gathering Data

BGP RR-client of all Border routers Currently maintaining ∼300 BGP connection with ∼260 Million routes

IGP BGP

Poese (BENOCS) Network-Aligned content delivery through collaborative optimization May 17 2017 4

SLIDE 15

BENOCS Processing

Gathering Data

Netflow from all Border routers tracking 2500 exporters @ ∼ 800Mbit

sec

@peak (50 Billion records/day)

IGP Net ow BGP

Poese (BENOCS) Network-Aligned content delivery through collaborative optimization May 17 2017 4

SLIDE 16

BENOCS Processing

Gathering Data

SNMP counters from all interfaces in the network tracking ∼17,000 interface @ 5 Minutes

IGP Net ow BGP SNMP

Poese (BENOCS) Network-Aligned content delivery through collaborative optimization May 17 2017 4

SLIDE 17

BENOCS Processing

Gathering Data

IP Ingress Points Link Classification Router Config Cost Models BMP ...

IGP Other Net ow BGP SNMP

?

Poese (BENOCS) Network-Aligned content delivery through collaborative optimization May 17 2017 4

SLIDE 18

BENOCS Processing

Processing Pipeline

IGP BGP Net ow SNMP Other Analytics Mapping BGP ALTO JSON XML

automatic Updates Does not support hierarchy Pull + Push via HTTP(s) Updates via

✂le in JSON

EMAIL Push / SCP Push/Pull Updates via

le in XML

EMAIL Push / SCP Push/Pull max 60s reaction time

Poese (BENOCS) Network-Aligned content delivery through collaborative optimization May 17 2017 5

SLIDE 19

BENOCS Processing

Mapping Information

Running online

1 Network Topology T as Abstract Graph 2 Annotate T with all available information from all Sources 3 Assign all Subnets S in T 4 function f (S, T) → R maps subnets to regions in T

f (S, T) can be customized to use any data available in T from any source
f (S, T) is independent of the CDN to be optimized, i.e. global

5 for each CDN (C) to be optimized 1 find (in)direct Ingress Nodes I for C in T 2 use c(T, C, I, S) → wTCIS to calculate weight for delivery to S from C

c(T, C, I, S) can be customized on C, I, S and all information in T
c(...) can be adapted/changed during run time
c(...) should be stable to avoid oscilation

3 Build preference table based on wTCIS as a directed 2 dimensional Mapping

if desired, this can also build hierarchical structures

4 generate diff-set if previous results are available 5 push set/full information via interface to C

Poese (BENOCS) Network-Aligned content delivery through collaborative optimization May 17 2017 6

SLIDE 20

Results

Networks #1 - Network Allignment (TE)

Poese (BENOCS) Network-Aligned content delivery through collaborative optimization May 17 2017 7

SLIDE 21

Results

Networks #2 - Upgrade Planning

10 20 30 40 50 relative Capacity | Planning Load Links sorted by Planning Load unchanged BENOCS reduction BENOCS increase Other reduction Other increase Capacity Poese (BENOCS) Network-Aligned content delivery through collaborative optimization May 17 2017 8

SLIDE 22

Conclusion

Summary

Collaboration

Align traffic of CDN to topology
easy, on demand interface
up to date network information
CDN keeps control

Benefits

improved network alignment
reliable, distributed delivery

planning

reduced network load
improved network planning

reliability

reduced RTT in content delivery

Poese (BENOCS) Network-Aligned content delivery through collaborative optimization May 17 2017 9

SLIDE 23

Conclusion

Summary

Collaboration

Align traffic of CDN to topology
easy, on demand interface
up to date network information
CDN keeps control

Benefits

improved network alignment
reliable, distributed delivery

planning

reduced network load
improved network planning

reliability

reduced RTT in content delivery

Poese (BENOCS) Network-Aligned content delivery through collaborative optimization May 17 2017 9

SLIDE 24

Conclusion

Closing remarks

This is already running live ! AS3320 (Deutsche Telekom) is offering to engage in the collaborative program at no cost other than to staff the project because the network benefits are interesting already. Contacts

For how the solution works technically: Ingmar Poese (ipoese@benocs.com)
For joining DT’s ”Net Reflekt” program, CDNs please contact: Oliver

Holschke (oliver.holschke@telekom.de)

Poese (BENOCS) Network-Aligned content delivery through collaborative optimization May 17 2017 10