Performance Comparison of DTN Bundle Protocol Implementations ottner - - PowerPoint PPT Presentation

▶
performance comparison of dtn bundle protocol
SMART_READER_LITE
LIVE PREVIEW

Performance Comparison of DTN Bundle Protocol Implementations ottner - - PowerPoint PPT Presentation

Feb 22, 2023 681 likes •875 views

Performance Comparison of DTN Bundle Protocol Implementations ottner , Johannes Morgenroth, Sebastian Schildt, Lars Wolf Wolf-Bastian P September 23, 2011: CHANTS Workshop, Las Vegas, NV Motivation Several Bundle Protocol (BP) implementations

slide-1
SLIDE 1

Performance Comparison of DTN Bundle Protocol Implementations

Wolf-Bastian P¨

  • ttner, Johannes Morgenroth, Sebastian Schildt, Lars Wolf

September 23, 2011: CHANTS Workshop, Las Vegas, NV

slide-2
SLIDE 2

Motivation

Several Bundle Protocol (BP) implementations for Linux exist

DTN2: DTNRG’s reference implementation IBR-DTN: Implementation for embedded OpenWRT devices ION: JPL’s implementation for spacecrafts running on RTOS Postellation: Viagenie’s closed-source (?) BP implementation Spindle: Closed-source BP implementation by Raytheon BBN Technologies

Performance?

No quantitative evaluation and comparison has been performed (yet)

P¨

  • ttner, Morgenroth, Schildt, Wolf | Bundle Protocol Performance | 2
slide-3
SLIDE 3

Motivation (cont’d)

Why is performance evaluation of BP implementations important?

Contacts are rare and short, communication has to be efficient Broken interoperability can point out ambiguities in the specs

Goals of this paper

Concentrate on open-source TCPCL implementations for Linux Quantitative “test bench” performance evaluation Quantitative opportunistic performance evaluation Systematic evaluation of interoperability

P¨

  • ttner, Morgenroth, Schildt, Wolf | Bundle Protocol Performance | 3
slide-4
SLIDE 4

Metrics

Application Layer Throughput

For different storage backends Between different implementations In an opportunistic scenario

Interoperability

Can implementations discover each other? Throughput between different implementations

Communication Efficiency

In an opportunistic scenario

P¨

  • ttner, Morgenroth, Schildt, Wolf | Bundle Protocol Performance | 4
slide-5
SLIDE 5

Experimental Setup

Hardware

Athlon II X4 2.8 GHz CPUs with 4 GiB RAM 1 GBit Ethernet (good for 940 MBit/s TCP goodput with iperf) Different Ethernet ports for measurement and control traffic Samsung Spinpoint F3 500GB (HD502HJ) hard drive

Software

Ubuntu Linux 11.04 DTN2 v2.7, IBR-DTN v0.6.3, ION v2.4.0 Connection blocked via iptables (IBR-DTN) or daemon’s control interface (DTN2, ION)

P¨

  • ttner, Morgenroth, Schildt, Wolf | Bundle Protocol Performance | 5
slide-6
SLIDE 6

Storage Backends: BP Throughput

1e+07 200 400 600 800 1000 1 10 100 1000 10000 100000 1e+06 1e+07 Bundle Throughput [MBit/s] Bundle Payload Size [bytes] DTN2 Disk DTN2 Mem IBR-DTN Disk IBR-DTN Mem Bundle Throughput [MBit/s]

P¨

  • ttner, Morgenroth, Schildt, Wolf | Bundle Protocol Performance | 6
slide-7
SLIDE 7

Interoperability: Discovery, Bundle Exchange

Discovery Capabilities

DTN2 uses a “proprietary” discovery beacon format IBR-DTN supports IPND v0 & v1 and DTN2 discovery format ION is focussed on scheduled contacts only

Interoperability Evaluation Results

DTN2 and IBR-DTN discover each other just fine Bundles can be exchanged in both directions ION exchanges bundles with DTN2 and IBR-DTN

P¨

  • ttner, Morgenroth, Schildt, Wolf | Bundle Protocol Performance | 7
slide-8
SLIDE 8

Interoperability: BP Throughput

Throughput (memory storage, 1 MByte payload size)

❍❍❍❍❍ ❍ TX RX DTN2 IBR-DTN ION DTN2

687 MBit/s 635 MBit/s 93 MBit/s

IBR-DTN

881 MBit/s 679 MBit/s 90 MBit/s

ION

872 MBit/s 926 MBit/s 449 MBit/s

Observations

DTN2 may have a bottleneck in the TX component IBR-DTN and ION show unclear bottlenecksshows unclear bottlenecks Fastest result is between ION and IBR-DTN

P¨

  • ttner, Morgenroth, Schildt, Wolf | Bundle Protocol Performance | 8
slide-9
SLIDE 9

Opportunistic Scenario: Setup

Scenario

A M B

Memory-based storage backends A creates bundles for B at constant rate, M commutes from A to B TCP throughput limited to 12.7 MBit/s (based on measurements) Cycle: 72 s contact time, 30 s travel, 72 s contact time, 30 s travel (almost) 9 complete cycles in 30 minutes measurement time

P¨

  • ttner, Morgenroth, Schildt, Wolf | Bundle Protocol Performance | 9
slide-10
SLIDE 10

Opportunistic Scenario: Transferred Data

200 400 600 800 1000 250000 500000 1e+06 2e+06 Transferred Data [MB] Bundle Payload Size [bytes] DTN2 IBR-DTN theoretical Maximum

P¨

  • ttner, Morgenroth, Schildt, Wolf | Bundle Protocol Performance | 10
slide-11
SLIDE 11

Opportunistic Scenario: Communication Efficiency

20 40 60 80 100 250000 500000 1e+06 2e+06 Communication Efficiency [%] Bundle Payload Size [bytes] DTN2 IBR-DTN theoretical Maximum

P¨

  • ttner, Morgenroth, Schildt, Wolf | Bundle Protocol Performance | 11
slide-12
SLIDE 12

Conclusions

Motivation

Performance of BP implementations is important! Comparison of three BP implementations: DTN2, IBR-DTN, ION

Results

All three implementations are interoperable Performance varies widely and unpredictably Fastest result between ION and IBR-DTN Working with the implementations is not easy

More results

More results in our technical report (WiP, look for updates) Mail me: poettner@ibr.cs.tu-bs.de

P¨

  • ttner, Morgenroth, Schildt, Wolf | Bundle Protocol Performance | 12
slide-13
SLIDE 13

BACKUP SLIDES

BACKUP SLIDES

P¨

  • ttner, Morgenroth, Schildt, Wolf | Bundle Protocol Performance | 13
slide-14
SLIDE 14

Throughput (linear y)

200 400 600 800 1000 1 10 100 1000 10000 100000 1e+06 1e+07 Bundle Throughput [MBit/s] Bundle Payload Size [bytes] DTN2 Disk DTN2 Mem IBR-DTN Disk IBR-DTN Mem ION Disk (T) ION Mem (T)

P¨

  • ttner, Morgenroth, Schildt, Wolf | Bundle Protocol Performance | 14
slide-15
SLIDE 15

Throughput (logarithmic y)

0.001 0.01 0.1 1 10 100 1000 1 10 100 1000 10000 100000 1e+06 1e+07 Bundle Throughput [MBit/s] Bundle Payload Size [bytes] DTN2 Disk DTN2 Mem IBR-DTN Disk IBR-DTN Mem ION Disk (T) ION Mem (T)

P¨

  • ttner, Morgenroth, Schildt, Wolf | Bundle Protocol Performance | 15
slide-16
SLIDE 16

DTN2 Slowdown

50 100 150 200 250 1 2 3 4 5 6 7 8 9 10 Throughput [MBit/s] Measurement Run 50e+03 Bytes Payload 100e+03 Bytes Payload 500e+03 Bytes Payload 1000e+03 Bytes Payload

P¨

  • ttner, Morgenroth, Schildt, Wolf | Bundle Protocol Performance | 16
slide-17
SLIDE 17

Interoperability: BP Throughput

Throughput (memory storage, 100 KByte payload size)

❍❍❍❍❍ ❍ TX RX DTN2 IBR-DTN ION DTN2

197 MBit/s 193 MBit/s 72 MBit/s

IBR-DTN

677 MBit/s 542 MBit/s 76 MBit/s

ION

455 MBit/s 420 MBit/s 268 MBit/s

Throughput (memory storage, 1 MByte payload size)

❍❍❍❍❍ ❍ TX RX DTN2 IBR-DTN ION DTN2

687 MBit/s 635 MBit/s 93 MBit/s

IBR-DTN

881 MBit/s 679 MBit/s 90 MBit/s

ION

872 MBit/s 926 MBit/s 449 MBit/s

P¨

  • ttner, Morgenroth, Schildt, Wolf | Bundle Protocol Performance | 17