CompSci 514: Computer Networks Lecture 17: Datacenter Network - PowerPoint PPT Presentation

CompSci 514: Computer Networks Lecture 17: Datacenter Network Architectures Xiaowei Yang

Overview • Motivation • Challenges • The FatTree architecture

��

Two design choices • Specialized hardware and communication protocols – InfiniBand, Myrinet – Cons: expensive, may not support TCP/IP • Commodity Ethernet switches and routes – Aggregate cluster bandwidth scales poorly with cluster size – High bandwidth incurs non-linear cost

��

FatTree Design Goals Scalable interconnection bandwidth: it should be possible for an • arbitrary host in the data center to communicate with any other host in the network at the full bandwidth of its local network interface. Economies of scale: just as commodity personal computers became • the basis for large-scale computing environments, we hope to leverage the same economies of scale to make cheap off-the-shelf Ethernet switches the basis for large- scale data center networks. Backward compatibility: the entire system should be backward • compatible with hosts running Ethernet and IP. That is, existing data centers, which almost universally leverage commodity Ethernet and run IP, should be able to take advantage of the new interconnect architecture with no modifications.

Components Hierarchical design Fat-tree Cost/ Cost/ Year 10 GigE Hosts GigE Hosts GigE GigE 2002 28-port 4,480 $25.3K 28-port 5,488 $4.5K 2004 32-port 7,680 $4.4K 48-port 27,648 $1.6K 2006 64-port 10,240 $2.1K 48-port 27,648 $1.2K 2008 128-port 20,480 $1.8K 48-port 27,648 $0.3K Table 1: The maximum possible cluster size with an oversub- scription ratio of 1:1 for different years. • GigE switches

��

�� • � �� • � ��

�� • � �� • �

�� 2 �� 3 �� • � � � ��

��

�� 2 �� 3 �� 3 ��

��

CompSci 514: Computer Networks Lecture 17: Datacenter Network - PowerPoint PPT Presentation

CompSci 514: Computer Networks Lecture 17: Datacenter Network Architectures Xiaowei Yang Overview Motivation Challenges The FatTree architecture

CompSci 514: Computer Networks Lecture 15 Practical Datacenter Networks Xiaowei Yang Overview

CompSci 514: Computer Networks Lecture 14 Datacenter Transport protocols II Xiaowei Yang

CompSci 514: Computer Networks L18: Datacenter Network Architectures II Xiaowei Yang 1

CompSci 514: Computer Networks Lecture 04: Evolution of the Internet Xiaowei Yang

CompSci 514: Computer Networks Lecture 10: BGP problems Xiaowei Yang 1 Today Known

CompSci 514: Computer Networks Lecture 16: Network Function Virtualization Xiaowei Yang Adapted

CompSci 514: Computer Networks Lecture 21-2: From BitTorrent to BitTyrant Problem Statement

CompSci 514 Computer Networks Lecture 20: Combating Denial of Service Attacks Xiaowei Yang How

CompSci 514: Computer Networks Lecture 13 TCP incast and Solutions Xiaowei Yang Roadmap

CompSci 514: Computer Networks Lecture 17: Network Support for Remote Direct Memory Access

CompSci 356: Computer Network Architectures Lecture 24: Overlay Networks Chap 9.4 Xiaowei Yang

CompSci 514: Computer Networks Lecture 11: Software Defined Networking Xiaowei Yang 1

CompSci 514: Computer Networks Lecture 13: Distributed Hash Table Xiaowei Yang Overview

CompSci 356: Computer Network Architectures Lecture 23: Domain Name System (DNS) and Content

CompSci 514: Computer Networks Lecture 3: The Design Philosophy of the DARPA Internet Protocols

CompSci 356: Computer Network Architectures Lecture 8: Spanning Tree Algorithm and Basic

Determinacy models and good scales at singular cardinals Trevor Wilson University of California,

CS 6453 Network Fabric Presented by Ayush Dubey Based on: 1. Jupiter Rising: A Decade of Clos

Tools for the Analysis and Design of Complex Multi-Scale Networks: Overview MURI

Splitting a stationary set: Is there another way? Arctic Set Theory Workshop 4, Kilpisj arvi,

Advanced Data Placement via Ad-hoc File Systems at Extreme Scales (ADA-FS) Michael Kluge,

Extreme-Scale HPC Network Analysis using Discrete-Event Simula=on Noah Wolfe 1 , Misbah Mubarak 2

Housekeeping Tw itter: # ACMW ebinarScaling W elcom e to today s ACM Learning Webinar.

Data Center Switch Architecture in the Age of Merchant Silicon Nathan Farrington Erik Rubow