Simple building blocks 2 taken to the extreme! Lego house built - - PowerPoint PPT Presentation

▶
simple building blocks
SMART_READER_LITE
LIVE PREVIEW

Simple building blocks 2 taken to the extreme! Lego house built - - PowerPoint PPT Presentation

Feb 13, 2024 211 likes •689 views

Rise of the Appliances How purpose built hardware is enabling the next generation of massive scale infrastructure Hans Jespersen Principal Systems Engineer Solace Systems Inc. hans.jespersen@solacesystems.com Simple building blocks 2

slide-1
SLIDE 1

Rise of the Appliances

How purpose built hardware is enabling the next generation of massive scale infrastructure

Hans Jespersen Principal Systems Engineer Solace Systems Inc. hans.jespersen@solacesystems.com

slide-2
SLIDE 2

Simple building blocks…

2

slide-3
SLIDE 3

…taken to the extreme!

Lego house built for Top Gear's James May

3

slide-4
SLIDE 4

The (not so) Central Processing Unit

slide-5
SLIDE 5

HD H.264 Video CODEC

Remember when video encoding was a batch process?

slide-6
SLIDE 6

There’s much more to Moore than MIPS

slide-7
SLIDE 7

Let’s take a techie tour

7

slide-8
SLIDE 8

FPGA

Xilinx Virtex-7 2000T FPGA

  • More than twice the capacity and

bandwidth offered by the largest monolithic devices

  • 2 million logic cells (equivalent to 20

million ASIC gates)

  • 6.8 billion transistors
slide-9
SLIDE 9

Verilog Hardware Description Language

9

slide-10
SLIDE 10

Horizontal scalability on a single chip

Xilinx Virtex-7 2000T FPGA

  • 6.8 billion transistors
  • 3,600 8-bit processors @ 100 MHz
  • 180,000 MIPS
  • 20 watts TDP

Intel Westmere-EX

  • 2.6 billion transistors
  • 10 64-bit cores @ 2.4 GHz
  • 7,200 MIPS
  • 130 watts TDP
slide-11
SLIDE 11

GPU

slide-12
SLIDE 12

$239.99 = 275,000,000 polygons per second

slide-13
SLIDE 13

Supercomputing Floating Point Performance

Tesla M2090 665 Gigaflops double precision 1331 Gigaflops single precision 512 Cores 6 GigaBytes Local Memory 177 GBytes/sec Memory bandwidth

slide-14
SLIDE 14

Scaling Interconnects

Mellanox SwitchX Integration of 144 SerDes (Serializer/Deserializer) InfiniBand, Ethernet, Fiber Channel and PCIe

  • Up to 4Tb/s switching capacity

Flexible Port Configurations

  • Up to 36 56Gig IB Ports
  • Up to 36 40GigE Ports
  • Up to 64 10GigE Ports
  • Up to 24 2/4/8Gig FC Ports

Imagine: IB for RDMA between cluster nodes for distributed state 40 GigE for Data Center Ethernet Backbone 1/10 GigE for Internet Facing connections and server farms Fiber Channel for RAM SAN Storage

slide-15
SLIDE 15

Network Processors

slide-16
SLIDE 16

Offloading the IP Stack to Hardware

Cavium Octeon II

  • 32 core MIPS64 Processor

Pre-built application acceleration engines

  • Packet Processing
  • Encryption/Decryption
  • Deep Packet Inspection (RegEx)
  • Compression/decompression
  • De-duplication
  • RAID

Millions of concurrent connections

slide-17
SLIDE 17

The GeoWeb and the GeoRouter

The Geospatial Web or GeoWeb is a term used to describe the convergence of Web technologies with geographical (location-based) information.

slide-18
SLIDE 18

Location is the fuel driving mobile app growth

slide-19
SLIDE 19

What Powers the Internet Growth Rate?

Image: Internet Mapping Project, Bell Labs/Lumeta Corporation

slide-20
SLIDE 20

Federated GIS is just in its infancy

slide-21
SLIDE 21

Dude, where’s my hospital?

slide-22
SLIDE 22

The Story of a Simple Mission

“Protect Our Nation from Dangerous People”

slide-23
SLIDE 23

Try exchanging “alert” across the following

State of New York State of New Jersey State of Connecticut NYC Government New York City Police Department (NYPD), NJPD… New York City Fire Department (NYFD), NJFP… Port Authority of New York/New Jersey (PANYNJ) Metropolitan Transportation Authority (MTA) Various Federal Agencies, NGO’s (i.e. Red Cross), etc. and that’s just the New York area!

slide-24
SLIDE 24

Step 1: Connect Everything

slide-25
SLIDE 25

Step 2: Agree on names for everything

slide-26
SLIDE 26

Step 3: Follow all applicable standards

  • CAP v1.1, CAP v1.2, CAP with IPAWS Profile, CAP-CP, EDXL-DE, EDXL-RM, EDXL-HAVE,

EDXL-SitRep, Cursor On Target (COT), NIEM CBRN N.25, NIEM SAR, ANSI N42.42, IEEE 1512.1, IEEE 1512.2, IEEE 1512.3, UN/LOCODE 2007, …

http://xkcd.com/927/

slide-27
SLIDE 27

Federated ESB : The Problem

slide-28
SLIDE 28

28

CONFIDENTIAL

The Power of the Point and the Polygon Point

The Washington Monument

Proximity

Within a half mile of The White House

Polygon

slide-29
SLIDE 29

We can make lots of cool things with polygons

slide-30
SLIDE 30

DHS/DNDO Mission

slide-31
SLIDE 31

Real-time Geospatial Routing in Hardware

Router Inspects Content Compares with many subscriptions

  • Data Itself
  • Incident Type
  • Sending

Agency

  • Latitude and

Longitude

Sensors/senders Subscribers publish data

  • Information
  • f Interest
  • Jurisdiction
  • Current Location

get the info they need.

slide-32
SLIDE 32

32

CONFIDENTIAL

Geospatial overlay networks

Geospatial content aware networking infrastructure Hardware-based messaging and middleware overlay for IP networks Automatic propagation of data by “point in polygon” subscriptions

Mobile Devices Applications Databases Applications Applications

Content Network IP/MPLS Network

slide-33
SLIDE 33

“Sensor to Shooter” Message Distribution

I need I need Link Down...

Content Based Message Routing Network (edge-to-edge layer 7 overlay

  • n top of core IP network)

Existing IP/MPLS Network (Black Core) Messages only flow when and to where they are needed

slide-34
SLIDE 34

BlockAway.com

34

slide-35
SLIDE 35

35

CONFIDENTIAL

Augmented Reality

slide-36
SLIDE 36

36

CONFIDENTIAL

Social Automotive Telematics

<for sale> <needs service> <carpool?> <cat person> <dog person>

slide-37
SLIDE 37

Online Gaming Use Case

37

slide-38
SLIDE 38

Existing Architecture

Casino

Backend Services

Action Events

Clients

  • UI events (cards & clicks)
  • Bets
  • In-game rewards
  • Presence heartbeats
  • Chat
  • Financial Transactions
  • Marketing events
  • Tournament promotions
  • Login/out events
  • Statistical data
  • Regulatory audit logging
slide-39
SLIDE 39

Classic Job for a Message Bus?

slide-40
SLIDE 40

Online Casino Company Requirements

Scalable

  • Needed 150,000 msgs/s with guaranteed once in order delivery
  • 1 million concurrent users growing to 10 million

Low Latency

  • Web responsiveness with support for streaming to various RIAs

Reliability

  • Both HA and DR failover required with no data loss

Operations

  • Simplicity of appliance
  • Flexible Management & monitoring

40

slide-41
SLIDE 41

Superbowl Sunday Problem

41

slide-42
SLIDE 42

The Buzzer Problem

42

slide-43
SLIDE 43

The Regulatory Problem

43

slide-44
SLIDE 44

44

Publisher Subscriber

If subscriber available, message is delivered immediately

3b 4

If subscriber is slow

  • r disconnected, their backlog

is spooled to SAN, delivered as soon as client is able to receive

Redundant Mate

  • Connected to primary

via two fiber links

  • Same connectivity to L2

and storage as primary

SAN

Receipt acknowledged since message is guaranteed

3a

Fault Tolerant Clustering of Solace Routers

Message persisted in on-board RAM

1

Message and state replicated to mate, which confirms receipt

2

slide-45
SLIDE 45

Inevitable Migration to Hardware

Well Understood, Critical Processing Paradigms Always Migrate to Dedicated Hardware

45

E x a d a t a IP Routing Web Infrastructure Data Warehouse Online Transaction Processing (OLTP) Storage

Performance & Scalability Cost Effectiveness

slide-46
SLIDE 46

What are you thinking of building?

46