distributed systems
play

Distributed Systems with ZeroMQ and gevent Jeff Lindsay @progrium - PowerPoint PPT Presentation

Jan 05, 2024 •483 likes •2.04k views

Distributed Systems with ZeroMQ and gevent Jeff Lindsay @progrium Why distributed systems? Harness more CPUs and resources Run faster in parallel Tolerance of individual failures Better separation of concerns Most web apps evolve into

  1. Plumbing inproc ipc tcp multicast socket.bind("tcp://localhost:5560") socket.bind("ipc:///tmp/this-socket") socket.connect("tcp://10.0.0.100:9000") socket.connect("ipc:///tmp/another-socket") socket.connect("inproc://another-socket")

  2. Message Patterns

  3. Message Patterns Request-Reply REP REQ

  4. Message Patterns Request-Reply REP REP REQ REP

  5. Message Patterns Request-Reply REP REP REQ REP

  6. Message Patterns Request-Reply REP REP REQ REP

  7. Message Patterns Request-Reply REP REP REQ REP

  8. Message Patterns Request-Reply Publish-Subscribe REP SUB REP SUB REQ PUB SUB REP

  9. Message Patterns Request-Reply Publish-Subscribe REP SUB REP SUB REQ PUB SUB REP Push-Pull (Pipelining) PULL PULL PUSH PULL

  10. Message Patterns Request-Reply Publish-Subscribe REP SUB REP SUB REQ PUB SUB REP Push-Pull (Pipelining) PULL PULL PUSH PULL

Download Presentation
Download Policy: The content available on the website is offered to you 'AS IS' for your personal information and use only. It cannot be commercialized, licensed, or distributed on other websites without prior consent from the author. To download a presentation, simply click this link. If you encounter any difficulties during the download process, it's possible that the publisher has removed the file from their server.

Recommend

Distributed Systems Goals of Distributed Systems 13A. Distributed Systems: Goals & Challenges

Distributed Systems Goals of Distributed Systems 13A. Distributed Systems: Goals & Challenges

5/17/2017 Distributed Systems Goals of Distributed Systems 13A. Distributed Systems: Goals & Challenges scalability and performance apps require more resources than one computer has 13B. Distributed Systems: Communication grow

572 views • 7 slides
Distributed Systems Goals of Distributed Systems 13A. Distributed Systems: Goals & Challenges

Distributed Systems Goals of Distributed Systems 13A. Distributed Systems: Goals & Challenges

5/19/2018 Distributed Systems Goals of Distributed Systems 13A. Distributed Systems: Goals & Challenges scalability and performance apps require more resources than one computer has 13B. Distributed Systems: Communication grow

131 views • 9 slides
Distributed Systems Reasons for distributed systems Resource sharing sharing and

Distributed Systems Reasons for distributed systems Resource sharing sharing and

CSC 4103 - Operating Systems Motivation Spring 2007 Distributed system is collection of loosely coupled processors that do not share memory Lecture - XXII interconnected by a communications network Distributed Systems

477 views • 4 slides
Distributed File Systems Distributed File Systems A distributed file system (DFS) is a

Distributed File Systems Distributed File Systems A distributed file system (DFS) is a

Distributed File Systems Distributed File Systems A distributed file system (DFS) is a distributed Definitions implementation of a classical time-sharing model of a file Distributed system - A number of loosely coupled system. machines

997 views • 8 slides
Introduction to Distributed Systems Material adapted from Distributed Systems: Concepts &

Introduction to Distributed Systems Material adapted from Distributed Systems: Concepts &

Introduction to Distributed Systems Material adapted from Distributed Systems: Concepts & Design , George Coulouris, et al. and Engineering Distributed Objects , Wolfgang Emmerich Outline What is a Distributed System? Examples of

961 views • 36 slides
Introduction to Distributed Systems Material adapted from Distributed Systems: Concepts &

Introduction to Distributed Systems Material adapted from Distributed Systems: Concepts &

Introduction to Distributed Systems Material adapted from Distributed Systems: Concepts & Design , George Coulouris, et al. and Engineering Distributed Objects , Wolfgang Emmerich Outline What is a Distributed System? Examples of

565 views • 18 slides
Distributed Systems of distributed systems Types of Distributed Describe various

Distributed Systems of distributed systems Types of Distributed Describe various

Objectives/Outline (selected topics from chapter 16 & 18) Objectives Outline Provide a high-level overview Introduction Distributed Systems of distributed systems Types of Distributed Describe various methods for

436 views • 9 slides
Coordinating distributed systems Marko Vukoli Distributed Systems and Cloud Computing Previous

Coordinating distributed systems Marko Vukoli Distributed Systems and Cloud Computing Previous

Coordinating distributed systems Marko Vukoli Distributed Systems and Cloud Computing Previous lectures Distributed Storage Systems CAP Theorem Amazon Dynamo Cassandra 2 Today Distributed systems coordination Apache

1.57k views • 62 slides
Distributed Systems - III What about distributed systems? No common clock or memory

Distributed Systems - III What about distributed systems? No common clock or memory

CSC 4103 - Operating Systems Distributed Coordination Spring 2007 Ordering events and achieving synchronization in centralized systems is easier. Lecture - XXIV We can use common clock and memory Distributed Systems - III What

286 views • 4 slides
Towards a Theory of Formal Distributed Systems Why and how distributed systems can solve

Towards a Theory of Formal Distributed Systems Why and how distributed systems can solve

Towards a Theory of Formal Distributed Systems Why and how distributed systems can solve distributed problems ? Towards = immature or not ready for presenting Formal = unrealistic or useless Masafumi Yamashita (Kyushu Univ.) Table of

578 views • 33 slides
CSE 452 Distributed Systems Tom Anderson Distributed Systems How to make a set of computers

CSE 452 Distributed Systems Tom Anderson Distributed Systems How to make a set of computers

CSE 452 Distributed Systems Tom Anderson Distributed Systems How to make a set of computers work together Reliably Efficiently At (huge) scale With high availability Despite messages being lost and/or taking a variable

833 views • 40 slides
CSE 452 Distributed Systems Arvind Krishnamurthy Distributed Systems How to make a set of

CSE 452 Distributed Systems Arvind Krishnamurthy Distributed Systems How to make a set of

CSE 452 Distributed Systems Arvind Krishnamurthy Distributed Systems How to make a set of computers work together Correctly Efficiently At (huge) scale With high availability Despite messages being lost and/or taking a

779 views • 29 slides
Distributed File Systems: An Overview of Peer-to-Peer Architectures Distributed File Systems

Distributed File Systems: An Overview of Peer-to-Peer Architectures Distributed File Systems

Distributed File Systems: An Overview of Peer-to-Peer Architectures Distributed File Systems Data is distributed among many sources Ex. Distributed database systems Frequently utilize a centralized lookup server for addressing

500 views • 15 slides
WHAT WE TALK ABOUT WHEN WE TALK ABOUT DISTRIBUTED SYSTEMS ALVARO VIDELA DISTRIBUTED SYSTEMS

WHAT WE TALK ABOUT WHEN WE TALK ABOUT DISTRIBUTED SYSTEMS ALVARO VIDELA DISTRIBUTED SYSTEMS

WHAT WE TALK ABOUT WHEN WE TALK ABOUT DISTRIBUTED SYSTEMS ALVARO VIDELA DISTRIBUTED SYSTEMS FOR THE IKEA FAMILY ALVARO VIDELA HTTP://BIT.LY/DIST-SYS101 @HINTJENS DISTRIBUTED SYSTEMS A DISTRIBUTED SYSTEM IS ONE IN WHICH THE FAILURE

1.58k views • 118 slides
Distributed Systems How does the OS ensure security? 13C. Distributed Systems: Security all

Distributed Systems How does the OS ensure security? 13C. Distributed Systems: Security all

5/20/2018 Distributed Systems How does the OS ensure security? 13C. Distributed Systems: Security all key resources are kept inside of the OS protected by hardware (mode, memory management) 13I. Secure sessions processes cannot

129 views • 9 slides
Distributed Systems How does the OS ensure security? 13C. Security for Distributed Systems

Distributed Systems How does the OS ensure security? 13C. Security for Distributed Systems

5/27/2017 Distributed Systems How does the OS ensure security? 13C. Security for Distributed Systems all key resources are kept inside of the OS protected by hardware (mode, memory management) 13I. Secure Sessions processes cannot

253 views • 9 slides
Component-Based Behavioural Modelling with High-Level Petri Nets Rmi Bastide, Eric Barboni

Component-Based Behavioural Modelling with High-Level Petri Nets Rmi Bastide, Eric Barboni

Component-Based Behavioural Modelling with High-Level Petri Nets Rmi Bastide, Eric Barboni LIIHS IRIT, University of Toulouse, France {bastide, barboni}@irit.fr Software Components Active domain for industry, commercial success

802 views • 20 slides
Time- -of of- -day timer synchronization day timer synchronization Time Maintained by David V

Time- -of of- -day timer synchronization day timer synchronization Time Maintained by David V

Residential Ethernet: Residential Ethernet: Time- -of of- -day timer synchronization day timer synchronization Time Maintained by David V James IEEE 1588/802.1 Joint Meeting February 21 1 NIST in Gaithersburg, MD This is an RE slide

339 views • 29 slides
Ethernet Access Technologies 2 Moldovn Istvn Department of Budapest University of

Ethernet Access Technologies 2 Moldovn Istvn Department of Budapest University of

Ethernet Access Technologies 2 Moldovn Istvn Department of Budapest University of Technology and Economics Telecommunications and Media Informatics Ethernet Forwarding BME-TMIT MAC Forwarding Topology VLAN Forwarding Topology Active

1.26k views • 42 slides
Abstractions for Network Update Cole Schlesinger Nate Foster Jennifer Rexford Mark Reitblatt

Abstractions for Network Update Cole Schlesinger Nate Foster Jennifer Rexford Mark Reitblatt

Abstractions for Network Update Cole Schlesinger Nate Foster Jennifer Rexford Mark Reitblatt David Walker At 12:47 AM PDT on April 21st, a network change was performed as part of our normal scaling activities... During the change, one of

435 views • 18 slides
Political Science 17 . 20 Introduction to American Politics Professor Devin Caughey MIT

Political Science 17 . 20 Introduction to American Politics Professor Devin Caughey MIT

Political Science 17 . 20 Introduction to American Politics Professor Devin Caughey MIT Department of Political Science and Partisanship Parties Lecture 14 (March 2, 2013) 1 / 13 Outline What Are Parties? 1 Why Do Parties Exist? 2 How Do

186 views • 14 slides
Multi Party Computation: From Theory to Practice Nigel P . Smart Department of Computer

Multi Party Computation: From Theory to Practice Nigel P . Smart Department of Computer

Multi Party Computation: From Theory to Practice Nigel P . Smart Department of Computer Science, University Of Bristol, Merchant Venturers Building, Woodland Road, Bristol, BS8 1UB. January 8, 2013 Nigel P . Smart Multi Party

604 views • 28 slides
Parties to a Mortgage loan of funds Owner-Debtor Creditor-Lender Borrower (Mortgagee)

Parties to a Mortgage loan of funds Owner-Debtor Creditor-Lender Borrower (Mortgagee)

Parties to a Mortgage loan of funds Owner-Debtor Creditor-Lender Borrower (Mortgagee) (Mortgagor) Security Interest (SI) in real property Parties to Note and Deed of Trust Loan of Funds Owner-Debtor Creditor-Lender

189 views • 4 slides
Brokered Agreements in Multi-Party Machine Learning 10th ACM SIGOPS Asia-Pacific Workshop on

Brokered Agreements in Multi-Party Machine Learning 10th ACM SIGOPS Asia-Pacific Workshop on

Brokered Agreements in Multi-Party Machine Learning 10th ACM SIGOPS Asia-Pacific Workshop on Systems (APSys 2019) Clement Fung, Ivan Beschastnikh University of British Columbia 1 The emerging ML economy With the explosion of machine

596 views • 42 slides

More recommend