concurrent programming using the disruptor
play

Concurrent Programming Using The Disruptor Trisha Gee LMAX - PowerPoint PPT Presentation

Sep 29, 2022 •114 likes •1.14k views

Concurrent Programming Using The Disruptor Trisha Gee LMAX Wednesday, 23 May 12 Concurrent Programming Using The Disruptor Trisha Gee, Developer at LMAX @trisha_gee mechanitis.blogspot.com Wednesday, 23 May 12 The Disruptor? Wednesday,

  1. Concurrent Programming Using The Disruptor Trisha Gee LMAX Wednesday, 23 May 12

  2. Concurrent Programming Using The Disruptor Trisha Gee, Developer at LMAX @trisha_gee mechanitis.blogspot.com Wednesday, 23 May 12

  3. The Disruptor? Wednesday, 23 May 12

  4. What I’m covering • Overview of the Disruptor • Create your own! • Turn it up to Eleven • Q&A Wednesday, 23 May 12

  5. What is it? • Data structure and work flow with no contention. • Very fast message passing. • Allows you to go truly parallel. Wednesday, 23 May 12

  6. So...? Wednesday, 23 May 12

  7. The Magic RingBuffer Wednesday, 23 May 12

  8. The Magic RingBuffer Wednesday, 23 May 12

  9. The Magic RingBuffer Wednesday, 23 May 12

  10. The Magic RingBuffer Wednesday, 23 May 12

  11. The Magic RingBuffer Wednesday, 23 May 12

  12. The Magic RingBuffer Wednesday, 23 May 12

  13. The Magic RingBuffer Wednesday, 23 May 12

  14. Creating a RingBuffer final RingBuffer<SimpleEvent> ringBuffer = new RingBuffer<SimpleEvent>(SimpleEvent.EVENT_FACTORY, RING_BUFFER_SIZE); Wednesday, 23 May 12

  15. The Events are Buckets Wednesday, 23 May 12

  16. Great! I want one! public class SimpleEvent { public static final EventFactory<SimpleEvent> EVENT_FACTORY = new SimpleEventFactory(); private volatile String value; private static class SimpleEventFactory implements EventFactory<SimpleEvent> { @Override public SimpleEvent newInstance() { return new SimpleEvent(); } } } Wednesday, 23 May 12

  17. I’ve got a RingBuffer! • Erm.... how do I poke things into it? Wednesday, 23 May 12

  18. The Publisher Wednesday, 23 May 12

  19. Wednesday, 23 May 12

  20. Wednesday, 23 May 12

  21. Wednesday, 23 May 12

  22. Wednesday, 23 May 12

  23. Wednesday, 23 May 12

  24. Wednesday, 23 May 12

  25. What do I do? public class SimpleEventTranslator implements EventTranslator<SimpleEvent> SimpleEventTranslator translator = new SimpleEventTranslator(); EventPublisher<SimpleEvent> publisher = new EventPublisher<SimpleEvent>(ringBuffer); // poke your translator here // ...and when you’re done... publisher.publishEvent(translator); Wednesday, 23 May 12

  26. ...so now I want to read • The Disruptor provides nice batching behaviour for free Wednesday, 23 May 12

  27. Wednesday, 23 May 12

  28. Wednesday, 23 May 12

  29. Wednesday, 23 May 12

  30. Wednesday, 23 May 12

  31. Wednesday, 23 May 12

  32. Wednesday, 23 May 12

  33. Wednesday, 23 May 12

  34. Wednesday, 23 May 12

  35. Wednesday, 23 May 12

  36. Wednesday, 23 May 12

  37. Wednesday, 23 May 12

  38. Wednesday, 23 May 12

  39. Wednesday, 23 May 12

  40. Wednesday, 23 May 12

  41. Wednesday, 23 May 12

  42. ...and all you need is... public class SimpleEventHandler implements EventHandler<SimpleEvent> { @Override public void onEvent( final SimpleEvent event, final long sequence, final boolean endOfBatch) throws Exception { // do stuff } } Wednesday, 23 May 12

  43. Shiny. So what? Wednesday, 23 May 12

  44. Let’s go parallel Wednesday, 23 May 12

  45. And now for something different... Wednesday, 23 May 12

  46. Remember Henry Ford? Wednesday, 23 May 12

  47. Wednesday, 23 May 12

  48. Wednesday, 23 May 12

  49. Wednesday, 23 May 12

  50. Wednesday, 23 May 12

  51. Wednesday, 23 May 12

  52. Wednesday, 23 May 12

  53. Wednesday, 23 May 12

  54. Complex workflow... Wednesday, 23 May 12

  55. What on Earth has this got to do with RingBuffers?! Wednesday, 23 May 12

  56. Wednesday, 23 May 12

  57. Wednesday, 23 May 12

  58. Wednesday, 23 May 12

  59. Wednesday, 23 May 12

  60. Wednesday, 23 May 12

  61. Wednesday, 23 May 12

  62. Wednesday, 23 May 12

  63. Wednesday, 23 May 12

  64. Wednesday, 23 May 12

  65. Wednesday, 23 May 12

  66. Wednesday, 23 May 12

  67. Wednesday, 23 May 12

  68. Wednesday, 23 May 12

  69. Wednesday, 23 May 12

  70. Wednesday, 23 May 12

  71. Wednesday, 23 May 12

  72. Wednesday, 23 May 12

  73. Wednesday, 23 May 12

  74. Wednesday, 23 May 12

  75. Wednesday, 23 May 12

  76. Wednesday, 23 May 12

  77. Wednesday, 23 May 12

  78. Wednesday, 23 May 12

  79. Wednesday, 23 May 12

  80. Wednesday, 23 May 12

  81. Wednesday, 23 May 12

  82. Wednesday, 23 May 12

  83. Wednesday, 23 May 12

  84. Wednesday, 23 May 12

  85. Wednesday, 23 May 12

  86. Wednesday, 23 May 12

  87. Wednesday, 23 May 12

  88. Wednesday, 23 May 12

  89. Wednesday, 23 May 12

  90. Wednesday, 23 May 12

  91. Wednesday, 23 May 12

  92. Wednesday, 23 May 12

  93. Don’t wrap the buffer! ringBuffer.setGatingSequences(finalEventProcessor.getSequence()); Wednesday, 23 May 12

  94. Caveats Wednesday, 23 May 12

  95. Is that it? • Wait and claim strategies • Batch publishing • Multiple publishers • Different EventHandlers • The Wizard • You don’t even need a RingBuffer... Wednesday, 23 May 12

  96. You get... • A framework the encourages you to model your domain • The ability to run in parallel but single- threaded • Reliable ordering • ...and it can be very fast Wednesday, 23 May 12

  97. More Information • Google Code Site, including Wiki http://code.google.com/p/disruptor/ • Blogs, e.g. mine: mechanitis.blogspot.com • Presentations • Google Group Wednesday, 23 May 12

  98. Q&A Wednesday, 23 May 12

  99. WorkerPool Wednesday, 23 May 12

  100. AggregateEventHandler Wednesday, 23 May 12

Download Presentation
Download Policy: The content available on the website is offered to you 'AS IS' for your personal information and use only. It cannot be commercialized, licensed, or distributed on other websites without prior consent from the author. To download a presentation, simply click this link. If you encounter any difficulties during the download process, it's possible that the publisher has removed the file from their server.

Recommend

Concurrent Programming in Scala 1 / 7 Concurrent Programming 1 Concurrent programming:

Concurrent Programming in Scala 1 / 7 Concurrent Programming 1 Concurrent programming:

Concurrent Programming in Scala 1 / 7 Concurrent Programming 1 Concurrent programming: separate overlapping threads of execution, not necessarily run on separate processors/cores Parallel programming: separate threads of execution running

257 views • 7 slides
What is Concurrent Programming? M. Ben-Ari Principles of Concurrent and Distributed Programming

What is Concurrent Programming? M. Ben-Ari Principles of Concurrent and Distributed Programming

CoSc 450: Programming Paradigms 01 What is Concurrent Programming? M. Ben-Ari Principles of Concurrent and Distributed Programming Second Edition Addison-Wesley, 2006 c Mordechai Ben-Ari 2006 Computer Time - 0 100 200 300 400

711 views • 15 slides
Concurrent programming made simple The (r)evolution of transactional memory Torvald Riegel Nuno

Concurrent programming made simple The (r)evolution of transactional memory Torvald Riegel Nuno

Concurrent programming made simple The (r)evolution of transactional memory Torvald Riegel Nuno Diegues Red Hat INESC-ID, Lisbon, Portugal FOSDEM 2014 Concurrent programming Concurrent = at the same time and not independent Concurrent

849 views • 47 slides
Chapter 3 Concurrent Execution DM519 Concurrent Programming 1 Repetition (Concepts, Models,

Chapter 3 Concurrent Execution DM519 Concurrent Programming 1 Repetition (Concepts, Models,

Chapter 3 Concurrent Execution DM519 Concurrent Programming 1 Repetition (Concepts, Models, and Practice) u Concepts: l We adopt a model-based approach for the design and construction of concurrent programs u Safe model =&gt; safe

919 views • 43 slides
Concurrent programming Multiple threads working together to achieve a common goal These threads

Concurrent programming Multiple threads working together to achieve a common goal These threads

Concurrent programming slides T.S. Norvell (c) 2001 Concurrent programming Multiple threads working together to achieve a common goal These threads may share memory Communication is via shared variables. Care is required to ensure

392 views • 11 slides
Concurrent programming in C++11 Computer Architecture J. Daniel Garca Snchez (coordinator)

Concurrent programming in C++11 Computer Architecture J. Daniel Garca Snchez (coordinator)

Concurrent programming in C++11 Concurrent programming in C++11 Computer Architecture J. Daniel Garca Snchez (coordinator) David Expsito Singh Francisco Javier Garca Blas ARCOS Group Computer Science and Engineering Department

843 views • 60 slides
Advanced Programming Concurrency Concurrent Programming Until now, a program was a sequence

Advanced Programming Concurrency Concurrent Programming Until now, a program was a sequence

Advanced Programming Concurrency Concurrent Programming Until now, a program was a sequence of operations, executing one after another. In a concurrent program, several sequences of operations may execute in the same time ,

456 views • 34 slides
Concurrent and parallel programming Seminars in Advanced Topics in Computer Science Engineering

Concurrent and parallel programming Seminars in Advanced Topics in Computer Science Engineering

Concurrent and parallel programming Seminars in Advanced Topics in Computer Science Engineering 2019/2020 Romolo Marotta Trend in processor technology Concurrent and parallel programming 2 Blocking synchronization SHARED RESOURCE

1.31k views • 74 slides
Concurrent Programming Actors, SALSA, Coordination Abstractions Carlos Varela Rensselaer

Concurrent Programming Actors, SALSA, Coordination Abstractions Carlos Varela Rensselaer

Concurrent Programming Actors, SALSA, Coordination Abstractions Carlos Varela Rensselaer Polytechnic Institute March 14, 2019 C. Varela 1 Advantages of concurrent programs Reactive programming User can interact with applications

697 views • 31 slides
Rela%vis%c Red Black Trees Rela%vis%c Programming Concurrent

Rela%vis%c Red Black Trees Rela%vis%c Programming Concurrent

Rela%vis%c Red Black Trees Rela%vis%c Programming Concurrent reading and wri%ng improves performance and scalability concurrent readers may disagree on the

771 views • 51 slides
Computational Logic Concurrent (Constraint) Logic Programming 1 Concurrent Logic Programs

Computational Logic Concurrent (Constraint) Logic Programming 1 Concurrent Logic Programs

Computational Logic Concurrent (Constraint) Logic Programming 1 Concurrent Logic Programs Predicate: Set of clauses Clause: Head :- Guard | Body. Head is an atom Guard and Body are conjunctions of atoms Resolvent: Set of goals

623 views • 28 slides
Concurrent Message Service M. Clemencic CERN - LHCb Forum on Concurrent Programming Models and

Concurrent Message Service M. Clemencic CERN - LHCb Forum on Concurrent Programming Models and

Concurrent Message Service M. Clemencic CERN - LHCb Forum on Concurrent Programming Models and Frameworks 24-10-2012 M. Clemencic (CERN - LHCb) Concurrent Message Service 24-10-2012 1 / 11 Outline Introduction 1 Gaudi Concurrent

777 views • 32 slides
Concurrent Programming Multitasking (Interactive) Perform more than one task at a time for

Concurrent Programming Multitasking (Interactive) Perform more than one task at a time for

Multiprocessing granularity Using Multiple Processors. Multiprogramming (Batch) Switch and execute different jobs simultaneously, to improve CPU utilization. Concurrent Programming Multitasking (Interactive) Perform

273 views • 15 slides
Concurrent Programming 15-213: Introduc0on to Computer Systems 22

Concurrent Programming 15-213: Introduc0on to Computer Systems 22

Carnegie Mellon Concurrent Programming 15-213: Introduc0on to Computer Systems 22 nd Lecture, Nov. 11, 2010 Instructors: Randy Bryant and Dave OHallaron 1

657 views • 41 slides
Basic Synchronization Principles Encourage Concurrency No widely-accepted concurrent

Basic Synchronization Principles Encourage Concurrency No widely-accepted concurrent

Basic Synchronization Principles Encourage Concurrency No widely-accepted concurrent programming languages No concurrent programming paradigm Each problem requires careful consideration There is no common model See SOR

630 views • 49 slides
Concurrent Programming Languages and Semantic Analyses Manfred Schmidt-Schauss

Concurrent Programming Languages and Semantic Analyses Manfred Schmidt-Schauss

Concurrent Programming Languages and Semantic Analyses Manfred Schmidt-Schauss Goethe-Universit at Frankfurt, Institut f ur Informatik, Germany RTA/TLCA 14 16. July 2014 Based on joint work with David Sabel 1 Concurrency of Programming

1.05k views • 87 slides
Concurrent Programming with Java Threads Almost all computer systems on the market today have more

Concurrent Programming with Java Threads Almost all computer systems on the market today have more

ETHZ D-INFK Prof. Dr. B. Meyer, M. Pedroni Software Architecture 2010 Concurrent Programming with Java Threads Almost all computer systems on the market today have more than one CPU, typically in the form of a multi-core processor. The benefits

392 views • 18 slides
Concurrent programming in C++11 Multithreading is just one damn thing after, before, or

Concurrent programming in C++11 Multithreading is just one damn thing after, before, or

Concurrent programming in C++11 Multithreading is just one damn thing after, before, or simultaneous with another. --Andrei Alexandrescu Problems with C++98 memory model Double-checked locking pattern C++11 memory model Atomics

1.02k views • 70 slides
Concurrent Programming with Parallel Extensions to .NET Joe Duffy Architect &amp; Development

Concurrent Programming with Parallel Extensions to .NET Joe Duffy Architect &amp; Development

Concurrent Programming with Parallel Extensions to .NET Joe Duffy Architect &amp; Development Lead Parallel Extensions Talk Outline Overview 5 things about Parallel Extensions 1. Tasks and futures 2. Parallel loops 3. Parallel LINQ

650 views • 36 slides
Advances in Programming Languages APL2: Concurrency David Aspinall (including slides by Ian

Advances in Programming Languages APL2: Concurrency David Aspinall (including slides by Ian

Advances in Programming Languages APL2: Concurrency David Aspinall (including slides by Ian Stark) School of Informatics The University of Edinburgh Friday 24 September 2010 Semester 1 Week 1 N I V E U R S E I H T T Y O H F G

563 views • 27 slides
Concurrent Programming Problems OS Spring 2011 Concurrency pros and cons Concurrency is

Concurrent Programming Problems OS Spring 2011 Concurrency pros and cons Concurrency is

Concurrent Programming Problems OS Spring 2011 Concurrency pros and cons Concurrency is good for users One of the reasons for multiprogramming Working on the same problem, simultaneous execution of programs, background execution

570 views • 34 slides
Concurrent Programming Tevfik Ko ar Louisiana State University November 2nd, 2010 1 2

Concurrent Programming Tevfik Ko ar Louisiana State University November 2nd, 2010 1 2

CSC 4304 - Systems Programming Concurrency Issues Fall 2010 Lecture - XIV Concurrent Programming Tevfik Ko ar Louisiana State University November 2nd, 2010 1 2 Concurrency Issues Synchronization Mechanism that allows the

303 views • 5 slides
Two Theads, One Shared Variable Two threads updating shared variable amount T 1 wants to decrement

Two Theads, One Shared Variable Two threads updating shared variable amount T 1 wants to decrement

Two Theads, One Shared Variable Two threads updating shared variable amount T 1 wants to decrement amount by $10K Thread Synchronization: T 2 wants to decrement amount by 50% Foundations T 1 T 2 . . . . . . amount := amount - 10,000; amount :=

545 views • 7 slides
Structured Concurrent Programming Jayadev Misra Department of Computer Science University of

Structured Concurrent Programming Jayadev Misra Department of Computer Science University of

D EPARTMENT OF C OMPUTER S CIENCES Structured Concurrent Programming Jayadev Misra Department of Computer Science University of Texas at Austin Email: misra@cs.utexas.edu web: http://www.cs.utexas.edu/users/psp Collaborators: William Cook,

1.26k views • 54 slides

More recommend