predictable latency
play

Predictable Latency Adventures in Java Concurrency Martin Thompson - PowerPoint PPT Presentation

Feb 24, 2024 •527 likes •1.69k views

A Quest for Predictable Latency Adventures in Java Concurrency Martin Thompson - @mjpt777 If a system does not respond in a timely manner then it is effectively unavailable 1. Its all about the Blocking 2. What do we mean by Latency 3.

  1. File Header Message 1 Header Message 2 Tail

  2. File Header Message 1 Header Message 2 Tail

  3. File Header Message 1 Header Message 2 Message 3 Tail

  4. File Header Message 1 Header Message 2 Header Message 3 Tail

  5. One big file that goes on forever?

  6. No!!! Page faults, page cache churn, VM pressure, ...

  7. Clean Dirty Active Header Header Message Message Header Header Message Message Header Header Message Message Tail Header Message Header Message

  8. Do publishers need a CAS?

  9. File Header Message 1 Header Message 2 Header Message 3 Tail <<XADD>> Message X Message Y

  10. File Header Message 1 Header Message 2 Header Message 3 Message X Tail <<XADD>> Message Y

  11. File Header Message 1 Header Message 2 Header Message 3 Message X Message Y Tail

  12. File Header Message 1 Header Message 2 Header Message 3 Header Message X Message Y Tail

  13. File Header Message 1 Header Message 2 Header Message 3 Header Message X Message Y Padding Tail

  14. File File Tail Header Message 1 Header Message 2 Header Message 3 Header Message X Message Y Padding

  15. File File Header Header Message 1 Message X Header Tail Message 2 Header Message 3 Header Message Y Padding

  16. Have a background thread do zero’ing and flow control

  17. Burst Length = 1: RTT (ns) Prod # Mean 99% 1 167 189 Baseline (Wait-free) 1 281 361 ConcurrentLinkedQueue 2 381 559 3 444 705 1 170 194 ManyToOneRingBuffer 2 256 279 3 283 340 1 192 210 Aeron IPC 2 251 286 3 290 342

  18. Burst Length = 1: RTT (ns) Prod # Mean 99% 1 167 189 Baseline (Wait-free) 1 281 361 ConcurrentLinkedQueue 2 381 559 3 444 705 1 170 194 ManyToOneRingBuffer 2 256 279 3 283 340 1 192 210 Aeron IPC 2 251 286 3 290 342

  19. Aeron Data Message Header 0 1 2 3 0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1 +-+-------------------------------------------------------------+ |R| Frame Length | +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-------------------------------+ | Version |B|E| Flags | Type | +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-------------------------------+ |R| Term Offset | +-+-------------------------------------------------------------+ | Session ID | +---------------------------------------------------------------+ | Stream ID | +---------------------------------------------------------------+ | Term ID | +---------------------------------------------------------------+ | Encoded Message ... ... | +---------------------------------------------------------------+

  20. Burst Length = 100: RTT (ns) Prod # Mean 99% 1 721 982 Baseline (Wait-free) 1 12,916 15,792 ConcurrentLinkedQueue 2 25,132 35,136 3 39,462 56,768 1 3,773 3,992 ManyToOneRingBuffer 2 11,286 13,200 3 27,255 34,432 1 4,436 4,632 Aeron IPC 2 7,623 8,224 3 10,825 13,872

Download Presentation
Download Policy: The content available on the website is offered to you 'AS IS' for your personal information and use only. It cannot be commercialized, licensed, or distributed on other websites without prior consent from the author. To download a presentation, simply click this link. If you encounter any difficulties during the download process, it's possible that the publisher has removed the file from their server.

Recommend

CROSS-LAYER CROSS-LAYER LATENCY-AWARE AND -PREDICTABLE LATENCY-AWARE AND -PREDICTABLE DATA

CROSS-LAYER CROSS-LAYER LATENCY-AWARE AND -PREDICTABLE LATENCY-AWARE AND -PREDICTABLE DATA

CROSS-LAYER CROSS-LAYER LATENCY-AWARE AND -PREDICTABLE LATENCY-AWARE AND -PREDICTABLE DATA COMMUNICATION DATA COMMUNICATION Andreas Schmidt Apr 07th, 2020 Anywhere on Earth Doctoral Colloquium 1

702 views • 59 slides
Predictable Latency Adventures in Java Concurrency Martin Thompson - @mjpt777 If a system does

Predictable Latency Adventures in Java Concurrency Martin Thompson - @mjpt777 If a system does

A Quest for Predictable Latency Adventures in Java Concurrency Martin Thompson - @mjpt777 If a system does not respond in a timely manner then it is effectively unavailable 1. Its all about the Blocking 2. What do we mean by Latency 3.

1.33k views • 112 slides
Rocksteady: Fast Migration for Low-Latency In-memory Storage Chinmay Kulkarni , Aniraj Kesavan,

Rocksteady: Fast Migration for Low-Latency In-memory Storage Chinmay Kulkarni , Aniraj Kesavan,

Rocksteady: Fast Migration for Low-Latency In-memory Storage Chinmay Kulkarni , Aniraj Kesavan, Tian Zhang, Robert Ricci, Ryan Stutsman 1 Introduction Distributed low-latency in-memory key-value stores are emerging Predictable response

757 views • 50 slides
Quest-V: A Secure and Predictable System for IoT and Beyond Richard West richwest@cs.bu.edu

Quest-V: A Secure and Predictable System for IoT and Beyond Richard West richwest@cs.bu.edu

Quest-V: A Secure and Predictable System for IoT and Beyond Richard West richwest@cs.bu.edu Computer Science Goals Develop system for high-confidence (embedded) systems Mixed criticalities (timeliness and safety) Predictable

572 views • 45 slides
Is It Latency or Do You Just Suck? Latency Can Kill: Precision and Deadline in Online Games

Is It Latency or Do You Just Suck? Latency Can Kill: Precision and Deadline in Online Games

12/6/2011 Is It Latency or Do You Just Suck? Latency Can Kill: Precision and Deadline in Online Games http://www.youtube.com/watch?v=r6PwHkhEAkU Mark Claypool and Kajal Claypool ACM MMSys Scottsdale, AZ, USA February 2010

412 views • 4 slides
Predictable Communication and Migration in the Quest-V Separation Kernel Ye Li, Richard West,

Predictable Communication and Migration in the Quest-V Separation Kernel Ye Li, Richard West,

Introduction Quest-V Overview Inter-Sandbox Communication Predictable Migration Conclusions Predictable Communication and Migration in the Quest-V Separation Kernel Ye Li, Richard West, Zhuoqun Cheng, Eric Missimer Boston University 1 / 29

870 views • 29 slides
How Predictable is Information Diffusion? Travis Martin, Jake Hofman, Amit Sharma, Ashton

How Predictable is Information Diffusion? Travis Martin, Jake Hofman, Amit Sharma, Ashton

How Predictable is Information Diffusion? Travis Martin, Jake Hofman, Amit Sharma, Ashton Anderson, and Duncan Watts How Predictable is Information Diffusion? 1 / 36 How far will this spread? How Predictable is Information Diffusion? 2 / 36

807 views • 51 slides
Asynchronous I/O Stack: A Low-latency Kernel I/O Stack for Ultra-Low Latency SSDs Jinkyu Jeong

Asynchronous I/O Stack: A Low-latency Kernel I/O Stack for Ultra-Low Latency SSDs Jinkyu Jeong

Asynchronous I/O Stack: A Low-latency Kernel I/O Stack for Ultra-Low Latency SSDs Jinkyu Jeong Sungkyunkwan University (SKKU) Source: Gyusun Lee et al., Asynchronous I/O Stack: A Low-latency Kernel I/O Stack for Ultra-Low Latency SSDs, USENIX

672 views • 48 slides
The Benefits and Burdens of Nuclear Latency by Mehta and Whitlark Andrew Malandra Possible

The Benefits and Burdens of Nuclear Latency by Mehta and Whitlark Andrew Malandra Possible

The Benefits and Burdens of Nuclear Latency by Mehta and Whitlark Andrew Malandra Possible Effects of Latency The Background Virtual Deterrence Latency Provocation Theory Theory You cant deter challengers Essentially its the

273 views • 24 slides
Bibliography on Synchronous Elastic (aka Latency Insensitive) Systems July 20, 2009 Latency

Bibliography on Synchronous Elastic (aka Latency Insensitive) Systems July 20, 2009 Latency

Bibliography on Synchronous Elastic (aka Latency Insensitive) Systems July 20, 2009 Latency insensitive designs [CMSV01,CSV02,CSV03,CM04,BMdS06a,Sve04,VA09] SELF implementation and compilation to elastic designs [CKG06,CK07,HB08] Interlock

313 views • 5 slides
STORM AND LOW-LATENCY PROCESSING www.inf.ed.ac.uk Low latency processing Similar to data

STORM AND LOW-LATENCY PROCESSING www.inf.ed.ac.uk Low latency processing Similar to data

STORM AND LOW-LATENCY PROCESSING www.inf.ed.ac.uk Low latency processing Similar to data stream processing, but with a twist Data is streaming into the system (from a database, or a network stream, or an HDFS file, or ) We want to

573 views • 31 slides
Latency and Throughput Latency (of task): Time elapsed between start of the task and

Latency and Throughput Latency (of task): Time elapsed between start of the task and

Latency and Throughput Latency (of task): Time elapsed between start of the task and and its finish Example : Travel from Houston to NY Takeoff to Landing Arrival at Airport to Baggage pickup Leave for Airport to Arrival at

506 views • 12 slides
Run-time interrupts latency detection in real-time systems Julien Desfossez Michel Dagenais

Run-time interrupts latency detection in real-time systems Julien Desfossez Michel Dagenais

Run-time interrupts latency detection in real-time systems Julien Desfossez Michel Dagenais December 2015 cole Polytechnique de Montreal Latency-tracker Kernel module to track down latency problems at run-time Simple API that can be

686 views • 16 slides
Seek Novelty Personality Environment Predictable Unpredictable Seek Stability Seek Novelty

Seek Novelty Personality Environment Predictable Unpredictable Seek Stability Seek Novelty

Seek Novelty Personality Environment Predictable Unpredictable Seek Stability Seek Novelty Predictable Unpredictable Seek Stability ? X ? ? 1. Establish 1RM (performance) 2. Plan the training block/phase 3. Rinse and repeat How to

726 views • 60 slides
Failures, Latency and Happy Eyeballs Contributions Takeaway Content Caches Latency IPv6

Failures, Latency and Happy Eyeballs Contributions Takeaway Content Caches Latency IPv6

Motivation Vaibhav Bajpai March 20, 2019 https://doi.org/10.1109/TNET.2019.2895165 March 2019 IEEE/ACM Transactions on Networking Garching bei Mnchen, Germany NetSys 2019 (Invited Talk) Technische Universitt Mnchen Failures, Latency

648 views • 16 slides
Green Latency-aware Data Deployment in Data Centers: Balancing Latency, Energy in Networks and

Green Latency-aware Data Deployment in Data Centers: Balancing Latency, Energy in Networks and

Green Latency-aware Data Deployment in Data Centers: Balancing Latency, Energy in Networks and Servers Yuqi Fan, Hongli Ding, Donghui Hu School of Computer and Information Hefei University of Technology August 18, 2014 School of Computer &amp;

351 views • 10 slides
Welcome! Thank you for coming to the last session of Drupal Gov Con. 1 My name is Noah Wolfe.

Welcome! Thank you for coming to the last session of Drupal Gov Con. 1 My name is Noah Wolfe.

Welcome! Thank you for coming to the last session of Drupal Gov Con. 1 My name is Noah Wolfe. Ive been a web project manager for over a decade and Ive worked as a government contractor for 6 years. I have a B.A. in Psychology from the

1.04k views • 69 slides
Luke 15:1-32 These parables were told in response to a complaint of the Pharisees and

Luke 15:1-32 These parables were told in response to a complaint of the Pharisees and

Luke 15:1-32 These parables were told in response to a complaint of the Pharisees and scribes (Luke 15:1-2). This man receives sinners and eats with them. The lesson is the same in each parable. Each shows the joy found

331 views • 22 slides
Good Programming Practice Juli 6, 2017 | Tobias Stockmanns Why is this necessary? When ever

Good Programming Practice Juli 6, 2017 | Tobias Stockmanns Why is this necessary? When ever

Mitglied der Helmholtz-Gemeinschaft Good Programming Practice Juli 6, 2017 | Tobias Stockmanns Why is this necessary? When ever many people work over a long time on a complex software project with a high demand on

714 views • 38 slides
Sustainability Transition CREATIVE APOCALYPSE NOW CREATIVE APOCALYPSE NOW GREAT SUSTAINABILITY

Sustainability Transition CREATIVE APOCALYPSE NOW CREATIVE APOCALYPSE NOW GREAT SUSTAINABILITY

Sustainability Transition CREATIVE APOCALYPSE NOW CREATIVE APOCALYPSE NOW GREAT SUSTAINABILITY TRANSITION BEGINS TODAY GREAT SUSTAINABILITY TRANSITION BEGINS TODAY GREAT SUSTAINABILITY TRANSITION BEGINS TODAY The The End End

134 views • 12 slides
The Need for Parallel I/O in Classical Molecular Dynamics I.T. Todorov I.J. Bush, A.R. Porter

The Need for Parallel I/O in Classical Molecular Dynamics I.T. Todorov I.J. Bush, A.R. Porter

The Need for Parallel I/O in Classical Molecular Dynamics I.T. Todorov I.J. Bush, A.R. Porter Advanced Research Computing, CSE Department STFC Daresbury Laboratory, Warrington WA4 4AD, UK The DL_POLY_3 MD Package General purpose MD

354 views • 18 slides
Osmocom Testing Initiative Harald Welte &lt;laforge@gnumonks.org&gt; split NITB aftermath (the

Osmocom Testing Initiative Harald Welte &lt;laforge@gnumonks.org&gt; split NITB aftermath (the

Osmocom Testing Initiative Harald Welte &lt;laforge@gnumonks.org&gt; split NITB aftermath (the good parts) biggest architectural change since we started in 2008 lots of good reasons and design improvements finite state machines with proper

449 views • 26 slides
Process Management forks, bombs, zombies, and daemons! Lecture 5, Hands-On Unix System

Process Management forks, bombs, zombies, and daemons! Lecture 5, Hands-On Unix System

Process Management forks, bombs, zombies, and daemons! Lecture 5, Hands-On Unix System Administration DeCal 2012-10-01 what is a process? an abstraction! you can think of it as a program in the midst of execution but also much more

477 views • 25 slides
Excep&amp;onal Control Flow: Signals and Nonlocal Jumps

Excep&amp;onal Control Flow: Signals and Nonlocal Jumps

Carnegie Mellon Excep&amp;onal Control Flow: Signals and Nonlocal Jumps 15-213: Introduc0on to Computer Systems 13 th Lecture, Oct. 7, 2010 Instructors: Randy

871 views • 42 slides

More recommend