efficient memory disaggregation with infiniswap
play

Efficient Memory Disaggregation with Infiniswap Juncheng Gu , - PowerPoint PPT Presentation

Sep 27, 2022 •205 likes •857 views

Efficient Memory Disaggregation with Infiniswap Juncheng Gu , Youngmoon Lee, Yiwen Zhang, Mosharaf Chowdhury, Kang G. Shin Agenda Motivation and related work Design and system overview Implementation and evaluation Future work and

  1. Efficient Memory Disaggregation with Infiniswap Juncheng Gu , Youngmoon Lee, Yiwen Zhang, Mosharaf Chowdhury, Kang G. Shin

  2. Agenda • Motivation and related work • Design and system overview • Implementation and evaluation • Future work and conclusion 3/30/17 1

  3. Memory-intensive applications 2 3/30/17

  4. Memory-intensive applications 3 3/30/17

  5. Performance degradation 1 Normalized Performance 0.8 0.6 0.4 0.2 0 VoltDB Memcached PowerGraph GraphX (TPC-C) (Facebook/FB SYS) (TunkRank) (PageRank) 100% working sets in memory 75% working sets in memory 50% working sets in memory 3/30/17 4

  6. Performance degradation 1 1 Normalized Performance Normalized Performance 0.8 0.8 0.6 0.6 0.4 0.4 0.18 0.2 0.2 0 0 VoltDB VoltDB Memcached Memcached PowerGraph PowerGraph GraphX GraphX (TPC-C) (TPC-C) (Facebook/FB SYS) (Facebook/FB SYS) (TunkRank) (TunkRank) (PageRank) (PageRank) 100% working sets in memory 100% working sets in memory 75% working sets in memory 75% working sets in memory 50% working sets in memory 50% working sets in memory 3/30/17 5

  7. Performance degradation 1 1 1 Normalized Performance Normalized Performance Normalized Performance 0.8 0.8 0.8 0.6 0.6 0.6 0.47 0.4 0.4 0.4 0.18 0.18 0.2 0.2 0.2 0 0 0 VoltDB VoltDB VoltDB Memcached Memcached Memcached PowerGraph PowerGraph PowerGraph GraphX GraphX GraphX (TPC-C) (TPC-C) (TPC-C) (Facebook/FB SYS) (Facebook/FB SYS) (Facebook/FB SYS) (TunkRank) (TunkRank) (TunkRank) (PageRank) (PageRank) (PageRank) 100% working sets in memory 100% working sets in memory 100% working sets in memory 75% working sets in memory 75% working sets in memory 75% working sets in memory 50% working sets in memory 50% working sets in memory 50% working sets in memory 3/30/17 6

  8. Performance degradation 1 1 1 1 Normalized Performance Normalized Performance Normalized Performance Normalized Performance 0.8 0.8 0.8 0.8 0.6 0.6 0.6 0.6 0.47 0.47 0.4 0.4 0.4 0.4 0.18 0.18 0.18 0.2 0.2 0.2 0.2 0.04 0 0 0 0 VoltDB VoltDB VoltDB VoltDB Memcached Memcached Memcached Memcached PowerGraph PowerGraph PowerGraph PowerGraph GraphX GraphX GraphX GraphX (TPC-C) (TPC-C) (TPC-C) (TPC-C) (Facebook/FB SYS) (Facebook/FB SYS) (Facebook/FB SYS) (Facebook/FB SYS) (TunkRank) (TunkRank) (TunkRank) (TunkRank) (PageRank) (PageRank) (PageRank) (PageRank) 100% working sets in memory 100% working sets in memory 100% working sets in memory 100% working sets in memory 75% working sets in memory 75% working sets in memory 75% working sets in memory 75% working sets in memory 50% working sets in memory 50% working sets in memory 50% working sets in memory 50% working sets in memory 3/30/17 7

  9. Performance degradation 1 1 1 1 1 Normalized Performance Normalized Performance Normalized Performance Normalized Performance Normalized Performance 0.8 0.8 0.8 0.8 0.8 0.6 0.6 0.6 0.6 0.6 0.47 0.47 0.47 0.4 0.4 0.4 0.4 0.4 0.18 0.18 0.18 0.18 0.2 0.2 0.2 0.2 0.2 0.06 0.04 0.04 0 0 0 0 0 VoltDB VoltDB VoltDB VoltDB VoltDB Memcached Memcached Memcached Memcached Memcached PowerGraph PowerGraph PowerGraph PowerGraph PowerGraph GraphX GraphX GraphX GraphX GraphX (TPC-C) (TPC-C) (TPC-C) (TPC-C) (TPC-C) (Facebook/FB SYS) (Facebook/FB SYS) (Facebook/FB SYS) (Facebook/FB SYS) (Facebook/FB SYS) (TunkRank) (TunkRank) (TunkRank) (TunkRank) (TunkRank) (PageRank) (PageRank) (PageRank) (PageRank) (PageRank) 100% working sets in memory 100% working sets in memory 100% working sets in memory 100% working sets in memory 100% working sets in memory 75% working sets in memory 75% working sets in memory 75% working sets in memory 75% working sets in memory 75% working sets in memory 50% working sets in memory 50% working sets in memory 50% working sets in memory 50% working sets in memory 50% working sets in memory 3/30/17 8

  10. Performance degradation 1 1 1 1 1 1 0.94 Normalized Performance Normalized Performance Normalized Performance Normalized Performance Normalized Performance Normalized Performance 0.8 0.8 0.8 0.8 0.8 0.8 0.6 0.6 0.6 0.6 0.6 0.6 0.47 0.47 0.47 0.47 0.4 0.4 0.4 0.4 0.4 0.4 0.18 0.18 0.18 0.18 0.18 0.2 0.2 0.2 0.2 0.2 0.2 0.06 0.06 0.04 0.04 0.04 0 0 0 0 0 0 VoltDB VoltDB VoltDB VoltDB VoltDB VoltDB Memcached Memcached Memcached Memcached Memcached Memcached PowerGraph PowerGraph PowerGraph PowerGraph PowerGraph PowerGraph GraphX GraphX GraphX GraphX GraphX GraphX (TPC-C) (TPC-C) (TPC-C) (TPC-C) (TPC-C) (TPC-C) (Facebook/FB SYS) (Facebook/FB SYS) (Facebook/FB SYS) (Facebook/FB SYS) (Facebook/FB SYS) (Facebook/FB SYS) (TunkRank) (TunkRank) (TunkRank) (TunkRank) (TunkRank) (TunkRank) (PageRank) (PageRank) (PageRank) (PageRank) (PageRank) (PageRank) 100% working sets in memory 100% working sets in memory 100% working sets in memory 100% working sets in memory 100% working sets in memory 100% working sets in memory 75% working sets in memory 75% working sets in memory 75% working sets in memory 75% working sets in memory 75% working sets in memory 75% working sets in memory 50% working sets in memory 50% working sets in memory 50% working sets in memory 50% working sets in memory 50% working sets in memory 50% working sets in memory 3/30/17 9

  11. Performance degradation 0.97 1 1 1 1 1 1 1 0.94 0.94 Normalized Performance Normalized Performance Normalized Performance Normalized Performance Normalized Performance Normalized Performance Normalized Performance 0.8 0.8 0.8 0.8 0.8 0.8 0.8 0.6 0.6 0.6 0.6 0.6 0.6 0.6 0.47 0.47 0.47 0.47 0.47 0.4 0.4 0.4 0.4 0.4 0.4 0.4 0.18 0.18 0.18 0.18 0.18 0.18 0.2 0.2 0.2 0.2 0.2 0.2 0.2 0.06 0.06 0.06 0.04 0.04 0.04 0.04 0 0 0 0 0 0 0 VoltDB VoltDB VoltDB VoltDB VoltDB VoltDB VoltDB Memcached Memcached Memcached Memcached Memcached Memcached Memcached PowerGraph PowerGraph PowerGraph PowerGraph PowerGraph PowerGraph PowerGraph GraphX GraphX GraphX GraphX GraphX GraphX GraphX (TPC-C) (TPC-C) (TPC-C) (TPC-C) (TPC-C) (TPC-C) (TPC-C) (Facebook/FB SYS) (Facebook/FB SYS) (Facebook/FB SYS) (Facebook/FB SYS) (Facebook/FB SYS) (Facebook/FB SYS) (Facebook/FB SYS) (TunkRank) (TunkRank) (TunkRank) (TunkRank) (TunkRank) (TunkRank) (TunkRank) (PageRank) (PageRank) (PageRank) (PageRank) (PageRank) (PageRank) (PageRank) 100% working sets in memory 100% working sets in memory 100% working sets in memory 100% working sets in memory 100% working sets in memory 100% working sets in memory 100% working sets in memory 75% working sets in memory 75% working sets in memory 75% working sets in memory 75% working sets in memory 75% working sets in memory 75% working sets in memory 75% working sets in memory 50% working sets in memory 50% working sets in memory 50% working sets in memory 50% working sets in memory 50% working sets in memory 50% working sets in memory 50% working sets in memory 3/30/17 10

  12. Performance degradation 0.97 0.97 1 1 1 1 1 1 1 1 0.94 0.94 0.94 Normalized Performance Normalized Performance Normalized Performance Normalized Performance Normalized Performance Normalized Performance Normalized Performance Normalized Performance 0.8 0.8 0.8 0.8 0.8 0.8 0.8 0.8 0.6 0.6 0.6 0.6 0.6 0.6 0.6 0.6 0.47 0.47 0.47 0.47 0.47 0.47 0.4 0.4 0.4 0.4 0.4 0.4 0.4 0.4 0.18 0.18 0.18 0.18 0.18 0.18 0.18 0.2 0.2 0.2 0.2 0.2 0.2 0.2 0.2 0.12 0.06 0.06 0.06 0.06 0.04 0.04 0.04 0.04 0.04 0 0 0 0 0 0 0 0 VoltDB VoltDB VoltDB VoltDB VoltDB VoltDB VoltDB VoltDB Memcached Memcached Memcached Memcached Memcached Memcached Memcached Memcached PowerGraph PowerGraph PowerGraph PowerGraph PowerGraph PowerGraph PowerGraph PowerGraph GraphX GraphX GraphX GraphX GraphX GraphX GraphX GraphX (TPC-C) (TPC-C) (TPC-C) (TPC-C) (TPC-C) (TPC-C) (TPC-C) (TPC-C) (Facebook/FB SYS) (Facebook/FB SYS) (Facebook/FB SYS) (Facebook/FB SYS) (Facebook/FB SYS) (Facebook/FB SYS) (Facebook/FB SYS) (Facebook/FB SYS) (TunkRank) (TunkRank) (TunkRank) (TunkRank) (TunkRank) (TunkRank) (TunkRank) (TunkRank) (PageRank) (PageRank) (PageRank) (PageRank) (PageRank) (PageRank) (PageRank) (PageRank) 100% working sets in memory 100% working sets in memory 100% working sets in memory 100% working sets in memory 100% working sets in memory 100% working sets in memory 100% working sets in memory 100% working sets in memory 75% working sets in memory 75% working sets in memory 75% working sets in memory 75% working sets in memory 75% working sets in memory 75% working sets in memory 75% working sets in memory 75% working sets in memory 50% working sets in memory 50% working sets in memory 50% working sets in memory 50% working sets in memory 50% working sets in memory 50% working sets in memory 50% working sets in memory 50% working sets in memory 3/30/17 11

Download Presentation
Download Policy: The content available on the website is offered to you 'AS IS' for your personal information and use only. It cannot be commercialized, licensed, or distributed on other websites without prior consent from the author. To download a presentation, simply click this link. If you encounter any difficulties during the download process, it's possible that the publisher has removed the file from their server.

Recommend

Disaggregation and the Application Sebastian Angel Mihir Nanavati Siddhartha Sen Traditional

Disaggregation and the Application Sebastian Angel Mihir Nanavati Siddhartha Sen Traditional

Disaggregation and the Application Sebastian Angel Mihir Nanavati Siddhartha Sen Traditional data center racks RDMA NIC GPUs CPUs Memory Storage Prior and current disaggregation efforts Towards DDCs OS kernel + Cache Why? Many

1.06k views • 21 slides
NVMe-over-Fabrics Performance Characterization and the Path to Low-Overhead Flash Disaggregation

NVMe-over-Fabrics Performance Characterization and the Path to Low-Overhead Flash Disaggregation

NVMe-over-Fabrics Performance Characterization and the Path to Low-Overhead Flash Disaggregation Zvika Guz, Harry Li, Anahita Shayesteh, and Vijay Balakrishnan Memory Solution Lab Samsung Semiconductor Inc. 1 Synopsis Performance

224 views • 21 slides
Efforts in Monitoring SDG with Disaggregation in the Philippines International Workshop on Data

Efforts in Monitoring SDG with Disaggregation in the Philippines International Workshop on Data

Efforts in Monitoring SDG with Disaggregation in the Philippines International Workshop on Data Disaggregation for the SDGs Bangkok, Thailand 28 30 January 2019 Bernadette B. Balamban Chief Statistical Specialist Philippine Statistics

722 views • 27 slides
Last class: Virtual Memory Today: Virtual Memory Uses Efficient Use of Physical

Last class: Virtual Memory Today: Virtual Memory Uses Efficient Use of Physical

Last class: Virtual Memory Today: Virtual Memory Uses Efficient Use of Physical Memory Through virtual memory N 2 32 -sized address spaces All isolated by default Uses for memory Make a new process Address

516 views • 22 slides
Disaggregation March 4, 2020 D. Pallme, A. Kosanovic, TN-DOT K. Pujats, M. Golias, S. Mishra,

Disaggregation March 4, 2020 D. Pallme, A. Kosanovic, TN-DOT K. Pujats, M. Golias, S. Mishra,

Methods and T ools for Freight Flow Disaggregation March 4, 2020 D. Pallme, A. Kosanovic, TN-DOT K. Pujats, M. Golias, S. Mishra, Univ. of Memphis Brief project overview Production/Attraction Methods Contents OD Disaggregation GIS Tools

421 views • 18 slides
Energy-Efficient In-Memory Data Stores on Hybrid Memory Hierarchies Eleventh International

Energy-Efficient In-Memory Data Stores on Hybrid Memory Hierarchies Eleventh International

Energy-Efficient In-Memory Data Stores on Hybrid Memory Hierarchies Eleventh International Workshop on Data Management on New Hardware June 2015 Ahmad Hassan (SAP), Hans Vandierendonck (QUB) and Dimitrios S. Nikolopoulos (QUB) May 2015

513 views • 30 slides
SILT A Memory-Efficient, High-Performance Key- Value Store Based on paper of H. Lim, B. Fan,

SILT A Memory-Efficient, High-Performance Key- Value Store Based on paper of H. Lim, B. Fan,

SILT A Memory-Efficient, High-Performance Key- Value Store Based on paper of H. Lim, B. Fan, D.G. Andersen, and M. Kaminsky: Presenter: SILT: A Memory-Efficient, High-Performance Key-Value Store Andrzej Findeisen in Proceedings ACM SOSP

590 views • 19 slides
Efficient Hardware-assisted Logging with Asynchronous and Direct Update for Persistent Memory

Efficient Hardware-assisted Logging with Asynchronous and Direct Update for Persistent Memory

Efficient Hardware-assisted Logging with Asynchronous and Direct Update for Persistent Memory Jungi Jeong , Chang Hyun Park, Jaehyuk Huh, and Seungryoul Maeng International Symposium on Microarchitecture (MICRO) 2018 Storage-Class Memory

1.95k views • 155 slides
HOOP: Efficient Hardware-Assisted Out-of-Place Update for Non-Volatile Memory Miao Cai Chance

HOOP: Efficient Hardware-Assisted Out-of-Place Update for Non-Volatile Memory Miao Cai Chance

HOOP: Efficient Hardware-Assisted Out-of-Place Update for Non-Volatile Memory Miao Cai Chance Coats Jian Huang Systems Platform Research Group Non-Volatile Memory is a Revolutionary Technology Close-to-DRAM Performance Data

367 views • 21 slides
CCHL: Compression-Consolidation Hardware Logging for Efficient Failure-Atomic Persistent Memory

CCHL: Compression-Consolidation Hardware Logging for Efficient Failure-Atomic Persistent Memory

CCHL: Compression-Consolidation Hardware Logging for Efficient Failure-Atomic Persistent Memory Updates Xueliang Wei, Dan Feng, Wei Tong, Jingning Liu, Chengning Wang, Liuqing Ye Huazhong University of Science and Technology Persistent Memory

817 views • 38 slides
Search Lookaside Buffer: Efficient Caching for Index Data Structures Xingbo Wu, Fan Ni, Song

Search Lookaside Buffer: Efficient Caching for Index Data Structures Xingbo Wu, Fan Ni, Song

Search Lookaside Buffer: Efficient Caching for Index Data Structures Xingbo Wu, Fan Ni, Song Jiang Background Large-scale in-memory applications. In-memory databases In-memory NoSQL stores and caches Software routing tables

728 views • 36 slides
The Basics What is memory management? Programs contain Objects Data Occupy memory

The Basics What is memory management? Programs contain Objects Data Occupy memory

The Basics What is memory management? Programs contain Objects Data Occupy memory Runtime system must allocate and reclaim memory for program in an efficient manner Why is this important? Why is this hard? Why is

319 views • 20 slides
Tolerating Faults in Disaggregated Datacenters Amanda Carbonari , Ivan Beschastnikh University

Tolerating Faults in Disaggregated Datacenters Amanda Carbonari , Ivan Beschastnikh University

Tolerating Faults in Disaggregated Datacenters Amanda Carbonari , Ivan Beschastnikh University of British Columbia HotNets17 Todays Datacenters 2 The future: Disaggregation 3 The future: Disaggregation The future: Disaggregation is

497 views • 25 slides
Efficient Memory Integrity Verification and Encryption for Secure Processors G. Edward Suh,

Efficient Memory Integrity Verification and Encryption for Secure Processors G. Edward Suh,

Efficient Memory Integrity Verification and Encryption for Secure Processors G. Edward Suh, Dwaine Clarke, Blaise Gassend, Marten van Dijk, Srinivas Devadas Massachusetts Institute of Technology New Security Challenges Current computer

411 views • 26 slides
Efficient Parallel Functional Programming with Hierarchical Memory Management Sam Westrick

Efficient Parallel Functional Programming with Hierarchical Memory Management Sam Westrick

Efficient Parallel Functional Programming with Hierarchical Memory Management Sam Westrick Carnegie Mellon University Joint work with: Ram Raghunathan, Adrien Guatto, Stefan Muller, Rohan Yadav, Umut Acar, Guy Blelloch, Matthew Fluet Setting

892 views • 42 slides
CoMerge Toward Efficient Data Placement in Shared Heterogeneous Memory Systems Thaleia Dimitra

CoMerge Toward Efficient Data Placement in Shared Heterogeneous Memory Systems Thaleia Dimitra

CoMerge Toward Efficient Data Placement in Shared Heterogeneous Memory Systems Thaleia Dimitra Doudali Ada Gavrilovska Motivation Performance slowdown in heterogeneous memory systems. Application data objects How to reduce the

343 views • 12 slides
Cray Management Services (CMS) Group Charter The Problem with Log and State Information

Cray Management Services (CMS) Group Charter The Problem with Log and State Information

Cray Management Services (CMS) Group Charter The Problem with Log and State Information Solutions CMS Log Manager Solutions CMS State Daemon Future Functionality Summary, Questions, and Contact Information

223 views • 10 slides
NDN-Trace A A PATH TRA RACING UT UTILITY Y FOR R NDN NDN SIHAM KHOUSSI, DAVIDE PESAVENTO ,

NDN-Trace A A PATH TRA RACING UT UTILITY Y FOR R NDN NDN SIHAM KHOUSSI, DAVIDE PESAVENTO ,

NDN-Trace A A PATH TRA RACING UT UTILITY Y FOR R NDN NDN SIHAM KHOUSSI, DAVIDE PESAVENTO , LOTFI BENMOHAMED, ABDELLA BATTOU NATIONA NA ONAL L INS NSTITUTE OF OF STAND NDARDS DS AND ND TECHNOL NOLOG OGY (NI NIST) NDN vs IP IP

478 views • 11 slides
Wallet Security Wallets Keep track of the world If you want Synchronize with the

Wallet Security Wallets Keep track of the world If you want Synchronize with the

Wallet Security Wallets Keep track of the world If you want Synchronize with the network if you fall behind Address end user needs Send coin Receive coin Answer queries What is my balance? What is my activity

772 views • 37 slides
Table of Contents 3 14 Q3/2017 highlights Balance sheet 25 Hedging experience 4 15

Table of Contents 3 14 Q3/2017 highlights Balance sheet 25 Hedging experience 4 15

Third Quarter 2017 Conference Call Presenters: Yvon Charest, President and CEO Ren Chabot, EVP, CFO and Chief Actuary November 8, 2017 1 Table of Contents 3 14 Q3/2017 highlights Balance sheet 25 Hedging experience 4 15 Acquisitions

748 views • 36 slides
Network Security CIA +Availability By Jinjian Ma Topics DOS/DDoS Detection & Defense

Network Security CIA +Availability By Jinjian Ma Topics DOS/DDoS Detection & Defense

Network Security CIA +Availability By Jinjian Ma Topics DOS/DDoS Detection & Defense Prevention DOS/DDoS Types Vulnerability attack Flooding attack DoS vs DDoS DoS: Attack is launched from single host Less

614 views • 26 slides
Inferring semantically related words from software context Jinqiu Yang , Lin Tan University of

Inferring semantically related words from software context Jinqiu Yang , Lin Tan University of

Inferring semantically related words from software context Jinqiu Yang , Lin Tan University of Waterloo 1 Motivation I need to find all functions that disable interrupts in the Linux kernel. Hmmm, so I search for disable*interrupt .

259 views • 24 slides
End Site Control Plane System (ESCPS) Network service to

End Site Control Plane System (ESCPS) Network service to

End-Site Control Plane Service (ESCaPeS) Monitoring with Perisc pe Mar8n Swany U. Delaware (Indiana University effec8ve 8.1.11) End Site

437 views • 19 slides
Siphon: Expediting Inter-Datacenter Coflows in Wide-Area Data Analytics Shuhao Liu, Li Chen ,

Siphon: Expediting Inter-Datacenter Coflows in Wide-Area Data Analytics Shuhao Liu, Li Chen ,

Siphon: Expediting Inter-Datacenter Coflows in Wide-Area Data Analytics Shuhao Liu, Li Chen , Baochun Li University of Toronto July 12, 2018 What is a Coflow ? One stage in a data analytic job Map 1 Reduce 1 Map 2 Reduce 2 Map 3 Reduce 3

840 views • 47 slides

More recommend