Mosaic: c: A GPU Memory Manager wit with Applic lication ion-Tr - - PowerPoint PPT Presentation

▶
mosaic c a gpu memory manager wit with applic lication
SMART_READER_LITE
LIVE PREVIEW

Mosaic: c: A GPU Memory Manager wit with Applic lication ion-Tr - - PowerPoint PPT Presentation

May 29, 2023 118 likes •287 views

Mosaic: c: A GPU Memory Manager wit with Applic lication ion-Tr Transparent Support fo for Multiple Page Sizes Rachata Ausavarungnirun , Joshua Landgraf, Vance Miller Saugata Ghose, Jayneel Gandhi, Christopher J. Rossbach, Onur Mutlu

slide-1
SLIDE 1

Mosaic: c: A GPU Memory Manager wit with Applic lication ion-Tr Transparent Support fo for Multiple Page Sizes

Rachata Ausavarungnirun, Joshua Landgraf, Vance Miller Saugata Ghose, Jayneel Gandhi, Christopher J. Rossbach, Onur Mutlu Session 2-A 2PM-4PM

slide-2
SLIDE 2

GPU Core

Private TLB

GPU Core GPU Core GPU Core Shared TLB

Private TLB

Page Table Walkers Page Table (Main memory)

Private TLB Private TLB

Data (Main Memory) CPU Memory

Private Shared CPU-side memory GPU-side memory

Bottlenecks of GPU Virtual Memory

2

slide-3
SLIDE 3

GPU Core

Private TLB

GPU Core GPU Core GPU Core Shared TLB

Private TLB

Page Table Walkers Page Table (Main memory)

Private TLB Private TLB

Limited TLB reach

High latency page walks

Data (Main Memory) CPU Memory

High latency I/O

Private Shared CPU-side memory GPU-side memory

Bottlenecks of GPU Virtual Memory

3

slide-4
SLIDE 4

Key Page Size Tradeoffs

Larger pages: Better TLB reach High demand paging latency

4

slide-5
SLIDE 5

Key Page Size Tradeoffs

Larger pages: Better TLB reach High demand paging latency Smaller pages: Lower demand paging latency Limited TLB reach

5

slide-6
SLIDE 6

Key Page Size Tradeoffs

Larger pages: Better TLB reach High demand paging latency Smaller pages: Lower demand paging latency Limited TLB reach

Mosaic enables application-transparent use

  • f both page sizes

6

slide-7
SLIDE 7

Key Challenge with Multiple Page Sizes

Large Page Frame 1

State-of-the-art

Cannot coalesce pages

Unallocated App 1 App 2

7

Large Page Frame 2

slide-8
SLIDE 8

Key Idea of Mosaic

Large Page Frame 1 Large Page Frame 1 Large Page Frame 1

With Mosaic State-of-the-art

Cannot coalesce pages

Unallocated App 1 App 2

In-Place Coalescing

8

Large Page Frame 2 Large Page Frame 2 Large Page Frame 2

slide-9
SLIDE 9

Mosaic

Hardware GPU Runtime

9

slide-10
SLIDE 10

Mosaic

Contiguity-Conserving Allocation Hardware GPU Runtime

10

slide-11
SLIDE 11

Mosaic

Contiguity-Conserving Allocation In-Place Coalescer Hardware GPU Runtime

11

slide-12
SLIDE 12

Mosaic

Contiguity-Conserving Allocation In-Place Coalescer Contiguity-Aware Compaction Hardware GPU Runtime

12

slide-13
SLIDE 13

Benefits

High TLB reach Low demand paging latency Application-transparent 55% higher average performance

13

slide-14
SLIDE 14

Mosaic: c: A GPU Memory Manager wit with Applic lication ion-Tr Transparent Support fo for Multiple Page Sizes

Rachata Ausavarungnirun, Joshua Landgraf, Vance Miller Saugata Ghose, Jayneel Gandhi, Christopher J. Rossbach, Onur Mutlu Session 2-A 2PM-4PM

14