Ginseng, the Learning TEE Fast, Confidential Machine Learning in - PowerPoint PPT Presentation

Ginseng, the Learning TEE Fast, Confidential Machine Learning in FPGA Enclaves Nick Hynes | Oasis Labs

Id Idea eal : data providers pool data to train a large, complex model

Id Idea eal : data providers pool data to train a large, complex model TransUnion Equifax Experian credit scoring model

Idea Id eal : data providers pool data to train a large, complex model Kaiser Permanente Mass. General UCSF Medical Hospital health diagnosis model

Id Idea eal : data providers pool data to train a large, complex model your neighbor you me truly personal, personal assistant

Re Reality : data providers are mutually distrusting! inappropriate use data theft (ads, military) re-identification

Solu Solution ion : cooperation via a trusted third party (i.e. enclave)

What about CPU Enclaves? Performance of VGG-9 on CIFAR (32x32 RGB images) img/s (training) img/s (inference) Myelin [1] 21 img/s 496 img/s Chiron (4 enclaves) [2] 25 img/s – non-private CPU 42 img/s 1119 img/s [1] Efficient Deep Learning on Multi-Source Private Data . N. Hynes, R. Cheng, D. Song. Arxiv 2018 [2] Chiron: Privacy-preserving machine learning as a service . T. Hunt, C. Song, R. Shokri, V. Shmatikov, and E. Witchel. Arxiv 2018 [3] Graviton: Trusted Execution Environments on GPUs . S. Volos, K. Vaswani. OSDI 2018

What about CPU Enclaves? Performance of VGG-9 on CIFAR (32x32 RGB images) img/s (training) img/s (inference) Myelin [1] 21 img/s 496 img/s Chiron (4 enclaves) [2] 25 img/s – non-private CPU 42 img/s 1119 img/s private GPU: Graviton [3] >1500 img/s >10,000 img/s [1] Efficient Deep Learning on Multi-Source Private Data . N. Hynes, R. Cheng, D. Song. Arxiv 2018 [2] Chiron: Privacy-preserving machine learning as a service . T. Hunt, C. Song, R. Shokri, V. Shmatikov, and E. Witchel. Arxiv 2018 [3] Graviton: Trusted Execution Environments on GPUs . S. Volos, K. Vaswani. OSDI 2018

Ginseng, the Learning TEE FPGA-based ML accelerator 1. Start with a tensor accelerator framework (e.g., VTA [4]) 2. Bolt on a Tensor Encryption Core (TEC) 3. Add remote attestation hardware (PUF, RNG) 4. Distribute with a lightweight, secure unikernel End result: a speedy end-to-end private ML pipeline [4] A Hardware-Software Blueprint for Flexible Deep Learning Specialization . T. Moreau, et al. Arxiv 2019

Ginseng, the Learning TEE Ginseng, the Learning TEE on an FPGA+CPU SoC CPU FPGA Tensor tensor accel. runtime TEC o ff -chip Accelerator Ginseng runtime memory tensor tile bu ff ers TEC data secure µkernel attestation engine PUF RNG

Ginseng, the Learning TEE

Sterling: A Privacy-Preserving Data Marketplace A Demonstration of Sterling: A Privacy-Preserving Data Marketplace. N. Hynes, D. Yan, R. Cheng, and D. Song. VLDB 2018.

Ginseng, the Learning TEE Fast, Confidential Machine Learning in - PowerPoint PPT Presentation

Ginseng, the Learning TEE Fast, Confidential Machine Learning in FPGA Enclaves Nick Hynes | Oasis Labs Id Idea eal : data providers pool data to train a large, complex model Id Idea eal : data providers pool data to train a large, complex

The Effects of American Ginseng Extracts on Streptozocin Induced Diabetic Sciatic Neuropathy in

of Polysaccharides Fractions from American Ginseng Root Lijun Wang Chinese Academy of Agriculture

Learning is a never-ending process Tasks come and go, but learning is forever Learn more e ff

What is Action Learning? What is an ALC? 1 What is Action Learning? Learning by doing

Learning From Data Lecture 2 The Perceptron The Learning Setup A Simple Learning Algorithm: PLA

4. Learning in MAS 4.1. What is learning? One definition: Bower, Hilgard: Theories of learning,

What are learning outcomes? Learning Outcomes Learning outcomes are statements that specify what

Machine Learning 11 AI Slides (6e) c Lin Zuoquan@PKU 1998-2020 11 1 11 Machine Learning

04 FOCUS ON LEARNING STUDENTS REFLECTING ON THEIR LEARNING In this unit we are learning to

The JOY of LEARNING Think of a topic you are passionate about Think about your learning

Complex learning example: curve fitting t = sin(2 x ) + noise t n t 1 y ( x n , w ) 0 1

Further thoughts How does e-Learning relate to instruction? How does eLearning change

Learning Sciences: Impact on Learning Technologies & Learning Activities Phillip D. Long,

The Learning Tree Workshop: The Learning Tree Workshop: Regulating Sensation Series on Learning

Foundations of AI Why learning works 1 6 . Statistical Machine Learning Bayesian Learning and

Welcome to Welcome to The Learning Tree Workshop Series on Learning Differences, Learning

National Lifespan Respite Conference October 13, 2017 1 Agenda About the Society &

for the Social Sciences (9/22/14) Instructors : Benot, Ewart, Rebecca, Caitie, Kara Topics

2/24/16 February 24, 2016 Simulation 3 highlights, a. unmyelinated axon MRO

Transformations Rotations Reflections Dilations Symmetry Return to Congruence &

Fast & Faster Privacy-Preserving ML in Secure Hardware Enclaves Nick Hynes, Raymond

One year of developments and collaborations around the MinION on the Genomic facility of the

Ps Psychoneur ychoneuroimmunol oimmunology ogy CNELM Webinar | Leo Pruimboom Contents

An En-lyte-ening case of osmotic injury Amy Miles, PGY-3 Internal Medicine Nadia Gabarin, PGY-2

Ginseng, the Learning TEE Fast, Confidential Machine Learning in - PowerPoint PPT Presentation

Ginseng, the Learning TEE Fast, Confidential Machine Learning in FPGA Enclaves Nick Hynes | Oasis Labs Id Idea eal : data providers pool data to train a large, complex model Id Idea eal : data providers pool data to train a large, complex

The Effects of American Ginseng Extracts on Streptozocin Induced Diabetic Sciatic Neuropathy in

of Polysaccharides Fractions from American Ginseng Root Lijun Wang Chinese Academy of Agriculture

Learning is a never-ending process Tasks come and go, but learning is forever Learn more e ff

What is Action Learning? What is an ALC? 1 What is Action Learning? Learning by doing

Learning From Data Lecture 2 The Perceptron The Learning Setup A Simple Learning Algorithm: PLA

4. Learning in MAS 4.1. What is learning? One definition: Bower, Hilgard: Theories of learning,

What are learning outcomes? Learning Outcomes Learning outcomes are statements that specify what

Machine Learning 11 AI Slides (6e) c Lin Zuoquan@PKU 1998-2020 11 1 11 Machine Learning

04 FOCUS ON LEARNING STUDENTS REFLECTING ON THEIR LEARNING In this unit we are learning to

The JOY of LEARNING Think of a topic you are passionate about Think about your learning

Complex learning example: curve fitting t = sin(2 x ) + noise t n t 1 y ( x n , w ) 0 1

Further thoughts How does e-Learning relate to instruction? How does eLearning change

Learning Sciences: Impact on Learning Technologies &amp; Learning Activities Phillip D. Long,

The Learning Tree Workshop: The Learning Tree Workshop: Regulating Sensation Series on Learning

Foundations of AI Why learning works 1 6 . Statistical Machine Learning Bayesian Learning and

Welcome to Welcome to The Learning Tree Workshop Series on Learning Differences, Learning

National Lifespan Respite Conference October 13, 2017 1 Agenda About the Society &amp;

for the Social Sciences (9/22/14) Instructors : Benot, Ewart, Rebecca, Caitie, Kara Topics

2/24/16 February 24, 2016 Simulation 3 highlights, a. unmyelinated axon MRO

Transformations Rotations Reflections Dilations Symmetry Return to Congruence &amp;

Fast &amp; Faster Privacy-Preserving ML in Secure Hardware Enclaves Nick Hynes, Raymond

One year of developments and collaborations around the MinION on the Genomic facility of the

Ps Psychoneur ychoneuroimmunol oimmunology ogy CNELM Webinar | Leo Pruimboom Contents

An En-lyte-ening case of osmotic injury Amy Miles, PGY-3 Internal Medicine Nadia Gabarin, PGY-2

Learning Sciences: Impact on Learning Technologies & Learning Activities Phillip D. Long,

National Lifespan Respite Conference October 13, 2017 1 Agenda About the Society &

Transformations Rotations Reflections Dilations Symmetry Return to Congruence &

Fast & Faster Privacy-Preserving ML in Secure Hardware Enclaves Nick Hynes, Raymond