Emerging Algorithms for Verifying Deep Neural Networks Changliu Liu - PowerPoint PPT Presentation

Nov 05, 2023 •105 likes •710 views

Emerging Algorithms for Verifying Deep Neural Networks Changliu Liu 1 , Tomer Arnon 2 , Chris Lazarus 2 , Clark Barrett 2 , and Mykel Kochenderfer 2 1 Carnegie Mellon University 2 Stanford University Overview Deep neural networks are widely

Emerging Algorithms for Verifying Deep Neural Networks Changliu Liu 1 , Tomer Arnon 2 , Chris Lazarus 2 , Clark Barrett 2 , and Mykel Kochenderfer 2 1 Carnegie Mellon University 2 Stanford University
Overview • Deep neural networks are widely used for nonlinear function approximation with applications spanning from computer vision to control. • Although these networks involve the composition of simple arithmetic operations, it can be very challenging to verify whether a particular network satisfies certain input-output properties . • We survey methods that have emerged recently for soundly verifying such properties. In this talk, we will 1. Discuss fundamental di ff erences and connections between existing algorithms; 2. Introduce NeuralVerification.jl toolbox which contains pedagogical implementations of existing methods. * C. Liu, T. Arnon, C. Lazarus, C. Barrett, and M. Kochenderfer, "Algorithms for Verifying Deep Neural Networks," arXiv:1903.06758. ! 2

Download Presentation

Download Policy: The content available on the website is offered to you 'AS IS' for your personal information and use only. It cannot be commercialized, licensed, or distributed on other websites without prior consent from the author. To download a presentation, simply click this link. If you encounter any difficulties during the download process, it's possible that the publisher has removed the file from their server.

Recommend

Reluplex: An Efficient SMT Solver for Verifying Deep Neural Networks David L Dill Stanford

Reluplex: An Efficient SMT Solver for Verifying Deep Neural Networks David L Dill Stanford University 1 / 39 Based on: Reluplex: An Efficient SMT Solver for Verifying Deep Neural Networks Guy Katz, Clark Barrett, David Dill, Kyle

440 views • 25 slides

(Very) Brief Introduction to Neural Networks IITP-03 Algorithms for NLP 1 / 31 Learning

(Very) Brief Introduction to Neural Networks IITP-03 Algorithms for NLP 1 / 31 Learning objectives What are neural networks? What are deep neural networks? How do we train neural networks? What variants of neural network

331 views • 31 slides

Deep Learning with Neural Networks The Structure and Optimization of Deep Neural Networks Allan

Deep Learning with Neural Networks The Structure and Optimization of Deep Neural Networks Allan Zelener Machine Learning Reading Group January 7 th 2016 The Graduate Center, CUNY Objectives Explain some of the trends of deep learning and

680 views • 44 slides

Eyeriss v2: A Flexible Accelerator for Emerging Deep Neural Networks on Mobile Devices Authors:

Eyeriss v2: A Flexible Accelerator for Emerging Deep Neural Networks on Mobile Devices Authors: Yu-Hsin Chen, Tien-Ju Yang, Joel S. Emer, Vivienne Sze Presented by: Florian Mahlknecht Systems Group | | Florian Mahlknecht 2020-04-31 1 / 37

984 views • 45 slides

Introduction to Deep Neural Networks 0. Logistics Spring 2020 1 Neural Networks are taking

Introduction to Deep Neural Networks 0. Logistics Spring 2020 1 Neural Networks are taking over! Neural networks have become one of the major thrust areas recently in various pattern recognition, prediction, and analysis problems In

987 views • 40 slides

Visualizing and Interpreting Deep Neural Networks Bolei Zhou Department of Information

Visualizing and Interpreting Deep Neural Networks Bolei Zhou Department of Information Engineering The Chinese University of Hong Kong Deep Neural Networks are Everywhere Playing Go Making Medical Decision Understanding Scenes Deep Neural

1.1k views • 46 slides

On the Expressive Power of Deep Neural Networks Maithra Raghu, Ben Poole, Jon Kleinberg, Surya

On the Expressive Power of Deep Neural Networks Maithra Raghu, Ben Poole, Jon Kleinberg, Surya Ganguli, Jascha Sohl Dickstein Tom Brady Deep Neural Networks Recent successes in using Deep neural networks for image classification,

1.32k views • 17 slides

Outline Evolution of neurocomputing Artificial neural networks Feed forward

Introduction to Neural Networks and Deep Learning Ling Guan References: S. Haykin, Neural Networks , 2 nd Edition, New Jersey: Prentice Hall, 1. 2004. C. M. Bishop, Neural Networks for Pattern Re cognition, New York: 2. Oxford University

451 views • 17 slides

TRADING USING DEEP LEARNING MAN VS MACHINE Orders By Algorithms 84% Orders By Human 16%

TRADING USING DEEP LEARNING MAN VS MACHINE Orders By Algorithms 84% Orders By Human 16% TRADING USING DEEP LEARNING Artificial Neural Networks Neural networks are a family of models inspired by biological brain structure and are used to

690 views • 49 slides

Introduction to Artificial Intelligence Neural Networks - Deep Learning for NLP Janyl Jumadinova

Introduction to Artificial Intelligence Neural Networks - Deep Learning for NLP Janyl Jumadinova November 21, 2016 Neural Networks 2/20 Neural Networks 3/20 Neural Networks Neural computing requires a number of neurons , to be connected

813 views • 21 slides

Optimizing Deep Neural Networks Leena Chennuru Vankadara 26-10-2015 Table of Contents Neural

Optimizing Deep Neural Networks Leena Chennuru Vankadara 26-10-2015 Table of Contents Neural Networks and loss surfaces Problems of Deep Architectures Optimization in Neural Networks Under fitting Proliferation of Saddle

1.67k views • 41 slides

Deep Neural Networks and Molecular Dynamics Roberto Car Princeton University MAX Conference

Deep Neural Networks and Molecular Dynamics Roberto Car Princeton University MAX Conference ICTP, Trieste, Jan 29-31 2018 Deep Neural Networks When properly trained, deep NN are capable of learning the complex functional dependence of

442 views • 17 slides

CS7015 (Deep Learning) : Lecture 13 Visualizing Convolutional Neural Networks, Guided

CS7015 (Deep Learning) : Lecture 13 Visualizing Convolutional Neural Networks, Guided Backpropagation, Deep Dream, Deep Art, Fooling Convolutional Neural Networks Mitesh M. Khapra Department of Computer Science and Engineering Indian Institute

1.07k views • 72 slides

Deep Neural Networks and Deep Reinforcement Learning Deep Learning, Goodfellow, Bengio and

Deep Neural Networks and Deep Reinforcement Learning Deep Neural Networks and Deep Reinforcement Learning Deep Learning, Goodfellow, Bengio and Courville [chapt. 6,7,8]; AIMA [sect. 21.1-21.3]; Sutton and Barto, Reinforcement Learning: an

527 views • 35 slides

Propagating Error Backward Hyperparameters for Neural Networks } Multi-layer (deep) neural

Learning in Neural Networks w 1,3 w 3,5 1 3 5 w w 1,4 3,6 w w 2,3 4,5 2 4 6 w w 2,4 4,6 Class #18: Back-Propagation; } A neural network can learn a classification function by Tuning Hyper-Parameters adjusting its weights to

259 views • 4 slides

Deep Neural Networks Reveal a Gradient in the Complexity of Neural Representations across the

Deep Neural Networks Reveal a Gradient in the Complexity of Neural Representations across the Ventral Stream Umut Gcl and Marcel A. J. van Gerven Article overview by Ilya Kuzovkin Computational Neuroscience Seminar University of Tartu

852 views • 63 slides

Humble ISD First Nine Weeks Curriculum and Technology Updates for Elementary English Language

Humble ISD First Nine Weeks Curriculum and Technology Updates for Elementary English Language Arts and Reading July 1, 2015 Session Presenters Content Support Today s Session Presenters: Sherry Chapman(ELT) Chanelle

231 views • 20 slides

Pauls Preaching Pauls Journey to Rome Acts 27 Pauls Journey to Rome Acts 27 Paul

Pauls Preaching Pauls Journey to Rome Acts 27 Pauls Journey to Rome Acts 27 Paul would not travel to Rome alone. Luke was with him (vs. 1), as well as another Christian named Aristarchus (vs. 2; Colossians 4:10). Let us

507 views • 24 slides

Participants Lives: Early findings comparing baseline and 18 month narrative interviews Eric

Changes in At Home/Chez Soi Participants Lives: Early findings comparing baseline and 18 month narrative interviews Eric Macnaughton, Ph.D. Wilfrid Laurier University; emacnaug@telus.net Lauren Polvere, Ph.D. Douglas Mental Health

463 views • 5 slides

Test Oracles and Test Script Generation in Combinatorial Testing Peter M. Kruse Berner &

Test Oracles and Test Script Generation in Combinatorial Testing Peter M. Kruse Berner & Mattner Systemtechnik GmbH Berlin, Germany Overview Classification Tree Method Expected results Executable test scripts Test Oracles and

374 views • 25 slides

CS 466 Introduction to Bioinformatics Lecture 2 Mohammed El-Kebir August 30, 2019

CS 466 Introduction to Bioinformatics Lecture 2 Mohammed El-Kebir August 30, 2019 Document history: 9/5/2018: Fixed typo in Section 1.4, O (4 n /n ) should have been O (4 n / n ). 9/5/2018: Included analysis of naive fitting

266 views • 3 slides

Perceptrons Introduction: Neural Networks 1 The Perceptron 2 Using Perceptrons Perceptrons

Introduction: Neural Networks The Perceptron Multilayer Perceptrons Training MLPs Applying MLPs Introduction: Neural Networks The Perceptron Multilayer Perceptrons Training MLPs Applying MLPs Perceptrons Introduction: Neural Networks 1

761 views • 11 slides

Interpretability of Machine Learning for Computer Vision Xinshuo Weng* *Most slides borrowed

Interpretability of Machine Learning for Computer Vision Xinshuo Weng* *Most slides borrowed from CVPR 2018 tutorial and Stanford Type of interpretability methods Type of interpretability methods Type of interpretability methods Type of

392 views • 27 slides

The renormalization of the NN potential 1.1 Introduction First of all, it is worth to recall

Chapter 1 The renormalization of the NN potential 1.1 Introduction First of all, it is worth to recall some of the basic features of the nucleon-nucleon ( NN ) potential V NN , which can be inferred from the experimental data of the atomic

572 views • 31 slides