deep learning a brief overview on the possibility for
play

Deep Learning: a brief overview on the possibility for astrophysics - PowerPoint PPT Presentation

Feb 25, 2023 •120 likes •461 views

Deep Learning: a brief overview on the possibility for astrophysics Fran cois-Xavier Dup e (LIS/Aix-Marseille Universit e, France) Journ ee SKA @ LAM Introduction What is Machine Learning? The aim of Machine Learning is to build a

  1. Deep Learning: a brief overview on the possibility for astrophysics Fran¸ cois-Xavier Dup´ e (LIS/Aix-Marseille Universit´ e, France) Journ´ ee SKA @ LAM

  2. Introduction What is Machine Learning? The aim of Machine Learning is to build a mathematical function which solve a human task. F.-X. Dup´ e (AMU) Deep learning: an overview 16 May 2018 2 / 25

  3. Introduction What is Machine Learning? The aim of Machine Learning is to build a mathematical function which solve a human task. Today tasks include classification/regression; representation (or feature) learning; transfert learning; reinforcement learning; . . . F.-X. Dup´ e (AMU) Deep learning: an overview 16 May 2018 2 / 25

  4. Introduction Some history about Machine Learning 1956: the Dartmouth workshop Proposal We propose that a 2 month, 10 man study of artificial intelligence be carried out during the summer of 1956 at Dartmouth College in Hanover, New Hampshire. The study is to proceed on the basis of the conjecture that every aspect of learning or any other feature of intelligence can in principle be so precisely described that a machine can be made to simulate it. An attempt will be made to find how to make machines use language, form abstractions and concepts, solve kinds of problems now reserved for humans, and improve themselves. We think that a significant advance can be made in one or more of these problems if a carefully selected group of scientists work on it together for a summer. F.-X. Dup´ e (AMU) Deep learning: an overview 16 May 2018 3 / 25

  5. Introduction Some history about Machine Learning (2) F.-X. Dup´ e (AMU) Deep learning: an overview 16 May 2018 4 / 25

  6. Introduction A brief timeline from Andrew L. Beam F.-X. Dup´ e (AMU) Deep learning: an overview 16 May 2018 5 / 25

  7. Introduction Today’s talk 1 Deep learning 2 Interactions with astrophysics 3 What next? F.-X. Dup´ e (AMU) Deep learning: an overview 16 May 2018 6 / 25

  8. Deep learning Today’s talk 1 Deep learning 2 Interactions with astrophysics 3 What next? F.-X. Dup´ e (AMU) Deep learning: an overview 16 May 2018 7 / 25

  9. Deep learning What is it? F.-X. Dup´ e (AMU) Deep learning: an overview 16 May 2018 8 / 25

  10. Deep learning What is it? Deep learning ⇒ hierarchical learning with high order features. F.-X. Dup´ e (AMU) Deep learning: an overview 16 May 2018 8 / 25

  11. Deep learning The location of deep learning From https://www.machinecurve.com/index.php/2017/09/30/ the-differences-between-artificial-intelligence-machine-learning-more/ F.-X. Dup´ e (AMU) Deep learning: an overview 16 May 2018 9 / 25

  12. Deep learning The zoo From http://www.asimovinstitute.org/neural-network-zoo/ F.-X. Dup´ e (AMU) Deep learning: an overview 16 May 2018 10 / 25

  13. Deep learning AlexNet ImageNet Classification with Deep Convolutional Neural Networks by A. Krizhevsky et al (NIPS 2012) F.-X. Dup´ e (AMU) Deep learning: an overview 16 May 2018 11 / 25

  14. Deep learning AlexNet (results) F.-X. Dup´ e (AMU) Deep learning: an overview 16 May 2018 12 / 25

  15. Deep learning Long Short-Time Memory (LSTM) Example of a recurrent neural network. From http://colah.github.io/posts/2015-08-Understanding-LSTMs/ F.-X. Dup´ e (AMU) Deep learning: an overview 16 May 2018 13 / 25

  16. Deep learning Long Short-Time Memory (LSTM): details Input gate : encode the input data. Output gate : create the next output (from the input). Forget gate : remove information from input data. Block input : output data from another block. F.-X. Dup´ e (AMU) Deep learning: an overview 16 May 2018 14 / 25

  17. Deep learning Generative Adversarial Networks (GAN) Idea: building a generator that can fool a discriminator Generator : a NN that produce new data from noise . Discriminator : a classifier which distinguish fake data from true. A set of real samples. Generative adversarial nets by I. Goodfellow et al (NIPS 2014) F.-X. Dup´ e (AMU) Deep learning: an overview 16 May 2018 15 / 25

  18. Deep learning Generative Adversarial Networks (GAN): some results From https://adeshpande3.github.io/Deep-Learning-Research-Review-Week-1-Generative-Adversarial-Nets F.-X. Dup´ e (AMU) Deep learning: an overview 16 May 2018 16 / 25

  19. Interactions with astrophysics Today’s talk 1 Deep learning 2 Interactions with astrophysics 3 What next? F.-X. Dup´ e (AMU) Deep learning: an overview 16 May 2018 17 / 25

  20. Interactions with astrophysics Some examples Star-galaxy Classification Using Deep Convolutional Neural Networks by Edward J. Kim Robert J. Brunner (MNRAS 2016) Idea: Use ConvNet on the reduced calibrated pixel values. F.-X. Dup´ e (AMU) Deep learning: an overview 16 May 2018 18 / 25

  21. Interactions with astrophysics Some examples Star-galaxy Classification Using Deep Convolutional Neural Networks by Edward J. Kim Robert J. Brunner (MNRAS 2016) Idea: Use ConvNet on the reduced calibrated pixel values. F.-X. Dup´ e (AMU) Deep learning: an overview 16 May 2018 18 / 25

  22. Interactions with astrophysics Some examples (2) Fast Cosmic Web Simulations with Generative Adversarial Networks by A.C. Rodr´ ıguez et al ( arXiv:1801.09070 ) Idea: use deep learning to avoid the computational cost of N-body simulation. F.-X. Dup´ e (AMU) Deep learning: an overview 16 May 2018 19 / 25

  23. Interactions with astrophysics Some examples (2) Fast Cosmic Web Simulations with Generative Adversarial Networks by A.C. Rodr´ ıguez et al ( arXiv:1801.09070 ) Idea: use deep learning to avoid the computational cost of N-body simulation. F.-X. Dup´ e (AMU) Deep learning: an overview 16 May 2018 19 / 25

  24. Interactions with astrophysics Some other examples from arXiv Deep learning for studies of galaxy morphology ( arXiv:1701.05917 ) Detecting Solar-like Oscillations in Red Giants with Deep Learning ( arXiv:1804.07495 ) Lunar Crater Identification via Deep Learning ( arXiv:1803.02192 ) Deep learning from 21-cm images of the Cosmic Dawn ( arXiv:1805.02699 ) Fast Point Spread Function Modeling with Deep Learning ( arXiv:1801.07615 ) F.-X. Dup´ e (AMU) Deep learning: an overview 16 May 2018 20 / 25

  25. What next? Today’s talk 1 Deep learning 2 Interactions with astrophysics 3 What next? F.-X. Dup´ e (AMU) Deep learning: an overview 16 May 2018 21 / 25

  26. What next? Explainable Machine Learning Deep learning a black-box? Source: Department of Defense, Advanced Research Projects Agency. F.-X. Dup´ e (AMU) Deep learning: an overview 16 May 2018 22 / 25

  27. What next? Evaluation One of the open question in Machine Learning: how to fully evaluate a method? F.-X. Dup´ e (AMU) Deep learning: an overview 16 May 2018 23 / 25

  28. What next? Evaluation One of the open question in Machine Learning: how to fully evaluate a method? No free lunch theorem (Wolpert and Macready 1997) which ”states that any two optimization algorithms are equivalent when their performance is averaged across all possible problems”. F.-X. Dup´ e (AMU) Deep learning: an overview 16 May 2018 23 / 25

  29. What next? Evaluation One of the open question in Machine Learning: how to fully evaluate a method? No free lunch theorem (Wolpert and Macready 1997) which ”states that any two optimization algorithms are equivalent when their performance is averaged across all possible problems”. Ugly Duckling theorem (Watanabe 1969) which states that perfect classification is impossible without some sort of bias. By OswaldLR - From: A Corny Concerto (2).png, Public Domain F.-X. Dup´ e (AMU) Deep learning: an overview 16 May 2018 23 / 25

  30. Conclusion Take away message Evaluation is primordial! Must be coherent with the task. F.-X. Dup´ e (AMU) Deep learning: an overview 16 May 2018 24 / 25

  31. Conclusion Take away message Evaluation is primordial! Must be coherent with the task. Learning representation is a way to avoid some bias. F.-X. Dup´ e (AMU) Deep learning: an overview 16 May 2018 24 / 25

  32. Conclusion Take away message Evaluation is primordial! Must be coherent with the task. Learning representation is a way to avoid some bias. Deep learning asks for big datasets, but scale very well. F.-X. Dup´ e (AMU) Deep learning: an overview 16 May 2018 24 / 25

  33. Conclusion Take away message Evaluation is primordial! Must be coherent with the task. Learning representation is a way to avoid some bias. Deep learning asks for big datasets, but scale very well. There is no free lunch! F.-X. Dup´ e (AMU) Deep learning: an overview 16 May 2018 24 / 25

  34. Conclusion Thank you for your attention. Any questions? F.-X. Dup´ e (AMU) Deep learning: an overview 16 May 2018 25 / 25

Download Presentation
Download Policy: The content available on the website is offered to you 'AS IS' for your personal information and use only. It cannot be commercialized, licensed, or distributed on other websites without prior consent from the author. To download a presentation, simply click this link. If you encounter any difficulties during the download process, it's possible that the publisher has removed the file from their server.

Recommend

Hao Su July 6, 2017 Outline Overview of 3D deep learning 3D deep learning algorithms

Hao Su July 6, 2017 Outline Overview of 3D deep learning 3D deep learning algorithms

Deep 3D Representation Learning for Visual Computing Hao Su July 6, 2017 Outline Overview of 3D deep learning 3D deep learning algorithms Conclusion 2 Outline Overview of 3D deep learning Background 3D deep learning tasks 3D deep

1.66k views • 122 slides
An Overview of Deep Residual Learning Semih Yagcioglu 01.03.2016 Deep Residual Learning

An Overview of Deep Residual Learning Semih Yagcioglu 01.03.2016 Deep Residual Learning

An Overview of Deep Residual Learning Semih Yagcioglu 01.03.2016 Deep Residual Learning Microsoft Research Asia (MSRA) Kaiming He, Xiangyu Zhang, Shaoqing Ren, & Jian Sun. Deep Residual Learning for Image Recognition. arXiv

1.32k views • 54 slides
Deep Learning: From Theory to Algorithm Outline: 1. Overview of

Deep Learning: From Theory to Algorithm Outline: 1. Overview of

Deep Learning: From Theory to Algorithm Outline: 1. Overview of theoretical studies of deep learning 2. Optimization theory of deep neural networks 1) Gradient finds global optima 2) Gram-Gauss-Newton Algorithm

484 views • 31 slides
Course Information CS 6956: Deep Learning for NLP What we will see A general overview of

Course Information CS 6956: Deep Learning for NLP What we will see A general overview of

Course Information CS 6956: Deep Learning for NLP What we will see A general overview of underlying concepts that pervade deep learning for NLP tasks A collection of successful design ideas to handle sparse, compositional varying sized

146 views • 10 slides
Think Deep Learning: Overview Ju Sun Computer Science & Engineering University of Minnesota,

Think Deep Learning: Overview Ju Sun Computer Science & Engineering University of Minnesota,

Think Deep Learning: Overview Ju Sun Computer Science & Engineering University of Minnesota, Twin Cities January 21, 2020 1 / 28 Outline Why deep learning? Why first principles? Our topics Course logistics 2 / 28 What is Deep

1.54k views • 67 slides
Deep Learning for NLP Kiran Vodrahalli Feb 11, 2015 Overview What is NLP? Natural

Deep Learning for NLP Kiran Vodrahalli Feb 11, 2015 Overview What is NLP? Natural

Deep Learning for NLP Kiran Vodrahalli Feb 11, 2015 Overview What is NLP? Natural Language Processing We try to extract meaning from text: sentiment, word sense, semantic similarity, etc. How does Deep Learning relate? NLP

2.02k views • 124 slides
ACCELERATE DEEP LEARNING WITH NVIDIA'S DEEP LEARNING PLATFORM | STEPHEN JONES | GTC16 DEEP

ACCELERATE DEEP LEARNING WITH NVIDIA'S DEEP LEARNING PLATFORM | STEPHEN JONES | GTC16 DEEP

ACCELERATE DEEP LEARNING WITH NVIDIA'S DEEP LEARNING PLATFORM | STEPHEN JONES | GTC16 DEEP LEARNING EVERYWHERE INTERNET & CLOUD MEDICINE & BIOLOGY MEDIA & ENTERTAINMENT SECURITY & DEFENSE AUTONOMOUS MACHINES Image

307 views • 26 slides
Deep Learning Tutorial Part II Greg Shakhnarovich TTI-Chicago December 2016 Deep Learning

Deep Learning Tutorial Part II Greg Shakhnarovich TTI-Chicago December 2016 Deep Learning

Deep Learning Tutorial Part II Greg Shakhnarovich TTI-Chicago December 2016 Deep Learning Tutorial,Part II 1 Overview Goals of the tutorial Somewhat organized overview of basics, and some more advanced topics Demistify jargon Pointers

925 views • 63 slides
Deep Learning Tutorial Part I Greg Shakhnarovich TTI-Chicago December 2016 Deep Learning

Deep Learning Tutorial Part I Greg Shakhnarovich TTI-Chicago December 2016 Deep Learning

Deep Learning Tutorial Part I Greg Shakhnarovich TTI-Chicago December 2016 Deep Learning Tutorial,Part I 1 Overview Goals of the tutorial Somewhat organized overview of basics, and some more advanced topics Demistify jargon Pointers for

1.25k views • 105 slides
Deep Learning on GPUs March 2016 What is Deep Learning? GPUs and DL AGENDA DL in practice

Deep Learning on GPUs March 2016 What is Deep Learning? GPUs and DL AGENDA DL in practice

Deep Learning on GPUs March 2016 What is Deep Learning? GPUs and DL AGENDA DL in practice Scaling up DL 2 What is Deep Learning? 3 DEEP LEARNING EVERYWHERE INTERNET & CLOUD MEDICINE & BIOLOGY SECURITY & DEFENSE MEDIA &

1.45k views • 39 slides
9.1 Overview 9 Deep Learning Alexander Smola Introduction to Machine Learning 10-701

9.1 Overview 9 Deep Learning Alexander Smola Introduction to Machine Learning 10-701

9.1 Overview 9 Deep Learning Alexander Smola Introduction to Machine Learning 10-701 http://alex.smola.org/teaching/10-701-15 A brief history of computers 1970s 1980s 1990s 2000s 2010s Data 10 5 10 8 10 2 10 3 10 11 RAM ? 1MB 100MB

932 views • 57 slides
Smelling Source Code Using Deep Learning Tushar Sharma http://www.tusharma.in What is a smell?

Smelling Source Code Using Deep Learning Tushar Sharma http://www.tusharma.in What is a smell?

Smelling Source Code Using Deep Learning Tushar Sharma http://www.tusharma.in What is a smell? certain structures in the code that suggest (sometimes they scream for) the possibility of refactoring . - Kent Beck 20 Definitions of smells:

766 views • 35 slides
Reproducibility and Replicability in Deep Reinforcement Learning (and Other Deep Learning

Reproducibility and Replicability in Deep Reinforcement Learning (and Other Deep Learning

Reproducibility and Replicability in Deep Reinforcement Learning (and Other Deep Learning Methods) Peter Henderson Statistical Society of Canada Annual Meeting 2018 Contributors Riashat Islam Phil Bachman Doina Precup David Meger Joelle

850 views • 37 slides
Distributed DeepLearning at Scale Soumith Chintala Facebook AI Research Overview Deep

Distributed DeepLearning at Scale Soumith Chintala Facebook AI Research Overview Deep

Distributed DeepLearning at Scale Soumith Chintala Facebook AI Research Overview Deep Learning Research at FAIR Deep Learning on GPUs Deep Learning at scale Emerging Trends Deep Learning Research at Facebook AI Research Image

1.18k views • 50 slides
Image Classification with DIGITS NVIDIA Deep Learning Institute 1 DEEP LEARNING INSTITUTE DLI

Image Classification with DIGITS NVIDIA Deep Learning Institute 1 DEEP LEARNING INSTITUTE DLI

Image Classification with DIGITS NVIDIA Deep Learning Institute 1 DEEP LEARNING INSTITUTE DLI Mission Helping people solve challenging problems using AI and deep learning. Developers, data scientists and engineers Self-driving cars,

1.44k views • 72 slides
Deep Neural Networks and Deep Reinforcement Learning Deep Learning, Goodfellow, Bengio and

Deep Neural Networks and Deep Reinforcement Learning Deep Learning, Goodfellow, Bengio and

Deep Neural Networks and Deep Reinforcement Learning Deep Neural Networks and Deep Reinforcement Learning Deep Learning, Goodfellow, Bengio and Courville [chapt. 6,7,8]; AIMA [sect. 21.1-21.3]; Sutton and Barto, Reinforcement Learning: an

527 views • 35 slides
The SPE Foundation through member donations and a contribution from Offshore Europe The Society

The SPE Foundation through member donations and a contribution from Offshore Europe The Society

Primary funding is provided by The SPE Foundation through member donations and a contribution from Offshore Europe The Society is grateful to those companies that allow their professionals to serve as lecturers Additional support provided by

830 views • 80 slides
AD ADOT T TA TAC MEETI TING NG # #3 28 TH TH , 201 JUNE NE 28 2016 Agenda Introductions

AD ADOT T TA TAC MEETI TING NG # #3 28 TH TH , 201 JUNE NE 28 2016 Agenda Introductions

AD ADOT T TA TAC MEETI TING NG # #3 28 TH TH , 201 JUNE NE 28 2016 Agenda Introductions Update on Project Progress Scenario Analysis Dry Run Wrap-up/Next Steps Update Goals, Objectives, and Performance Measures Mod odifi

210 views • 17 slides
Student Success Strategies for Distance Learners Presented by Vince Rodriguez, Jorge Sanchez,

Student Success Strategies for Distance Learners Presented by Vince Rodriguez, Jorge Sanchez,

Student Success Strategies for Distance Learners Presented by Vince Rodriguez, Jorge Sanchez, and Bob Nash Tomorrows College Today. 1998-99 DL Enrollments = 12,513 2002-03 DL Enrollments = 20,405 Television Television 48% 77% Cable 3%

402 views • 19 slides
Second Quarter Fiscal 2012 Results Presentation May 17, 2012 Safe Harbor Statement This

Second Quarter Fiscal 2012 Results Presentation May 17, 2012 Safe Harbor Statement This

Second Quarter Fiscal 2012 Results Presentation May 17, 2012 Safe Harbor Statement This presentation contains forward-looking statements. These statements are made under the safe harbor provisions of the U.S. Private Securities Litigation

442 views • 20 slides
DIVS DL/ID Verification Systems Verification of Legal Status DIVS Passport Verification

DIVS DL/ID Verification Systems Verification of Legal Status DIVS Passport Verification

DIVS DL/ID Verification Systems Verification of Legal Status DIVS Passport Verification Projects Birth Record Verification State to State Verification DIVS State to State Verification Service (S2S) Program Benefits Mission

349 views • 8 slides
Academic Improvement Plan Richmond Public Schools January 2015 RPS Proposed Academic

Academic Improvement Plan Richmond Public Schools January 2015 RPS Proposed Academic

Proposed Richmond Public Schools Academic Improvement Plan Richmond Public Schools January 2015 RPS Proposed Academic Improvement Plan (AIP) Pu Purpose se To establish a multi-year, comprehensive plan designed to facilitate the

441 views • 26 slides
CLPPP Guidelines for Children with BLL of > or = 40mcg/dl Karen Lishinski, RN MA Nurse

CLPPP Guidelines for Children with BLL of > or = 40mcg/dl Karen Lishinski, RN MA Nurse

Chelation Therapy: CLPPP Guidelines for Children with BLL of > or = 40mcg/dl Karen Lishinski, RN MA Nurse Consultant Childhood Lead Poisoning Prevention Program Public Health Code 333.5474 Establishes a lead poisoning prevention

481 views • 8 slides
Consumer motivations and behaviours for fruit and i i d b h i f f i d fruit products in

Consumer motivations and behaviours for fruit and i i d b h i f f i d fruit products in

Consumer motivations and behaviours for fruit and i i d b h i f f i d fruit products in the Balkans Sie t Sijtse ma Ha rri tte Snoe k Sie t Sijtse ma , Ha rri tte Snoe k Ha na Ba ronija n, Cristina Mora , Isa be lla va n de n Be

510 views • 15 slides

More recommend