modeling with machine learning
play

modeling with machine learning Kelly Kochanski NCAR Multicore - PowerPoint PPT Presentation

Oct 01, 2023 •157 likes •654 views

Accelerating Earth and climate modeling with machine learning Kelly Kochanski NCAR Multicore Workshop 2019 2014 xkcd.com/1425/ What is machine learning? What is machine learning? Machine learning at its most basic is the practice of using

  1. Accelerating Earth and climate modeling with machine learning Kelly Kochanski NCAR Multicore Workshop 2019

  2. 2014 xkcd.com/1425/

  4. What is machine learning?

  5. What is machine learning? Machine learning at its most basic is the practice of using algorithms to parse data, learn from it, and then make a determination or prediction about something in the world. Michael Copeland 2016

  6. Why is machine learning relevant to Earth System Modeling now?

  7. Current trends 1/3 Machine learning offers solutions to once-intractable problems

  10. Model for Prediction Across Scales (2015), Los Alamos National Laboratory

  11. Current trends 2/3 New data streams increase the potential power of data-driven models

  12. Microprocessor trends Karl Rupp, World Economic Forum, 2018

  13. Microprocessor trends Karl Rupp, World Economic Forum, 2018

  14. 9,216 Power9 22-core CPUs 27,648 NVIDIA Tesla V100 GPUs

  15. nvidia.com

  16. Google TensorFlow Processing Units IBM TrueNorth Chips

  17. Current trends 3/3 Machine learning is driving innovation in HPC

  18. My perspective: Climate change impacts ML in service of earth science

  19. climatechange.ai

  20. How can we use machine learning to build better Earth System Models? Image: MPAS-Ocean Los Alamos National Lab

  21. How can we use machine learning to build better Earth System Models? Aims: ● To solve long-standing problems with new methods ● To integrate new sources of data into existing models ● To take advantage of new computing hardware

  22. Monitoring marine clouds Yuan, Tianle, et al. "Automatically Finding Ship ‐ tracks to Enable Large ‐ scale Analysis of Aerosol ‐ Cloud Interactions." Geophysical Research Letters (2019).

  23. Monitoring marine clouds Watson-Parris, Duncan, et al. "Detecting anthropogenic cloud perturbations with deep learning." International Conference on Machine Learning, 2019.

  24. Improving convection + aerosol modelling

  25. Improving convection + aerosol modelling

  26. Improving convection + aerosol modelling Gentine, Pierre, et al. "Could machine learning break the convection parameterization deadlock?." Geophysical Research Letters 45.11 (2018): 5742-5751.

  27. Improving convection + aerosol modelling Rasp, S, M. S. Pritchard, and P. Gentine. "Deep learning to represent subgrid processes in climate models." PNAS (2018)

  28. Tracking extreme events Kurth, Thorsten, et al. "Exascale deep learning for climate analytics." Proceedings of the International Conference for High Performance Computing, Networking, Storage, and Analysis . IEEE Press, 2018.

  29. Deep learning for spatio-temporal patterns Mathieu, Michael, Camille Couprie, and Yann LeCun. "Deep multi-scale video prediction beyond mean square error." (2016)

  30. Deep learning for spatio-temporal patterns Reedster, Mogle and Bogel, ‘Monitoring and analysis of sand dune movement and growth on the Navajo Nation, Southwestern United States’ (2011) USGS Fact Sheet 3085.

  31. Deep learning for spatio-temporal patterns Simulated example Generated frame(s)

  32. Barriers to implementation

  33. Barriers to implementation Machine learning Climate science What’s exciting? Big data! Science! Objectives Well-defined is useful. Broad is interesting. Explainability Second to prediction Often the main goal Data Ideally clean and labelled Many unlabeled features Data formats Images, csv, dataframes Images, netcdf, misc Data use Integral to model Data -> theory -> model Existing code Python, R, Julia C/C++, Fortran Publications At conferences In journals

  34. Removing barriers

  35. Building climate models that are ready to learn Schneider, T., et al. "Earth system modeling 2.0: A blueprint for models that learn from observations and targeted high ‐ resolution simulations." Geophysical Research Letters (2017)

  36. Barriers to implementation Machine learning Climate science What’s exciting? Big data! Science! Objectives Well-defined is useful. Broad is interesting. Explainability Second to prediction Often the main goal Data Ideally clean and labelled Many unlabeled features Data formats Images, csv, dataframes Images, netcdf, misc Data use Integral to model Data -> theory -> model Existing code Python, R, Julia C/C++, Fortran Publications At conferences In journals

  37. Creating benchmark datasets is-geo.org/benchmarks: JPL-CH4-detection-2017-V1.0 extremeweatherdataset.github.io

  38. Barriers to implementation Machine learning Climate science What’s exciting? Big data! Science! Objectives Well-defined is useful. Broad is interesting. Explainability Second to prediction Often the main goal Data Ideally clean and labelled Many unlabeled features Data formats Images, csv, dataframes Images, netcdf, misc Data use Integral to model Data -> theory -> model Existing code Python, R, Julia C/C++, Fortran Publications At conferences In journals

  39. Running machine-learning oriented workshops

  40. Barriers to implementation Machine learning Climate science What’s exciting? Big data! Science! Objectives Well-defined is useful. Broad is interesting. Explainability Second to prediction Often the main goal Data Ideally clean and labelled Many unlabeled features Data formats Images, csv, dataframes Images, netcdf, misc Data use Integral to model Data -> theory -> model Existing code Python, R, Julia C/C++, Fortran Publications At conferences In journals

  41. Next steps

  42. Learn more about machine learning Online courses ● coursera.org/learn/machine-learning Informational blogs ● towardsdatascience.com Python tutorials ● Scikit-learn: bit.ly/sklstrata, fastai: course.fast.ai

  43. Learn more about machine learning for Earth, weather, and climate science ● McGovern, Amy, et al. Bulletin of the American Meteorological Society 98.10 (2017): 2073-2090. Using artificial intelligence to improve real-time decision-making for high-impact weather . ● Reichstein, Markus, et al. Nature 566.7743 (2019): 195. Deep learning and process understanding for data-driven Earth system science . ● Karpatne, Anuj, et al. IEEE Transactions on Knowledge and Data Engineering (2018). Machine learning for the geosciences : Challenges and opportunities. ● Gil, Y., Pierce, S. A., ... & Horel, J. (2018). Communications of the ACM , 62 (1), 76-84. Intelligent systems for geosciences : an essential research agenda. ● Rolnick, D., Donti, P., Kaack, L., Kochanski, K., et al. arXiv preprint arXiv:1906.05433 (2019). Tackling climate change with machine learning

  44. Make connections Climate Change AI climatechange.ai

  45. Make connections Climate Change AI climatechange.ai Climate Informatics climateinformatics.org

  46. Make connections _IS-GEO__ Climate Change AI Intelligent Systems and climatechange.ai Geosciences is-geo.org Climate Informatics climateinformatics.org

  47. Make connections _IS-GEO__ Climate Change AI Intelligent Systems and climatechange.ai Geosciences is-geo.org Climate Informatics AMS Committee on AI climateinformatics.org for Env. Science

  48. Thanks Greg Tucker, David Rolnick, Ghaleb Abdulla, Divya Mohan, Jenna Horrall, Priya Donti, Surya Karthik Mukkavilli, Barry Rountree, Goodwin Gibbons

  49. Questions?

Download Presentation
Download Policy: The content available on the website is offered to you 'AS IS' for your personal information and use only. It cannot be commercialized, licensed, or distributed on other websites without prior consent from the author. To download a presentation, simply click this link. If you encounter any difficulties during the download process, it's possible that the publisher has removed the file from their server.

Recommend

Machine Learning Modeling and Learning 15-110 Monday 4/13 Learning Goals Given a

Machine Learning Modeling and Learning 15-110 Monday 4/13 Learning Goals Given a

Machine Learning Modeling and Learning 15-110 Monday 4/13 Learning Goals Given a dataset, identify features which may help predict information about the data Identify common types of machine learning algorithms 2 Machine

553 views • 27 slides
Neural Networks for Machine Learning Lecture 7a Modeling sequences: A brief overview Geoffrey

Neural Networks for Machine Learning Lecture 7a Modeling sequences: A brief overview Geoffrey

Neural Networks for Machine Learning Lecture 7a Modeling sequences: A brief overview Geoffrey Hinton Nitish Srivastava, Kevin Swersky Tijmen Tieleman Abdel-rahman Mohamed Getting targets when modeling sequences When applying machine

719 views • 34 slides
STAT 339 Probabilistic Modeling and Machine Learning 30 January 2017 Colin Reimer Dawson

STAT 339 Probabilistic Modeling and Machine Learning 30 January 2017 Colin Reimer Dawson

STAT 339 Probabilistic Modeling and Machine Learning 30 January 2017 Colin Reimer Dawson Outline Data Science and Machine Learning Types of Learning Supervised Learning Unsupervised Learning Discovering Model Complexity Course Outline

239 views • 22 slides
Welcome to the Machine Learning Toolbox! Machine Learning Toolbox Supervised learning caret

Welcome to the Machine Learning Toolbox! Machine Learning Toolbox Supervised learning caret

MACHINE LEARNING TOOLBOX Welcome to the Machine Learning Toolbox! Machine Learning Toolbox Supervised learning caret R package Automates supervised learning (a.k.a. predictive modeling ) Target variable Machine Learning Toolbox

634 views • 16 slides
Machine Learning for Healthcare HST.956, 6.S897 Lecture 19: Disease progression modeling &

Machine Learning for Healthcare HST.956, 6.S897 Lecture 19: Disease progression modeling &

Machine Learning for Healthcare HST.956, 6.S897 Lecture 19: Disease progression modeling & subtyping, Part 2 David Sontag Recap of goals of disease progression modeling Predictive: What will this patients future trajectory look

1.56k views • 51 slides
Machine Learning 2 DS 4420 - Spring 2020 Topic Modeling 2 Byron C. Wallace Last time: Topic

Machine Learning 2 DS 4420 - Spring 2020 Topic Modeling 2 Byron C. Wallace Last time: Topic

Machine Learning 2 DS 4420 - Spring 2020 Topic Modeling 2 Byron C. Wallace Last time: Topic Modeling! Word Mixtures Idea: Model text as a mixture over words (ignore order) gene 0.04 dna 0.02 genetic 0.01 .,, life 0.02

890 views • 37 slides
THE NEXT EVOLUTION OF MDE: a Seamless Integration of Machine Learning into Domain Modeling Thomas

THE NEXT EVOLUTION OF MDE: a Seamless Integration of Machine Learning into Domain Modeling Thomas

THE NEXT EVOLUTION OF MDE: a Seamless Integration of Machine Learning into Domain Modeling Thomas Hartmann*, Assaad Moawad+, Fouquet Franois* and Yves le Traon* (*) Interdisciplinary Centre for Security, Reliability and Trust University of

438 views • 32 slides
machine learning classification algorithms & Topic Modeling A quick look at 145,000 World

machine learning classification algorithms & Topic Modeling A quick look at 145,000 World

An empirical comparison of machine learning classification algorithms & Topic Modeling A quick look at 145,000 World Bank documents Olivier Dupriez, Development Data Group Slides prepared for DEC Policy Research Talk, February 27, 2018

739 views • 43 slides
An Exercise in An Exercise in Machine Learning Machine Learning

An Exercise in An Exercise in Machine Learning Machine Learning

An Exercise in An Exercise in Machine Learning Machine Learning http://www.cs.iastate.edu/~cs573x/bbsilab.html Machine Learning Software Preparing Data Building Classifiers Interpreting Results Machine Learning Software

496 views • 26 slides
Using machine learning Learning knot methods in geometric modeling placement SVM knot placement

Using machine learning Learning knot methods in geometric modeling placement SVM knot placement

Machine learning in geometric modeling Georg Umlauf Using machine learning Learning knot methods in geometric modeling placement SVM knot placement for curves SVM knot placement for skinning Georg Umlauf Learning primitive

825 views • 38 slides
Machine Learning By Alex Scarlatos What is Machine Learning? Machine Learning is the process by

Machine Learning By Alex Scarlatos What is Machine Learning? Machine Learning is the process by

Machine Learning By Alex Scarlatos What is Machine Learning? Machine Learning is the process by which computers can be trained through observation, rather than being explicitly programmed. Basically, a program is given input and adjusts its

556 views • 17 slides
Machine Learning: Study of algorithms that improve their performance P at some task T

Machine Learning: Study of algorithms that improve their performance P at some task T

Machine Learning 10-601 Tom M. Mitchell Machine Learning Department Carnegie Mellon University January 12, 2015 Today: Readings: What is machine learning? The Discipline of ML Decision tree learning Mitchell, Chapter 3

872 views • 29 slides
Traditional Machine Learning: Unsupervised Learning Juhan Nam Traditional Machine Learning

Traditional Machine Learning: Unsupervised Learning Juhan Nam Traditional Machine Learning

GCT634/AI613: Musical Applications of Machine Learning (Fall 2020) Traditional Machine Learning: Unsupervised Learning Juhan Nam Traditional Machine Learning Pipeline in Classification Tasks A set of hand-designed audio features are selected

398 views • 26 slides
Towards Better Crash Frequency Modeling: Fusing Machine Learning & Econometric Methods

Towards Better Crash Frequency Modeling: Fusing Machine Learning & Econometric Methods

Towards Better Crash Frequency Modeling: Fusing Machine Learning & Econometric Methods Presenter: Behram Wali Ph.D. Student TSITE 2017 Summer Meeting Morning Session July 26, 2017 Contents Background/Challenges Conceptual

693 views • 44 slides
Interactive Machine Learning via Transparent Modeling: Putting Human Experts in the Drivers

Interactive Machine Learning via Transparent Modeling: Putting Human Experts in the Drivers

Interactive Machine Learning via Transparent Modeling: Putting Human Experts in the Drivers Seat Rich Caruana Microsoft Research Joint Work with Sarah Tan & Yin Lou Johannes Gehrke, Paul Koch, Marc Sturm, Noemie Elhadad Thanks to Greg

842 views • 82 slides
Physical Modeling meets Machine Learning: Teaching Bow Control to a Virtual Violinist Graham

Physical Modeling meets Machine Learning: Teaching Bow Control to a Virtual Violinist Graham

Physical Modeling meets Machine Learning: Teaching Bow Control to a Virtual Violinist Physical Modeling meets Machine Learning: Teaching Bow Control to a Virtual Violinist Graham Percival , Nicholas Bailey , George Tzanetakis

1.12k views • 26 slides
BOT/CBOC Special Joint Meeting Capital Facilities Financing Plan Karen Michel, Chief Financial

BOT/CBOC Special Joint Meeting Capital Facilities Financing Plan Karen Michel, Chief Financial

BOT/CBOC Special Joint Meeting Capital Facilities Financing Plan Karen Michel, Chief Financial Officer Tom Calhoun, Chief Facilities Executive Paul Woods, Director of Planning and Construction January 12, 2015 . Providing Facilities for Our

872 views • 45 slides
The Vision The Structure The Future US Club Soccers 10 -Year Vision US Club Soccers 10

The Vision The Structure The Future US Club Soccers 10 -Year Vision US Club Soccers 10

The Vision The Structure The Future US Club Soccers 10 -Year Vision US Club Soccers 10 -Year Vision Statement articulates, among others, the following principles: Clubs and their leadership should be the primary decision-makers in the

217 views • 17 slides
9 th Annual Health & Housing Convening December 5, 2019 Lehman College, Music Building East

9 th Annual Health & Housing Convening December 5, 2019 Lehman College, Music Building East

9 th Annual Health & Housing Convening December 5, 2019 Lehman College, Music Building East Dining Room Thank you to our Sponsors! Board of Directors Megan Fogarty, President Scott Auwarter, Vice President Jim Mutton, Secretary Joe

210 views • 19 slides
C OMBINING OLD SCHOOL McCarter & English, LLP Managing ences and understanding what

C OMBINING OLD SCHOOL McCarter & English, LLP Managing ences and understanding what

LAW Annual Law Firm Managing Partners Roundtable: Recruiting, Mentoring and Managing Millennials Creativity is allowing New Jerseys top law firms to assimilate Millennials into their complicated cultures. All generations learn and are

403 views • 6 slides
An unequal world: class, leisure and health outcomes in older people Pauline McGovern * &

An unequal world: class, leisure and health outcomes in older people Pauline McGovern * &

An unequal world: class, leisure and health outcomes in older people Pauline McGovern * & James Nazroo, University of Manchester, * pauline.mcgovern@manchester.ac.uk Associations between occupational class and health Work Occupational

86 views • 5 slides
Users Guide for Integrated Stormwater and Wastewater Planning Tuesday, February 20, 2018 1:00

Users Guide for Integrated Stormwater and Wastewater Planning Tuesday, February 20, 2018 1:00

2/16/2018 Users Guide for Integrated Stormwater and Wastewater Planning Tuesday, February 20, 2018 1:00 2:30 pm ET How to Participate Today Audio Modes Listen using Mic & Speakers Or, select Use Telephone and dial the

768 views • 40 slides
COVENTRY & WARWICKSHIRE LOCAL ENTERPRISE PARTNERSHIP Governance Delivery - Strategy

COVENTRY & WARWICKSHIRE LOCAL ENTERPRISE PARTNERSHIP Governance Delivery - Strategy

COVENTRY & WARWICKSHIRE LOCAL ENTERPRISE PARTNERSHIP Governance Delivery - Strategy Sarah Windrum Board Director, CWLEP ABOUT THE LEP Coventry & Warwickshires aspiration is to become a high growth economy and global hub for

368 views • 13 slides
Mixed-Finance Development Programs Converting and Preserving Public Housing Through Public-Private

Mixed-Finance Development Programs Converting and Preserving Public Housing Through Public-Private

Presenting a live 90-minute webinar with interactive Q&A Leveraging Affordable Housing HUD Financing: RAD and Other Mixed-Finance Development Programs Converting and Preserving Public Housing Through Public-Private Partnerships THURSDAY,

775 views • 74 slides

More recommend