A Machine Learning Pipeline for Drought Prediction Tommy Lees , - PowerPoint PPT Presentation

Aug 30, 2023 •164 likes •291 views

A Machine Learning Pipeline for Drought Prediction Tommy Lees , Gabriel Tseng , Alex Hernandez-Garcia, Clement Atzberger, Simon Dadson, Steven Reece @tommylees112, @gabrieltseng tommylees112, gabrieltseng Agricultural drought is a significant

A Machine Learning Pipeline for Drought Prediction Tommy Lees , Gabriel Tseng , Alex Hernandez-Garcia, Clement Atzberger, Simon Dadson, Steven Reece @tommylees112, @gabrieltseng tommylees112, gabrieltseng
Agricultural drought is a significant global problem, and is getting worse. $29 billion in losses to developing world agriculture between 2005 and 2015
Kenya distributes emergency funds using a vegetation index, mitigating the impact of droughts.
We sought a machine-learning based approach to forecast vegetation health. “Information on certain parameters is not only difficult to access … [we also] lack understanding of the different physical processes. This has led to the widespread use and development of data-driven models over process- based models ” Anshuka et. al. 2019
There is friction in applying machine learning to drought forecasting Going from climate data formats (e.g. NetCDF) A very large input space (above: ERA5 land and storage conventions to something which a variables from the Copernicus Climate Data machine learning model can ingest Store)
Our pipeline* aimed to reduce this friction Turn it into machine learning-ready data Plug and play machine Dataset selection and integration learning models *https://github.com/ml-clim/drought-prediction
We used it with the following datasets and models: Copernicus Climate Data Store ERA5 Climate Reanalysis data Persistence Baseline Linear Regression Climate Hazards Group InfraRed Precipitation data (CHIRPS) Linear Neural Network LSTM Global Land Evaporation Amsterdam Model Entity-Aware LSTM Evapotranspiration and Soil Moisture CGIAR-CSI Shuttle Radar Topography Mission Data
Using this pipeline, we were able to achieve results competitive with SOTA to predict vegetation health in Kenya. * * Our predictions are much more spatially granular (pixel wise vs. district wide) than the current SOTA. In order to make models comparable we downscale our predictions to district-level and compare results at this scale. Here we show a table of results for four arid counties in the North of Kenya.
We have started using trained models to investigate the relationships between vegetation health and weather. Lake Turkana
This is how our models need to improve to become operationally useful.
https://github.com/ml-clim/drought-prediction

Download Presentation

Download Policy: The content available on the website is offered to you 'AS IS' for your personal information and use only. It cannot be commercialized, licensed, or distributed on other websites without prior consent from the author. To download a presentation, simply click this link. If you encounter any difficulties during the download process, it's possible that the publisher has removed the file from their server.

Recommend

1 Dont Make Me Get Non -Linear! A Grounding Example: Linear Regression Predict

What is Machine Learning? A (Very Short) List of Applications Many different forms of Machine Learning Machine learning widely used in many contexts We focus on the problem of prediction Stock price prediction o Using economic

262 views • 3 slides

Machine Learning pipeline wit ith R Contributions to whiteboxing machine learning for

Towards an Enterprise grade Machine Learning pipeline wit ith R Contributions to whiteboxing machine learning for interoperation with production environments Thomas.Strehl@at.ibm.com Thomas.Weinrich@at.ibm.com Rudolf.Pailer@at.ibm.com @20200120

858 views • 58 slides

Traditional Machine Learning: Unsupervised Learning Juhan Nam Traditional Machine Learning

GCT634/AI613: Musical Applications of Machine Learning (Fall 2020) Traditional Machine Learning: Unsupervised Learning Juhan Nam Traditional Machine Learning Pipeline in Classification Tasks A set of hand-designed audio features are selected

398 views • 26 slides

Indigenous Knowledge Aware Drought Monitoring, Forecasting and Prediction using Deep Learning

Indigenous Knowledge Aware Drought Monitoring, Forecasting and Prediction using Deep Learning Techniques Kidane W. Degefa kidane1982@gmail.com [or] kidane.woldemariyam@haramaya.edu.et Lecturer and Researcher at Haramaya Univeristy (Ethiopia)

299 views • 8 slides

AMR and machine-learning Prediction of AMR from metagenomes among other things Finlay Maguire

AMR and machine-learning Prediction of AMR from metagenomes among other things Finlay Maguire finlaymaguire@gmail.com December 3, 2019 Faculty of Computer Science, Dalhousie University Table of contents 1. Genomic Phenotype Prediction 2.

908 views • 77 slides

Scaled Machine Learning at Matroid Reza Zadeh @Reza_Zadeh | http://reza-zadeh.com Machine Learning

Scaled Machine Learning at Matroid Reza Zadeh @Reza_Zadeh | http://reza-zadeh.com Machine Learning Pipeline Learning Replicate Algorithm model Data Trained Serve Model Model Repeat entire pipeline Scaling Machine Learning Datasets and

890 views • 21 slides

Machine Learning Methods for Metabolic Pathway Prediction Joseph M. Dale, Liviu Popescu, and

PathoLogic Machine Learning Methods for Prediction Evaluation Conclusions and Future Directions Machine Learning Methods for Metabolic Pathway Prediction Joseph M. Dale, Liviu Popescu, and Peter D. Karp Pathway Tools Workshop August 27, 2009

590 views • 26 slides

Deep Learning: Intro Juhan Nam Review of Traditional Machine Learning The traditional machine

GCT634/AI613: Musical Applications of Machine Learning (Fall 2020) Deep Learning: Intro Juhan Nam Review of Traditional Machine Learning The traditional machine learning pipeline Temporal Frame-level Unsupervised Classifier Summary

613 views • 27 slides

Introduction to Machine Learning COMPSCI 371D Machine Learning COMPSCI 371D Machine

Introduction to Machine Learning COMPSCI 371D Machine Learning COMPSCI 371D Machine Learning Introduction to Machine Learning 1 / 12 Outline 1 Nearest Neighbor Prediction 2 Complexity Considerations 3 The Voronoi Diagram 4 Overfitting

564 views • 12 slides

Automatically Explaining Machine Learning Prediction Results: A Demonstration on Type 2 Diabetes

Automatically Explaining Machine Learning Prediction Results: A Demonstration on Type 2 Diabetes Risk Prediction Gang Luo Department of Biomedical Informatics and Medical Education University of Washington luogang@uw.edu Clinical Big Data

437 views • 19 slides

Stealing Machine Learning Models via Prediction APIs Florian Tramr, Fan Zhang, Ari Juels,

Stealing Machine Learning Models via Prediction APIs Florian Tramr, Fan Zhang, Ari Juels, Michael K. Reiter, Thomas Ristenpart Usenix Security Symposium Austin, Texas, USA August, 11 th 2016 Machine Learning (ML) Systems (1) Gather labeled

213 views • 17 slides

A Deep Learning Pipeline for Patient Diagnosis Prediction Using Electronic Health Records BIOKDD

A Deep Learning Pipeline for Patient Diagnosis Prediction Using Electronic Health Records BIOKDD 2020 19th International Workshop on Data Mining in Bioinformatics Leopold Franz, Dr. Yash Raj Shrestha, Dr. Bibek Paudel 1 | | 29.05.2020

502 views • 23 slides

GPU Accelerated Machine Learning for Bond Price Prediction Venkat Bala Rafael Nicolas Fermin

GPU Accelerated Machine Learning for Bond Price Prediction Venkat Bala Rafael Nicolas Fermin Cota Motivation Primary Goals Demonstrate potential benefjts of using GPUs over CPUs for machine learning Exploit inherent parallelism to

405 views • 24 slides

AlphaD3M Machine Learning Pipeline Synthesis Iddo Drori, Yamuna Krishnamurthy, Remi Rampin, Raoni

AlphaD3M Machine Learning Pipeline Synthesis Iddo Drori, Yamuna Krishnamurthy, Remi Rampin, Raoni de Paula Lourenco, Jorge Piazentin Ono, Kyunghyun Cho, Claudio Silva, Juliana Freire International Workshop on Automatic Machine Learning, ICML,

741 views • 28 slides

AlphaD3M Machine Learning Pipeline Synthesis Iddo Drori, Yamuna Krishnamurthy, Remi Rampin, Raoni

421 views • 26 slides

What can Statistical Machine Translation teach Neural Machine Translation about Structured

What can Statistical Machine Translation teach Neural Machine Translation about Structured Prediction? Graham Neubig @ ICLR Workshop on Deep Reinforcement Learning Meets Structured Prediction 5/6/2019 Types of Prediction Types of

1.73k views • 127 slides

ARIADNE Joris Klerkx, Erik Duval, Frans Van Assche http://hmdb.cs.kuleuven.be/

ARIADNE Joris Klerkx, Erik Duval, Frans Van Assche http://hmdb.cs.kuleuven.be/ http://ariadne.cs.kuleuven.be ariadne@cs.kuleuven.be TF-Media task force meeting March 18-19 2010 1 1 http://www.slideshare.net/jkofmsk

734 views • 42 slides

#csae2015 CSAE Panel Debate 22 March 2015 Awudu Abdulai University of Kiel Sam Benin CGIAR

CSAE P ANEL D EBATE S MALL FARMS : AN ENEMY OF GROWTH IN A FRICA ? #csae2015 CSAE Panel Debate 22 March 2015 Awudu Abdulai University of Kiel Sam Benin CGIAR Doug Gollin University of Oxford Diego Restuccia University of Toronto

1.17k views • 24 slides

Its all about the Data! Andy Stanford-Clark Distinguished Engineer, IoT IBM UK 20 October

Its all about the Data! Andy Stanford-Clark Distinguished Engineer, IoT IBM UK 20 October 2015 AllSeen Alliance 1 IoTs all about the Data! Andy Stanford-Clark Distinguished Engineer, IoT IBM UK 20 October 2015 AllSeen Alliance 2

564 views • 33 slides

AWP Webinar: Strengthening understanding of Gender Equality and

AWP Webinar: Strengthening understanding of Gender Equality and Social Inclusion (GESI) 24 May 2019 1 waterpartnership.org.au Presenters Nick Schofield Melita Grant Julie

829 views • 35 slides

Path Query Data Structures in Practice Meng He, Serikzhan Kazi June 3, 2020 Dalhousie University

Path Query Data Structures in Practice Meng He, Serikzhan Kazi June 3, 2020 Dalhousie University Plan Introduction Methods Results Discussion 1 Motivation Both theoretical and practical reasons: Proliferation of tree-structured data

798 views • 32 slides

The Regional Multidisciplinary Platform Rural communities, Environment and Climate in West

The Regional Multidisciplinary Platform Rural communities, Environment and Climate in West Africa h"p://ppr-srec.org/ The Regional Multidisciplinary Platform Rural communities, Environment and Climate in West Africa A

583 views • 25 slides

and vice versa Peter Carberry A rising perfect storm A personal perspective Born on a

Innovation in Australian agriculture benefits world agriculture and vice versa Peter Carberry A rising perfect storm A personal perspective Born on a farm at Narrabri, NSW Agricultural Science at The annual RD Watt Lecture

451 views • 33 slides

Change Actions Models of Generalised Differentiation Mario Alvarez-Picallo C.-H. L. Ong

Change Actions Models of Generalised Differentiation Mario Alvarez-Picallo C.-H. L. Ong Department of Computer Science, University of Oxford March 28, 2019 Mario Alvarez-Picallo, C.-H. L. Ong Change Actions Incremental computation with

751 views • 24 slides