Data? Mike R. Duncan, Ph.D. Sarah Lepp, B.Sc. Gregor Maclean The - - PowerPoint PPT Presentation

data
SMART_READER_LITE
LIVE PREVIEW

Data? Mike R. Duncan, Ph.D. Sarah Lepp, B.Sc. Gregor Maclean The - - PowerPoint PPT Presentation

How Much Data is Enough Data? Mike R. Duncan, Ph.D. Sarah Lepp, B.Sc. Gregor Maclean The 3D Vineyard Engine (2006) Creation of a 3D data-driven visualization model from 8pt/m2 LiDAR data. The vineyard engine was connected to a


slide-1
SLIDE 1

How Much Data is Enough Data…?

Mike R. Duncan, Ph.D. Sarah Lepp, B.Sc. Gregor Maclean

slide-2
SLIDE 2

The 3D Vineyard Engine (2006)

  • Creation of a 3D data-driven visualization model from 8pt/m2 LiDAR data.
  • The vineyard engine was connected to a database containing attribute data of over 70,000 vines
  • Different colours in the left image are varietals.
slide-3
SLIDE 3

Vine Tracking Systems (2007)

Converted the 3D Vineyard Engine to Google Earth with 300,000 vines in the DB. Reynold’s GPS mapped Sentinel Vines.

slide-4
SLIDE 4

Real-Time Temperature Tracking (2007)

slide-5
SLIDE 5

PrAgMatic (2007-2012)

slide-6
SLIDE 6

0.5 1.0 1.5 2.0 2.5 3.0 3.5

  • 6
  • 5
  • 4
  • 3
  • 2
  • 1

Ensemble spectra for 16 sensors

  • 5/3

Shows that the temperature field is as turbulent as Kolmogorov air turbulence. Characterized by sudden violent changes. Suggests a need for high frequency sampling to capture all the variability.

slide-7
SLIDE 7

Sudden Violent Changes in T(t) - Shocks

  • A sudden rapid drop in temperature.
  • Shock events occupy 1% of our time series.

8 13 18 23 28 03/05/2012 0:00 04/05/2012 0:00 05/05/2012 0:00

Data from the Niagara College R-T Temperature Sensor Network – May 3rd, 2012

slide-8
SLIDE 8

Deltas/Shocks can be very ‘bad’

  • The following Delta – or Shock – Event happened on

March 27th, 2012 and killed much of Ontario’s tender fruit crop.

  • 5
  • 3
  • 1

1 3 5 7 9 26/03/2012 0:00 26/03/2012 12:00 27/03/2012 0:00 27/03/2012 12:00 28/03/2012 0:00

Temperature in deg C Data from the Niagara College R-T Temperature Sensor Network – March 27th, 2012

slide-9
SLIDE 9

Result of the March 27th Shock Event

200 400 600 800 1,000 1,200 1985 1987 1989 1991 1993 1995 1997 1999 2001 2003 2005 2007 2009 2011 2013 2015 (million lbs)

Marketed Production of Fruit Crops, Ontario, 1985-2015

apples grapes peaches strawberries pears sour cherries sweet cherries plums & prunes raspberries Total

March 27 Killer cold event reduced production by >300 million lbs.

9

slide-10
SLIDE 10

Switching to Grains

Yield Monitor Good GPS device to map Yield Monitor output Well tuned and well maintained harvester. Keep in mind that there’s a lag between when the harvester takes in yield and when the monitor sees it – this distance can be largish – so you need to correct for it. Vines/grapes are a very managed yield which makes it hard to verify the terrain/yield relationships. In 2009 we started looking at grains and grain farms. Opened the door to making map tools Yellow-Gold Farms in Parkhill Ontario.

slide-11
SLIDE 11

Premise: Corn Yield Performance Follows Landforms

LandMapR 4 Landform Map for Frasier Field in Parkhill Ontario 2002 Corn Yield map for Frasier field

  • verlaid on 3D field

surface data

slide-12
SLIDE 12

LandMapR: Pits (Blues) and Knolls (Yellow)

Pits/Gulleys Tops of Knolls

slide-13
SLIDE 13

LandMapR: High (Green) and Low (Red) Yields

Higher Yield Lower Yield

slide-14
SLIDE 14

Schuyler – 2001 Corn

Yield/Landform Distributions

  • 0.005

0.005 0.01 0.015 0.02 0.025 0.03 0.035 20 40 60 80 100 120 140 160 Landform 1 Landform 2 Landform 3 Landform 4

slide-15
SLIDE 15

Schuyler – 2010 Corn

Yield/Landform Distributions

  • 0.005

0.005 0.01 0.015 0.02 50 100 150 200 250 300 Landform 1 Landform 2 Landform 3 Landform 4

slide-16
SLIDE 16

Performance of Yield by Landform: The key to Variable Rate Farming Management Zones

  • 0.15
  • 0.1
  • 0.05

0.05 0.1 0.15 0.2 0.25 0.3 0.35 1 2 3 4 Gaps (differences) in population between over and under performing cells 1 = P<20%, 2 = P<40%, 3 = P<70%, 4 = P=100% LandForm 1 LandForm 2 LandForm 3 LandForm 4

The correct way to compare landforms and crop performance is via a yield probability map. This graph shows that landform 1 shows a performance deficit throughout the full range of yield values. The yield probability index is a reclassification of yield values into performance values relative to the average performance of the crop for a year. The values cluster and the clusters closely follow the landforms

slide-17
SLIDE 17

LandMapR Watersheds, Wetness, Streams

Local Watersheds Global Watersheds Wetness and Streamflow

slide-18
SLIDE 18

Rx

maps with validation built-in!

Co-operator data submitted + collect geospatial data to fill gaps Goals: wireless data transfer & analyze data layers with transparent mathematics for teaching farmers Rx maps: implemented with industry direction, support

PAAO Project – Precision Ag Advancement for Ontario

This project was funded in part through Growing Forward 2, a federal-provincial-territorial initiative. The Agricultural Adaptation Council assists in the delivery of Growing Forward 2 in Ontario.

slide-19
SLIDE 19

The Portal Data ‘Pipeline’

Upload Cleaning Gridding/Mapping (Kriging) YI Elevation YPI/YPZones

YCI

EC Partitioning

Analytics Yield Elevation Soil Type

Chemistry Nutrients

Velocities, direction, boundaries, etc…

Inputs VRx RRx Variable Rate Sampling

Measurement Test Plots

Field Work

slide-20
SLIDE 20

RAW

Elevation

Cleaned

Block Kriged

slide-21
SLIDE 21

Data Cleaning

Clipping the distribution to remove high and low

  • utliers.

Function removes << 1% of the data most of the time. Not the best way to do business.

slide-22
SLIDE 22

Delta Clean – Point to Point Differencing

Velocity, Azimuth and Yield

Y

  • Y

V

  • V

A

  • A

dY dV

slide-23
SLIDE 23

50 100 150 200 250 20.000 40.000 60.000 80.000 100.000 120.000 140.000 160.000 180.000 200.000 220.000 Yield in bu/ac Corn 1996 Corn 1998 Corn 2000 Corn 2002 Corn 2005 Corn 2007

Yield Distributions

slide-24
SLIDE 24

Normalized Yield Distributions

50 100 150 200 250 300 350 0.2 0.4 0.6 0.8 1 1.2 1.4 1.6 Histogram Count Normalized Yield Corn 1996 Corn 1998 Corn 2000 Corn 2002 Corn 2005 Corn 2007

Single trait seed Multi trait seed

slide-25
SLIDE 25
slide-26
SLIDE 26

0.1 0.2 0.3 0.4 0.5 0.6 0.7 1 2 3 4 5 6 7

Yield Stability Always Converges onto Areas of the Farm Field

Always Over-Performing Area Always Under-Performing Area

Percent of Field Area

slide-27
SLIDE 27

Schuyler Yield Distributions

Non-normalized distributions show an average yield that varies greatly from year to year

2000 4000 6000 8000 10000 12000 14000 16000 30 80 130 180 230 280 330 Yield in bu/ac Corn 2001 Corn 2002 Corn 2004 Corn 2005 Corn 2008 Corn 2010 Corn 2011

slide-28
SLIDE 28

Calculations

YPI Membership Distributions YPI Membership YPI Clusters Historical Yield Maps Avg Yield Cells (6m2) YPI Level

slide-29
SLIDE 29

Partitioned Yield Histograms for Cul-Owned (Schuyler Farms)

1000 2000 3000 4000 5000 6000 7000 110 130 150 170 190 210 Yield in bu/ac P=7 P=6 P=5 P=4 P=3 P=2 P=1 P=0

slide-30
SLIDE 30

Green is High White is Low

Partitioned Yield – Spatial Distribution

slide-31
SLIDE 31

Summed Yield Histograms for Cul-Owned (Schuyler Farms)

2000 4000 6000 8000 10000 12000 110 130 150 170 190 210 Yield in bu/ac P=6&7 P=3&4&5 P=0&1&2

slide-32
SLIDE 32

Green is High Pink is Low Yellow is Mid

Partitioned Yield – Spatial Distribution

slide-33
SLIDE 33

VRx – Variable Rate Prescription Generator

Push Button Operation. Uses a yield map, or yield index map as a pattern and takes a target yield to generate removals. Fertilizers are added to match the removals. There are seven resulting maps.

slide-34
SLIDE 34

But this area can’t be any good… it’s full

  • f sand!

Yield Performance Index Map Green is High-Performing areas Red is Under-Performing areas.

slide-35
SLIDE 35

Variable Rate Over Watersheds: Keeping Track

A complex calculation involving historical yield and field topography performed by the NC Research Crop Portal. Another complex calculation performed by LandMapR using field topography, or elevation data. The figure shows local watersheds in the field, or where water will first pool under rain or irrigation inputs.

slide-36
SLIDE 36

Return of Sensor Networks! 16 May, 2016 Temperature Event.

slide-37
SLIDE 37

Adding in Real-Time Radar Rainfall Estimates

slide-38
SLIDE 38

Sudden 4 deg C drop and 35% rise in RH

10 11 12 13 14 15 16 40 45 50 55 60 65 70 75 80 16/05/2016 20:09:36 16/05/2016 20:38:24 16/05/2016 21:07:12 16/05/2016 21:36:00

May 16, 2016 - 20:58(ish)

RH(Low) RH(High) T(Low) T(High)

No Prior warning of the sudden drop in either RH%

  • r in temperature – all is

moving along and then a drop….

Humidity RH(%) Temperature deg C Time

slide-39
SLIDE 39

Evapotranspiration Node Raw Data Output

(Top sensors are in a canopy – T(T), RH(T), Therm(T))

10 20 30 40 50 60 70 80 25 30 35 40 45 50 1 299 597 895 1193 1491 1789 2087 2385 2683 2981 3279 3577 3875 4173 4471 4769 5067 5365 5663 5961 6259 6557 6855 7153 7451 7749 8047 8345 8643 8941 9239 9537 9835 10133 10431 10729 11027 11325 11623 11921 12219 12517 12815 13113 13411 13709 14007 14305 14603 14901 15199 15497 15795 16093 16391 16689 16987 17285 17583 17881 18179 18477 18775 19073 19371 19669 19967 20265 20563 20861 21159 21457 T(T) T(M) T(B) Therm(T) Therm(B) RH(T) RH(M) RH(B)

Nightfall – characterized rising humidity and falling temperatures, as well as inversions.

slide-40
SLIDE 40

Rover Tracks April 14 (Orange), April 20 (Green)

Temperature data points at 3cm and 1.2m mapped onto Google Earth. Data rate is 1Hz. Vehiccle velocity is ~3 mph

slide-41
SLIDE 41

Temp Map (High) – Temp Map (Low) – April 20 Kriging at 1m Resolution

slide-42
SLIDE 42

Questions?