Immersive Analytics of Honey Bee Data Interaction and Visualisation - - PowerPoint PPT Presentation

▶
immersive analytics of honey bee data
SMART_READER_LITE
LIVE PREVIEW

Immersive Analytics of Honey Bee Data Interaction and Visualisation - - PowerPoint PPT Presentation

Apr 30, 2023 148 likes •569 views

Expanded Perception and Interaction Centre Immersive Analytics of Honey Bee Data Interaction and Visualisation Design Huyen Nguyen | Postdoctoral Fellow Sydney, May 2018 YOW! Data Conference http://epicentre.matters.today Research Background

slide-1
SLIDE 1

http://epicentre.matters.today

Expanded Perception and Interaction Centre

Immersive Analytics of Honey Bee Data

Interaction and Visualisation Design

Sydney, May 2018 YOW! Data Conference

Huyen Nguyen | Postdoctoral Fellow

slide-2
SLIDE 2

Research Background

  • 3D Navigation and Interaction

Techniques in Immersive Systems

  • Collaborative Ergonomic

Design Process

Immersive Analytics of Honey Bee Data | Huyen Nguyen 2 |

slide-3
SLIDE 3

Acknowledgement

  • CSIRO Collaborators
  • Students
  • Holly Hutson
  • Sarah Ketchell
  • Ben Ward

Immersive Analytics of Honey Bee Data | Huyen Nguyen 3 |

  • Ulrich Engelke
  • Paulo de Souza
  • Peter Marendy
  • Ray Williams
  • Justin Baker
  • Florence Wang
  • Matt Adcock
  • Stuart Anderson
slide-4
SLIDE 4

Expanded Perception and Interaction Centre

Global Initiative for Honey bee Health

slide-5
SLIDE 5

GIHH

https://www.youtube.com/watch?v=B2G4zmW8Gsk

Immersive Analytics of Honey Bee Data | Huyen Nguyen 5 |

slide-6
SLIDE 6

Issues

  • Economy depends on Bees
  • $170B, 84% global crop production

rely on pollinators

  • Bees play a key role in the

sustainable food production

  • Demand/Supply Imbalance
  • Food production increased thanks

to – Better agricultural practices – Seed improvement – Expansion of planted area

  • In the next decade the world will

need 60% more food

Immersive Analytics of Honey Bee Data | Huyen Nguyen 6 |

slide-7
SLIDE 7

Issues

Immersive Analytics of Honey Bee Data | Huyen Nguyen 7 |

Over the last five decades global bee populations have steadily declined leading to significant global nutrition, health and economic warning signs

slide-8
SLIDE 8

Bees with Backpacks

Immersive Analytics of Honey Bee Data | Huyen Nguyen 8 |

slide-9
SLIDE 9

Bees with Backpacks

https://www.youtube.com/watch?v=CfkNFo-Hysc

Immersive Analytics of Honey Bee Data | Huyen Nguyen 9 |

slide-10
SLIDE 10

Experiment Setup

Immersive Analytics of Honey Bee Data | Huyen Nguyen 10 |

Tag reader at the hives and feeders Electronics box Solar panel Hive scales Weather station

slide-11
SLIDE 11

Experiments in Tasmania

Immersive Analytics of Honey Bee Data | Huyen Nguyen 11 |

slide-12
SLIDE 12

Experiments in Brazilian Amazon

Immersive Analytics of Honey Bee Data | Huyen Nguyen 12 |

slide-13
SLIDE 13

Locations

Immersive Analytics of Honey Bee Data | Huyen Nguyen 13 |

slide-14
SLIDE 14

Expanded Perception and Interaction Centre

From Data to Insights

Visual Analytics and Immersive Analytics

slide-15
SLIDE 15

15 | Immersive Analytics of Honey Bee Data | Huyen Nguyen

Facilitate comprehension and decision making

slide-16
SLIDE 16

Visual Analytics

Facilitate comprehension and decision making

Immersive Analytics of Honey Bee Data | Huyen Nguyen 16 |

slide-17
SLIDE 17

Bee Activities

Immersive Analytics of Honey Bee Data | Huyen Nguyen 17 |

slide-18
SLIDE 18

Individual Bee Activities

Immersive Analytics of Honey Bee Data | Huyen Nguyen 18 |

slide-19
SLIDE 19

Bee Drifting

Immersive Analytics of Honey Bee Data | Huyen Nguyen 19 |

H1 H2 H3 H4 Number of bees recorded Hive H1 H2 H3 H4

slide-20
SLIDE 20

Immersive Analytics

Immersive Analytics of Honey Bee Data | Huyen Nguyen 20 |

slide-21
SLIDE 21

AR/VR Head-mounted Displays

Immersive Analytics of Honey Bee Data | Huyen Nguyen 21 |

slide-22
SLIDE 22

HoloBee (AR)

  • Bee drifting: the behaviour of bees which leave one colony and

join another.

  • Visualise bee drift to help understand bee drifting behaviour over

6-month period in Geeveston using AR interface on HoloLens.

  • Provide an easy to use and intuitive interface for data exploration.

Immersive Analytics of Honey Bee Data | Huyen Nguyen 22 |

slide-23
SLIDE 23

HoloBee (AR)

Immersive Analytics of Honey Bee Data | Huyen Nguyen 23 |

HoloBee

DATA COLLECTION, POST-PROCESSING & ANALYSIS

Cleaning, classification, and aggregation operations on bee data

COLLABORATION

Collaborative sessions in a shared environment

INFORMATION DISPLAY

Overview+Detail paradigm

COMMAND LANGUAGES & SYSTEM FEEDBACK

Voice, gaze, gesture recognition Directional pointers, visual cursor, auditory channel

slide-24
SLIDE 24

HoloBee (AR) – Interface

Immersive Analytics of Honey Bee Data | Huyen Nguyen 24 |

Global View Site View Interface Screenshot

slide-25
SLIDE 25

HoloBee (AR) – Collaboration

Immersive Analytics of Honey Bee Data | Huyen Nguyen 25 |

slide-26
SLIDE 26

MelissAR

[Melissa – ancient Greek for Honey Bee]

Immersive Analytics of Honey Bee Data | Huyen Nguyen 26 |

slide-27
SLIDE 27

MelissAR – Interface

Detailed Information Information Query Site Information

Immersive Analytics of Honey Bee Data | Huyen Nguyen 27 |

slide-28
SLIDE 28

Virtual Bee Keeper (VR)

  • Visualise spatial and temporal data of bee activities and health-

related information of bee hives in a 3D world.

  • Brood temperature, number of workers and drones, hive weight, site state,

hive drift, etc.

  • Map the virtual world with the real settings of bee hives to access,

query and analyse bee data to study bee behaviours.

Immersive Analytics of Honey Bee Data | Huyen Nguyen 28 |

slide-29
SLIDE 29

Virtual Bee Keeper (VR) – Interface

Immersive Analytics of Honey Bee Data | Huyen Nguyen 29 |

Detailed Information Information Query Video Stream

slide-30
SLIDE 30

I-Flight

  • Virtual environment for visualising simulated data of bee flight

trajectories depending on terrain, temperature, time of day, etc.

  • Interaction techniques to interact with bees, beehives.
  • Interface for analytics queries and graphical representations of

results integrated into the virtual world

Immersive Analytics of Honey Bee Data | Huyen Nguyen 30 |

slide-31
SLIDE 31

I-Flight – Desktop Interface

Immersive Analytics of Honey Bee Data | Huyen Nguyen 31 |

slide-32
SLIDE 32

Bee Roles

Novice

  • Undertaking orientation flights

Water carrier:

  • Exploiting a water source

Scout:

  • Searching spontaneously for new food sources

Expert:

  • Exploiting a current food source

Recruit:

  • Searching for a food source by observing the waggle dance of an exploiter

Inspector:

  • Reconnaissance flights to previously exhausted food sources to see if it is replenished

Immersive Analytics of Honey Bee Data | Huyen Nguyen 32 |

slide-33
SLIDE 33

Bee Activities

Location dependent activity models:

  • Exploratory searching
  • Seeking a food source
  • Searching for a food source by visual or olfactory sensing
  • Foraging at a food source
  • Returning to the hive
  • Resting in the hive

Immersive Analytics of Honey Bee Data | Huyen Nguyen 33 |

slide-34
SLIDE 34

I-Flight – VR Interface

Immersive Analytics of Honey Bee Data | Huyen Nguyen 34 |

Environmental Factor Vis. Information Query Trajectories mapped

  • n realistic terrain
slide-35
SLIDE 35

Reality – Virtuality Continuum

Immersive Analytics of Honey Bee Data | Huyen Nguyen 35 |

Real Environment Augmented Reality (AR) Augmented Virtuality (AV) Virtual Environment

slide-36
SLIDE 36

Collaborative Design for Immersive Analytics

  • Facilitate collaboration amongst GIHH partners

Immersive Analytics of Honey Bee Data | Huyen Nguyen 36 |

slide-37
SLIDE 37

Collaborative Design for Immersive Analytics

Immersive Analytics of Honey Bee Data | Huyen Nguyen 37 |

slide-38
SLIDE 38

Human Factors in Mixed Reality

  • Multidisciplinary study of cognition, interaction design and immersive analytics.

Immersive Analytics of Honey Bee Data | Huyen Nguyen 38 |

slide-39
SLIDE 39

http://epicentre.matters.today

Expanded Perception and Interaction Centre

  • Division/Unit Name
  • Presenter Name

Presenter Title – t +61 2 9123 4567 – e firstname.surname@csiro.au – w www.csiro.au/lorem

  • Division/Unit Name
  • Presenter Name

Presenter Title – t +61 2 9123 4567 – e firstname.surname@csiro.au – w www.csiro.au/lorem

Thank you

huyen.nguyen@unsw.edu.au

slide-40
SLIDE 40

References

  • U. Engelke, D. Darcy, G. Mulliken, S. Bosse, M. Martini, S. Arndt, J.-N. Antons, K. Y. Chan, N. Ramzan, and K. Brunnstroem, “Psychophysiology-based QoE Assessment:

A Survey,” in IEEE Journal on Selected Topics in Signal Processing, vol. 11, no. 1, pp. 6-21, 2017.

  • U. Engelke, P. Marendy, F. Susanto, R. Williams, S. Mahbub, H. Nguyen, and P. de Souza, “A Visual Analytics Framework to Study Honey Bee Behaviour,” in IEEE

International Conference on Data Science Systems (DSS), Sydney, Dec 2016.

  • E. Kandogan and U. Engelke, “Agile Visual Analytics in Data Science Systems,” in IEEE International Conference on Data Science and Systems (DSS), Sydney, Dec 2016.
  • H. Nguyen, P. Marendy, and U. Engelke, “Collaborative Framework Design for Immersive Analytics,” in International Symposium on Big Data Visual Analytics (BDVA),

Sydney, Nov 2016.

  • U. Engelke and E. Kandogan, “Towards an Algebra for the Visual Analytics Design Process,” in IEEE Visual Analytics Science and Technology (VAST), Poster Track,

Baltimore, Oct 2016.

  • U. Engelke, H. Hutson, H. Nguyen, and P. de Souza, “MelissAR: Towards Augmented Visual Analytics of Honey Bee Behaviour,” in Proceedings of ACM CHI, San Jose,

May 2016.

  • F. Susanto, S. Budi, P. de Souza, U. Engelke, and J. He, “Design of Environmental Sensor Networks Using Evolutionary Algorithms,“ IEEE Geoscience and Remote

Sensing Letters, vol. 13, no. 4, pp. 575-579, 2016.

  • U. Engelke, J. Vuong, and J. Heinrich, “Visual Performance in Multidimensional Data Characterisation with Scatterplots and Parallel Coordinates,” in IS&T Human

Vision and Electronic Imaging (HVEI), San Francisco, Feb 2016.

  • U. Engelke, F. Susanto, P. de Souza, and P. Marendy, “Visual Assessment of Spatial Data Interpolation,” in International Symposium on Big Data Visual Analytics

(BDVA), Hobart, Sep 2015.

Immersive Analytics of Honey Bee Data | Huyen Nguyen 40 |