Configuration Strategies of an AR Toolkit-based Wide Area Tracker - - PowerPoint PPT Presentation

configuration strategies of an ar toolkit based wide area
SMART_READER_LITE
LIVE PREVIEW

Configuration Strategies of an AR Toolkit-based Wide Area Tracker - - PowerPoint PPT Presentation

Configuration Strategies of an AR Toolkit-based Wide Area Tracker The Second IEEE International AR Toolkit Workshop Martin Wagner, Felix Loew Lehrstuhl fr Angewandte Softwaretechnik Institut fr Informatik Technische Universitt Mnchen


slide-1
SLIDE 1

16-Dez-03

Martin Wagner, Felix Loew Lehrstuhl für Angewandte Softwaretechnik Institut für Informatik Technische Universität München wagnerm@in.tum.de

Configuration Strategies of an AR Toolkit-based Wide Area Tracker

The Second IEEE International AR Toolkit Workshop

slide-2
SLIDE 2

16-Dez-03 Configuration Strategies of an AR Toolkit-based Wide Area Tracker Martin Wagner, Felix Loew 2

Summary

  • Scenario: mobile user in intelligent “AR-ready”

building

  • AR Toolkit used for

– High-precision tracking in small areas – Coarse room-based wide area tracking ( “ID tags”)

  • Software architecture for

– Dynamic context aware reconfiguration of AR Toolkit marker detection – Room-dependent choice of transition strategies

slide-3
SLIDE 3

16-Dez-03 Configuration Strategies of an AR Toolkit-based Wide Area Tracker Martin Wagner, Felix Loew 3

Outline

  • Scenario: Intelligent Building
  • System Components

– DWARF overview – Configuration components

  • Distributed Configuration

– Description of concepts – Detailed example scenario

  • Strategies for Using AR Toolkit as Wide Area

Tracker

  • Conclusion & Future Work
slide-4
SLIDE 4

16-Dez-03 Configuration Strategies of an AR Toolkit-based Wide Area Tracker Martin Wagner, Felix Loew 4

Scenario: Intelligent Building

  • User walks around in an

intelligent building, wearing mobile client with camera and AR Toolkit

  • AR apps tied to specific

rooms, i.e. table-based AR in Lab

  • Mobile client has no a

priori knowledge of environment

  • Detection of current room

triggered by sets of Toolkit markers

slide-5
SLIDE 5

16-Dez-03 Configuration Strategies of an AR Toolkit-based Wide Area Tracker Martin Wagner, Felix Loew 5

Scenario: Requirements

  • No a priori knowledge about environment:

fi Distributed architecture fi Dynamic configuration fi Split AR Toolkit functionality in components

  • Trigger detection of room changes using AR

Toolkit markers

fi Allow varying room-dependent strategies to increase

robustness

fi Provide flexible architecture to use additional

information sources (RF ID tags, ultra wideband trackers, …)

slide-6
SLIDE 6

16-Dez-03 Configuration Strategies of an AR Toolkit-based Wide Area Tracker Martin Wagner, Felix Loew 6

Outline

  • Scenario: Intelligent Building
  • System Components

– DWARF overview – Configuration components

  • Distributed Configuration

– Description of concepts – Detailed example scenario

  • Strategies for Using AR Toolkit as Wide Area

Tracker

  • Conclusion & Future Work
slide-7
SLIDE 7

16-Dez-03 Configuration Strategies of an AR Toolkit-based Wide Area Tracker Martin Wagner, Felix Loew 7

DWARF Overview

  • Distributed Wearable Augmented Reality

Framework

  • CORBA-based middleware dynamically connects

Services (DWARF components) based on description of their Needs and Abilities

  • Ability descriptions may be enhanced using

Attributes describing contextual information

  • Many communication protocols

– CORBA method invocations – CORBA notification service (events) – Shared memory (for video transmission)

slide-8
SLIDE 8

16-Dez-03 Configuration Strategies of an AR Toolkit-based Wide Area Tracker Martin Wagner, Felix Loew 8

Components - Overview

Video Grabber: gets video image and puts it in a shared memory segment Marker Detection: takes video image out of shared memory, detects AR Toolkit markers, sends events describing position and ID of markers Marker Loader: configures the Marker Detection using remote method invocation with marker descriptions suitable for the current context Coarse Tracker: listens for events from Marker Detection and changes the mobile client’s context according to the new room

slide-9
SLIDE 9

16-Dez-03 Configuration Strategies of an AR Toolkit-based Wide Area Tracker Martin Wagner, Felix Loew 9

Components - Connections

slide-10
SLIDE 10

16-Dez-03 Configuration Strategies of an AR Toolkit-based Wide Area Tracker Martin Wagner, Felix Loew 10

Outline

  • Scenario: Intelligent Building
  • System Components

– DWARF overview – Configuration components

  • Distributed Configuration

– Description of concepts – Detailed example scenario

  • Strategies for Using AR Toolkit as Wide Area

Tracker

  • Conclusion & Future Work
slide-11
SLIDE 11

16-Dez-03 Configuration Strategies of an AR Toolkit-based Wide Area Tracker Martin Wagner, Felix Loew 11

Distributed Configuration

  • Basic Idea: distribute information processing

– Video Grabber and Marker Detection on user’s mobile client – Marker Loaders and Coarse Trackers in rooms

  • Environmental services run in multiple instances,
  • ne for each room

– Room-dependent evaluation of Marker Detection events gets possible – Available more accurate tracking technology (i.e. ultra wideband tracker) can be integrated seamlessly

slide-12
SLIDE 12

16-Dez-03 Configuration Strategies of an AR Toolkit-based Wide Area Tracker Martin Wagner, Felix Loew 12 CoarseTracker MarkerLoader Room 1

Distributed Configuration - Example

VideoGrabber MarkerDetection Mobile Client Room 2 CoarseTracker MarkerLoader Room 2 AR App

slide-13
SLIDE 13

16-Dez-03 Configuration Strategies of an AR Toolkit-based Wide Area Tracker Martin Wagner, Felix Loew 12 CoarseTracker MarkerLoader Room 1

Distributed Configuration - Example

VideoGrabber MarkerDetection Mobile Client Room 2 CoarseTracker MarkerLoader Room 2 AR App Load Room 1 Context Markers

slide-14
SLIDE 14

16-Dez-03 Configuration Strategies of an AR Toolkit-based Wide Area Tracker Martin Wagner, Felix Loew 12 CoarseTracker MarkerLoader Room 1

Distributed Configuration - Example

VideoGrabber MarkerDetection Mobile Client Send marker events Room 2 CoarseTracker MarkerLoader Room 2 AR App

slide-15
SLIDE 15

16-Dez-03 Configuration Strategies of an AR Toolkit-based Wide Area Tracker Martin Wagner, Felix Loew 12 CoarseTracker MarkerLoader Room 1

Distributed Configuration - Example

VideoGrabber MarkerDetection Mobile Client Send marker events Detect Room Change Room 2 CoarseTracker MarkerLoader Room 2 AR App

slide-16
SLIDE 16

16-Dez-03 Configuration Strategies of an AR Toolkit-based Wide Area Tracker Martin Wagner, Felix Loew 12 CoarseTracker MarkerLoader Room 1

Distributed Configuration - Example

VideoGrabber MarkerDetection Mobile Client Send marker events Room 2 CoarseTracker MarkerLoader Room 2 AR App Change Client’s Context to Room=Room2

slide-17
SLIDE 17

16-Dez-03 Configuration Strategies of an AR Toolkit-based Wide Area Tracker Martin Wagner, Felix Loew 12 CoarseTracker MarkerLoader Room 1

Distributed Configuration - Example

VideoGrabber MarkerDetection Mobile Client Send marker events Room 2 CoarseTracker MarkerLoader Room 2 AR App

slide-18
SLIDE 18

16-Dez-03 Configuration Strategies of an AR Toolkit-based Wide Area Tracker Martin Wagner, Felix Loew 12 CoarseTracker MarkerLoader Room 1

Distributed Configuration - Example

VideoGrabber MarkerDetection Mobile Client Unload Room 1 Context Markers Room 2 CoarseTracker MarkerLoader Room 2 AR App

slide-19
SLIDE 19

16-Dez-03 Configuration Strategies of an AR Toolkit-based Wide Area Tracker Martin Wagner, Felix Loew 12 CoarseTracker MarkerLoader Room 1

Distributed Configuration - Example

VideoGrabber MarkerDetection Mobile Client Room 2 CoarseTracker MarkerLoader Room 2 AR App

slide-20
SLIDE 20

16-Dez-03 Configuration Strategies of an AR Toolkit-based Wide Area Tracker Martin Wagner, Felix Loew 12 CoarseTracker MarkerLoader Room 1

Distributed Configuration - Example

VideoGrabber MarkerDetection Mobile Client Room 2 CoarseTracker MarkerLoader Load Room 2 Context + App Markers Room 2 AR App

slide-21
SLIDE 21

16-Dez-03 Configuration Strategies of an AR Toolkit-based Wide Area Tracker Martin Wagner, Felix Loew 12 CoarseTracker MarkerLoader Room 1

Distributed Configuration - Example

VideoGrabber MarkerDetection Mobile Client Room 2 CoarseTracker MarkerLoader Room 2 AR App Send marker events

slide-22
SLIDE 22

16-Dez-03 Configuration Strategies of an AR Toolkit-based Wide Area Tracker Martin Wagner, Felix Loew 13

Outline

  • Scenario: Intelligent Building
  • System Components

– DWARF overview – Configuration components

  • Distributed Configuration

– Description of concepts – Detailed example scenario

  • Strategies for Using AR Toolkit as Wide Area

Tracker

  • Conclusion & Future Work
slide-23
SLIDE 23

16-Dez-03 Configuration Strategies of an AR Toolkit-based Wide Area Tracker Martin Wagner, Felix Loew 14

Strategies for Marker-Based Wide Area Tracking

Factors influencing the choice of strategies:

  • Light conditions
  • Movement of user
  • Marker position
  • Camera
  • Room properties

Basic strategies:

  • Minimum number of

frames

  • Weighting number of

frames by confidence value

  • Detect multiple markers

simultaneously

  • Detect sequence of

markers

slide-24
SLIDE 24

16-Dez-03 Configuration Strategies of an AR Toolkit-based Wide Area Tracker Martin Wagner, Felix Loew 15

Outline

  • Scenario: Intelligent Building
  • System Components

– DWARF overview – Configuration components

  • Distributed Configuration

– Description of concepts – Detailed example scenario

  • Strategies for Using AR Toolkit as Wide Area

Tracker

  • Conclusion & Future Work
slide-25
SLIDE 25

16-Dez-03 Configuration Strategies of an AR Toolkit-based Wide Area Tracker Martin Wagner, Felix Loew 16

Conclusion & Future Work

  • Prototypical implementation:

– Proof of concept for configuration architecture – Demonstration within ARCHIE project

  • Future Work:

– Evaluate robustness of different strategies – Describe criteria for suitability of different strategies – Design combination strategies – Incorporate additional trackers/ information sources – Algorithms for detecting and reverting wrongly triggered context changes

slide-26
SLIDE 26

16-Dez-03 Configuration Strategies of an AR Toolkit-based Wide Area Tracker Martin Wagner, Felix Loew 17

Thank you!

See our website: http://www.augmentedreality.de Or send E-Mail: dwarf@augmentedreality.de