Instrumented Environments Andreas Butz, butz@ifi.lmu.de, - - PowerPoint PPT Presentation

▶
instrumented environments
SMART_READER_LITE
LIVE PREVIEW

Instrumented Environments Andreas Butz, butz@ifi.lmu.de, - - PowerPoint PPT Presentation

Apr 17, 2023 411 likes •732 views

Instrumented Environments Andreas Butz, butz@ifi.lmu.de, www.mimuc.de Fri, 12:15-13:45, Theresienstr. 39, Room E 045 27. April 06 LMU Mnchen, Medieninformatik, Instrumented Environments, SS 2006, Andreas Butz 1 Topics today Introduction,

slide-1
SLIDE 1
  • 27. April 06

LMU München, Medieninformatik, Instrumented Environments, SS 2006, Andreas Butz 1

Instrumented Environments

Andreas Butz, butz@ifi.lmu.de, www.mimuc.de Fri, 12:15-13:45, Theresienstr. 39, Room E 045

slide-2
SLIDE 2
  • 27. April 06

LMU München, Medieninformatik, Instrumented Environments, SS 2006, Andreas Butz 2

Topics today

Introduction, Motivation

  • Ubiquitous Computing
  • Instrumented environments

Overview of this class

  • Class topics
  • Appointments
  • Exercises, examples
  • Criteria for the certificate
slide-3
SLIDE 3
  • 27. April 06

LMU München, Medieninformatik, Instrumented Environments, SS 2006, Andreas Butz 3

Post-PC Era or Ubiquitous Computing

Mainframe: 1 computer, many users Personal Computer: 1 computer, 1 user Ubiquitous Comp.: many computers, 1 user …

  • r rather:

many computers, many users

Mark Weiser: What Ubiquitous Computing Isn't

Ubiquitous computing is roughly the opposite of virtual reality. Where virtual reality puts people inside a computer-generated world, ubiquitous computing forces the computer to live out here in the world with people.

slide-4
SLIDE 4
  • 27. April 06

LMU München, Medieninformatik, Instrumented Environments, SS 2006, Andreas Butz 4

Computer out here in the world: Instrumented Environments

slide-5
SLIDE 5
  • 27. April 06

LMU München, Medieninformatik, Instrumented Environments, SS 2006, Andreas Butz 5

Instrumented Environments

?

slide-6
SLIDE 6
  • 27. April 06

LMU München, Medieninformatik, Instrumented Environments, SS 2006, Andreas Butz 6

Instrumented desk

  • Borders between phys.

and virtual world

  • Interaction objects
  • Physical tools for

virtual media Research Topics:

slide-7
SLIDE 7
  • 27. April 06

LMU München, Medieninformatik, Instrumented Environments, SS 2006, Andreas Butz 7

Instrumented room

  • Environment as display

continuum (+ audio)

  • Interaction with large

displays

  • Interaction with many

different displays

  • Ambient displays
  • Borders between phys.

and virtual world

  • Interaction objects
  • Physical tools for

virtual media Research Topics:

slide-8
SLIDE 8
  • 27. April 06

LMU München, Medieninformatik, Instrumented Environments, SS 2006, Andreas Butz 8

Instrumented building

  • Interaction between different displays

without line of sight

  • place holder objects, transport metaphors
  • interaction over distance
slide-9
SLIDE 9
  • 27. April 06

LMU München, Medieninformatik, Instrumented Environments, SS 2006, Andreas Butz 9

Instrumented city

slide-10
SLIDE 10
  • 27. April 06

LMU München, Medieninformatik, Instrumented Environments, SS 2006, Andreas Butz 10

Sci-Fi version of Instr. Env.

slide-11
SLIDE 11
  • 27. April 06

LMU München, Medieninformatik, Instrumented Environments, SS 2006, Andreas Butz 11

Interaction with IE, some visions

Interaction, multiple heterogeneous displays Source: “Minority Report“ (Steven Spielberg, USA 2002) Consulting by John Underkoffler (gestures), Jaron Lanier (VR) Electronic Ink, Ubiquitous displays

slide-12
SLIDE 12
  • 27. April 06

LMU München, Medieninformatik, Instrumented Environments, SS 2006, Andreas Butz 12

Some related conferences and workshops

  • International Conference on Ubiquitous Computing (Ubicomp, Springer)
  • International Conference on Pervasive Computing (Pervasive, Springer)
  • IEEE International Conference on Pervasive Computing and

Communications (PerCom, IEEE)

  • IEE Symposium on Intelligent Environments
  • Mobile Human-Computer-Interaction (mobileHCI, Springer)
  • Computer-Human-Interaction (CHI, ACM)
  • Intelligent User Interfaces (IUI, ACM)
  • AI in mobile Systems (AIMS, ECAI/IJCAI-Workshop notes)
  • AITAmI workshop
  • Multi-User Ubiquitous User Interfaces (MU3I, IUI workshop notes)
  • Smart Graphics Symposium (SG, Springer)
  • User Modeling (UM, Springer)
slide-13
SLIDE 13
  • 27. April 06

LMU München, Medieninformatik, Instrumented Environments, SS 2006, Andreas Butz 13

Some Journals and Digital Libraries

IEEE Pervasive Computing Personal and Ubiquitous Computing, Springer ACM Transactions on Computer-Human Interaction ACM Digital Library http://portal.acm.org Springer Online http://link.springer.de/ol/csol/

  • Lecture Notes in Computer Sciences Series
slide-14
SLIDE 14
  • 27. April 06

LMU München, Medieninformatik, Instrumented Environments, SS 2006, Andreas Butz 14

Class top level structure

Intro & Motivation (1) Base technologies

  • Hardware (2-3)
  • Software & modeling (2-3)

Interaction in IE (2-3)

  • Different styles

Intelligent IEs (1) Example systems (1) Related fields, Summary (1) Demos (1)

slide-15
SLIDE 15
  • 27. April 06

LMU München, Medieninformatik, Instrumented Environments, SS 2006, Andreas Butz 15

Base technologies: hardware

Displays

  • small, med, large
  • projection, steerable
  • touch screens/input
  • digital ink, e-paper

Sensing

  • Cameras, microphones
  • RFID, NFC
  • IR, BT

Tracking

  • Optical: markers &

markerless

  • Acoustic: active & passive
  • Radio: GPS, WLAN
  • hybrid: Cricket
  • Magnetic
  • Load sensing, Floor tiles
  • Tracking Meta-techniques
  • sensor fusion
  • temporal filtering
  • Dead reckoning

Networking

  • IR
  • WLAN/BT/custom RF
  • 1-wire bus, Pin&Play

hardware toolkits

  • SmartIts
  • Motes
  • [...]
  • Phidgets
slide-16
SLIDE 16
  • 27. April 06

LMU München, Medieninformatik, Instrumented Environments, SS 2006, Andreas Butz 16

Base technologies: SW & modeling

Device descriptions

  • JINI, UPNP, [...]

Architectures

  • tuple spaces/event

heap

  • (multi-) blackboards
  • pipe-and-filter

SW architectures in research systems

  • BEACH,
  • [...]

User modeling

  • Individual Ums
  • Stereotypes
  • explicit vs. implicit UM

acquisition

  • ubis world

Context modeling

  • context toolkit
  • genius loci & numen
  • [...]
slide-17
SLIDE 17
  • 27. April 06

LMU München, Medieninformatik, Instrumented Environments, SS 2006, Andreas Butz 17

Interaction in instrum. environments

direct physical interaction tangible interaction remote interaction implicit interaction ambient Uis interface agents interaction models

  • strictly tool-based
  • automation, assisted living
  • proactivity, intelligent agents
slide-18
SLIDE 18
  • 27. April 06

LMU München, Medieninformatik, Instrumented Environments, SS 2006, Andreas Butz 18

Intelligent instrum. environments

representations of actions & time action & plan recognition dialog planning

slide-19
SLIDE 19
  • 27. April 06

LMU München, Medieninformatik, Instrumented Environments, SS 2006, Andreas Butz 19

Example Systems

Xerox ParcTab Active Badges OXYGEN, i-room FhG Roomware Rekimoto Continuous work spaces Linz, Essex, SB projects [...]

slide-20
SLIDE 20
  • 27. April 06

LMU München, Medieninformatik, Instrumented Environments, SS 2006, Andreas Butz 20

Related fields, Summary

IE vs. wearable computing IE vs. AR Summary, hints for exam questions Demos of exercise projects

slide-21
SLIDE 21
  • 27. April 06

LMU München, Medieninformatik, Instrumented Environments, SS 2006, Andreas Butz 21

Appointments

  • 28.04. Intro, overview
  • 05.05. Visit in the Fluidum IE, exercise groups
  • 12.05.
  • 19.05.
  • 26.05. -> 24.05. (Christi Himmelfahrt)
  • 02.06.
  • 09.06.
  • 16.06. -> 14.06. (Fronleichnam)
  • 23.06.
  • 30.06.
  • 07.07.
  • 14.07.
  • 21.07. -> 19.07. Presentations of exercise results
  • 28.07. AB & OH @SG symposium
slide-22
SLIDE 22
  • 27. April 06

LMU München, Medieninformatik, Instrumented Environments, SS 2006, Andreas Butz 22

The FLUIDUM Instrumented Environment

slide-23
SLIDE 23
  • 27. April 06

LMU München, Medieninformatik, Instrumented Environments, SS 2006, Andreas Butz 23

Brainstorming Demo

slide-24
SLIDE 24
  • 27. April 06

LMU München, Medieninformatik, Instrumented Environments, SS 2006, Andreas Butz 24

Instrumented Environment SUPIE

Saarland University Pervasive Instrumented Environment

slide-25
SLIDE 25
  • 27. April 06

LMU München, Medieninformatik, Instrumented Environments, SS 2006, Andreas Butz 25

Physikalische Suchfunktion

Indexerstellung: Abscannen des Raums mit Kamera Marker-Erkennung (>= 1cm) mit AR-Toolkit Abspeichern der Pan/Tilt Werte zu jeder Marker ID Dauer: ca. 1h für gesamten Raum Suchanfrage: Marker ID Ansteuern der gespeicherten Pan/Tilt Werte Anleuchten des Objektes Bei ungenauer Position: Bereich ausleuchten

slide-26
SLIDE 26
  • 27. April 06

LMU München, Medieninformatik, Instrumented Environments, SS 2006, Andreas Butz 26

Annotating physical objects

Idea:

  • Environment should be able to „label“ objects

Approach:

  • Describe possible display

surfaces in the 3D model

  • Position annotations acc. to:
  • Proximity to objects
  • Uniqueness of position
  • Grouping of annotations
  • Main axes of objects
slide-27
SLIDE 27
  • 27. April 06

LMU München, Medieninformatik, Instrumented Environments, SS 2006, Andreas Butz 27

camera-based interaction

projection widgets hand gestures finger gestures

slide-28
SLIDE 28
  • 27. April 06

LMU München, Medieninformatik, Instrumented Environments, SS 2006, Andreas Butz 28

Course Material

Web site: www.mimuc.de Lehre Literature

  • Relevant scientific articles will be given as necessary

Presentation slides

  • will be available shortly after each appointment (in pdf

format)

  • All-in-one PDF file for exam preparation at the end of

the semester

Relevant material for exams:

  • Lecture slides
  • Understanding from the articles given
slide-29
SLIDE 29
  • 27. April 06

LMU München, Medieninformatik, Instrumented Environments, SS 2006, Andreas Butz 29

Exercises

Tutor: Otmar Hilliges (+ Sebastian Boring) Task: develop a component for the Fluidum IE (Amalienstrasse 17, basement) Meet next week (Fri 5.5. 12:15) there to see room demo and define projects Meet weekly to discuss progress, exchange and demo intermediate states On 19.07. Final presentation (slides and demo)

slide-30
SLIDE 30
  • 27. April 06

LMU München, Medieninformatik, Instrumented Environments, SS 2006, Andreas Butz 30

Lecture certificate

Based on

  • Succesful demo of the exercise project
  • Final presentation of the project

Graded (!)

  • Irrelevant for Diploma students (just ignore)
  • Relevant if you switch to Bachelor/Master

later