Tangible User Interface Ludovic GARREAU, Nadine COUTURE LIPSI-ESTIA - - PDF document

▶
tangible user interface
SMART_READER_LITE
LIVE PREVIEW

Tangible User Interface Ludovic GARREAU, Nadine COUTURE LIPSI-ESTIA - - PDF document

Sep 07, 2023 368 likes •434 views

TUI ESKUA Design September, 8 th Monday 2003 : Physical interaction Workshop on Real World User Interfaces Sample Context Mobile HCI Conference 2003 in Udine Study of Tangible User H uman C omputer Interface for handling I

slide-1
SLIDE 1

Study of Tangible User Interface for handling tridimensional objects

Ludovic GARREAU, Nadine COUTURE

LIPSI-ESTIA (biarritz), LaBRI (bordeaux) France September, 8th Monday 2003 : “Physical interaction – Workshop on Real World User Interfaces” Mobile HCI Conference 2003 in Udine

TUI ESKUA Design Sample

September , 8th 2003

Ludovic Garreau

2/24

Context

Handling 3D Visualisati

  • n

Human Computer Interaction

Tangible User Interface

TUI ESKUA Design Sample

September , 8th 2003

Ludovic Garreau

3/24

  • 1. Presentation of TUI
  • 2. Description of ESKUA
  • 3. Specification and design
  • 4. Example of theoretical ESKUA use

Outline

TUI ESKUA Design Sample

September , 8th 2003

Ludovic Garreau

4/24

  • 1. Presentation of TUI
  • 2. Description of ESKUA
  • 3. Specification and design
  • 4. Example of theoretical ESKUA use

Outline

TUI ESKUA Design Sample

September , 8th 2003

Ludovic Garreau

5/24

Tangible User Interface (1/3)

Aim : provide control of digital information with real

  • bjects
  • Pioneers are Frazer 1983 and Aish 1979

Aish R., "3D Input for CAAD Systems, Computer-Aided Design", 11 (2):66-70, Mar. 1979.

  • MIT, tangible MediaLab
  • B. A. Ullmer :Models and Mechanisms for Tangible User Interfaces, University of Illinois, 1995

Segal model . E. Sharlin et AL. 3D Computer interaction

using physical objects: exploration of tangible user interfaces .Leonardo Electronic Almanac, 9, 7 (2001).

CADcast (MIT, 1999)

TUI ESKUA Design Sample

September , 8th 2003

Ludovic Garreau

6/24

Tangible User Interface (2/3)

exploit human sense of touch and kinesthesia Give physical form to digital information Choice of Artifact Link between action and result

Architectural Interpretation of 3D Models

Anderson, D et AL. "Tangible Interactions and Graphical Interpretation: A New Approach to 3D Modeling", ACM SIGGRAPH, pps 393 -402, July 2000

Aim : provide control of digital information with real

  • bjects
slide-2
SLIDE 2

TUI ESKUA Design Sample

September , 8th 2003

Ludovic Garreau

7/24

Tangible User Interface (3/3)

ActiveCube

  • Y. Kitamura and al : Real Time Interaction with ActiveCube, CHI 2001 Extended

abstracts

Aim : provide control of digital information with real

  • bjects

TUI ESKUA Design Sample

September , 8th 2003

Ludovic Garreau

8/24

  • 1. Presentation of TUI
  • 2. Description of ESKUA
  • 3. Specification and design
  • 4. Example of theoretical ESKUA use

Outline

TUI ESKUA Design Sample

September , 8th 2003

Ludovic Garreau

9/24

ESKUA Project

Design and Create a Tangible User Interface to allow users to handle and assemble virtual objects with real objects.

Pascal Guitton, Nadine Rouillon Couture , Jérémy Legardeur , Ludovic Garreau

TUI ESKUA Design Sample

September , 8th 2003

Ludovic Garreau

10/24

Virtual World Real World

TUI

Input device Software User Virtual Objects Graphical User Interface Capture system

TUI ESKUA Design Sample

September , 8th 2003

Ludovic Garreau

11/24

  • 1. Presentation of TUI
  • 2. Description of ESKUA
  • 3. Specification and design
  • 4. Example of theoretical ESKUA use

Outline

TUI ESKUA Design Sample

September , 8th 2003

Ludovic Garreau

12/24

Artifact 1/2

What is the good form of the artifact ?

Handling, connexion artifact/model, assemblage

mock

  • up

?

Abstract form

slide-3
SLIDE 3

TUI ESKUA Design Sample

September , 8th 2003

Ludovic Garreau

13/24

Artifact 2/2

« Design for Assembly» (DFA)

  • Cylinder
  • Block

Good form for handling and assemblage.

  • J. Legardeur and L. Garreau and N. Couture.

Des interacteurs pour l'assemblage mécanique en CAO. 3rd International Conference : Integrated Design and Production, CPI'2003, Meknès, Maroc, 2003.

TUI ESKUA Design Sample

September , 8th 2003

Ludovic Garreau

14/24

Large Medium Small

Our Artifacts : “Interacteurs”

Interacteur ˜ inter + to act on Typology interacteur

Cylinder Parallelepiped Size Depth Name Name 14 mm Cs , 1 Ps , 1 28mm Cs,2 Ps,2 42mm Ps,3 56mm Cs,4 Ps,4 Small (48mm) 98mm Cs,7 Ps,7 14 mm Cm, 1 Pm, 1 28mm Cm, 2 Pm,

2

56mm Pm,

3

70mm Cm, 4 Pm,

4

Medium (70mm) 98mm Cm, 7 Pm,

7

14 mm Cl , 1 Pl ,

1

28mm Cl , 2 Pl ,

2

56mm Cl , 4 Pl ,

4

Large (98mm) 98mm Cl , 7 Pl ,

7

1 Make plan with Catia

(CAD software)

2 Machining with lathe 3 Machining with drilling machine

1 2 3 Fabrication process TUI ESKUA Design Sample

September , 8th 2003

Ludovic Garreau

15/24

Camera and a vision processor board (MatroxOdyssey Xa) Model based System approach

Link between real world and virtual

  • ne

J-B de la Rivière and P. Guitton. Hand posture recognition in large display VR

  • environments. In gesture Workshop, April 2003.

CRT screen with an OpenGL display

TUI ESKUA Design Sample

September , 8th 2003

Ludovic Garreau

16/24

Software Architecture

Link (joint)

Name List of pieces Orientation Position Type List of links Name (String) Operation History

Assembly GUI Interacteur

Name 3D representation Colour Position Orientation Identifier List of Interacteurs Model Based System approach

CaptureDat a Shape

3D representation Colour Orientation Position Identifier Name CameraArg Collision Detection

ConvertDat a

TUI ESKUA Design Sample

September , 8th 2003

Ludovic Garreau

17/24

  • 1. Presentation of TUI
  • 2. Description of ESKUA
  • 3. Specification and design
  • 4. Example of theoretical ESKUA use

Outline

September , 8th 2003

Ludovic Garreau

18/24

TUI ESKUA Design Sample

Camer a Worktop start

Top View

interacteurs

Platform : ESKUA

(under construction)

Screen for the user interface List of parts lis t vie w

slide-4
SLIDE 4

September , 8th 2003

Ludovic Garreau

19/24

TUI ESKUA Design Sample

lis t vie w

Top View

Platform : ESKUA

(under construction)

September , 8th 2003

Ludovic Garreau

20/24

TUI ESKUA Design Sample

lis t vie w

Platform : ESKUA

(under construction)

start

September , 8th 2003

Ludovic Garreau

21/24

TUI ESKUA Design Sample

start

Platform : ESKUA

(under construction)

lis t vie w

September , 8th 2003

Ludovic Garreau

22/24

TUI ESKUA Design Sample

start

Platform : ESKUA

(under construction)

lis t vie w

September , 8th 2003

Ludovic Garreau

23/24

TUI ESKUA Design Sample

Platform : ESKUA

(under construction)

start

  • J. Legardeur and L. Garreau and N. Couture.

Des interacteurs pour l'assemblage mécanique en CAO. 3rd International Conference : Integrated Design and Production, CPI'2003, Meknès, Maroc, 2003.

lis t vie w

September , 8th 2003

Ludovic Garreau

24/24

TUI ESKUA Design Sample Now we need to :

  • adapt the 3D detection capture (model

approach)

  • make the worktop

Future Work

Currently, we finish to design our interacteurand develop the software.

slide-5
SLIDE 5

September , 8th 2003

Ludovic Garreau

Questions ?

September , 8th 2003

Ludovic Garreau

60° 90°

September , 8th 2003

Ludovic Garreau

27/24

TUI ESKUA Design Sample

Illustration

Logiciel de CAO Sélection avec la souris de S1 Sélection avec la souris de S2 Sélection avec la souris de l'action « coplanaire » Sélection avec la souris de S3 Sélection avec la souris de S4 Sélection avec la souris de l'action « coplanaire » Sélection avec la souris de S5 Sélection avec la souris de S6 Sélection avec la souris de l'action «jointes »