CS-525U: 3D User Interaction Intro to 3D UI Robert W. Lindeman - - PowerPoint PPT Presentation

▶

Oct 03, 2022 320 likes •577 views

CS-525U: 3D User Interaction Intro to 3D UI Robert W. Lindeman Worcester Polytechnic Institute Department of Computer Science gogo@wpi.edu Why Study 3D UI? Relevant to real-world tasks Can use familiarity to ease adaptation Can

SLIDE 1

CS-525U: 3D User Interaction

Intro to 3D UI

Robert W. Lindeman

Worcester Polytechnic Institute Department of Computer Science

gogo@wpi.edu

SLIDE 2

R.W. Lindeman - WPI Dept. of Computer Science 2

Why Study 3D UI?

Relevant to real-world tasks

Can use familiarity to ease adaptation Can increase realism of experience

Mature technology

Cheap, robust solutions Need to create interface mappings

3D interaction is difficult

Many VR/gaming systems lack necessary

cues

Adapting WIMP techniques is not adequate

SLIDE 3

R.W. Lindeman - WPI Dept. of Computer Science 3

Why Study 3D UI? (cont.)

Current approaches are either too simple

r unusable

Since users have problems, dumb it down! Need to be able to perform all actions

though!

Ripe area for study

Very hot area of HCI We know a lot about doing things in 2D And also about doing things in the real world

SLIDE 4

R.W. Lindeman - WPI Dept. of Computer Science 4

Sample Applications

Design and prototyping

Assembly Ergonomics (test virtual prototype)

Psychiatric treatment

Phobias Post-traunatic stress disorders

Scientific visualization

Explore 3D data sets

Collaborative work

Tools, gestures, madia control

SLIDE 5

R.W. Lindeman - WPI Dept. of Computer Science 5

A Brief History

Before 1980

Mostly keyboard input Display for text

After first Graphical User Interfaces

(GUIs)

Added complexity Growth in HCI studies

SLIDE 6

R.W. Lindeman - WPI Dept. of Computer Science 6

A Brief History (cont.)

HCI draws on

Perception Cognition Linguistics Human factors Ethnography Graphics design Computer science …

SLIDE 7

R.W. Lindeman - WPI Dept. of Computer Science 7

A Brief History (cont.)

Technology developments also drove

growth

Flight simulators 3D Graphics Augmented Reality (AR) Virtual Reality (VR) Flight

SLIDE 8

R.W. Lindeman - WPI Dept. of Computer Science 8

Birth of Virtual Reality

The Ultimate Display

paper by Ivan Sutherland (1965)

Sutherland’s HMD

(1968)

Jaron Lanier VPL

DataGlove (1985)

Jim Foley's Scientific

American paper (1987)

SLIDE 9

R.W. Lindeman - WPI Dept. of Computer Science 9

Basic Interaction Tasks in VR (Bowman et al.)

Object Selection

What do I want to manipulate?

Object Manipulation

How can I manipulate it?

Navigation

Wayfinding: How do I know where I am, and

how to get where I am going?

Travel: How do I get there? (locomotion)

System Control

How do I change system parameters?

Symbolic Input

Inputting text and numbers

SLIDE 10

R.W. Lindeman - WPI Dept. of Computer Science 10

Oh, I forgot One (Lindeman)

Killing

SLIDE 11

R.W. Lindeman - WPI Dept. of Computer Science 11

Dealing with Objects

Problems

Ambiguity Distance

Selection Approaches

Direct / enhanced grabbing Ray-casting techniques Image-plane techniques

Manipulation Approaches

Direct position / orientation control Worlds in miniature Skewers Surrogates Courtesy: D. Bowman

SLIDE 12

R.W. Lindeman - WPI Dept. of Computer Science 12

Navigation: Wayfinding

People get lost/disoriented easily Traditional tools

Maps (North-up vs.

Forward-up)

Landmarks Spoken directions

Non-traditional

Callouts Zooming

Images: http://vehand.engr.ucf.edu/handbook/Chapters/Chapter28/Chapter28.html

SLIDE 13

R.W. Lindeman - WPI Dept. of Computer Science 13

Navigation: Travel

Problems

Limited physical space, unlimited virtual

space

Cables

Approaches

Fly where you point/look Treadmills Walking in place Big track ball

Image: www.virtusphere.com

CLIP

SLIDE 14

R.W. Lindeman - WPI Dept. of Computer Science 14

System Control

Need to manipulate widgets

Lighting effects Object representation Data filtering

Approaches

Floating windows Hand-held windows Gestures Menus on fingers

SLIDE 15

R.W. Lindeman - WPI Dept. of Computer Science 15

System Control Examples

Courtesy: D. Bowman Courtesy: R. Lindeman

SLIDE 16

R.W. Lindeman - WPI Dept. of Computer Science 16

User, Task & Environment

The "optimal" interface will depend on

the capabilities of the user, the nature of the task being performed, and the constraints of the environment.

User

Dexterity, level of expertise

Task

Granularity and complexity of task

Environment

Stationary, moving, noisy, etc.

SLIDE 17

R.W. Lindeman - WPI Dept. of Computer Science 17

Direct Manipulation

Courtesy: Virginia Tech

SLIDE 18

R.W. Lindeman - WPI Dept. of Computer Science 18

Can We Do WIMP in VR?

Courtesy: Virginia Tech

SLIDE 19

R.W. Lindeman - WPI Dept. of Computer Science 19

Desktop Interaction: SensAble PHANToM

http://www.sensable.com/

SLIDE 20

R.W. Lindeman - WPI Dept. of Computer Science 20

Wearable Interaction with Haptics: Immersion CyberGrasp

http://www.immersion.com/

SLIDE 21

R.W. Lindeman - WPI Dept. of Computer Science 21

Wearable Interaction: Rob's Hand-Held Windows

http://www.cs.wpi.edu/~gogo/

SLIDE 22

R.W. Lindeman - WPI Dept. of Computer Science 22

How Do We Do Menus?

Courtesy: Virginia Tech

SLIDE 23

R.W. Lindeman - WPI Dept. of Computer Science 23

Interface Devices

Courtesy: Virginia Tech

SLIDE 24

R.W. Lindeman - WPI Dept. of Computer Science 24

Augmented Reality (AR)

Courtesy: Virginia Tech