Penspective: a Perspective-Aware Game Map Editor with Natural - - PowerPoint PPT Presentation

Title Introduction Design System Prototype Conclusion Bibliography

Penspective: a Perspective-Aware Game Map Editor with Natural Interaction

Alexandre M. F. de Sousa, Anderson C. M. Tavares, Carlos H. Morimoto

Department of Computer Science - DCC Institute of Mathematics and Statistics - IME University of Sao Paulo - USP {alemart, acmt, hitoshi}@ime.usp.br

October 15, 2013

Sousa, Tavares, Morimoto Penspective

Title Introduction Design System Prototype Conclusion Bibliography

Introduction

Map editors; Learning curve (WIMP → hotkeys, cluttered menus);

pixel-hungry, indirection; mouse/keyboard → impose complex interactions.

Advances in Human-Computer Interaction (HCI); Post-WIMP interfaces [1];

new generation of UIs; gestures, speech...

Leverage users’ mundane, pre-existent knowledge.

reduce the gap: human goals/actions; communication in the non-digital realm.

Sousa, Tavares, Morimoto Penspective

Title Introduction Design System Prototype Conclusion Bibliography

Introduction

Interaction: drawing sketches with pen and eraser;

versatile, widely used;

• bvious metaphor.

Visualization: illusion of depth;

like magic paper.

Penspective:

Grid paper (little 3D blocks); Affordance of pen and eraser; 3D View without glasses. Figure: Pen and eraser.

Sousa, Tavares, Morimoto Penspective

Title Introduction Design System Prototype Conclusion Bibliography

Design

(a) Drawing blocks. (b) Removing blocks. (c) Moving (selection phase). (d) Moving (dragging phase).

Sousa, Tavares, Morimoto Penspective

Title Introduction Design System Prototype Conclusion Bibliography

Design

(e) Adjusting height (before). (f) Adjusting height (after).

Sousa, Tavares, Morimoto Penspective

Title Introduction Design System Prototype Conclusion Bibliography

System

Multitouch Interaction

Kinect sensor (depth + color)

Detect touch events on ordinary surfaces [2]; Recognize the touching artifact [3].

(g) Detecting touch. (h) Color.

Sousa, Tavares, Morimoto Penspective

Title Introduction Design System Prototype Conclusion Bibliography

System Description

Above-the-surface Interaction

Kinect sensor (depth + color); Grab a template (grayscale); Track its position: pt = argmin(x,y)costt(x, y) costt(x, y) =        α · (1 − R(x, y)) + if dt(x, y) ≤ 1 (1 − α) · dt(x, y) ∞

• therwise

where:

α ∈ [0, 1], r are empirically defined; dt(x, y) = (x, y) − pt−1 / r; R(x, y) ∈ [0, 1] is a template matching function [4].

Depth sensor → 3D position.

Sousa, Tavares, Morimoto Penspective

Title Introduction Design System Prototype Conclusion Bibliography

System Description

Skeleton Tracking/Off-Axis Perspective

another Kinect camera tracks the user in physical space; calibration phase → position of the user relative to the screen;

• ff-axis perspective projection [5];

illusion of depth. Figure: calibration phase.

Sousa, Tavares, Morimoto Penspective

Title Introduction Design System Prototype Conclusion Bibliography

System Description

Setup: 2 Kinects, 1 LCD screen, pen, eraser. Components exchange data using VRPN [6];

Figure: System components.

Sousa, Tavares, Morimoto Penspective

Title Introduction Design System Prototype Conclusion Bibliography

Prototype

(a) Prototype (b) Changing the viewpoint (c) Erasing (d) Drawing

Sousa, Tavares, Morimoto Penspective

Title Introduction Design System Prototype Conclusion Bibliography

Prototype

(e) Height adjustment (f) Height adjustment (g) Height adjustment (h) moving a block

Sousa, Tavares, Morimoto Penspective

Title Introduction Design System Prototype Conclusion Bibliography

Conclusion

More direct ways of building maps; A new form of interaction: drawing on grid paper; Working prototype to show the viability of the concept.

Figure: Penspective.

Sousa, Tavares, Morimoto Penspective

Title Introduction Design System Prototype Conclusion Bibliography

Bibliography I

• A. van Dam, “Post-WIMP user interfaces,” Communications
• f the ACM, vol. 40, no. 2, pp. 63–67, Feb. 1997.
• A. D. Wilson, “Using a depth camera as a touch sensor,” in

ACM International Conference on Interactive Tabletops and Surfaces - ITS ’10, ACM. New York, New York, USA: ACM Press, 2010, p. 69. J.-Y. Lee and S. I. Yoo, “An elliptical boundary model for skin color detection,” in Proc. of the 2002 International Conference

• n Imaging Science, Systems, and Technology.

Citeseer, 2002.

• A. Kaehler and G. Bradski, Learning OpenCV: Computer

Vision with the OpenCV Library, 1st ed. O’Reilly Media, 2008.

Sousa, Tavares, Morimoto Penspective

Title Introduction Design System Prototype Conclusion Bibliography

Bibliography II

• R. Kooima, “Generalized Perspective Projection,” 2013.

[Online]. Available: http: //csc.lsu.edu/∼kooima/articles/genperspective/index.html

• R. M. Taylor, T. C. Hudson, A. Seeger, H. Weber, J. Juliano,

and A. T. Helser, “VRPN: a device-independent, network-transparent VR peripheral system,” in Proceedings of the ACM symposium on Virtual reality software and technology - VRST ’01. New York, New York, USA: ACM Press, 2001, p. 55.

Sousa, Tavares, Morimoto Penspective