GaussBricks: Magnetic Building Blocks for Constructive Tangible - - PowerPoint PPT Presentation

▶
gaussbricks
SMART_READER_LITE
LIVE PREVIEW

GaussBricks: Magnetic Building Blocks for Constructive Tangible - - PowerPoint PPT Presentation

Sep 20, 2023 176 likes •851 views

GaussBricks: Magnetic Building Blocks for Constructive Tangible Interactions on Portable Displays Rong-Hao Liang, Liwei Chan, Hung-Yu Tseng, Han-Chih Kuo, Da-Yuan Huang, De-Nian Yang, and Bing-Yu Chen National Taiwan University & Academia

slide-1
SLIDE 1

GaussBricks:

Magnetic Building Blocks for Constructive Tangible Interactions on Portable Displays

Rong-Hao Liang, Liwei Chan, Hung-Yu Tseng, Han-Chih Kuo, Da-Yuan Huang, De-Nian Yang, and Bing-Yu Chen

National Taiwan University & Academia Sinica

slide-2
SLIDE 2

Creating Physical Forms to Interact with Virtual Contents on Portable Displays

slide-3
SLIDE 3

Building Blocks

slide-4
SLIDE 4

Creating Geometries and Structures

by Nathan Sawaya

slide-5
SLIDE 5

Creating Mechanical Movements

slide-6
SLIDE 6

Constructive Assembly TUIs

Topobo [Raffle et. al. CHI ’04]

slide-7
SLIDE 7
slide-8
SLIDE 8

Active Blocks: battery & microcontroller

Blocks [Anderson et. al. SIGGRAPH ’00]

slide-9
SLIDE 9

Passive blocks - Cameras

DuploTrack [Gupta et. al. UIST ’12]

slide-10
SLIDE 10

Portable Displays

?

slide-11
SLIDE 11

Passive blocks - Optical Camera

X

slide-12
SLIDE 12

Passive blocks - Capacitive Tracking

Token

slide-13
SLIDE 13

Passive blocks - Capacitive Multitouch Displays

Capstones

[Chan et. al. CHI ‘12]

slide-14
SLIDE 14

Hardware 2D TUI Design Space of Portable Displays Token+Surface Constructive Assembly

Optical Cameras

3D

Optical Tags Optical tracking is occlusion-sensitive

slide-15
SLIDE 15

Hardware 2D TUI Design Space of Portable Displays Token+Surface Constructive Assembly 3D

Capacitive tracking cannot effectively support form construction Capacitance Tags Capacitive Multitouch Display CapStones Optical Cameras Optical Tags

[Chan et. al. CHI’12]

slide-16
SLIDE 16

Hardware 2D TUI Design Space of Portable Displays Token+Surface Constructive Assembly 3D

Capacitance Tags Capacitive Multitouch Display CapStones Optical Cameras Optical Tags

[Chan et. al. CHI’12]

New Materials and Techniques are Needed

slide-17
SLIDE 17

Magnetic Tangibles

Attachable Hall-Sensor Grid [Liang et al. UIST’12]

GaussSense GaussBits

Magnetic Tangible Bits [Liang et al. CHI’13]

slide-18
SLIDE 18

Attachable Hall-Sensor Grid

GaussSense

Analog Hall-Sensor Grid portable magnetic-field camera

Attachable Hall-Sensor Grid [Liang et al. UIST’12]

GaussSense

slide-19
SLIDE 19

Attachable Hall-Sensor Grid

GaussSense

Magnetic Tangibles passive, small, and occlusion-free

GaussBits

Magnetic Tangible Bits

GaussBits

Magnetic Tangible Bits [Liang et al. CHI’13]

slide-20
SLIDE 20

Hardware 2D TUI Design Space of Portable Displays Token+Surface Constructive Assembly 3D

Capacitance Tags Capacitive Multitouch Display CapStones

Optical Cameras Optical Tags

[Chan et. al. CHI’12]

Attachable Hall-Sensor Grid

[Liang et al. UIST’12]

GaussSense GaussBits

Magnetic Tangible Bits

[Liang et al. CHI’13]

Near-Surface 3D

Portable and Occlusion-Free Interaction Design On and Above Portable Displays

A technique and material that support

slide-21
SLIDE 21

A technique and material that Feasible for Designing Building Blocks by Magnets?

Hardware 2D TUI Design Space of Portable Displays Token+Surface Constructive Assembly 3D

Capacitance Tags Capacitive Multitouch Display CapStones

Optical Cameras Optical Tags

[Chan et. al. CHI’12]

Attachable Hall-Sensor Grid

[Liang et al. UIST’12]

GaussSense GaussBits

Magnetic Tangible Bits

[Liang et al. CHI’13]

Near-Surface 3D

slide-22
SLIDE 22

Magnets naturally attract together

slide-23
SLIDE 23

Magnets naturally attract together

slide-24
SLIDE 24

Challenge on Sensing

Magnet Analog Hall-Sensor Grid

The distribution of magnetic field may differ from the shape of magnetic sculpture Resulting Magnetic Field Distribution

slide-25
SLIDE 25

Analog Hall-Sensor Grid

Magnet attracting each other also counteract each other

Challenge on Sensing

The distribution of magnetic field may differ from the shape of magnetic sculpture

slide-26
SLIDE 26

4

Analog Hall-Sensor Grid

Magnet attracting each other also counteract each other

Challenge on Sensing

The distribution of magnetic field may differ from the shape of magnetic sculpture

slide-27
SLIDE 27

4

Analog Hall-Sensor Grid

Magnet attracting each other also counteract each other

Challenge

The distribution of magnetic field may differ from the shape of magnetic sculpture

slide-28
SLIDE 28

Firm Case Analog Hall-Sensor Grid

Shaping the Magnetic Fields for Sensing

Keep the construction’s magnetic field in the same polarity

slide-29
SLIDE 29

Firm Case Analog Hall-Sensor Grid

Shaping the Magnetic Fields for Sensing

Keep the construction’s magnetic field in the same polarity

slide-30
SLIDE 30

Valid magnetic-field distribution for deriving the geometry of a magnetic construction

slide-31
SLIDE 31

3 Types of GaussBricks

3 Types of GaussBricks > Sensing Algorithm > 3 Basic Utilities > 3 Advanced Extensions

slide-32
SLIDE 32
  • 1. Construction Bricks: for additive construction
slide-33
SLIDE 33
  • 1. Construction Bricks

for addictive construction

slide-34
SLIDE 34
  • 2. Supporting Bricks: for stabilizing structures

(1x1 construction bricks)

slide-35
SLIDE 35
  • 3. Locking Bricks: reduce unwanted DOFs by locking joints

gear-shaped female connector gear-shaped male connector

slide-36
SLIDE 36
  • 3. Locking Bricks

rigidifying parts to reduce unwanted DOFs

slide-37
SLIDE 37

Simple, Stable, and Transparent in use.

slide-38
SLIDE 38

Geometry Skeleton Sensing Algorithm

3 Types of GaussBricks > Sensing Algorithm > 3 Basic Utilities > 3 Advanced Extensions

slide-39
SLIDE 39
  • 1. contour extraction

Geometry

slide-40
SLIDE 40
  • 2. segmentation

Geometry

not stacked stacked

  • verhanging
slide-41
SLIDE 41
slide-42
SLIDE 42

locking brick supporting brick non-magnetic brick 50 100 150 (Unit: gauss)

  • verhanging

conditions supporting bricks + locking bricks supporting bricks

  • nly

3 2 3 1 2 3 Resolves 3D structures in maximum 3 levels of stacking

The uses of locking bricks do not affect sensing.

levels

slide-43
SLIDE 43

Skeleton

slide-44
SLIDE 44

Using Constrained Delaunay Triangulation

  • 1. spine extraction

Skeleton

slide-45
SLIDE 45
  • 2. trimming and merging

Skeleton

slide-46
SLIDE 46

Skeleton

  • 3. simplifying
slide-47
SLIDE 47

Skeleton

  • 4. trimming

Result

slide-48
SLIDE 48
slide-49
SLIDE 49

Basic Utilities of the Magnetic Building Blocks

1 2 3

3 Types of GaussBricks > Sensing Algorithm > 3 Basic Utilities > 3 Advanced Extensions

slide-50
SLIDE 50
  • 1. Interactive Form Construction and Manipulation
slide-51
SLIDE 51
  • 1. Interactive Form Construction and Manipulation
slide-52
SLIDE 52
  • 2. Constructing Elastic Physical Structures

by utilizing repulsions and attractions

slide-53
SLIDE 53
  • 2. Constructing Elastic Physical Structures

by utilizing repulsions and attractions

slide-54
SLIDE 54
  • 3. Constructing Controllers for Near-Surface Interactions

GaussBits

Magnetic Tangible Bits [Liang et al. CHI’13]

slide-55
SLIDE 55
  • 3. Constructing Controllers for Near-Surface Interactions
slide-56
SLIDE 56

Extending GaussBricks for More Interactivity Actuation brick Touch brick Optic brick

1 2 3

3 Types of GaussBricks > Sensing Algorithm > 3 Basic Utilities > 3 Advanced Extensions

slide-57
SLIDE 57
  • 1. Actuation Bricks enable Shape Changing

servo motor top bottom gear-shaped female connector gear-shaped male connector

slide-58
SLIDE 58
  • 1. Actuation Bricks enable Shape Changing
slide-59
SLIDE 59
  • 1. Actuation Bricks enable Shape Changing
slide-60
SLIDE 60
  • 2. Touch Bricks enable Multitouch Inputs

top bottom conductive coating

slide-61
SLIDE 61
  • 2. Touch Bricks enable Multitouch Inputs
slide-62
SLIDE 62
  • 2. Touch Bricks enable Multitouch Inputs
slide-63
SLIDE 63

fiber optics bundle

  • 3. Optic Bricks enhance Display Capability
slide-64
SLIDE 64
  • 3. Optic Bricks enable Display Capability
slide-65
SLIDE 65

Hardware 2D TUI Design Space of Portable Displays Token+Surface Constructive Assembly

Capacitance Tags Capacitive Multitouch Display

Attachable Hall-Sensor Grid

[Liang et al. UIST’12]

GaussSense GaussBits

Magnetic Tangible Bits

[Liang et al. CHI’13]

Near-Surface 3D

Conclusion

slide-66
SLIDE 66

Hardware 2D TUI Design Space of Portable Displays Token+Surface Constructive Assembly

Capacitance Tags Capacitive Multitouch Display CapStones

[Chan et. al. CHI’12]

Attachable Hall-Sensor Grid

[Liang et al. UIST’12]

GaussSense GaussBits

Magnetic Tangible Bits

[Liang et al. CHI’13]

Near-Surface 3D

GaussBricks

Magnetic Building Blocks

Magnetic Building Blocks for Supporting Constructive Tangible Interactions on Portable Displays