SLIDE 1
1
Dingzeyu Li Oct 24, 2017
Tags are everywhere.
2
AirCode: Unobtrusive Physical Tags for Digital Fabrication Dingzeyu - - PowerPoint PPT Presentation
AirCode: Unobtrusive Physical Tags for Digital Fabrication Dingzeyu - - PowerPoint PPT Presentation
AirCode: Unobtrusive Physical Tags for Digital Fabrication Dingzeyu Li Avinash S. Nair Shree K. Nayar Changxi Zheng 1 Tags are everywhere. metadata hyperlink interaction luggage tags boarding passes product barcodes Tags alter
SLIDE 2
SLIDE 3
Dingzeyu Li Oct 24, 2017
Compromises on Aesthetics
3
SLIDE 4
Dingzeyu Li Oct 24, 2017
Unobtrusive Tagging for Fabrication
4
SLIDE 5
Dingzeyu Li Oct 24, 2017
Related Work
5
InfraStructs - Terahertz [Willis et al., SIGGRAPH 2013] Affordance++ - Stimulating [Lopes et al., CHI 2015] Acoustic Barcodes [Harrison et al., UIST 2012]
SLIDE 6
Dingzeyu Li Oct 24, 2017
Light Transport
6
SLIDE 7
Dingzeyu Li Oct 24, 2017
Light Transport
7
light
direct
camera
SLIDE 8
Dingzeyu Li Oct 24, 2017
Light Transport
8
light
global
camera subsurface scattering
SLIDE 9
Dingzeyu Li Oct 24, 2017
Combined
9
light
direct global
camera
SLIDE 10
Dingzeyu Li Oct 24, 2017
Combined
10
light
direct global
camera
SLIDE 11
Dingzeyu Li Oct 24, 2017
Visual Appearance
11
light
direct global
camera
idea: embed unobtrusive tags in the global component 1. How to guarantee the tags are invisible? 2. How to detect the global component?
SLIDE 12
Dingzeyu Li Oct 24, 2017
Separate Global Component
12
[Nayar et al., SIGGRAPH 2006] projector camera
SLIDE 13
Dingzeyu Li Oct 24, 2017
Separate Global Component
13
camera projector
direct global
[Nayar et al., SIGGRAPH 2006]
SLIDE 14
Dingzeyu Li Oct 24, 2017
Air Pockets
14
direct
camera projector air
SLIDE 15
Dingzeyu Li Oct 24, 2017
Air Pockets
15
global
camera projector subsurface scattering
SLIDE 16
Dingzeyu Li Oct 24, 2017
Air Pockets
16
direct global
subsurface scattering intensity position
SLIDE 17
Dingzeyu Li Oct 24, 2017
Air Pockets
17
global direct
subsurface scattering 1 1
direct
intensity position
SLIDE 18
Dingzeyu Li Oct 24, 2017
AirCode Layout
18
1 1 Markers Data Bits Calibration Bits
SLIDE 19
Dingzeyu Li Oct 24, 2017
AirCode Benefits
19
- during fabrication
- invisible
- camera/projector setup
SLIDE 20
Dingzeyu Li Oct 24, 2017
Invisibility: Contrast Threshold
20
Contrast threshold is the minimal contrast required to see the target reliably.
SLIDE 21
Dingzeyu Li Oct 24, 2017
Invisibility: Contrast Threshold
21
[Bijl et al., Vision Research 1989] [Campbell and Robson, Journal of Physiology 1968]
contrast
= Lmax − Lmin ¯ L
intensity pattern 0.1% - 10% Contrast threshold is the minimal contrast required to see the target reliably.
SLIDE 22
Dingzeyu Li Oct 24, 2017
Layered Scattering Model
22
[Donner and Jensen, SIGGRAPH 2005]
Reflection profile Transmission profile
- multi-layer reflection profile
R(d), T ), T(d)
d d
SLIDE 23
Dingzeyu Li Oct 24, 2017
Multi-Layer Profile
23
R(d) = R1 + T1R2T1 + T1R2R1R2T1 + · · · = R1 + T1R2T1(1 + R1R2 + (R1R2)2 + · · · ) = R1 + T1R2T1 1 − R1R2
0-bounce 1-bounce 2-bounce
Efficient computation for layered material
[Donner and Jensen, SIGGRAPH 2005]
R1(d), T1(d) R2(d), T2(d)
SLIDE 24
Dingzeyu Li Oct 24, 2017
Putting it together
24
Details in the paper
R(d) = R1 + T1R2T1 + T1R2R1R2T1 + · · ·
0-bounce 1-bounce 2-bounce
0.1% - 10%
+
SLIDE 25
Applications
metadata embedding robotic grasping paper watermarking
SLIDE 26
Dingzeyu Li Oct 24, 2017
Metadata Embedding
26
SLIDE 27
Dingzeyu Li Oct 24, 2017 27
Metadata Embedding
SLIDE 28
Dingzeyu Li Oct 24, 2017
Metadata Embedding
28
direct global “visibility”
SLIDE 29
Dingzeyu Li Oct 24, 2017
Physical Hyperlink
29
SLIDE 30
Dingzeyu Li Oct 24, 2017
Physical Hyperlink
30
SLIDE 31
Dingzeyu Li Oct 24, 2017
Robotic Grasping
31
recognition - pose estimation - gasping location
SLIDE 32
Dingzeyu Li Oct 24, 2017 32
SLIDE 33
Dingzeyu Li Oct 24, 2017
Cup
- 33
SLIDE 34
Dingzeyu Li Oct 24, 2017
Beyond 3D Printing Materials
34
SLIDE 35
Dingzeyu Li Oct 24, 2017 35
Paper Watermarking
35
SLIDE 36
Dingzeyu Li Oct 24, 2017
Paper Watermarking
36
global component
SLIDE 37
Dingzeyu Li Oct 24, 2017 37
Air Pockets in Paper
SLIDE 38
Dingzeyu Li Oct 24, 2017
Separation Results
38
direct global
SLIDE 39
Dingzeyu Li Oct 24, 2017
Separation Results
39
mask global
SLIDE 40
Dingzeyu Li Oct 24, 2017
Separation Results
40
mask filtered global
SLIDE 41
Dingzeyu Li Oct 24, 2017
Conclusion
41
AirCode to Tag Physical Objects embedded during fabrication unobtrusive robust decoding with camera/projector non-opaque material Limitations and Future Work capture time non-smooth surface long-term preservation changeability
matterhackers.com different humidities
SLIDE 42
Dingzeyu Li Oct 24, 2017
Acknowledgement
Arthur Autz, Daniel Miau, Brian A. Smith, Henrique Teles Maia, Yonghao Yue, Shuang Zhao, Klint Qinami, Anne Fleming, Daniel Sims, Jason Hollaway Thingiverse.com users: Filar3D, mbeyerle116, gravityisweak, Tinyeyes, National Science Foundation (CAREER-1453101) Adobe PhD Research Fellowship
42
SLIDE 43