Glyph Visualization: A Fail-Safe Design Scheme Based on - - PowerPoint PPT Presentation

Glyph Visualization:

A Fail-Safe Design Scheme Based on Quasi-Hamming Distances

     

Outline



  

 

Motivation

Main Challenge: differentiation errors

Source Filtering Visual Mapping Rendering raw data D information I geometry & labels G N N N image V

vis-encoder

Displaying Optical Transmission

• ptical signal

S

• ptical signal

S' N N Viewing image V' N

vis-channel

Perception Cognition Destination information I' knowledge K N N

vis-decoder

vis-encoder vis-channel vis-decoder









Opportunities

    

 

Hamming Distance

valid codeword invalid codeword

111 000 110 101 011 100 010 001 111 000 110 101 011 100 010 001

Richard Hamming 1915-1998



 





Quasi-Hamming Distance

Source Filtering Visual Mapping Rendering raw data D information I geometry & labels G N N N image V

vis-encoder

Displaying Optical Transmission

• ptical signal

S

• ptical signal

S' N N Viewing image V' N

vis-channel

Perception Cognition Destination information I' knowledge K N N

vis-decoder

    

Possible Metrics



  



  

User-centric Estimation

MIN MAX Color (hue) Shape Component Connection Luminance Orientation Texture A B C D E F G I J Size H

Group A: MIN Pairs that are difficult to differentiate

3 8 4 2 1 5 7 6 10 9

 difficult to differentiate easy to differentiate 

d d

aa 3 8 4 2 1 5 7 6 10 9

 difficult to differentiate easy to differentiate 

d d

ab 3 8 4 2 1 5 7 6 10 9

 difficult to differentiate easy to differentiate 

d d

ac 3 8 4 2 1 5 7 6 10 9

 difficult to differentiate easy to differentiate 

d d

ad

Group B: MAX Pairs that are easy to differentiate

3 8 4 2 1 5 7 6 10 9

 difficult to differentiate easy to differentiate 

d d

ba 3 8 4 2 1 5 7 6 10 9

 difficult to differentiate easy to differentiate 

d d

bb 3 8 4 2 1 5 7 6 10 9

 difficult to differentiate easy to differentiate 

d d

bc 3 8 4 2 1 5 7 6 10 9

 difficult to differentiate easy to differentiate 

d d

bd

Group C: Colour (Hue): Measure colour (hue) distance

3 8 4 2 1 5 7 6 10 9

 difficult to differentiate easy to differentiate 

d d

ca 3 8 4 2 1 5 7 6 10 9

 difficult to differentiate easy to differentiate 

d d

cb 3 8 4 2 1 5 7 6 10 9

 difficult to differentiate easy to differentiate 

d d

cc 3 8 4 2 1 5 7 6 10 9

 difficult to differentiate easy to differentiate 

d d

cd 3 8 4 2 1 5 7 6 10 9

 difficult to differentiate easy to differentiate 

d d

ce 3 8 4 2 1 5 7 6 10 9

 difficult to differentiate easy to differentiate 

d d

cf

Group D: Basic Shape: Measure basic shape distance

3 8 4 2 1 5 7 6 10 9

 difficult to differentiate easy to differentiate 

d d

da 3 8 4 2 1 5 7 6 10 9

 difficult to differentiate easy to differentiate 

d d

db 3 8 4 2 1 5 7 6 10 9

 difficult to differentiate easy to differentiate 

d d

dc 3 8 4 2 1 5 7 6 10 9

 difficult to differentiate easy to differentiate 

d d

dd 3 8 4 2 1 5 7 6 10 9

 difficult to differentiate easy to differentiate 

d d

de 3 8 4 2 1 5 7 6 10 9

 difficult to differentiate easy to differentiate 

d d

df

Group E: Components: Measure distance due to components

3 8 4 2 1 5 7 6 10 9

 difficult to differentiate easy to differentiate 

d d

ea 3 8 4 2 1 5 7 6 10 9

 difficult to differentiate easy to differentiate 

d d

ec 3 8 4 2 1 5 7 6 10 9

 difficult to differentiate easy to differentiate 

d d

ed 3 8 4 2 1 5 7 6 10 9

 difficult to differentiate easy to differentiate 

d d

ef 3 8 4 2 1 5 7 6 10 9

 difficult to differentiate easy to differentiate 

d d

ee 3 8 4 2 1 5 7 6 10 9

 difficult to differentiate easy to differentiate 

d d

eb

Group F: Connection Lines: Measure distance due to connection lines

3 8 4 2 1 5 7 6 10 9

 difficult to differentiate easy to differentiate 

d d

ff 3 8 4 2 1 5 7 6 10 9

 difficult to differentiate easy to differentiate 

d d

fe 3 8 4 2 1 5 7 6 10 9

 difficult to differentiate easy to differentiate 

d d

fb 3 8 4 2 1 5 7 6 10 9

 difficult to differentiate easy to differentiate 

d d

fc 3 8 4 2 1 5 7 6 10 9

 difficult to differentiate easy to differentiate 

d d

fa 3 8 4 2 1 5 7 6 10 9

 difficult to differentiate easy to differentiate 

d d

fd

Group G: Luminance: Measure luminance distance

3 8 4 2 1 5 7 6 10 9

 difficult to differentiate easy to differentiate 

d d

ga 3 8 4 2 1 5 7 6 10 9

 difficult to differentiate easy to differentiate 

d d

gb 3 8 4 2 1 5 7 6 10 9

 difficult to differentiate easy to differentiate 

d d

gc 3 8 4 2 1 5 7 6 10 9

 difficult to differentiate easy to differentiate 

d d

gd 3 8 4 2 1 5 7 6 10 9

 difficult to differentiate easy to differentiate 

d d

ge 3 8 4 2 1 5 7 6 10 9

 difficult to differentiate easy to differentiate 

d d

gf

Group H: Size: Measure size distance

3 8 4 2 1 5 7 6 10 9

 difficult to differentiate easy to differentiate 

d d

ha 3 8 4 2 1 5 7 6 10 9

 difficult to differentiate easy to differentiate 

d d

hb 3 8 4 2 1 5 7 6 10 9

 difficult to differentiate easy to differentiate 

d d

hf 3 8 4 2 1 5 7 6 10 9

 difficult to differentiate easy to differentiate 

d d

he 3 8 4 2 1 5 7 6 10 9

 difficult to differentiate easy to differentiate 

d d

hc 3 8 4 2 1 5 7 6 10 9

 difficult to differentiate easy to differentiate 

d d

hd

Group I: Texture: Measure texture distance

3 8 4 2 1 5 7 6 10 9

 difficult to differentiate easy to differentiate 

d d

ia 3 8 4 2 1 5 7 6 10 9

 difficult to differentiate easy to differentiate 

d d

if 3 8 4 2 1 5 7 6 10 9

 difficult to differentiate easy to differentiate 

d d

ie 3 8 4 2 1 5 7 6 10 9

 difficult to differentiate easy to differentiate 

d d

id 3 8 4 2 1 5 7 6 10 9

 difficult to differentiate easy to differentiate 

d d

ib 3 8 4 2 1 5 7 6 10 9

 difficult to differentiate easy to differentiate 

d d

ic

Group J: Orientation: Measure orientation distance

3 8 4 2 1 5 7 6 10 9

 difficult to differentiate easy to differentiate 

d d

ja 3 8 4 2 1 5 7 6 10 9

 difficult to differentiate easy to differentiate 

d d

jd 3 8 4 2 1 5 7 6 10 9

 difficult to differentiate easy to differentiate 

d d

jb 3 8 4 2 1 5 7 6 10 9

 difficult to differentiate easy to differentiate 

d d

jc 3 8 4 2 1 5 7 6 10 9

 difficult to differentiate easy to differentiate 

d d

je 3 8 4 2 1 5 7 6 10 9

 difficult to differentiate easy to differentiate 

d d

jf

User-centric Estimation (QHD = average score  2)

MIN MAX Color (hue) Shape Component Connection Luminance Orientation Texture A B C D E F G I J Size H Human 0.5 [0.0~1.5] 4.8 [4.6~5.0] 2.2 3.4 3.5 2.8 1.2 2.1 2.2 3.0 5th* 2nd 1st 4th 8th 5th* 3rd 7th





 















Computer-based Similarity Measure: 𝑡 = 5𝛽0.5+5𝛾0.25

Computer-based Similarity Measures

1st 2nd 8th 5th* 7th 5th* 3rd 4th Computer 1.6 [0.9~2.3] 3.7 [2.9~4.7] 1.5 3.5 3.4 2.4 2.4 4.2 3.3 1.6 MIN MAX Color (hue) Shape Component Connection Luminance Orientation Texture A B C D E F G I J Size H

Comparison of the two metrics

MIN MAX Color (hue) Shape Component Connection Luminance Orientation Texture A B C D E F G I J Size H Human 2.2 3.4 3.5 2.8 1.2 2.1 2.2 3.0 5th* 2nd 1st 4th 8th 5th* 3rd 7th 1st 2nd 8th 5th* 7th 5th* 3rd 4th Computer 1.5 3.5 3.4 2.4 2.4 4.2 3.3 1.6 MIN MAX Color (hue) Shape Component Connection Luminance Orientation Texture A B C D E F G I J Size H 1.6 [0.9~2.3] 3.7 [2.9~4.7] 0.5 [0.0~1.5] 4.8 [4.6~5.0]

Glyph Design

      

Evaluation

Group O: Evaluation (I): Measure distance between our glyphs

3 8 4 2 1 5 7 6 10 9

 difficult to differentiate easy to differentiate 

d d

• a

d d

• b

d d

• c

d d

pa

d d

pb

d d

pc

d d

qa

d d

qb

d d

qc

d d

rc

d d

ra

d d

rb

d d

rd

d d

rf

d d

re

Group O: Evaluation (II): Measure distance between our glyphs

d d

sa

d d

sb

d d

sc

d d

ta

d d

tc

d d

tb

d d

uc

d d

ua

d d

ub

d d

vb

d d

vc

d d

va

d d

wc

d d

wa

d d

wd

d d

wb

d d

we

d d

wf

Group O: Evaluation (III): Measure distance between our glyphs

d d

xa

d d

xc

d d

xb

d d

ya

d d

yb

d d

yc

d d

yd

d d

yf

d d

ye

d d

za

d d

zc

d d

zb

d d

zd

d d

ze

d d

zf

User-centric and Computer-based Estimation

Users Computer

valid codeword invalid codeword

111 000 110 101 011 100 010 001 111 000 110 101 011 100 010 001

 detect 1 bit error  correct 1 bit error

User-centric and Computer-based Estimation

Users Computer Users Computer

Application: Dropbox Activity Log

Application: Git Repository History

 













Summary and Future Work