CloakingNote: A Novel Desktop Interface for Subtle Writing Using Decoy Texts Sehi L'Yi 1 Kyle Koh 1 Jaemin Jo 1 Bohyoung Kim 2 Jinwook Seo 1 ¹ Human-Computer Interaction Laboratory, Seoul National University , Seoul, South Korea 2 Division of Biomedical Engineering, Hankuk University of Foreign Studies , Yongin-si, South Korea
Writing Personal Texts in Offices Social Issues Boss Colleague X 1 new message shlyi@hcil.snu.ac.kr X new messages arrived! 2
Writing Personal Texts in Offices Privacy Issues 3
Subtle Input Interaction Methods Writing performance is largely limited by the use of gestural inputs Supporting Subtlety with Nenya: Subtle and Eyes-free Intimate Interfaces in Action: Deceptive Devices and Illusory Mobile Input with a Magnetically- Assessing the Usability and Subtlety Interactions tracked Finger Ring of EMG-based Motionless Gestures - Anderson et al. - Ashbrook et al. - Costanza et al. Shoulder-Surfing Resistant Input Interfaces Suitable only for acquiring short inputs from users such as passwords and PIN numbers Using Fake Cursors to Secure ColorPIN: Securing PIN Entry Vibrapass: Secure Authentication On-Screen Password Entry through Indirect Input Based on Shared Lies - De Luca et al. - De Luca et al. - De Luca et al.
Is my presentation going well? CloakingNote A novel desktop interface for subtle writing using decoy texts
IMAGE - The Art of Misdirection Main Idea from Magic • Misdirection* Drawing audiences’ attention away from magicians’ tricks • ➡ Misdirection from the previous slide * Kuhn et al. Misdirection in Magic: Implications for the Relationship Between Eye Gaze and Attention 6
Is my presentation going well? CloakingNote A novel desktop interface for subtle writing
Is my presentation going well? Real Text CloakingNote A novel desktop interface for subtle writing using decoy texts Decoy Text
CloakingNote Design • Based on Design Guidelines for Subtle Interfaces * • Simulation and Dissimulation • Separating Cause and E ff ect • Modularity • User Customization Main Interface of CloakingNote * Anderson et al. Supporting Subtlety with Deceptive Devices and Illusory Interactions 10
Modularity ➡ Alter the appearance of secret interaction to maintain its subtlety CloakingNote Supports Various Configurations for Real & Decoy Texts User Customization ➡ Let users customize it according to their contexts Details are in our paper * Anderson et al. Supporting Subtlety with Deceptive Devices and Illusory Interactions 11
Supporting Modularity & User Customization* Configuration window for decoy text Configuration window for real text * Anderson et al. Supporting Subtlety with Deceptive Devices and Illusory Interactions 12
Supporting Modularity & User Customization* * Anderson et al. Supporting Subtlety with Deceptive Devices and Illusory Interactions 13
Supporting Modularity & User Customization* Configuring a decoy text Choose a writing interface 1. Customize texts to make it suitable 2. for the interface 3. When start writing, the configuration window becomes invisible * Anderson et al. Supporting Subtlety with Deceptive Devices and Illusory Interactions 14
CONFIGURATION EXAMPLES BY USERS
SUBTLETY TEST
Study Design • Between-subject factor: Contrast • 36 participants (12 female) Participant • Normal or corrected-to- normal vision (20/25) Actor • no color-blindness 19
Contrast between the real text and its background Real Text Real Text Real Text Using Using Using High-contrast Mid-contrast Low-contrast (11:1) (3:1) (1.5:1) Optimal Ratio for Minimum Ratio for Lower Than The Visual Acuity* Proper Display Quality* Minimum Ratio * Lin et al. Effects of Viewing Angle and Contrast Ratio on Visual Performance using TFT-LCD * Snyder et al. Image Quality. In: M. Helander (Ed.), Handbook of Human–Computer Interaction. 20
Screen Layout In Subtlety Test 21
Procedure In each session ( 30 seconds ) • A participant entered a room and stand behind the actor’s right shoulder • Carried out two tasks • 1. Ask a question which was related to the decoy text e.g., “ What are you writing about? ” • 2. Observe what the actor was doing • Report to experimenter Repeated the session until the participant either 1) noticed what the actor • was really doing or 2) completed nine sessions 22
Results - Number of Participants Who Had Not Noticed 12 12 Who Had Not Found 10 # of Participants 8 6 4 4 2 2 0 low- mid- high- contrast contrast contrast ➡ The results suggested that CloakingNote successfully hides the content of secret writing as well as the use of the interface itself 23
How Finders Noticed The Use of CloakingNote real_ | I tried to compare between key pressed and the letter appear on the screen, but it was apple | Huma | impossible .… P25 Decoy text can Di ff erence between unnaturally stop in key pressed and the middle of the input decoy letter word 24
How Finders Noticed The Use of CloakingNote Just recognized the real text being rendered in an unexpected place 16 out of 18 Visual subtlety of the real text is much ➡ more important! 25
PERFORMANCE TEST
Study Design 1. Quantitative evaluation 1. Writing phrases using di ff erent contrast ratios 2. Qualitative evaluation Actor (Only in Qualitative Evaluation) 1. Using CloakingNote while in shoulder-surfing risks Participant • 18 participants (six female) 27
Study Design - Quantitative Evaluation (First Session) Dependent variable • Typing Speed: Character per second (CPS) • Accuracy: Character error rate (CER) using Damerau-Levenshtein • distance Participant Within-subjects factor • Configure ( low-, mid-, high- • contrast & baseline ) 28
Screen Layout In Performance Test Baseline video camera with a zoom lens video camera with a zoom lens Low-, Mid-, High-contrast video camera with a zoom lens video camera with a zoom lens 29
Procedure - Qualitative Evaluation (Second Session) Writing a short essay (i.e., TOEFL writing topics) for five minutes • while an actor peeked over their shoulder For 10, 20, and 30 secs at the 0.5-, 1-, and 2-minute marks • Actor Before writing, participants freely • (Only in Qualitative Evaluation) changed layout of on-screen components Participant 30
Results - Speed & Accuracy * 7 * Character Per Second (CPS) 6 5.5 5.4 5.3 5.1 5 4 3 2 1 0 low- mid- high- baseline contrast contrast contrast <Typing Speed> <Accuracy> ➡ CloakingNote supports reasonable writing performance compare to the use of gestural inputs 31
USERS’ LAYOUT STRATEGY
Foreground-match Strategy 33
Background-match Strategy 34
Distractive Strategy “I supposed that the observer wouldn’t ever noticed my [real text].” P49 35
EXTENDING CLOAKINGNOTE
Extending CloakingNote - Subtle Video Watching 37
Extending CloakingNote - FaceUnlock * De Luca et al. I Feel Like I'm Taking Selfies All Day!: Towards Understanding Biometric Authentication on Smartphones 38
SUMMARY 1. We designed CloakingNote, a novel desktop interface for subtle writing using decoy texts User studies showed that CloakingNote was effective in hiding 2. the real text as well as the secret action and could be used with reasonable writing performance We categorized and discussed the users’ layout strategies and 3. introduced possible extensions of CloakingNote shlyi@hcil.snu.ac.kr Contact 39
APPENDIX 40
APPENDIX: Knowledge Levels Diverse observation purposes in the real-world • No-knowledge level 1st - 3rd Observe the actor without any knowledge • sessions Suspicion-knowledge level 4th - 6th Look out for any suspicious activity • sessions Awareness-knowledge level 7th - 9th Look out for other activity than writing a text on a • sessions word processor 41
APPENDIX: Accumulated Number of Finders Few participants (11%) identified the real text during the first three sessions • 21 participants (58%) did not identify the real text in suspicion-knowledge level • Five finders noticed the content of the real text • 42
APPENDIX: Foreground-Match Strategy in Mobile 43
Recommend
More recommend
