Your Secrets Are Safe : How Browsers Explanations Impact - - PowerPoint PPT Presentation

your secrets are safe how browsers explanations impact
SMART_READER_LITE
LIVE PREVIEW

Your Secrets Are Safe : How Browsers Explanations Impact - - PowerPoint PPT Presentation

Your Secrets Are Safe : How Browsers Explanations Impact Misconceptions About Private Browsing Mode Yuxi Wu, Panya Gupta, Miranda Wei, Yasemin Acar, Sascha Fahl, Blase Ur https://FancyWines.com 2 Yuxi Wu, Miranda Wei | Your Secrets Are


slide-1
SLIDE 1

Your Secrets Are Safe: How Browsers’ Explanations Impact Misconceptions About Private Browsing Mode

Yuxi Wu, Panya Gupta, Miranda Wei, Yasemin Acar, Sascha Fahl, Blase Ur

slide-2
SLIDE 2

Yuxi Wu, Miranda Wei | Your Secrets Are Safe: How Browsers’ Explanations Impact Misconceptions About Private Browsing Mode

https://FancyWines.com

2

slide-3
SLIDE 3

Yuxi Wu, Miranda Wei | Your Secrets Are Safe: How Browsers’ Explanations Impact Misconceptions About Private Browsing Mode

Users have misconceptions about private mode

X X

(

3

slide-4
SLIDE 4

Consider the role of browsers in communicating what private mode actually does i.e., protection from local threats (and not most remote ones)

Study Motivation

4

slide-5
SLIDE 5

Yuxi Wu, Miranda Wei | Your Secrets Are Safe: How Browsers’ Explanations Impact Misconceptions About Private Browsing Mode

Disclosure

the explanation that a browser presents when users open a new window in private mode

5

slide-6
SLIDE 6

Yuxi Wu, Miranda Wei | Your Secrets Are Safe: How Browsers’ Explanations Impact Misconceptions About Private Browsing Mode

Disclosures vary

6

slide-7
SLIDE 7

Yuxi Wu, Miranda Wei | Your Secrets Are Safe: How Browsers’ Explanations Impact Misconceptions About Private Browsing Mode

Disclosures vary

7

slide-8
SLIDE 8

Yuxi Wu, Miranda Wei | Your Secrets Are Safe: How Browsers’ Explanations Impact Misconceptions About Private Browsing Mode 8

Disclosures vary

slide-9
SLIDE 9

Yuxi Wu, Miranda Wei | Your Secrets Are Safe: How Browsers’ Explanations Impact Misconceptions About Private Browsing Mode

Mobile disclosures vary even more

9

slide-10
SLIDE 10

Yuxi Wu, Miranda Wei | Your Secrets Are Safe: How Browsers’ Explanations Impact Misconceptions About Private Browsing Mode

Survey Methodology

460 participants on Amazon’s Mechanical Turk 30 minutes, $5 compensation 13 conditions

  • 12 conditions based on disclosures from the wild
  • 1 control condition

10

slide-11
SLIDE 11

Yuxi Wu, Miranda Wei | Your Secrets Are Safe: How Browsers’ Explanations Impact Misconceptions About Private Browsing Mode

Desktop Mobile

11

slide-12
SLIDE 12

Yuxi Wu, Miranda Wei | Your Secrets Are Safe: How Browsers’ Explanations Impact Misconceptions About Private Browsing Mode

Control Condition

12

slide-13
SLIDE 13

Yuxi Wu, Miranda Wei | Your Secrets Are Safe: How Browsers’ Explanations Impact Misconceptions About Private Browsing Mode

Survey Content

13

Distinguishing Comparative

https://

standard

https://

private

https://

standard

https://

private

? ? ?

[>, <, ==]

20 different scenarios Two sets of questions:

slide-14
SLIDE 14

Results

14

slide-15
SLIDE 15

Yuxi Wu, Miranda Wei | Your Secrets Are Safe: How Browsers’ Explanations Impact Misconceptions About Private Browsing Mode

Our participants (n = 460)

Gender 54.6% male 44.6% female 0.8% nonbinary/NA Tech background 86.5% no background 11.5% worked, educated in tech 2.0% NA

15

slide-16
SLIDE 16

Yuxi Wu, Miranda Wei | Your Secrets Are Safe: How Browsers’ Explanations Impact Misconceptions About Private Browsing Mode

Non-misconceptions

3:14 pm picturesofcorgis.com 3:15 pm picturesofcorgis.com 3:16 pm picturesofcorgis.com 3:17 pm picturesofcorgis.com 3:18 pm picturesofcorgis.com 3:19 pm picturesofcorgis.com 3:20 pm picturesofcorgis.com 3:21 pm picturesofcorgis.com 3:22 pm picturesofcorgis.com 3:23 pm picturesofcorgis.com 3:24 pm picturesofcorgis.com 3:25 pm picturesofcorgis.com 3:26 pm picturesofcorgis.com

downloads

16

89.8% correct 94.8% correct 99.3% correct Photos not cached History not saved in menu Downloaded files remain

slide-17
SLIDE 17

Yuxi Wu, Miranda Wei | Your Secrets Are Safe: How Browsers’ Explanations Impact Misconceptions About Private Browsing Mode

Overestimated Protections

What is a corgi?

127.0.0.1

17

56.3% incorrectly believed 25.2% incorrectly believed 40.2% incorrectly believed ...that searches could not be associated

(while logged in)

...that IP address could not be collected ...that geolocation could not be estimated

slide-18
SLIDE 18

Yuxi Wu, Miranda Wei | Your Secrets Are Safe: How Browsers’ Explanations Impact Misconceptions About Private Browsing Mode

Misconceptions - comparative differences

https://

Corgi dog beds for just $49.99!

X X

(

18

27.1% incorrectly believed 30.9% incorrectly believed ...that there was a difference in the level of virus and malware protection between modes ...that the proportion of targeted ads was the same between modes or higher in private mode

slide-19
SLIDE 19

Yuxi Wu, Miranda Wei | Your Secrets Are Safe: How Browsers’ Explanations Impact Misconceptions About Private Browsing Mode 19

slide-20
SLIDE 20

Yuxi Wu, Miranda Wei | Your Secrets Are Safe: How Browsers’ Explanations Impact Misconceptions About Private Browsing Mode 20

Individual disclosure results

Desktop Mobile Control vs.

slide-21
SLIDE 21

Yuxi Wu, Miranda Wei | Your Secrets Are Safe: How Browsers’ Explanations Impact Misconceptions About Private Browsing Mode 21

No different than control

slide-22
SLIDE 22

Yuxi Wu, Miranda Wei | Your Secrets Are Safe: How Browsers’ Explanations Impact Misconceptions About Private Browsing Mode

Better than control

Chrome v59 (desktop) Chrome v60 (desktop)

22

slide-23
SLIDE 23

Key Takeaways

23

slide-24
SLIDE 24

Yuxi Wu, Miranda Wei | Your Secrets Are Safe: How Browsers’ Explanations Impact Misconceptions About Private Browsing Mode

Understanding comes from interaction

3:14 pm picturesofcorgis.com 3:15 pm picturesofcorgis.com 3:16 pm picturesofcorgis.com 3:17 pm picturesofcorgis.com 3:18 pm picturesofcorgis.com 3:19 pm picturesofcorgis.com 3:20 pm picturesofcorgis.com 3:21 pm picturesofcorgis.com 3:22 pm picturesofcorgis.com 3:23 pm picturesofcorgis.com 3:24 pm picturesofcorgis.com 3:25 pm picturesofcorgis.com 3:26 pm picturesofcorgis.com

downloads

24

slide-25
SLIDE 25

Yuxi Wu, Miranda Wei | Your Secrets Are Safe: How Browsers’ Explanations Impact Misconceptions About Private Browsing Mode

Language matters

25

slide-26
SLIDE 26

Yuxi Wu, Miranda Wei | Your Secrets Are Safe: How Browsers’ Explanations Impact Misconceptions About Private Browsing Mode

Language matters

Opera (mobile) Firefox Focus (mobile)

26

slide-27
SLIDE 27

Yuxi Wu, Miranda Wei | Your Secrets Are Safe: How Browsers’ Explanations Impact Misconceptions About Private Browsing Mode

https://

27

Browsers’ disclosures make a difference

slide-28
SLIDE 28

Your Secrets Are Safe: How Browsers’ Explanations Impact Misconceptions About Private Browsing Mode

Yuxi Wu, Panya Gupta, Miranda Wei, Yasemin Acar, Sascha Fahl, Blase Ur

{yuxiwu,weim}@uchicago.edu

RQ: Do disclosures impact misconceptions of private browsing mode? If so, how? Methodology: 460-participant survey testing 13 disclosures in 20 scenarios Results: Disclosures have an impact and contribute to many misconceptions

28

slide-29
SLIDE 29

Yuxi Wu, Miranda Wei | Your Secrets Are Safe: How Browsers’ Explanations Impact Misconceptions About Private Browsing Mode 29

slide-30
SLIDE 30

Yuxi Wu, Miranda Wei | Your Secrets Are Safe: How Browsers’ Explanations Impact Misconceptions About Private Browsing Mode

Roadmap

1. Why use private browsing mode? 2. Past work 3. Study motivation 4. Survey methodology 5. Results 6. Key takeaways

30

slide-31
SLIDE 31

Yuxi Wu, Miranda Wei | Your Secrets Are Safe: How Browsers’ Explanations Impact Misconceptions About Private Browsing Mode

Aggregate Confidence

Males were 3.46 times more confident ... Younger participants were … Less time in private mode were more confident ...

31

slide-32
SLIDE 32

What do we use private browsing for?

32

slide-33
SLIDE 33

Yuxi Wu, Miranda Wei | Your Secrets Are Safe: How Browsers’ Explanations Impact Misconceptions About Private Browsing Mode

Disclosures vary

33

slide-34
SLIDE 34

Yuxi Wu, Miranda Wei | Your Secrets Are Safe: How Browsers’ Explanations Impact Misconceptions About Private Browsing Mode

Questions we anticipate getting:

But no one reads disclosures? What were all of the correct answers, anyways? Have disclosures been updated since publication? What should disclosures say?

34

slide-35
SLIDE 35

Yuxi Wu, Miranda Wei | Your Secrets Are Safe: How Browsers’ Explanations Impact Misconceptions About Private Browsing Mode

Notes from Blase

make title slide look like private mode disclosure include universities start with motivation

  • people have misconceptions about private browsing mode
  • all major browsers have private mode, meant to be local
  • some limited prior work on misconceptions
  • our main research question: browsers differ by how they

explain what private mode does

  • show real disclosures, show 3 different ones in full page;

maybe mobile versions

  • to what extent do the disclosure impact whether people have

misconceptions

  • no citations

“previously documented misconceptions” survey methodology

  • keep main lines, remove dots

move the walk through to right before 460 participants

  • maybe flip; abstract or example

results

  • participant demographics: as briefly as possible, more graphics;

separate reasons and usage

  • drop reasons for using
  • start with the scenarios, confidence/which disclosure did best at the

end

  • 4 types of scenarios —> remove org slide
  • make axes bigger, explain how to read the slide (incorrect answers)
  • no graph for non-misconceptions
  • show blank graph, then insert data
  • separate distinguishing and comparative
  • “overestimated protections”
  • have quotes in notes

implications/discussion

  • less words
  • screenshot of disclosure language and show the logo of each

browser how do the disclosures impact misconceptions

  • at beginning of results: show results for disclosures in aggregate
  • then specific disclosures at the end
  • meaninglessly vague control, read it outloud; see how the other
  • nes compare
  • scale of how many they got right
  • misconceptions that disclosures particularly emphasized

end on key takeaway slides, and contact info, pictures of coauthors

35

slide-36
SLIDE 36

Imagine there is a new web browser called Onyx.

Onyx has a mode called “private browsing mode.”

36

slide-37
SLIDE 37

Yuxi Wu, Miranda Wei | Your Secrets Are Safe: How Browsers’ Explanations Impact Misconceptions About Private Browsing Mode 37

slide-38
SLIDE 38

Yuxi Wu, Miranda Wei | Your Secrets Are Safe: How Browsers’ Explanations Impact Misconceptions About Private Browsing Mode

PicturesOfCorgis.com

38

slide-39
SLIDE 39

Yuxi Wu, Miranda Wei | Your Secrets Are Safe: How Browsers’ Explanations Impact Misconceptions About Private Browsing Mode 39

slide-40
SLIDE 40

Yuxi Wu, Miranda Wei | Your Secrets Are Safe: How Browsers’ Explanations Impact Misconceptions About Private Browsing Mode

MyGamingSite.com

40

slide-41
SLIDE 41

Yuxi Wu, Miranda Wei | Your Secrets Are Safe: How Browsers’ Explanations Impact Misconceptions About Private Browsing Mode 41

slide-42
SLIDE 42

Yuxi Wu, Miranda Wei | Your Secrets Are Safe: How Browsers’ Explanations Impact Misconceptions About Private Browsing Mode

google.com the meaning of life

42

slide-43
SLIDE 43

Yuxi Wu, Miranda Wei | Your Secrets Are Safe: How Browsers’ Explanations Impact Misconceptions About Private Browsing Mode 43

slide-44
SLIDE 44

Yuxi Wu, Miranda Wei | Your Secrets Are Safe: How Browsers’ Explanations Impact Misconceptions About Private Browsing Mode

Our Participants (N=460)

44

slide-45
SLIDE 45

Yuxi Wu, Miranda Wei | Your Secrets Are Safe: How Browsers’ Explanations Impact Misconceptions About Private Browsing Mode

Our Participants (N=460)

45

slide-46
SLIDE 46

Yuxi Wu, Miranda Wei | Your Secrets Are Safe: How Browsers’ Explanations Impact Misconceptions About Private Browsing Mode

Our Participants (N=460)

46

slide-47
SLIDE 47

Yuxi Wu, Miranda Wei | Your Secrets Are Safe: How Browsers’ Explanations Impact Misconceptions About Private Browsing Mode

Overestimated Protections

47

slide-48
SLIDE 48

Yuxi Wu, Miranda Wei | Your Secrets Are Safe: How Browsers’ Explanations Impact Misconceptions About Private Browsing Mode 48

slide-49
SLIDE 49

Yuxi Wu, Miranda Wei | Your Secrets Are Safe: How Browsers’ Explanations Impact Misconceptions About Private Browsing Mode 49

slide-50
SLIDE 50

Yuxi Wu, Miranda Wei | Your Secrets Are Safe: How Browsers’ Explanations Impact Misconceptions About Private Browsing Mode

Underestimated Protections

50

slide-51
SLIDE 51

Yuxi Wu, Miranda Wei | Your Secrets Are Safe: How Browsers’ Explanations Impact Misconceptions About Private Browsing Mode

Our Participants (N=460)

51