Believability of News Understanding users perceptions of fake news - - PowerPoint PPT Presentation

believability of news
SMART_READER_LITE
LIVE PREVIEW

Believability of News Understanding users perceptions of fake news - - PowerPoint PPT Presentation

Believability of News Understanding users perceptions of fake news and fact checking badges Andr Calero Valdez Human-Computer Interaction Center, RWTH-Aachen University Fake News - Definition What exactly are fake news? They are not:


slide-1
SLIDE 1

Believability of News

Understanding users perceptions of fake news and fact checking badges

André Calero Valdez

Human-Computer Interaction Center, RWTH-Aachen University

slide-2
SLIDE 2

Fake News - Definition

  • What exactly are fake news?
  • They are not:
  • Poor politics
  • Poor journalism
  • Click-Baiting
  • Accidental Falsehoods
slide-3
SLIDE 3

Satire

slide-4
SLIDE 4

Fake News - Definition

  • What exactly are fake news?
  • They are:
  • Desinformation

§ Purposefully harmful

  • Forms:
  • Misinterpreted Content

§ Decontextualized

  • Manipulated Content
  • Fabricated Content
  • As news or memes
slide-5
SLIDE 5

What is the problem?

  • Fake news spread further and faster than real news

Vosoughi, S., Roy, D., & Aral, S. (2018). The spread of true and false news online. Science, 359(6380), 1146-1151.

  • They are (un-)intentionally used by people,
  • rganizations, institutions

Lazer, D. M., Baum, M. A., Benkler, Y., Berinsky, A. J., Greenhill, K. M., Menczer, F., ... & Schudson, M. (2018). The science of fake news. Science, 359(6380), 1094-1096.

  • Bots are often utilized to further spread fake news

Shao, C., Ciampaglia, G. L., Varol, O., Yang, K., Flammini, A., & Menczer, F. (2017). The spread of low- credibility content by social bots. arXiv preprint arXiv:1707.07592.

slide-6
SLIDE 6

Are the users to blame?

  • Fake news often cater to the users strongly held beliefs
  • Confirmation Bias
  • Filter-Bubbles, Echo Chamber, Cyber-Balkanization
  • Users share news without reading them
  • Fake news target extremist perspectives
  • Far left, far right
  • Increased perceptions of polarization

=> Decrease in political discourse

  • Research Questions:
  • But who believes fake news?
  • Can users be assisted in detecting fake news?
slide-7
SLIDE 7

Method

Survey study (n=143)

  • Rate believability of news

items from the headline

  • Scale of 0 – 100
  • Before and after
  • Set of 13 news items
  • All related to refugees
  • 7 fake, 6 correct
  • On the left:

Lesbos: Refugees set asylum camp on fire

slide-8
SLIDE 8

Method

Measures Variables

  • Age, Gender, Income
  • Big-Five Personality Items
  • Openness, Conscientiousness, Extraversion, Agreeableness,

Neuroticism

  • Social Media and Classical Media Usage Frequency
  • Moral Value Judgments about Refugees
  • Nationalistic, Consequentialist
  • Political Interest Scale
  • Social Desirability Scale
  • Did users “fact-check” during the study
slide-9
SLIDE 9

Results: Are fact checking badges effective

  • ineffective

effective

Refugees set refugee camp on fire The amount of refugees is stagnating Upper limit of 1 Mio. refugees 100,000 refugees will leave voluntarily Commissioners demand integration tax 700 Euro Christmas bonus for refugees Refugees increase economic growth

−10 −5 5 10 Topic 1 Topic 2 Topic 3 Topic 4 Topic 5 Topic 6 Topic 8

Fake News Post Change in believability

Changes in believability for different topics

Error bars denote 95% confidence intervall from bootstrapping.

slide-10
SLIDE 10

Results: Are our news believable?

  • Real news

Fake news

10 20 30 40 50 Topic 1 Topic 2 Topic 3 Topic 4 Topic 5 Topic 6 Topic 7 Topic 8 Topic 9 Topic 10 Topic 11 Topic 12 Topic 13

News Post Believability

Believability for different topics

Error bars denote 95% confidence intervall from bootstrapping.

slide-11
SLIDE 11

Conclusion and Limitations

  • Users are bad at discerning fake and real news from

headlines

  • Only little influence of user diversity overall
  • But, topic dependent influence

§ E.g., nationalistic judgments on Topic 1

  • Users did not fact check
  • Limitations and future work:
  • Skewed sample (young, highly educated)
  • We looked at headlines only
  • Effects of topic order
  • No pre-post for real news
  • No real-life setting, study setting

Thank you for your Attention! Questions?