Enticing Notification Text & the Impact on Engagement Kieran - - PowerPoint PPT Presentation
Enticing Notification Text & the Impact on Engagement Kieran - - PowerPoint PPT Presentation
UbiTtention 2020 Enticing Notification Text & the Impact on Engagement Kieran Fraser & Owen Conlan Overview 1. Introduction 2. Related Work 3. Information-Gap Theory 4. Capturing Mobile Push-notifications 5. Enticing
- 1. Introduction
- 2. Related Work
- 3. Information-Gap Theory
- 4. Capturing Mobile Push-notifications
- 5. Enticing Push-notifications
- 6. Push-notification Delivery Agents
- 7. Capturing Web Push-notifications
- 8. Enticing Titles vs Summaries
- 9. Limitations & Future Work
- 10. Final Thoughts
Overview
1
Introduction
2
Related Work
3
Growing number of notifications pushed at users (Pielot, M. et al, 2014). Large no. of incoming notifications = negative user emotions (Sahami Shirazi, A. et al, 2014). Notification delivery not smart (Mehrotra, A. et al, 2016). Unnecessary notifications may dramatically decrease productivity (Iqbal, S.
- T. et al, 2010).
Information-Gap Theory
4
Previous Knowledge or Experience “Zone of Curiosity” Something New
“Curiosity happens when we feel a gap in our knowledge” - Loewenstein Curiosity peaks when a small amount of information is revealed, but key parts are withheld
Information-Gap Theory
5
John Caples, 1926 WordStream, 2017
Capturing Mobile Push-notifications
6
WeAreUs Android App
Experience Sampling Method Moments of notification interest, moments of phone usage interest Privacy-preserving text feature
Capturing Mobile Push-notifications
7
18 participants
- ver 3 months
35,314 notifications logged 309 questionnaire responses 7,123 smartphone usage logs
Enticing Push-notifications
8
Enticing Push-notifications
9
Neutral Notification Unigrams Enticing Notification Unigrams
Enticing Push-notifications
10
Enticing Push-notifications
11
Enticing Push-notifications
12
Exact Sign Test: p = .012
48.44 67.51 10 20 30 40 50 60 70 80 Neutral Enticing CTR (%)
Enticing Vs Neutral Notification Click-Through Rate
Push-notification Delivery Agents
13
OpenAI Gym Open source toolkit for “developing and comparing reinforcement learning algorithms” 1 Gym-Push Custom OpenAI Gym environment simulating push-notification overload
- n mobile device users
- 1. https://gym.openai.com/
Push-notification Delivery Agents
14
- 1. https://gym.openai.com/
Gym-Push Custom OpenAI Gym environment simulating push-notification overload
- n mobile device users
State Privacy-preserving Text Embedding Action Open / Dismiss the notification
Push-notification Delivery Agents
15
Push-notification Delivery Agents
16
Capturing Web Push-notifications
17
Subscribed Topics:
- Breaking
- Entertainment
- Health
- Beauty
- Style
- Science
- Sport
- Tech
- World
Title Content
Capturing Web Push-notifications
18
Enticing Titles vs Summaries
19
Limitations & Future Work
20
Limitations
- Granularity of notification text in WeAreUs study
- Lack of engagement action in Google Alert data set
- Enticing but useful, distinguishing nuance
- Offline simulations
Future Work
- Larger online in-the-wild study
- Link toward inherent participant traits e.g. curiosity or
personality
- How can we train intelligent systems to be better than us
Final Thoughts
21
This research is supported by the ADAPT Centre for Digital Content Technology under the SFI Research Centre Program (Grant 13/RC/2106) and is co-funded under the European Regional Development Fund.
- Click-through Rate larger for notifications
with enticing text
- Enticement is an important feature for
predicting subscriber engagement action
- Summarisation has potential to reduce
the influence of enticing notification text
www.adaptcentre.ie
22