Health Cards for Consumer Health Search Jimmy 1,2 , Guido Zuccon 1 , - - PowerPoint PPT Presentation
Health Cards for Consumer Health Search Jimmy 1,2 , Guido Zuccon 1 , Bevan Koopman 3 , & Gianluca Demartini 1 1 University of Queensland (UQ), Australia 2 University of Surabaya (UBAYA), Indonesia 3 AEHRC / CSIRO , Australia Presented at: 42
Jimmy1,2, Guido Zuccon1, Bevan Koopman3, & Gianluca Demartini1
1University of Queensland (UQ), Australia 2University of Surabaya (UBAYA), Indonesia 3AEHRC / CSIRO , Australia
Presented at: 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR ’19) July 21–25, 2019 Paris, France
searched online for health information (Fox & Duggan, 2013).
professional (Fox & Duggan, 2013).
2
engines to present coherent, easy to understand and trustworthy health information.
queries that contains a health condition name or its aliases.
for broader search tasks than only to know more about a health condition.
3
4
We considered two types of search scenario:
condition.
E.g., Scenario: Your physiotherapist has mentioned you may have pelvic inflammatory disease and suggested you to go to a doctor. Task: Find out more information about how this disease can be treated.
E.g., Scenario: It’s few days now that you have been getting hiccups after eating. You felt you eat enough every time, in fact, you felt full. At the same time, you feel something in the back of your throat: like if you had a bump
Task: Find out what you may have and when its time to make an appointment with a doctor.
5
6
Start Demographic questionnaire Perception questionnaire Search scenario User experience questionnaire Finish all tasks? Finish Yes Informed Consent and instructions Exit questionnaire No
7
8
On average, participants spent 55 % of their time to observe the health cards
9
Participants tend to consider health cards earlier in a session
Attention on Health Cards Attention on Snippets
start end 25 50 75 100
Progress in the session Percentage of participants
10
There was no significant difference between the number of tasks completed with and without selecting information from health cards.
Cards Not Selected Cards Selected 10 20 30 40 50
Six Measurements:
cards!
11
12
The number of correct answers are comparable across conditions.
No Cards Cards Not Selected Cards Selected 1 2
Correctness
Six Measurements:
13
The average times needed to complete a task are comparable across conditions.
No Cards Cards Not Selected Cards Selected 50 100 150 200 250
Duration
Six Measurements:
14
The number of clicks is significantly less when information from health cards was selected.
No Cards Cards Not Selected Cards Selected 1 2 3
UserClicks
Six Measurements:
15
There were no significance differences in the level of perceived workload across conditions
Six Measurements:
(harder) (easier)
No Cards Cards Not Selected Cards Selected 1 2 3 4
Workload
16
Participants felt significantly more satisfied with their own answers when selecting information from health cards to complete a search task.
No Cards Cards Not Selected Cards Selected 1 2 3
Satisfaction
Six Measurements:
positively correlates with correctness in their answers. This is inline with findings by Hu & Haake (2010).
bridging the gap between knowledgable and less knowledgable participants.
17
2.8 2.56 2.48 2.22 3 2.76 2.24 2.08 3 2.82 2.61 2.42
p=0.0453* p=0.0346* p=0.122
1 2 3 No Cards Cards Not Selected Cards Selected
Correctness
Prior Knowledge
none little some great deal
18
Factual:
Intellectual:
Benefits of health cards were found to be significant for Factual Tasks. Health cards provide no significant benefits for Intellectual tasks
100 53.12 46.88 100 44.79 55.21
Factual Intellectual
No Yes No Yes 25 50 75 100Health Cards Displayed % of scenarios Cards selected
No Yes
A
p = 0.055 p = 0.015 Factual Intellectual
200 220 240 260 Search results only Health cardsDuration (Seconds)
B
p = 0.163 p = 0.035 more effort less effort Factual Intellectual
3.0 3.5 4.0 Search results only Health cardsNumber of links followed
C
p = 0.825 p = 0.014 Factual Intellectual
2.3 2.5 2.7 Search results only Health cardsCorrectness (0−3)
D
p = 0.363 p = 0.028 (harder) (easier) Factual Intellectual
3.5 3.6 3.7 3.8 3.9 4.0 Search results only Health cardsWorkload (1−5)
E
p = 0.422 p = 0.007 (less) (more) Factual Intellectual
3.5 3.6 3.7 3.8 3.9 4.0 Search results only Health cardsSatisfaction (1−5)
F
19
44 36 15 48 33 10
10 20 30 40 50 Factual Intellectual
Frequency
Source of Information
Health Cards Health Cards & WebPage WebPage
the user’s satisfaction.
the knowledgeable (in terms of correctness).
search tasks (Factual).
“exploratory” health search tasks (Intellectual).
20
41% of participants never experienced health cards prior to this study.
health cards unreaped.
21
For further details:
http://ielab.io/publications/jimmy-2019-healthcard
Dana Pendidikan / LPDP)(20151022014644).
(DE180101579).
Acknowledgement