Evaluate the Interactives at TPM and MR Presented by: Cole Flegel - - PowerPoint PPT Presentation

▶
evaluate the interactives at tpm and mr
SMART_READER_LITE
LIVE PREVIEW

Evaluate the Interactives at TPM and MR Presented by: Cole Flegel - - PowerPoint PPT Presentation

Jan 10, 2023 133 likes •499 views

Evaluate the Interactives at TPM and MR Presented by: Cole Flegel The Huaxin Yang Postal Thomas Perry Museum Ziheng (Leo) Li 1 Introducing the Team Introducing the Team Cole Flegel Huaxin Yang Tom Perry Ziheng (Leo) Li Robotics

slide-1
SLIDE 1

Evaluate the Interactives at TPM and MR

Presented by: Cole Flegel Huaxin Yang Thomas Perry Ziheng (Leo) Li

The Postal Museum

1

slide-2
SLIDE 2

Introducing the Team

Cole Flegel

  • Robotics Engineering

Huaxin Yang

  • Management

Engineering

Tom Perry

  • Biology & Bio-

technology

Ziheng (Leo) Li

  • Computer Science &

Electrical Engineering

Introducing the Team

2

slide-3
SLIDE 3

1. Project Overview 2. Attraction & Placement 4. Engagement & Interaction

Report Map

6. Recommendation s

3. Usability & Intuitivenes s 5. Recollection & Learning

3

slide-4
SLIDE 4

We are here because TPM …

Opened July 28,2017 Holds large number of interactive exhibits Yet to conduct a formal evaluation of interactives

4

slide-5
SLIDE 5

We did…

  • 1. Identify

current and best practices 5/8 ~ 6/7

  • 2. Solicit TPM

Staff Knowledge 5/11 ~5/22

  • 3. Assess Visitor

Experience 5/23~6/7

  • 4. Evaluate

selected interactives in- depth 6/3~6/16

5

slide-6
SLIDE 6

TPM Layout

6

slide-7
SLIDE 7

MR Layout

7

slide-8
SLIDE 8

Attraction & Placement

Heat-map

  • Where do

visitors linger?

  • How attractive

are for each exhibit?

Trace-map

  • How do visitors

navigate through the gallery?

  • What’s the

traffic flow for each exhibit?

Scoring

  • Attraction

Score

  • Placement

Score

8

slide-9
SLIDE 9

1 1

9

MR Heat & Trace Map

slide-10
SLIDE 10

Issue 1: TPM Dressing Up

10

11/100

TPM Dressing Up Placement Score: TPM Placement Score Average:

73/100

slide-11
SLIDE 11

11

Issue 1: TPM Dressing Up

slide-12
SLIDE 12

2 2

12

MR Heat & Trace Map

slide-13
SLIDE 13

13

Issue 2: MR Timescope

slide-14
SLIDE 14

94 100 73 88 55 45 54 52 58 36 76 48 36 49 45 96 83 100 83 92 100 83 79 71 88 46 67 54 38 11 20 40 60 80 100 120

TPM Attraction & Placement Score

Attraction Score Placement Score

14

slide-15
SLIDE 15

100 63 61 58 47 37 100 70 60 55 30 28 20 40 60 80 100 120 TPO Carriage Pneumatic Train Switchframe Electric Train Timescope MR Network Explorer

MR Attraction & Placement Score

Attraction Score Placement Score

15

slide-16
SLIDE 16

Intuitiveness & Usability

  • Interactives should be easy to

understand and use

  • Many interactives use step-stools

to make them accessible to children

  • Traveling Post Office has no

instructions, but the idea is easy to get

  • Timescope also has no instructions,

but many visitors make assumptions

16

slide-17
SLIDE 17

17

  • The Switchframe interactive is very attractive, but suffers slightly from misuse
  • Most visitors approach exhibit from the right hand side, and attempt to pick up

the telephone, not noticing the “start” button on the left hand side

  • Very little in the way of written instructions, relying almost entirely on voiceover

Usability - Switchframe

slide-18
SLIDE 18

18

  • The Pneumatic Tube interactive also

suffers from misuse, exacerbated by its popularity

  • Some visitors do not use the canisters,

sending up letters that can jam by themselves, or send too many canisters at once, overtaxing the air pump

  • Coupled with frequent use, this can cause

problems with the mechanism behind the interactive very quickly

Usability – Pneumatic Tube

slide-19
SLIDE 19

Engagement & Interaction

Dwell Time (DT)

  • How long do

visitor stay at an exhibit?

Degree of Interaction (DOI)

  • How deeply

do visitors interact?

Scoring

  • Engagement

Score

  • DOI Score
  • DT Score

19

slide-20
SLIDE 20

20

Dwell Time

Short Dwell Time < 1 minute Long Dwell Time > 4 minutes Pneumatic Tube Design-a-Stamp Journey of a Mail Coach Packet Ships and Pirates Lantern Slide Viewer Unpack-a-Picture Timescope Forgettable Occupied

slide-21
SLIDE 21

21

Degree of interaction

Ignored Noticed Entered Interacted Accomplished

Coding: Ignored = 0 Noticed = 1 Entered = 2 Interacted = 3 Accomplished = 5

slide-22
SLIDE 22

22

0.0 1.0 2.0 3.0 4.0 5.0

TPM Average Degree of Interaction Degree of Interaction 0 -> Ignored 1 -> Noticed 2 -> Entered 3 -> Interacted 5 -> Accomplished

slide-23
SLIDE 23

23

0.0 1.0 2.0 3.0 4.0 5.0

TPM Degree of Interaction Comparison

Degree of Interaction 0 -> Ignored 1 -> Noticed 2 -> Entered 3 -> Interacted 5 -> Accomplished

slide-24
SLIDE 24

24

0.0 1.0 2.0 3.0 4.0 5.0

  • 1. Timescope
  • 2. Pneumatic

Trains

  • 3. Electric Trains
  • 4. Switchframe
  • 5. TPO Carriage
  • 6. MR Network

Explorer

MR Average degree of interaction

Degree of Interaction 0 -> Ignored 1 -> Noticed 2 -> Entered 3 -> Interacted 5 -> Accomplished

slide-25
SLIDE 25

25

0.0 1.0 2.0 3.0 4.0 5.0

  • 1. Timescope
  • 2. Pneumatic Trains
  • 3. Electric Trains
  • 4. Switchframe
  • 5. TPO Carriage
  • 6. MR Network

Explorer

MR Average Degree of Interaction Comparison

slide-26
SLIDE 26
  • Pneumatic tube atTPM breaks

most

  • In a sample size of 30, the

pneumatic tube was broken 15 times

  • Albeit pneumatic tube is one of

the most popular interactives

Broken

26

slide-27
SLIDE 27

27

100 90 83 77 69 20 40 60 80 100

  • 5. TPO Carriage 2. Pneumatic

Trains

  • 3. Electric

Trains

  • 4. Switchframe 1. Timescope 6. MR Network

Explorer

MR Engagement & Interaction Score

100

100 98 94 91 79 78 78 77 75 67 66 66 65 64 63 20 40 60 80 100

TPM Engagement & Interaction Score

Design-a-Stamp TPO Carriage Pneumatic Trains

slide-28
SLIDE 28

Recollection & Learning

Collected during visitor study stages

28

  • Exit Survey

Objective 3: Assess Visitor Experience

  • Visitor

Interview

Objective 4: Conduct In- depth Evaluation

slide-29
SLIDE 29

29

slide-30
SLIDE 30

30

slide-31
SLIDE 31

31

slide-32
SLIDE 32

Deliverables

32

Data Collected Survey Protocol Report Cards

slide-33
SLIDE 33

SWITCHFRAME

Good at:  Fair attractiveness

 The design reflects the real Switchframe which is on a poster to the right. Therefore it attracts visitors visually

 Fair Engagement

 Most visitor would choose to complete the tasks

 Fair Placement

 Since the middle four exhibits at MR (all but Timescope and MR Network Explorer) are placed linearly, they all receive a fairly good traffic flow.

Improvement Needed :

  • Long dwell time
  • Visitors must spend a long time to complete the

interactive

 Conclusion and Recommendation

 This exhibit mainly suffers from the difficulty in getting started (initial understanding). Visitors who first approach this exhibit often try to use the telephone on the right-hand side first, without noticing the “start” button on the left-hand side. Once visitors begin using the interactive and understand how to use the levers, the length of time required to fully complete all three stages of the interactive prevents other visitors from being able to use it.  For immediate changes, we recommend making this interactive more appealing while it is in use, to keep visitors from leaving partway through. One suggestion is to add some sound effect to keep visitors interested while the “trains” are moving.  For a long-term fix, we recommend switching the locations of the telephone and the “start” button, as most visitors approach this interactive from the right.

Physical

MR

slide-34
SLIDE 34

Learning Outcomes General

IN-DEPTH – SWITCHFRAME

Visitor Experience N = 30

slide-35
SLIDE 35

35

The Postal Museum Andy Richmond Emma Harper Hannah Smith Yatin Patel Sally Sculthorpe Joshua Henning Ian Tolley Martin Devereux Davide Avanzo Worcester Polytechnic Institute Dominique Golding James P. Hanlan Gbetonmasse B. Somasse KCA London Joe Martin Museum of London Felicity Paynter Elpiniki Psalti London Transport Museum Martin Pugh National Maritime Museum Katherine Biggs National Army Museum Domonique Bouchard

Acknowledgement