healthcare education using the Microsoft HoloLens Emma Collins - - PowerPoint PPT Presentation

healthcare education
SMART_READER_LITE
LIVE PREVIEW

healthcare education using the Microsoft HoloLens Emma Collins - - PowerPoint PPT Presentation

Using mixed reality in healthcare education using the Microsoft HoloLens Emma Collins Emma Collins Dr Liz Ditzel Principal Lecturer Principal Lecturer Professor School of Nursing School of Nursing School of Nursing The Project Early


slide-1
SLIDE 1

Using mixed reality in healthcare education using the Microsoft HoloLens

Emma Collins

Principal Lecturer School of Nursing

Emma Collins

Principal Lecturer School of Nursing

Dr Liz Ditzel

Professor School of Nursing

slide-2
SLIDE 2

The Project

  • Early Adopter with Pearson Immersive

Learning

  • HoloHuman
  • HoloPatient
slide-3
SLIDE 3

The technology

  • Mixed reality

– Blends the virtual world with the real world – The HoloLens is considered to be a MR device

slide-4
SLIDE 4

The Study

  • OPREC ethics approval 2018-790
  • HoloPatient

– BN509 students (N=68) met Jerry, a 27 year

  • ld mountain biker who had a large infected

laceration on his back. He had just received penicillin and a tetanus injection. However, students were not briefed about his condition.

  • HoloHuman

– BN507 students (N=19) revised a body system

slide-5
SLIDE 5

HoloHuman

slide-6
SLIDE 6

HoloHuman - Quant

Item Year 1 BN507 mean (N=19) It was easy to locate the body system I wished to review

4.16

It was easy to locate the body structures I wished to review

4.05

I thought the images looked real

4.11

The information associated with identified structures were helpful

3.16

It was easy to use the headset

4.32

The headset was comfortable to use

3.84

I felt I needed more technological support to use the technology

1.32

I enjoyed using this technology to learn assessment skills

4.53

I think that this technology should be used in all nursing courses

4.21

I felt that my learning was enhanced by using the HoloLens technology

4.11 Scale: 1 = strongly disagree, 2 = disagree, 3 = neither disagree nor agree, 4 = agree, 5 = strongly agree.

slide-7
SLIDE 7

HoloHuman - Qual

“This supported my studying of the systems” “It was good to see more lifelike body structures” “It provided a visual way of learning” “I could actually see what I had been taught” “It was easy and made the experience realistic” “It gave me a better perspective of the body systems” “I have a visual picture, helps with visualising in exams”

slide-8
SLIDE 8

HoloPatient

slide-9
SLIDE 9
slide-10
SLIDE 10

2018 Research

  • Meet Jerry – no handover or

briefing

– Clip 1: a man dressed in a hospital gown, appearing very agitated. – Clip 2: the same man, much ‘sicker’ – Clip 3: a very ill man.

slide-11
SLIDE 11

Student Activity

  • For each clip students in

groups were asked to:

– record as many

  • bservations as possible

– Write down possible nursing diagnoses – Decide on nursing actions

slide-12
SLIDE 12

2 4 6 8 10 12 14 16 18

B/P 124/84 heart rate 88 itchy skin white male irregular heart rate cuts or wound on body laboured breathing coughing solid build uncomfortable

Clip 1: Student observations

slide-13
SLIDE 13

2 4 6 8 10 12 14 16

infection sepsis anaphalxysis purpura respiratory disease shingles meningitis

Clip 1: Nursing diagnosis

slide-14
SLIDE 14

1 2 3 4 5 6 7 8 9

Clip 1: Nursing actions

slide-15
SLIDE 15
slide-16
SLIDE 16

5 10 15 20 pulse 140 temperature 38.4 loss of consciousness more redder spots eyes closed blue lips

Clip 3: Student observations

slide-17
SLIDE 17

0.5 1 1.5 2 2.5 3 3.5

anaphalactic reaction sepsis infected shoulder wound allergic reaction respiratory arrest dehydration fever

Clip 3: Nursing diagnosis

slide-18
SLIDE 18

5 10 15

call doctor urgently administer I/V antibiotics prepare for ventilation anaphalaxis maintain airway Clip 3: Nursing actions

slide-19
SLIDE 19

HoloPatient - Quant

Item Year 1 BN509 mean (N=68) Year 2 BN605 mean N=23) It was easy to pick up clues about the condition of the patient 4.43 4.7 It was easy to process the information gained from the patient cues 4.18 3.91 It was easy to describe the patient situation 4.35 4.48 The patient appeared to be very real 4.15 4.22 I felt confident about assessing the patient condition from the cues 4.03 4.30 It was easy to use the headset 4.42 3.78 The headset was comfortable to use 4.03 3.48 I felt I needed more technical support to use the technology 2.38 2.91 I felt I needed more support from the teacher when using the technology 1.94 2.30 I experienced motion sickness / disorientation from using the headset 1.53 2.35 I enjoyed using this technology to learn assessment skills 4.71 4.74 I think that this technology should be used in all nursing courses 4.47 4.57 I felt that my learning was enhanced by using the HoloLens technology 4.44 4.61

Scale: 1 = strongly disagree, 2 = disagree, 3 = neither disagree nor agree, 4 = agree, 5 = strongly agree.

slide-20
SLIDE 20

Qualitative results

  • Q6 Do you feel that your learning experience was enhanced using the

HoloLens?

– “It is easier to see the symptoms rather than be told them” – “See the actual patient and not having to ‘act’ – real time” – “It was interesting to assess a patient without feeling the pressure” – “A highly adaptable tool that gives cues not easily replicated in practice labs, giving a more realistic assessment” – “I felt I learnt more being in the situation and it was fun learning so made it more interesting” – “Allowed me to apply skills I had learnt and put them into practice – I learn by doing” – “Being able to see physical signs/symptoms is far more beneficial than explaining them”

slide-21
SLIDE 21
  • Q7= What’s the best thing about learning using the

HoloLens technology?

– “That you can see the patient and symptoms. It makes it more real” – “It was very real, cool to see the patient in our own eyes” – “This visual and auditory perspective allows a lot of cues to develop a nursing assessment and planning” – “Observing the progressing of a situation in a client without the panic and stress of a real situation” – “You can learn to observe patients and medical conditions in a stress free and learning environment” – “It feels so real. The patient looks like they are right there” – “It looked very life like. The skin looked very real was easy to see the cues from physical appearance” – “Awesome to see OP using emerging technology to assist learning”

slide-22
SLIDE 22

2019 Research

  • Year 1

– HoloPatient (Jerry) – HoloHuman

  • Year 2

– HoloPatient (Asthma and Trauma)

slide-23
SLIDE 23

Conclusion

  • Students enjoy the

experience

  • Students learning

seems to be enhanced

  • Research is ongoing
slide-24
SLIDE 24

Emma Collins

Principal Lecturer, School of Nursing, Otago Polytechnic, Dunedin, New Zealand

Emma.collins@op.ac.nz

Thank you