Building of a Lifelong Ohana: Evaluating an online resource site for - - PowerPoint PPT Presentation

building of a lifelong ohana evaluating an online
SMART_READER_LITE
LIVE PREVIEW

Building of a Lifelong Ohana: Evaluating an online resource site for - - PowerPoint PPT Presentation

Building of a Lifelong Ohana: Evaluating an online resource site for LTEC online masters program students Learning Design & Technology Kitty Hino College of Education hinok@hawaii.edu University of Hawaii at M noa Presentation


slide-1
SLIDE 1

Building of a Lifelong ‘Ohana: Evaluating an online resource site for LTEC online master’s program students

Learning Design & Technology College of Education University of Hawai‘i at Mānoa Kitty Hino hinok@hawaii.edu

slide-2
SLIDE 2

❏ Background ❏ Project Design ❏ Usability Study ❏ Findings

Presentation Outline

slide-3
SLIDE 3

❏ Background

slide-4
SLIDE 4

❏ Online LTEC Master’s Program ❏ Compulsory 3 Days in person

  • rientation

Background

Background · Project Design · Usability Study · Findings

slide-5
SLIDE 5
  • A. Yes! For sure!
  • B. Nope!

Type your answer in the chat box

Audience Poll

Have you been to any in person orienation that is over 3 hours?

Background · Project Design · Usability Study · Findings

slide-6
SLIDE 6
  • A. More than 80%
  • B. 50%
  • C. 30%
  • D. 10%...?

Type your answer in the chat box

Audience Poll

How much do you remember a day after the orienation?

Background · Project Design · Usability Study · Findings

slide-7
SLIDE 7

❏ Online LTEC Master’s Program ❏ Compulsory 3 Days in person

  • rientation

❏ Too little time, too much to know!

Background

Background · Project Design · Usability Study · Findings

slide-8
SLIDE 8

Why did I choose this project?

❏ Locus of control ❏ Need ❏ Content experts

Background · Project Design · Usability Study · Findings

slide-9
SLIDE 9

❏ Develop an online orientational resource site for new OTEC students ❏ Evaluate the site by conducting a usability study ❏ Improve the resource site based on user feedback

Project Purpose and Goals

Background · Project Design · Usability Study · Findings

slide-10
SLIDE 10

Target Audience

Background · Project Design · Usability Study · Findings

slide-11
SLIDE 11

❏ Project Design

slide-12
SLIDE 12

Content

Background · Project Design · Usability Study · Findings

Research Journal

Student FAQ

SME Survey

Experience

slide-13
SLIDE 13

Topics

Background · Project Design · Usability Study · Findings

1 2 3 4

slide-14
SLIDE 14

Platform

Background · Project Design · Usability Study · Findings ❏ Canvas by Instructure

◆ Free! ◆ Explore LMS in a risk-free environment ◆ Easy to use / configure ◆ Assess control

slide-15
SLIDE 15

Background · Project Design · Usability Study · Findings

Theme Graphics Font & Colors

slide-16
SLIDE 16

Background · Project Design · Usability Study · Findings

Icons Original Videos Orignal Written Guide

slide-17
SLIDE 17

❏ Usability Study

slide-18
SLIDE 18

❏ 30 - 45 minutes in-person or virtual ❏ Three rounds ❏ Pre-questionnaire

❏ Demographics & Online Resource Experience

❏ Consent Form

Usability Design

Background · Project Design · Usability Study · Findings

slide-19
SLIDE 19

Usability Design

Background · Project Design · Usability Study · Findings

❏ Protocol - Steve Krug’s Rocket Surgery Made Easy

❏ Concurrent Think Aloud ❏ 5 tasks

❏ Post-questionnaire

❏ Design & Layout ❏ Navigation ❏ Usefulness

slide-20
SLIDE 20

❏ 10 Participants, LTEC current or alumni students

Test Population

Background · Project Design · Usability Study · Findings

slide-21
SLIDE 21

Test Population

Background · Project Design · Usability Study · Findings

slide-22
SLIDE 22

Evaluation Methodology

Background · Project Design · Usability Study · Findings

Jakob Neilsen’s Severity Rating for Usability Problems

0 = I don't agree that this is a usability problem at all 1 = Cosmetic problem only: need not be fixed unless extra time is available on project 2 = Minor usability problem: fixing this should be given low priority 3 = Major usability problem: important to fix, so should be given high priority 4 = Usability catastrophe: imperative to fix this before product can be released

slide-23
SLIDE 23

Testing Round 1

Background · Project Design · Usability Study · Findings

❏ General aesthetics and

content usefulness

❏ Inconsistancy font sizes and color ❏ Reduce redundancy ❏ Navigation issue

0 - no problem 1 - cosmetic 2 - minor

3 - major

4 - catastrophe 1 - cosmetic

3 - major 3 - major

slide-24
SLIDE 24

BEFORE

Background · Project Design · Usability Study · Findings

AFTER

slide-25
SLIDE 25

Testing Round 2

Background · Project Design · Usability Study · Findings

❏ Videos dimensions & links ❏ Graphics ❏ ‘Okina and kahako ❏ Faculty & Staff Profiles

0 - no problem 2 - minor

3 - major

4 - catastrophe 1 - cosmetic 2 - minor 2 - minor 2 - minor

3 - major

slide-26
SLIDE 26

Background · Project Design · Usability Study · Findings

BEFORE AFTER

slide-27
SLIDE 27

Background · Project Design · Usability Study · Findings

AFTER BEFORE

slide-28
SLIDE 28

Testing Round 3

Background · Project Design · Usability Study · Findings

❏ Icons ❏ Graphics sizes ❏ “Benefits” ❏ College of Education

Information

0 - no problem 2 - minor

3 - major

4 - catastrophe 1 - cosmetic 2 - minor

3 - major 3 - major 3 - major

slide-29
SLIDE 29

Background · Project Design · Usability Study · Findings

AFTER BEFORE

slide-30
SLIDE 30

❏ Findings

slide-31
SLIDE 31

Findings and Conclusion

Background · Project Design · Usability Study · Findings

slide-32
SLIDE 32

Findings and Conclusion

Background · Project Design · Usability Study · Findings

slide-33
SLIDE 33

Findings and Conclusion

Background · Project Design · Usability Study · Findings

slide-34
SLIDE 34

Findings and Conclusion

Background · Project Design · Usability Study · Findings

slide-35
SLIDE 35

Post-Questionnaire User Ratings

Background · Project Design · Usability Study · Findings

slide-36
SLIDE 36

Post-Questionnaire User Ratings

Background · Project Design · Usability Study · Findings

slide-37
SLIDE 37

Moving Forward

Background · Project Design · Usability Study · Findings

❏ Pilot testing resource site ❏ Seek continual feedback ❏ Further expand on site content

slide-38
SLIDE 38

Big Mahalo!

❏ LTEC Faculty ❏ Critical Friends ❏ Family & Friends ❏ Coffee!

slide-39
SLIDE 39

❏ Questions?