21 st Century Instructional Assessments: Moving from Paper to Online - - PowerPoint PPT Presentation

21 st century instructional assessments moving from paper
SMART_READER_LITE
LIVE PREVIEW

21 st Century Instructional Assessments: Moving from Paper to Online - - PowerPoint PPT Presentation

Conference 2018 Conference 2018 21 st Century Instructional Assessments: Moving from Paper to Online WELCOME! Presenters Judy Shandler Nancy Morello Senior Business Analyst Supervisor, Instructional Assessment & Exams


slide-1
SLIDE 1

Conference 2018

Conference 2018

21st Century Instructional Assessments: Moving from Paper to Online

WELCOME!

slide-2
SLIDE 2

Conference 2018

Judy Shandler

Senior Business Analyst

Performance Development System Coordinator

Instructional Assessment Online Project Lead

Instructor

Nancy Morello

Supervisor, Instructional Assessment & Exams

Learning and Teaching Centre

Presenters

slide-3
SLIDE 3

Paper-Paper Everywhere!

slide-4
SLIDE 4

Conference 2018

2015 Student Evaluation of Teaching (SET) - System Selection Project

 Purpose:

 Recommend an enterprise-level software system for online SET to better support teaching and

learning at BCIT

A Longitudinal Project (actually 2 Projects)

slide-5
SLIDE 5

Conference 2018

 Approach:

 Establish a working group including: ITS, Registrar, Business Analyst, Learner Services  Consult with internal and external stakeholders  Students  Instructors  Managers  Administrators  Bargaining Units  Other Canadian post-secondary Institutions  Vendors

SET System Selection Project

slide-6
SLIDE 6

Conference 2018

 Feedback:

 Excessive number of

existing SET business processes

Eight (8) systems requiring data processing for surveys

SET Student Evaluation of Teaching

slide-7
SLIDE 7

Conference 2018

 Feedback:

 Concerns about content of questionnaire  Program/course feedback and formative student feedback  Best practices for nonstandard courses  Improving response quality and response rates  Clarity about how the process is supposed to work  Short, well-designed questionnaires with targeted questions.  Support for online evaluation  Wi-Fi can be an issue when doing evaluations on a mobile device

SET Student Evaluation of Teaching

slide-8
SLIDE 8

Conference 2018

Overall Feedback. . .

Not much has changed since 2013

slide-9
SLIDE 9

Conference 2018

 eXplorance Blue

  • Hosted in Montreal
  • Highly secure
  • Easy to use
  • Increases accessibility & flexibility
  • Improve business processes & confidentiality
  • 10 Canadian Institutions using Blue

Recommendation

slide-10
SLIDE 10

Conference 2018

 Internal versus External hosting  Privacy Policies  Sponsorship  Political sensitivity  Bargaining units  Value of surveys  Sending the correct message

Considerations and Possible Issues

slide-11
SLIDE 11

Conference 2018

slide-12
SLIDE 12

Let’s Talk About

slide-13
SLIDE 13

Conference 2018

 Expected  Strong commitment to

Learning and Teaching for students and instructors

 Clear understanding of the

evaluation system and process

 Ease of administrating

Instructional Assessment Online (IAO)

Why?

slide-14
SLIDE 14

Conference 2018

 Sponsor(s)

 Executive Sponsor  Business Sponsor

 Project Manager (Vendor)  Project Lead  System Administrator  Data Administrator  Marketing  Web Design

IAO Project Team

slide-15
SLIDE 15

Conference 2018

 Phase out paper base surveys  Reduce admin tasks  Improved survey access for faculty, management and supporting staff  Improved survey deployment to students  Secured central access to reports  Ability for faculty to select from question banks  Improving quality of surveys

IAO Project Goals

slide-16
SLIDE 16

Conference 2018

 Phased implementation of eXplorance Blue  Training  Requirements doc.  Communication plan (incl. MarCom, SA, Faculty, Management, etc.)  Install and integrated with BCIT’s single sign on (SSO)

IAO Project Deliverables

slide-17
SLIDE 17

Conference 2018

 Assessment Model

Survey Design and Questions

slide-18
SLIDE 18

Conference 2018

 13 Core Questions

 12 Likert scale questions  1 comment/feedback question

 Extensive Question Bank Questions

 5 additional Likert scale questions  2 additional comment/feedback questions

 Either from question bank  Or customized by instructor

 Important!

 Getting agreement (standard questions & question bank)

 Instructors & Bargaining Units

Survey Design and Questions

slide-19
SLIDE 19

Conference 2018

 Emails to:

 Instructors  Program Heads  Program Assistants  Associate Deans  Deans

 Main Message:

 Highly secure  Easy to use  Increases accessibility and flexibility  Improves business processes and confidentiality

Communication Plan

slide-20
SLIDE 20

Conference 2018

STOP!!!

slide-21
SLIDE 21

Conference 2018

Security - PIA

slide-22
SLIDE 22

Conference 2018

 Website

 Overview  About IAO  Survey Questions  Instructor Toolkit  Student Toolkit  FAQ  Contact us

Communication Plan (cont’d . . .)

slide-23
SLIDE 23

Conference 2018

 Meeting with all Schools and Departments:

 Instructors  Program Heads  Program Assistants  Associate Deans  Deans  Student Association (SA)

 Email  Main Message

 Autonomous  Highly secure  Easy to use  Increases accessibility and flexibility  Improves business processes and confidentiality

Communication Plan Includes:

slide-24
SLIDE 24

Conference 2018

 Reports

 Instructors

 Associate Deans  Customize Administration for Instructors

 Change survey dates  Opt out  Monitor response rates

 Increase Engagement

 Instructors can verify their courses and enrollments maintaining student

anonymity

Features

slide-25
SLIDE 25

Conference 2018

 Part-Time Studies  Distance Ed  Full-Time Course  Labs and Clinical

Phases

slide-26
SLIDE 26

Conference 2018

2

Nancy Morello nancy_morello@bcit.ca Judy Shandler judy_shandler@bcit.ca