21 st Century Instructional Assessments: Moving from Paper to Online - - PowerPoint PPT Presentation
21 st Century Instructional Assessments: Moving from Paper to Online - - PowerPoint PPT Presentation
Conference 2018 Conference 2018 21 st Century Instructional Assessments: Moving from Paper to Online WELCOME! Presenters Judy Shandler Nancy Morello Senior Business Analyst Supervisor, Instructional Assessment & Exams
Conference 2018
Judy Shandler
Senior Business Analyst
Performance Development System Coordinator
Instructional Assessment Online Project Lead
Instructor
Nancy Morello
Supervisor, Instructional Assessment & Exams
Learning and Teaching Centre
Presenters
Paper-Paper Everywhere!
Conference 2018
2015 Student Evaluation of Teaching (SET) - System Selection Project
Purpose:
Recommend an enterprise-level software system for online SET to better support teaching and
learning at BCIT
A Longitudinal Project (actually 2 Projects)
Conference 2018
Approach:
Establish a working group including: ITS, Registrar, Business Analyst, Learner Services Consult with internal and external stakeholders Students Instructors Managers Administrators Bargaining Units Other Canadian post-secondary Institutions Vendors
SET System Selection Project
Conference 2018
Feedback:
Excessive number of
existing SET business processes
Eight (8) systems requiring data processing for surveys
SET Student Evaluation of Teaching
Conference 2018
Feedback:
Concerns about content of questionnaire Program/course feedback and formative student feedback Best practices for nonstandard courses Improving response quality and response rates Clarity about how the process is supposed to work Short, well-designed questionnaires with targeted questions. Support for online evaluation Wi-Fi can be an issue when doing evaluations on a mobile device
SET Student Evaluation of Teaching
Conference 2018
Overall Feedback. . .
Not much has changed since 2013
Conference 2018
eXplorance Blue
- Hosted in Montreal
- Highly secure
- Easy to use
- Increases accessibility & flexibility
- Improve business processes & confidentiality
- 10 Canadian Institutions using Blue
Recommendation
Conference 2018
Internal versus External hosting Privacy Policies Sponsorship Political sensitivity Bargaining units Value of surveys Sending the correct message
Considerations and Possible Issues
Conference 2018
Let’s Talk About
Conference 2018
Expected Strong commitment to
Learning and Teaching for students and instructors
Clear understanding of the
evaluation system and process
Ease of administrating
Instructional Assessment Online (IAO)
Why?
Conference 2018
Sponsor(s)
Executive Sponsor Business Sponsor
Project Manager (Vendor) Project Lead System Administrator Data Administrator Marketing Web Design
IAO Project Team
Conference 2018
Phase out paper base surveys Reduce admin tasks Improved survey access for faculty, management and supporting staff Improved survey deployment to students Secured central access to reports Ability for faculty to select from question banks Improving quality of surveys
IAO Project Goals
Conference 2018
Phased implementation of eXplorance Blue Training Requirements doc. Communication plan (incl. MarCom, SA, Faculty, Management, etc.) Install and integrated with BCIT’s single sign on (SSO)
IAO Project Deliverables
Conference 2018
Assessment Model
Survey Design and Questions
Conference 2018
13 Core Questions
12 Likert scale questions 1 comment/feedback question
Extensive Question Bank Questions
5 additional Likert scale questions 2 additional comment/feedback questions
Either from question bank Or customized by instructor
Important!
Getting agreement (standard questions & question bank)
Instructors & Bargaining Units
Survey Design and Questions
Conference 2018
Emails to:
Instructors Program Heads Program Assistants Associate Deans Deans
Main Message:
Highly secure Easy to use Increases accessibility and flexibility Improves business processes and confidentiality
Communication Plan
Conference 2018
STOP!!!
Conference 2018
Security - PIA
Conference 2018
Website
Overview About IAO Survey Questions Instructor Toolkit Student Toolkit FAQ Contact us
Communication Plan (cont’d . . .)
Conference 2018
Meeting with all Schools and Departments:
Instructors Program Heads Program Assistants Associate Deans Deans Student Association (SA)
Email Main Message
Autonomous Highly secure Easy to use Increases accessibility and flexibility Improves business processes and confidentiality
Communication Plan Includes:
Conference 2018
Reports
Instructors
Associate Deans Customize Administration for Instructors
Change survey dates Opt out Monitor response rates
Increase Engagement
Instructors can verify their courses and enrollments maintaining student
anonymity
Features
Conference 2018
Part-Time Studies Distance Ed Full-Time Course Labs and Clinical
Phases
Conference 2018
2