Introduction to Evaluation and Assessment August 2019 Office of - - PowerPoint PPT Presentation
Introduction to Evaluation and Assessment August 2019 Office of Assessment, Evaluation and Outcomes Mission: to create a data-driven culture that promotes growth and improvement of educational programs and individual students. Assistant
Tai Lockspeiser, MD, MHPE Assistant Dean of Assessment, Evaluation, and Outcomes Rachael Tan, PhD Director of Office of Assessment, Evaluation, and Outcomes Brooke Parsons, MPA Evaluator Susan Peth Sr Evaluation Specialist
grades and how they are administered
results
improvement, and accreditation of the medical school
evaluations in medical school is indicative of professionalism problems in medical school and in practice.
practice in medical school as providing feedback is something done by all practicing physicians
Lockspeiser sent to any students with incomplete evaluations
email sent to student about consequences of not completing evaluations
blocks a Professionalism Feedback Form will be completed
– Changes to the structure of Human Body Block – Change to pass/fail grading – Introduction of Lecturio
– This link is ONLY used to monitor completion and quality of feedback
– Oversees collection, storage, and use of medical student data – Members include faculty and staff from Evaluation, Curriculum, Student Life, Admissions and students
Specific Focused on Improvement Non-judgmental Descriptive Timely Focused on behaviors
did all the connective tissue stuff to teach us more! The other lecturers were fantastic but often continuity of teaching style and material is good for the student and learning.”
and she welcomed and addressed questions adequately. I also appreciated the examples she provided to help us.”
terminology and logistical things down. Her demeanor and presentation was calming and clear.”
– Lecturer evaluations – 2 weeks of Lecturers each block – Block Small Group Facilitator evaluations – All SGFs – Course/Block evaluations – either Essentials Core OR Foundations of Doctoring
– Everyone completes ALL Lecturer and Facilitator evaluations – Complete either Human Body Block OR Foundations of Doctoring Course Evaluations
evaluation opens, and every Sunday night
you have to complete
without logging in
Mobile device is possible, but works best if you use the individual links from the Oasis notification email
You can also check your progress toward completing your assigned evaluations
Do not evaluate someone you have not worked with
Did not attend, review video
OR wrong lecturer
Formative Assessment – Quizzes
Summative Assessment – Written Exams
Block
– Take exams on your own laptop – Download the exam the night before – Proctor provides password on exam day – Secure, timed
Password: practice1
Questions? Contact Matt Cook: MATTHEW.N.COOK@CUANSCHUTZ.EDU
– Posted to Canvas as a quiz – Correct answers provided as well as explanations if available – Students submit a “query” if they believe the identified answer is not correct – Queries submitted directly to the Assessment Team via email: SOM.ExamQuery@ucdenver.edu
– Percentage of students answering a question correctly (p-value) – Question discrimination – Exam reliability
Exam Day Student Queries Due Final Exam Scores Released
Monday 9am Wednesday 6pm Wednesday Tuesday 9am Thursday 6pm Thursday Wednesday 9am Friday 6pm Friday Thursday 9am Monday 6pm Monday Friday 9am Monday 6pm Monday
– Can “answer” questions again – Correct answers – Explanations/rationales provided at minimum for the questions missed by more than 30% of the class – Flawed questions removed
Susan Peth Brooke Parsons Rachael Tan Tai Lockspeiser
Evaluation Email: SOM.Evaluations@ucdenver.edu Assessment Email: SOM.ExamQuery@ucdenver.edu