Medical Education Gretchen Guiton Director of Evaluation Jennifer - - PowerPoint PPT Presentation

Evaluating Your Medical Education

Gretchen Guiton Director of Evaluation Jennifer Gong Assistant Director of Evaluation Susan Claxon Evaluation Specialist Susan Peth Evaluation Specialist

August 2013 - co 2017

Purpose of Presentation

Describe changes in the evaluation system and procedures Review evaluation responsibilities and policies Discuss FIRECRACKER Discount (optional)

August 2013 - co 2017

Evaluation Changes

Decrease evaluation burden

Balance assignment to Block or Longitudinal courses Reduce number of lecturer evaluations in Block Eliminate most required comments

Change evaluation program

Fewer evaluation notices Less confusion (“fingers crossed”)

August 2013 - co 2017

Evaluation Process

Evaluations will allow completion in “real time” – open at beginning of block All evaluations close on the same day – 10 business days after final exam for Block To reduce burden, class is randomly divided into 2 groups to complete either Block or Longitudinal course evaluations

August 2013 - co 2017

ALL STUDENTS Longitudinal Courses

Evaluate

Course Lecturers & Facilitators in Foundations of Doctoring Threads MSA

Essential Core Block

Evaluate

Block Lecturers (70%) Small Group Facilitators

Evaluate PBL Complete Other Questionnaires Randomize into 2 groups

August 2013 - co 2017

Evaluation Assignment

Group A

 Nervous System  Longitudinal during

 DEMS  Life Cycle

 Life Cycle

Group B

 Longitudinal during

 Nervous System  Infectious Diseases

 DEMS  Infectious Diseases

August 2013 - co 2017

Based on actual count of numbers of lecturers and facilitators

Email Notice of Evaluation

E-mail notifications will be sent: when evaluations open at beginning of Block (next Friday for NS Block) with completion status one week before final exam if not complete one week prior to close

August 2013 - co 2017

Link to Evaluations on Homepage

Rotation Name is your clue!

Sorting Assigned Evaluations

“NETing” Facilitator Evaluations

“NETing” Facilitator Evaluations

Facilitator Evaluation

August 2013 - co 2017

Lecturer Evaluation

August 2013 - co 2017

Save vs. Submit

August 2013 - co 2017

• Use Save Draft until your evaluation is complete.
• Evaluation is not complete until you Submit Final.

August 2013 - co 2017

Checking Completed Evaluations

• Change Department (top right hand corner of webpage)
• Click link – Completed Evaluations (about me and by me)
• This will provide you with a list of the evaluations you have completed

Evaluation Responsibilities and Policies

August 2013 - co 2017

Your feedback …

Informs curriculum decisions and improvements Motivates faculty to keep and improve teaching Enables you to provide and practice feedback

August 2013 - co 2017

How can these be made better?

• I do not relate to Dr. Xs lecturing style and

found the presentation confusing.

• Knowledgeable, but a little bit difficult to

follow.

August 2013 - co 2017

What is “good feedback”?

Appropriate scope and tone Specific Describes observable behaviors Objective Modifiable Timely Selective Suggests ways to improve/ Reinforces positive

August 2013 - co 2017

The impact you intend?

• Dr. X was the poorest lecturer of the unit. The

lectures were poorly organized and the lecture notes were almost impossible to follow. This material should be simplified because the truth is you can just memorize a flow chart and understand everything in under an hour but the lectures made it seem like this was rocket science.

August 2013 - co 2017

Let’s talk about your experience …

Lectures presenting clinical scenarios were absolutely

• amazing. Incredibly clear on the presentation of diseases

and how to approach using the knowledge we've learned. Which is why it was a surprise as to how unclear the initial Y lecture was. On first pass, both pre-reading and listening to lecture, I was unable to grasp the Y and feel as though the majority of the class feels the same way. Had to use additional, external resources to learn. However, the lecture and handouts were very useful for review once Y was learned and the Z lecture was very clear on how to differentiate the different diseases.

August 2013 - co 2017

Evaluation Responsibilities and Policies

August 2013 - co 2017

Your Feedback is Confidential

Confidential means that your responses can be linked to you Only members of Evaluation Office can view link Data always reported in aggregate form If “anonymous” or “optional” we will inform you

August 2013 - co 2017

Evaluations are Required

 Because your feedback is critical to the on-going monitoring, improvement, and accreditation of the educational program, the Curriculum Steering Committee has made participation in the evaluation system mandatory.  Evidence suggests that failure to complete evaluations in medical school is indicative of future professionalism problems in medical school* and in practice.**

*Stern, D.P., M, The Developing Physician — Becoming a Professional. New England Journal of Medicine, 2006 **Papadakis, et al. Disciplinary Action by Medical Boards and Prior Behavior in Medical School. New England Journal of Medicine, 2006

August 2013 - co 2017

Policy on Fulfilling Your Obligation

.

August 2013 - co 2017

1st Time

• Meet w/

Assistant Dean 2nd Time

• Ass’t Dean files

form w/ Professionalism Committee 3rd Time

• 2nd Form filed
• Professionalism

Cmte may meet to review

Failure to complete an evaluation on time results in referral to the Professionalism Committee. Procedure: Evaluation Office notifies the Asst. Dean of the Essentials Core (i.e., Dr. Taylor).

Firecracker

CU SOM Discount

Discount Available to MS2s

In the interest of our partnership, we want to give your students  ~50% off an 8th month plan  That's $88 for 8 months (Sept-April)

In Return, we ask that you

 Agree to have us receive your use data directly from company so that we can assess the value of Firecracker as a resource.  With your approval, the Evaluation Office will receive identifiable information on number of items, frequency

• f review, and item performance linked to your name.

 Data analyzed and reported in aggregate to evaluate effectiveness value over and above other study methods.  Potential value to future classes studying for Step I, your future board study behaviors, integration of practice tests with Essential Core.

Process

 Must sign form agreeing to release of information to Evaluation Office  Must complete form and turn in to Evaluation Office by Friday September 6th.  We’ll send a link to sign up for Firecracker that will allow you to receive discount.  Must access link using your UCDENVER email to receive discount  Check out Firecracker at

 : http://www.youtube.com/watch?v=VNLn dG__YZU

Contact Us!

 Susan Claxon  Susan Peth  Jennifer Gong  Gretchen Guiton  Evaluation Email:

SOM.Evaluations@ucdenver.edu

Evaluation Website:

http://www.ucdenver.edu/academics/colleges/me dicalschool/education/degree_programs/MDProgr am/administration/evaluation/Pages/default.aspx

August 2013 - co 2017