Resident Selection Sharing experiences from using selection science - - PowerPoint PPT Presentation

▶
resident selection
SMART_READER_LITE
LIVE PREVIEW

Resident Selection Sharing experiences from using selection science - - PowerPoint PPT Presentation

Mar 26, 2023 460 likes •794 views

Resident Selection Sharing experiences from using selection science to find the best surgical trainees Brian J. Dunkin, MD, FACS TSDA General Session Disclosure Not a selection scientist Disclosure I found someone with whom to

slide-1
SLIDE 1

Resident Selection

Sharing experiences from using selection science to find the best surgical trainees

Brian J. Dunkin, MD, FACS

TSDA General Session

slide-2
SLIDE 2

Disclosure

  • Not a selection scientist
slide-3
SLIDE 3

Disclosure

  • I found someone with whom to collaborate!

Aimee Gardner, PhD Assistant Dean of Evaluation & Research School of Health Professions Associate Professor, Health Professions & Surgery Baylor College of Medicine Houston, Texas

slide-4
SLIDE 4

Disclosure

  • Ownership interest in SurgWise
slide-5
SLIDE 5

Let me tell you a story …

slide-6
SLIDE 6

Typical file

  • USMLE
  • ABSITE
  • MIS Case Numbers
  • Unstructured letters of recommendation
  • Unstructured personal statements
  • Unstructured CV
slide-7
SLIDE 7

Assessment Tools

slide-8
SLIDE 8

USMLE / ABSITE / GRADES

slide-9
SLIDE 9

Assessment Tools

slide-10
SLIDE 10

We do lots of interviews

slide-11
SLIDE 11

Assessment Tools

slide-12
SLIDE 12

How could we do this better?

slide-13
SLIDE 13

Job Analysis

slide-14
SLIDE 14

Job Requirements  Competencies

slide-15
SLIDE 15

Competencies  Assessments

slide-16
SLIDE 16

Situational Judgment Tests (SJTs)

slide-17
SLIDE 17

Personality Profile

  • Agreeableness
  • Extraversion
  • Emotional Stability
  • Openness to new experiences
  • Conscientiousness

Gardner AK, Dunkin BJ. JAMA Surgery 2017

slide-18
SLIDE 18

Course Topic Delivery Method

Didactics Case-based Review Small Group Discussion Role Play Other Active Learning Strategies Part I: Background Structured Interview Basics

x x

Question Development

x x

Biases in Interviews

x x

Part II: Asking Questions Getting Complete Responses

x x

Types of Interviewing Questions

x x

Unacceptable & Illegal Questions

x x x x

Taking Notes

x x

Part III: Assessment Assigning Ratings

x x x x

Motivational Fit

x x

Integrating Data

x x

Part IV: Putting it All Together Interview Day Basics

x

Review

x x

slide-19
SLIDE 19

Technical Skills

  • Fast-paced program
  • High complexity
  • Time-compressed environment
slide-20
SLIDE 20

Gardner AK, Dunkin BJ. Annals of Surgery 2018

slide-21
SLIDE 21

Could Fit But … Great Fit Not A Good Fit

slide-22
SLIDE 22

Gardner AK, Dunkin BJ. Annals of Surgery 2018

slide-23
SLIDE 23

Structured Interviews Skills Testing

slide-24
SLIDE 24

Information on MIS Candidates for Ranking

  • SJT
  • 26 questions
  • 130 unique data points
  • Personality profile
  • 9 competencies

interviews

  • 3 competencies

group

  • Technical skills
slide-25
SLIDE 25

Results

slide-26
SLIDE 26

Gardner AK, Dunkin BJ. Annals of Surgery 2018

slide-27
SLIDE 27

Gardner AK, Dunkin BJ. Annals of Surgery 2018

slide-28
SLIDE 28

Gardner AK, Dunkin BJ. Annals of Surgery 2018

slide-29
SLIDE 29

55 applicants invited to take

  • nline assessment

50 (91%) completed 42 minutes

slide-30
SLIDE 30

80%

improved agreement among interviewers

45%

increase in knowledge of how to conduct structured interviews

45%

higher in how to avoid illegal questions

slide-31
SLIDE 31

Over 50% less interviews

slide-32
SLIDE 32

Success!

slide-33
SLIDE 33

Competency-based Selection

Aimee K. Gardner, PhD