SENSITIVITY OF AN MMPI-2-RF COMBINED RESPONSE INCONSISTENCY (CRIN) - - PowerPoint PPT Presentation

▶
sensitivity of an mmpi 2 rf combined
SMART_READER_LITE
LIVE PREVIEW

SENSITIVITY OF AN MMPI-2-RF COMBINED RESPONSE INCONSISTENCY (CRIN) - - PowerPoint PPT Presentation

Jun 09, 2023 485 likes •1.31k views

SENSITIVITY OF AN MMPI-2-RF COMBINED RESPONSE INCONSISTENCY (CRIN) SCALE TO MIXED RESPONDING Kendall ll Whitne tney, , Taylor or Chille le, , Danie ielle lle Burchett hett, , Ph.D .D. California State University, Monterey Bay Yossef

slide-1
SLIDE 1

SENSITIVITY OF AN MMPI-2-RF COMBINED RESPONSE INCONSISTENCY (CRIN) SCALE TO MIXED RESPONDING

Kendall ll Whitne tney, , Taylor

  • r Chille

le, , Danie ielle lle Burchett hett, , Ph.D .D. California State University, Monterey Bay Yossef sef S. Ben-Por

  • rath

ath, , Ph.D. D. Kent State University David Glassmire, smire, Ph.D .D. Patton State Hospital

slide-2
SLIDE 2

Ack ckno nowl wled edge gement ments s & D & Dis iscl clos

  • sures

ures

  • Funded by a grant from the University of Minnesota Press, Test Division.
  • Additional support provided by the Undergraduate Research Opportunity

Center at California State University, Monterey Bay.

  • The statements and opinions expressed are those of the authors and do

not constitute the official views or the official policy of DSH-Patton, the California Department of State Hospitals, or the State of California.

  • Approved by the California Human Services Agency Committee for the

Protection of Human Subjects.

slide-3
SLIDE 3

MIX IXED ED RE RESPONDING PONDING

slide-4
SLIDE 4

MIX IXED ED RE RESPONDING PONDING

slide-5
SLIDE 5

MIX IXED ED RE RESPONDING PONDING

Rando dom m Res espo pondi ding

slide-6
SLIDE 6

MIX IXED ED RE RESPONDING PONDING

Rando dom m Res espo pondi ding Acquie uiesce scent t Res espo pond ndin ing

slide-7
SLIDE 7

MIX IXED ED RE RESPONDING PONDING

Rando dom m Res espo pondi ding Acquie uiesce scent t Res espo pond ndin ing Coun unter er- Acquie uiesce scent t Res espo pondi ding

slide-8
SLIDE 8

Com

  • mbin

ined ed Resp espon

  • nse

se In Inco cons nsis isten ency cy Sca cale le (CRIN) RIN)

■ CRIN was developed on the MMPI-A-RF (Archer, Handel, Ben-Porath, & Tellegen, 2016) to augment the shortened VRIN-r and TRIN-r validity scales ■ Quasi-random and fixed responding ■ No published literature of CRIN on the MMPI-2-RF

slide-9
SLIDE 9

CRI RIN N Components ponents

slide-10
SLIDE 10

CRI RIN N Components ponents: : VR VRIN-r

VRIN-r

  • 53 pairs
  • A point is assigned when an

examinee inconsistently answers a pair of items written in same direction

slide-11
SLIDE 11

Hy Hypo pothe thetical tical VR VRIN IN-r r Pai air

2) Do Dogs gs ma make e me me happ ppy.

  • a. True

ue

  • b. False

se 44) Do Dogs gs bring ng me me joy.

  • a. True

ue

  • b. False

se

slide-12
SLIDE 12

Hy Hypo pothe thetical tical VR VRIN IN-r r Pai air

2) Do Dogs gs ma make e me me happ ppy.

  • a. True

ue

  • b. False

se 44) Do Dogs gs bring ng me me joy.

  • a. True

ue

  • b. False

se

slide-13
SLIDE 13

Hy Hypo pothe thetical tical VR VRIN IN-r r Pai air

2) Do Dogs gs ma make e me me happ ppy.

  • a. True

ue

  • b. False

se 44) Do Dogs gs bring ng me me joy.

  • a. True

ue

  • b. False

se

slide-14
SLIDE 14

Hy Hypo pothe thetical tical VR VRIN IN-r r Pai air

2) Do Dogs gs ma make e me me happ ppy.

  • a. True

ue

  • b. False

se 44) Do Dogs gs bring ng me me joy.

  • a. True

ue

  • b. False

se

slide-15
SLIDE 15

CRI RIN N Components ponents: : TR TRIN-r

11 11 TRIN-r r True TRIN-r r False

  • 26 pairs
  • “Tug-o-War” scoring
  • A point is added when an examinee gives the same response to a

pair of items written in the opposite direction

slide-16
SLIDE 16

Hy Hypo pothe thetical tical TR TRIN-r r Pai air

2) Do Dogs gs ma make e me me happ ppy.

  • a. True

ue

  • b. False

se 44) Do Dogs gs ma make e me me sa sad. d.

  • a. True

ue

  • b. False

se

slide-17
SLIDE 17

Hy Hypo pothe thetical tical TR TRIN-r r Pai air

2) Do Dogs gs ma make e me me happ ppy.

  • a. True

ue

  • b. False

se 44) Do Dogs gs ma make e me me sa sad. d.

  • a. True

ue

  • b. False

se

slide-18
SLIDE 18

Hy Hypo pothe thetical tical TR TRIN-r r Pai air

2) Do Dogs gs ma make e me me happ ppy.

  • a. True

ue

  • b. False

se 44) Do Dogs gs ma make e me me sa sad. d.

  • a. True

ue

  • b. False

se

slide-19
SLIDE 19

Hy Hypo pothe thetical tical TR TRIN-r r Pai air

2) Do Dogs gs ma make e me me happ ppy.

  • a. True

ue

  • b. False

se 44) Do Dogs gs ma make e me me sa sad. d.

  • a. True

ue

  • b. False

se

slide-20
SLIDE 20

Hy Hypo pothe thetical tical TR TRIN-r r Pai air

2) Do Dogs gs ma make e me me happ ppy.

  • a. True

ue

  • b. False

se 44) Do Dogs gs ma make e me me sa sad. d.

  • a. True

ue

  • b. False

se

slide-21
SLIDE 21

Hy Hypo pothe thetical tical TR TRIN-r r Pai air

2) Do Dogs gs ma make e me me happ ppy.

  • a. True

ue

  • b. False

se 44) Do Dogs gs ma make e me me sa sad. d.

  • a. True

ue

  • b. False

se

slide-22
SLIDE 22

Hy Hypo pothe thetical tical TR TRIN-r r Pai air

2) Do Dogs gs ma make e me me happ ppy.

  • a. True

ue

  • b. False

se 44) Do Dogs gs ma make e me me sa sad. d.

  • a. True

ue

  • b. False

se

slide-23
SLIDE 23

Hy Hypo pothe thetical tical TR TRIN-r r Pai air

2) Do Dogs gs ma make e me me happ ppy.

  • a. True

ue

  • b. False

se 44) Do Dogs gs ma make e me me sa sad. d.

  • a. True

ue

  • b. False

se

slide-24
SLIDE 24

Calcul alculat ation ion of f CRI RIN

slide-25
SLIDE 25

Calcul alculat ation ion of f CRI RIN

VRIN-r CRIN TRIN-r r True TRIN-r r False

Adapted from Archer et al. (2016)

53 pa pair irs 15 pairs 11 pa pair irs

slide-26
SLIDE 26

Whitn tney y et et al. . (2018): 18): Calcula lculating ting CRIN N with th th the MM e MMPI PI-2-RF RF Normativ ative e Sample ple ■ Whitney et al. (2018) examined CRIN in the MMPI-2-RF normative sample ■ Converted raw scores to T Scores ■ How rare is a particular score on CRIN?

slide-27
SLIDE 27

Raw Score

  • res

T Score

  • res

19 19 101 18 18 97 97 17 17 94 94 16 16 90 90 15 15 87 87 14 14 83 83 13 13 80 80 12 12 76 76 11 11 72 72 10 10 69 69 9 65 65 8 62 62 7 58 58 6 55 55 5 51 51 4 47 47 3 44 44 2 40 40 1 37 37 33 33

Whitn tney y et et al. . (2018): 18): Raw w Scores

  • res Conver

erted ed to

  • T Scores
  • res
slide-28
SLIDE 28

Raw Score

  • res

T Score

  • res

19 19 101 18 18 97 97 17 17 94 94 16 16 90 90 15 15 87 87 14 14 83 83 13 13 80 80 12 12 76 76 11 11 72 72 10 10 69 69 9 65 65 8 62 62 7 58 58 6 55 55 5 51 51 4 47 47 3 44 44 2 40 40 1 37 37 33 33

Whitn tney y et et al. . (2018): 18): Raw w Scores

  • res Conver

erted ed to

  • T Scores
  • res

Adapted from Archer et al. (2016) and Ben-Porath & Tellegen (2008/2011):

  • There is some evidence
  • f response

inconsistency

slide-29
SLIDE 29

Raw Score

  • res

T Score

  • res

19 19 101 18 18 97 97 17 17 94 94 16 16 90 90 15 15 87 87 14 14 83 83 13 13 80 80 12 12 76 76 11 11 72 72 10 10 69 69 9 65 65 8 62 62 7 58 58 6 55 55 5 51 51 4 47 47 3 44 44 2 40 40 1 37 37 33 33

Whitn tney y et et al. . (2018): 18): Raw w Scores

  • res Conver

erted ed to

  • T Scores
  • res

Adapted from Archer et al. (2016) and Ben-Porath & Tellegen (2008/2011):

  • The protocol is invalid

because of excessive response inconsistency

slide-30
SLIDE 30

Wh Whit itne ney e y et t al al. . (20 2018) 8): : Ex Exam amin inin ing CRI RIN N in n a a For

  • ren

ensi sic c In Inpat atie ient nt Sam ample le

■ Participants were from a deidentified archival data set ■ Examined CRIN’s basic properties

slide-31
SLIDE 31

Whitn tney y et et al. . (2018) 18) CRIN N in a For

  • rensic

ensic Inpati patient ent Sample ple

slide-32
SLIDE 32
  • Identified a

unique 3% of protocols not identified by VRIN-r or TRIN-r

Whitn tney y et et al. . (2018) 18) CRIN N in a For

  • rensic

ensic Inpati patient ent Sample ple

slide-33
SLIDE 33
  • Considerable
  • verlap

between CRIN and VRIN-r

Whitn tney y et et al. . (2018) 18) CRIN N in a For

  • rensic

ensic Inpati patient ent Sample ple

slide-34
SLIDE 34

Whitn tney y et et al. . (2018) 18) CRIN N in a For

  • rensic

ensic Inpati patient ent Sample ple

  • Is CRIN

detecting mixed responding?

slide-35
SLIDE 35

Current urrent Stu tudy dy

■ Examined if CRIN is useful in detecting mixed responding on the MMPI-2-RF ■ Used a computer-generated mixed responding research design

slide-36
SLIDE 36
slide-37
SLIDE 37

Method Method

  • Stringent exclusionary

criteria were used to exclude all invalid protocols (Burchett et al., 2016)

  • CNS ≥ 15; VRIN-r ≥ 70; TRIN-r

≥ 70; F-r ≥ 79; Fp-r ≥ 70; Fs ≥ 80; FBS ≥ 80; RBS ≥ 80; L-r ≥ 65; K ≥ 60

Par Partic ticip ipants ants

n = 1,110 Exclude invalid protocols n = 156

slide-38
SLIDE 38

Par Partic ticip ipants ants

75% Male 25% Female Age ge M (SD) = 42.28 (10.60) Caucasian African American Latino Asian Other Ethni nici city ty

slide-39
SLIDE 39

Not Guilty by Reason

  • f Insanity

Mentally Disordered Offender Incompetent to Stand Trial Other Prison Transfer Mentally Disordered Sex Offender

Par Partic ticip ipants ants

Years Hospitalized M (SD) = 2.46 (4.23) Commi mmitme tment nt Code des

slide-40
SLIDE 40

Method Method

■ The Minnesota Multiphasic Personality Inventory-2- Restructured Form (Ben-Porath & Tellegen, 2008/2011)

Mea easures sures

slide-41
SLIDE 41

Method Method

■ We divided each participant’s data into 3 sections

Section 1: Items 1-113

Section 2: Items 114-226

Section 3: Items 227-338

Procedure

  • cedure
slide-42
SLIDE 42

Items ms 227-338 338 Items ms 1-113 Items ms 114-226 226

slide-43
SLIDE 43

Meth Method

  • d

Procedure

  • cedure

■ We selected 40% as our guide to insert random, acquiescent, and counter-acquiescent responses. ■ 40% non-content-based invalid responding has a notable impact on VRIN-r and TRIN-r scores (Handel et al., 2010).

R A C

slide-44
SLIDE 44

Brace Yourself…

slide-45
SLIDE 45

Items ms 114-226 226 Items ms 1-113 Items ms 227-338 338

slide-46
SLIDE 46

40% Chosen Items ms 114-226 226 Items ms 1-113 Items ms 227-338 338

slide-47
SLIDE 47

Items ms 114-226 226 Items ms 1-113 Items ms 227-338 338 40% Chosen

slide-48
SLIDE 48

Items ms 114-226 226 Items ms 1-113 Items ms 227-338 338 40% RANDOM (True or False)

slide-49
SLIDE 49

Items ms 114-226 226 Items ms 1-113 Items ms 227-338 338 40% RANDOM (True or False) 40% Chosen

slide-50
SLIDE 50

Items ms 114-226 226 Items ms 1-113 Items ms 227-338 338 40% RANDOM (True or False) 40% Chosen

slide-51
SLIDE 51

Items ms 114-226 226 Items ms 1-113 Items ms 227-338 338 40% RANDOM (True or False) 40% ACQUIESCENT (All True)

slide-52
SLIDE 52

Items ms 114-226 226 Items ms 1-113 Items ms 227-338 338 40% RANDOM (True or False) 40% ACQUIESCENT (All True) 40% Chosen

slide-53
SLIDE 53

Items ms 114-226 226 Items ms 1-113 Items ms 227-338 338 40% RANDOM (True or False) 40% ACQUIESCENT (All True) 40% Chosen

slide-54
SLIDE 54

Items ms 114-226 226 Items ms 1-113 Items ms 227-338 338 40% RANDOM (True or False) 40% ACQUIESCENT (All True) 40% COUNTER- ACQUIESCENT (All False)

slide-55
SLIDE 55

Items ms 114-226 226 Items ms 1-113 Items ms 227-338 338 40% RANDOM (True or False) 40% ACQUIESCENT (All True) 40% COUNTER- ACQUIESCENT (All False)

This is the RAC condition

slide-56
SLIDE 56

Method Method

■ We did this six different times to account for six different mixed responding variations Procedure

  • cedure

ACR ARC CAR CRA RAC RCA

slide-57
SLIDE 57
slide-58
SLIDE 58

CRIN N me mean n sc scores res wi will l be e el elevat ated ed in th the e pr pres esence ence of

  • f mi

mixed ed res esponding. ponding.

Hy Hypo pothe thesis sis 1

slide-59
SLIDE 59

CRIN N wi will ll incrementally crementally add dd to VRIN-r r and nd TRIN-r r in th the det e detec ection tion of

  • f mi

mixed ed res esponding. ponding.

Hy Hypo pothe thesis sis 2

slide-60
SLIDE 60

■ To develop informed sub-hypotheses, we examined where item pairs lay on the instrument.

Hy Hypo pothe thesis sis 1A 1A – Sub ub-Hyp Hypothe thesis sis

slide-61
SLIDE 61
slide-62
SLIDE 62

ACR Condi ndition ion Section ction 1 (A) Section ction 2 (C) (C) Section ction 3 (R) Total tal

VRIN-r 1T/2F 8 *1 = 8 8 * 1 = 8 16 1T/3F 4 * 1 = 8 4 * ½ = 2 6 2F/3T 12 * 1 = 12 12 * ½ = 6 18 3F/3T or 3T/3F 6 * ½ = 3 & 6 * ½ = 3 6 TRIN-r True ue 1T/3T 2*1=2 2*½ = 1 3 1T/1T 2*1=2 & 2*1=2 4 3T/3T 2*½ =.5 & 2*½ =.5 2 TRIN-r False se 2F/3F 2*1=2 2*½ =1 3 2F/2F 2*1=2 & 2*1=2 4 3F/3F 1*½ =.5 1*½ =.5 1

slide-63
SLIDE 63

63 63 47 47 55 55 60.5 48.5 64 64

10 20 30 40 50 60 70

ACR CR ARC CAR CAR CRA CRA RAC RAC RCA RCA

Hypothesi pothesis1A s1A - Sub-Hyp Hypothe thesis sis

slide-64
SLIDE 64
slide-65
SLIDE 65

Results esults

■ CRIN means were notably higher in the presence of mixed responding as compared to the original data

Hypo pothe thesis sis 1

slide-66
SLIDE 66

10 20 30 40 50 60 70 80 90 100

ORIG ORIGINA INAL ACR ACR ARC ARC CAR CAR CR CRA RAC RAC RC RCA MEAN VRIN-r, TRIN-r, & CRIN SCORES VRIN VRIN-r

  • r

TRIN- TRIN-r CR CRIN IN

slide-67
SLIDE 67

10 20 30 40 50 60 70 80 90 100

ORIG ORIGINA INAL ACR ACR ARC ARC CAR CAR CR CRA RAC RAC RC RCA MEAN VRIN-r, TRIN-r, & CRIN SCORES VRIN VRIN-r

  • r

TRIN- TRIN-r CR CRIN IN

slide-68
SLIDE 68

10 20 30 40 50 60 70 80 90 100

ORIG ORIGINA INAL ACR ACR ARC ARC CAR CAR CR CRA RAC RAC RC RCA MEAN VRIN-r, TRIN-r, & CRIN SCORES VRIN VRIN-r

  • r

TRIN- TRIN-r CR CRIN IN

slide-69
SLIDE 69

10 20 30 40 50 60 70 80 90 100

ORIG ORIGINA INAL ACR ACR ARC ARC CAR CAR CR CRA RAC RAC RC RCA MEAN VRIN-r, TRIN-r, & CRIN SCORES VRIN VRIN-r

  • r

TRIN- TRIN-r CR CRIN IN

slide-70
SLIDE 70

CRIN RIN wi will ll increm crementally entally ad add to VR VRIN-r an and TRIN IN-r r in th the e det etect ection ion of mi mixed ed res esponding. ponding.

Hy Hypo pothe thesis sis 2

slide-71
SLIDE 71

0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%

ACR CR ARC CAR CAR CRA CRA RAC RAC RCA RCA

CRIN’S INCREMENTAL UTILITY

TRIN- TRIN-r TRIN- TRIN-r + r + VRIN- RIN-r VRI VRIN- N-r

slide-72
SLIDE 72

0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%

ACR CR ARC CAR CAR CRA CRA RAC RAC RCA RCA

CRIN’S INCREMENTAL UTILITY

TRIN- TRIN-r TRIN- TRIN-r + r + VRIN- RIN-r VRI VRIN- N-r CRIN CRIN

slide-73
SLIDE 73

31% 54% 54% 33% 33% 25% 25% 58% 58% 17%

0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%

ACR CR ARC CAR CAR CRA CRA RAC RAC RCA RCA

CRIN’S INCREMENTAL UTILITY

TRIN- TRIN-r TRIN- TRIN-r + r + VRIN- RIN-r VRI VRIN- N-r CRIN CRIN Below Below 80T 80T

slide-74
SLIDE 74

Lim imitations itations

Small l sampl ample n n = 156 56

slide-75
SLIDE 75

Lim imitations itations

Small l sampl ample n n = 156 56 Mix ixed ed Res espo pondi ding

slide-76
SLIDE 76

Lim imitations itations

Small l sampl ample n n = 156 56 Mix ixed ed Res espo pondi ding Various possible conceptualizations Only examined 40%

slide-77
SLIDE 77

Implications plications

“Tug-o-War” vs. Worki rking g in in tande dem

slide-78
SLIDE 78

Implications plications

“Tug-o-War” vs. Worki rking g in in tande dem CRIN pr promi misin ing g for r MMPI-2-RF RF or MMPI-3

slide-79
SLIDE 79

Implications plications

“Tug-o-War” vs. Worki rking g in in tande dem CRIN pr promi misin ing g for r MMPI-2-RF RF or MMPI-3 Consider carefully spacing items Consider equal balance of random

  • vs. fixed pairs
slide-80
SLIDE 80

Ref eference erences

Archer, R.P., Handel, R.W., Ben-Porath, Y.S. & Tellegen, A. (2016). Minnesota Multiphasic Personality Inventory – Adolescent Restructured Form; Administration, Scoring, Interpretation and Technical Manual. Minneapolis, MN: University of Minnesota Press. Ben-Porath, Y. S., & Tellegen, A. (2008/2011). MMPI-2-RF: Manual for administration, scoring and interpretation. University of Minnesota Press. Burchett, D., Dragon, W. R., Smith Holbert, A. M., Tarescavage, A. M., Mattson, C. A., Handel, R. W., & Ben-Porath,

  • Y. S. (2016). 'False feigners': Examining the impact of non-content-based invalid responding on the

Minnesota Multiphasic Personality Inventory-2 Restructured Form content-based invalid responding

  • indicators. Psychological Assessment, 28(5), 458-470. doi:10.1037/pas0000205

Handel, R. W., Ben-Porath, Y. S., Tellegen, A., & Archer, R. P. (2010). Psychometric functioning of the MMPI-2-RF VRIN-r and TRIN-r scales with varying degrees of randomness, acquiescence, and counter- acquiescence. Psychological Assessment, 22, 87–95. http://dx.doi.org/ 10.1037/a0017061

slide-81
SLIDE 81

TH THANK ANK YOU! U!