Assessment Made Easy Automated Assessment for More Effective - - PowerPoint PPT Presentation

Assessment Made Easy

Scott L. Cone, Ph.D. Talbot Hall, Assessment & Treatment Center

Community Education Centers

Automated Assessment for More Effective Treatment

http://cjinstitute.org/files/Community_Corrections_BoxSet_Oct09.pdf

TODAY’S FOCUS

Can this be done in an efficient, cost- effective manner? Can this data be aggregated to measure relevant practices? Can I share this data regularly with the offenders, counselors, supervisors, and administrators?

Crime and Justice Institute at Community Resources for Justice (2009). Implementing Evidence-Based Policy and Practice in Community Corrections, 2nd ed. Washington, DC: National Institute of Corrections.

The Assessment Process

STEP 1 STEP 2 STEP 3 STEP 4 STEP 5

Institute of Behavioral Research at Texas Christian University (TCU)

TCU CJ CEST (CJ - criminal justice version)

Client Evaluation of Self and Treatment

TCU CTS

Criminal Thinking Scales

TCU DS - II

Drug Screen II

www.ibr.tcu.edu

Test Format

Disagree Strongly Disagree Uncertain Agree Agree Strongly

1 You have people close to you who motivate and encourage your recovery. A B C D E

183 Questions on Pre Assessment Test 200 Questions on Post Assessment Test Multiple questions make up each score.

Identifying Information & Validity

Five validity questions for a score between 0 and 20. >9 is considered invalid

Validity Question

Disagree Strongly Disagree Uncertain Agree Agree Strongly

You are putting some effort into this test

A B C D E

HOW DO YOU THINK GUYS RESPOND?

Validity Question

Disagree Strongly Disagree Uncertain Agree Agree Strongly

You are putting some effort into this test

A B C D E ?% ?% ?% ?% ?%

Totals to 100%

Validity Question

Disagree Strongly Disagree Uncertain Agree Agree Strongly

You are putting some effort into this test

A B C D E 1% 3% 1% 43% 52%

Validity Question

Disagree Strongly Disagree Uncertain Agree Agree Strongly

Your favorite author is Logan Scott

A B C D E

Validity Question

Disagree Strongly Disagree Uncertain Agree Agree Strongly

Your favorite author is Logan Scott

A B C D E

HOW DO YOU THINK GUYS RESPOND?

Validity Question

Disagree Strongly Disagree Uncertain Agree Agree Strongly

Your favorite author is Logan Scott

A B C D E 35% 47% 17% 2% .3%

Is this lying or just trying to look good?

Identifying Information & Validity

Client Evaluation of Self and Treatment CJ CEST (CJ - criminal justice version)

• Treatment Needs & Motivation
• Problem Recognition, Desire for Help, Treatment

Readiness, External Pressure, Treatment Needs

• Psychological Functioning
• Self Esteem, Depression, Anxiety, Decision Making
• Social Functioning
• Hostility, Risk Taking, Social Support
• Treatment Engagement Process (post only)
• Participation, Satisfaction, Rapport, Peer Support

INTERPRETING SCORES

Disagree Agree Strongly Disagree Uncertain Agree Strongly 1 2 3 4 5

• Residents answers are scored from 1 to 5,
• An average score (mean) is calculated for each category,
• The mean is then multiplied by 10 so the scale ranges from 10-50
• 10 – strong disagreement
• 30 – uncertain or neutral
• 50 – strong agreement

Desire for Help

Disagree Strongly Disagree Uncertain Agree Agree Strongly

3 You need help dealing with

your criminal behavior

A B C D E 27

It is urgent you find help immediately for you criminal behavior

A B C D E 54

Your life has gone out of control

A B C D E 71

You are tired of all the problems caused by your criminal behavior.

A B C D E 94

You want to get your life straightened out.

A B C D E

4 5 3 4 3

Desire for Help

4 5 3 4 3

The average response to these questions is 3.8. Multiply by 10 and the DH Score is 38. 4 +3 +4 +3 +5

Sum = 19, 19 divided by 5 = 3.8

Subscale = 3 8

Motivated for Treatment

That is where this score comes from.

INTERPRETING SCORES

Disagree Agree Strongly Disagree Uncertain Agree Strongly 10 20 30 40 50

Subscale = 3 8 This resident AGREES that he Desires Help

Motivated for Treatment

Is Mr. Jersey Offender motivated for treatment?

Motivated for Treatment

INTERPRETING SCORES

Disagree Agree Strongly Disagree Uncertain Agree Strongly 10 20 30 40 50

Subscale = 2 7 At Intake, Mr. Jersey Offender DISAGREED with statements that he Desires Help Subscale = 3 3 At Discharge, Mr. Jersey Offender was a bit more ambivalent regarding statements that he Desires Help

WHAT IS THE TALBOT AVERAGE FOR Desire for Help (DH)?

You need help dealing with your criminal behavior It is urgent you find help immediately for you criminal behavior Your life has gone out of control You are tired of all the problems caused by your criminal behavior. You want to get your life straightened out.

10 DISAGREE STRONGLY 20 DISAGREE 50 AGREE STRONGY 40 AGREE 30 UNCERTAIN

WHAT IS THE TALBOT AVERAGE FOR Desire for Help (DH)?

You need help dealing with your criminal behavior It is urgent you find help immediately for you criminal behavior Your life has gone out of control You are tired of all the problems caused by your criminal behavior. You want to get your life straightened out.

10 DESIRES NO HELP 20 MINIMAL HELP 50 REALLY MOTIVATED 40 DESIRES HELP 30 UNCERTAIN

Mean = 35.80

What percentage are NOT REALLY Motivated (<25)?

2%

What percentage are REALLY Motivated (>40)?

20%

WHAT IS THE TALBOT AVERAGE FOR Problem Recognition (PR)?

Your criminal behavior is a problem for you. Your criminal behavior is more trouble than it is worth. Your criminal behavior is causing problems with your family or work. Your criminal behavior is making your life become worse and worse. Your criminal behavior is going to cause your death.

10 DISAGREE STRONGLY 20 DISAGREE 50 AGREE STRONGY 40 AGREE 30 UNCERTAIN

WHAT IS THE TALBOT AVERAGE FOR Problem Recognition (PR)?

Your criminal behavior is a problem for you. Your criminal behavior is more trouble than it is worth. Your criminal behavior is causing problems with your family or work. Your criminal behavior is making your life become worse and worse. Your criminal behavior is going to cause your death.

10 IT’S ALL GOOD 20 NO REAL PROBLEMS 50

I’M A MESS!!

40 SOME PROBLEMS 30 UNCERTAIN

Mean = 31.70

What percentage see NO Problems (<25)?

19%

What percentage really Recognize they have Problems (>40)?

10%

Impact on Motivation in Residents with Low Problem Recognition at Intake

Pre Test Scores

Pre DH 21.15 Pre TR 23.37 10 15 20 25 30 35

Enhanced Motivation

Pre DH 21.15 Pre TR 23.37 Post DH 30.39 Post TR 31.53 10 15 20 25 30 35

Residents’ Desire for Help (DH) and Treatment Readiness (TR) Increased Significantly (DH) Desire for Help (TR) Treatment Readiness

Cone (2008). OSAR, Vol 8(1).

Psychological & Social Functioning

Hostility is an IMPORTANT value to check out.

Note that the resident’s score (34) is WELL ABOVE average according to TCU norms

WHAT IS THE TALBOT AVERAGE FOR Hostility (HS)?

You feel a lot of anger inside of you. You have a hot temper. You like others to feel afraid of you. You get mad at other people easily. You have urges to fight or hurt others.

10 DISAGREE STRONGLY 20 DISAGREE 50 AGREE STRONGY 40 AGREE 30 UNCERTAIN

WHAT IS THE TALBOT AVERAGE FOR Hostility (HS)?

You feel a lot of anger inside of you. You have a hot temper. You like others to feel afraid of you. You get mad at other people easily. You have urges to fight or hurt others.

10 CALM & PEACEFUL 20 FAIRLY CALM 50

DANGER XXX

40 ANGRY & HOSTILE 30 UNCERTAIN

Mean = 19.67

What percentage do not have anger issues (<25)?

85%

What percentage admit anger issues (>30)?

4%

WHAT IS THE TALBOT AVERAGE FOR Decision Making (DM)?

You consider how your actions will affect others. You plan ahead. You think about what causes your current problems. You make good decisions. You analyze problems by looking at all choices.

10 DISAGREE STRONGLY 20 DISAGREE 50 AGREE STRONGY 40 AGREE 30 UNCERTAIN

WHAT IS THE TALBOT AVERAGE FOR Decision Making (DM)?

You consider how your actions will affect others. You plan ahead. You think about what causes your current problems. You make good decisions. You analyze problems by looking at all choices.

10 RECKLESS 20 BAD DECISIONS 50

ON POINT

40 GOOD DECISIONS 30 UNCERTAIN

Mean = 39.33

What percentage admit to poor decision making (<25)?

1%

What percentage make great decisions (>40)?

34%

How about Criminal Thinking?

Criminal Thinking Scale (CTS)

• Entitlement
• Society owes you a better life.
• Justification
• Breaking the law is no big deal as long as you do not physically

harm someone.

• Power Orientation
• You like to be in control.
• Cold Heartedness
• Seeing someone cry makes you sad.
• Rationalizing
• Anything can be fixed in court if you have the right connections.
• Irresponsibility
• You are in prison now because you had a run of bad luck.

Criminal Thinking Scales

Counselor Version Resident Version

Criminal Thinking Scales

Counselor Version Pre & Post Version

Post Scores

WHAT IS THE TALBOT AVERAGE FOR Justification (JU)?

You rationalize with statements like “Everyone else is doing it” You justify your behavior by pointing out how hard your life has been. You find yourself blaming the victims of some of your crimes. Breaking the law is no big deal as long as you do not physically harm someone. You find yourself blaming society and external circumstances for you problems.

10 DISAGREE STRONGLY 20 DISAGREE 50 AGREE STRONGY 40 AGREE 30 UNCERTAIN

WHAT IS THE TALBOT AVERAGE FOR Justification (JU)?

You rationalize with statements like “Everyone else is doing it” You justify your behavior by pointing out how hard your life has been. You find yourself blaming the victims of some of your crimes. Breaking the law is no big deal as long as you do not physically harm someone. You find yourself blaming society and external circumstances for you problems.

10 NEVER JUSTIFY 20 SELDOM JUSTIFY 50

ALWAYS JUSTIFY

40 JUSTIFY CRIMES 30 UNCERTAIN

Mean = 17.85

What percentage say they Never Justify (<15)?

28%

What percentage may consider that they justify sometimes (>30)?

1%

Talbot Mean

TCU Drug Screen II

During the last 12 months before being locked up: 1 Did you use larger amounts of drugs/alcohol or use them for a longer time than you planned or intended? No Yes 2 Did you try and cut down on your drug/alcohol use but were unable to do it? No Yes 3 Did you spend a lot of time getting drugs/alcohol, using them or recovering from their use? No Yes 4a Did you get so high or sick from drugs/alcohol that it kept you from doing your work, going to school, or caring for children? No Yes 4b Did you get so high or sick from drugs/alcohol that it caused an accident or put you or others in danger? No Yes

Scores range from 0 to 9

complete TCU DS has 12 items

Drug Screen II

What percent of our residents:

Admit to a drug abuse problem (Score >2)

22% 78% report NO problem 55% Score 0

Does Mr. Offender have a drug problem?

At Intake – Counselor Report At Intake – Resident Report At Discharge – Counselor Report

Treatment Engagement Process

• Participation
• You are following your counselors guidance.
• Satisfaction
• You are satisfied with this program.
• Rapport
• You are motivated and encouraged by your counselor.
• Peer Support
• Other clients in this program are helpful to you.

WHAT IS THE TALBOT AVERAGE FOR

10 DISAGREE STRONGLY 20 DISAGREE 50

AGREE STRONGLY

40 AGREE 30 UNCERTAIN

Mean = 42.17

What percentage say they Don’t Participate (<25)?

1%

What percentage are SUPER PARTICIPANTS (>45)?

28%

• Participation
• You are following your counselors guidance.

WHAT IS THE TALBOT AVERAGE FOR

10 DISAGREE STRONGLY 20 DISAGREE 50

AGREE STRONGLY

40 AGREE 30 UNCERTAIN

Mean = 40.98

What percentage really haven’t engaged (<25)?

2%

What percentage have been ‘SAVED’ by their counselor (>45)?

21%

• Rapport
• You are motivated and encouraged by your counselor.

An Integrated Approach to Treatment for Addiction

• D. Dwayne Simpson, Aug (2006)

www.ibr.tcu.edu

“A systems approach therefore suggests that targeted and relevant assessments be obtained and made available for client- level treatment planning and monitoring— and that they be used at the aggregated level for program planning and monitoring.”

Assessment Made Easy

Scott L. Cone, Ph.D. Scott.L.Cone@gmail.com

Community Education Centers

Talbot Hall, Assessment & Treatment Center

www.cecintl.com

Now wasn’t that easy.