program evaluation: you dont need a phd to do it! Sara Corwin, - - PowerPoint PPT Presentation
program evaluation: you dont need a phd to do it! Sara Corwin, MPH, PhD University of South Carolina Arnold School of Public Health Department of Health Promotion, Education and Behavior 2 Its really not that effective, but its
University of South Carolina Arnold School of Public Health Department of Health Promotion, Education and Behavior
2
“It’s really not that effective, but it’s easy to store.”
3
At the end of the session, participants will be able to: 1. define common program evaluation terms 2. explain the use of logic models in developing program evaluation strategies 3. clarify the differences between process, impact, and
4. describe frequently used evaluation tools for each level of program evaluation 5. provide suggestions for low cost methods of program evaluation that can be implemented in their setting 6. identify ways to use evaluation information (results) to improve their health promotion, wellness, and disease management programs.
4
5
6
7
July 20, 2006 31st Annual National Wellness Conference
8
9
Identified risk and protective factors Change Employee Behavior(s) Improved Employee Health & Orgz’l Outcomes By conducting a defined set of activities in the worksite We will modify In order to Resulting in
10
http://www.wkkf.org/pubs/tools/evaluation/pub3669.pdf
11
12
13
understand community & engage participants set goals &
develop intervention implement assess needs evaluate
McKenzie J. and Smeltzer J. (1997). Planning, Implementing, and Evaluating Health Promotion Programs: A Primer, 2nd Edition Allyn and Bacon.
14
15
Process Impact Outcome
“Are we doing what we said we would?” Effectiveness measures Morbidity, mortality, employee outcomes How much, for whom, when, by whom? Change in K, A, B/Skills, org’l changes Improved health, wellness for employees QAR/CQI/QI (integrity) Must occur before
Improved Q of L for employees
16
The Joint Committee on Standards for Educational Evaluation (1994). The Program Evaluation Standards. Thousand Oaks, CA: Sage Publications, Inc. http://www.wmich.edu/evalctr/jc/
17
University of Wisconsin Extension. (June 2005). Documenting outcomes in tobacco control programs. University of Wisconsin Cooperative Extension, Program Development and Evaluation, Madison, WI. Retrieved online July 9, 2006 at http://www.uwex.edu/ces/pdande/
18
Centers for Disease Control and Prevention. Framework for Program Evaluation in Public Health. MMWR 1999;48(No. RR-11). Retrieved online July 9, 2006 at http://www.cdc.gov/mmwr/preview/mmwrhtml/ rr4811a1.htm#fig1
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
Polacsek M, O’Brien LM, Lagasse W, Hammar N. Move & Improve: a worksite wellness program in
http://www.cdc.gov/pcd/issues/2006/ul/05_0123.htm. http://www.arkansas.gov/ha/worksite_wellness/index.html Chapman, L.S., Planning Wellness Getting Off to a Good Start. Seattle, WA; Summex Corporation, 1996. Green, L.W., and Kreuter, M.W., Health Promotion Planning, An Educational and Environmental Approach, (2nd ed.). Mountain View, CA; Mayfield Publishing Company, 1991. Hunnicutt, D., Deming, A., and Baun, B., Health Promotion Sourcebook for Small
McGinnis, J.M., Worksite Health Promotion Activities Summary Report, U.S. Department of Health and Human Services. Office of Disease Prevention and Health Promotion, 1992. Chapman, Larry S. Program Evaluation: A Key to Wellness Program Survival, 1996 McKenzie J. and Smeltzer J. Planning, Implementing, and Evaluating Health Promotion Programs: A Primer, 2nd Edition Allyn and Bacon, 1997 Schaloc, R. Outcome-Based Evaluation Plenum Press, 1995 Parsons, B.A. ( 1999, November) Making Logic Models More Systemic: An Activity Paper prepared for the 1999 American Evaluation Association annual meeting, Orlando, FL.
43
Health Promotion: Sourcebook for Small Businesses, published by the Wellness Councils of America and Canada. Call (402) 827-3590 to order. Schmitz, C. & Parsons, B.A. (1999) Everything You Ever Wanted to Know about Logic Models But Were Afraid to Ask.Paper funded by the W.K. Kellogg Foundation (WKKF) under a contract to InSites, a Colorado-based non-profit 501(c)3 organization. Bamberger, M., Rugh, J., Mabry, L. (2005). RealWorld Evaluation: Conducting Evaluations With Budget, Time, Data and Political Constraints. Newbury Park, CA: SAGE Publications, Inc. The Joint Committee on Standards for Educational Evaluation (1994). The Program Evaluation Standards. Thousand Oaks, CA: Sage Publications, Inc. http://www.wmich.edu/evalctr/jc/ University of Wisconsin Extension. (June 2005). Documenting outcomes in tobacco control programs. University of Wisconsin Cooperative Extension, Program Development and Evaluation, Madison, WI. Retrieved online July 9, 2006 at http://www.uwex.edu/ces/pdande/ Centers for Disease Control and Prevention. Framework for Program Evaluation in Public Health. MMWR 1999;48(No. RR-11). Retrieved online July 9, 2006 at http://www.cdc.gov/mmwr/preview/mmwrhtml/rr4811a1.htm#fig1
44
July 20, 2006 31st Annual National Wellness Conference
45
Hey … I feel better already!