Assessment, Development and Monitoring Presenters: Angela R. Moore, - PowerPoint PPT Presentation

Tools for Cancer Plan Assessment, Development and Monitoring Presenters: Angela R. Moore, MPH and Gina O’Sullivan, MPH The webinar will begin at 2:00 p.m. Eastern. Audio: Use computer speakers or phone (1-866-307-6033) If connecting by phone, please put your phone on mute! Live tweet this webinar: @GWCancerInst #CompCancer #TAPwebinar

New from GW Cancer Institute Comp Cancer 101 Wiki Priority Alignment Tool Cancer Plan Goal Bank Cervical Cancer Awareness & World Cancer Day Social Media Toolkits Executive Training on Navigation and Survivorship

Presenters Gina O’Sullivan, MPH Angela R. Moore, MPH Evaluation Specialist Evaluation and Partnership Team Lead Bureau of Chronic Disease Evaluation and Research Comprehensive Cancer Control Branch Division of Chronic Disease Prevention Centers for Disease Control and Prevention New York State Department of Health

Cancer Plan Self-Assessment Tool: A Resource for Actionable Comprehensive Cancer Control Plans Angela Moore, MPH Program Evaluation and Partnership Team Lead Tools for Cancer Plan Assessment, Development and Monitoring January 21, 2015 National Center for Chronic Disease Prevention and Health Promotion Division of Cancer Prevention and Control

Overview  Background  Overview of the Cancer Plan Self-Assessment Tool  Trends in Plan-Related Performance Measures  Program Implications

Overview of the Cancer Plan Index Study BACKGROUND

Purpose  Alignment of Comprehensive Cancer Control (CCC) plans with current guidelines.  Determine what is needed to:  Enhance plan quality  Facilitate implementation  Inform guidance Rochester P, Adams E, Porterfield D, Holden D, McAleer K, Steele B. Cancer plan index: a measure for assessing the quality of cancer plans. JPHMP. 2011; 17(6): E12-E17.

Methods • Identify essential components Cancer Plan • Develop indicators Index • Pilot testing Development • Random assignment of 63 plans CCC Plan • Indicator rating scale Assessment • Descriptive statistics • Cronbach’s alpha Analysis • Component score Rochester P, Adams E, Porterfield D, Holden D, McAleer K, Steele B. Cancer plan index: a measure for assessing the quality of cancer plans. JPHMP. 2011; 17(6): E12-E17.

Findings Plan Component Level of Description Objectives High Goals High Usability of plan High Strategies High Presentation of burden data Moderate Developing the plan Moderate Reduction of cancer disparities Moderate Involvement of stakeholders Low Implementation Low Evaluation Low Funds to implement the plan Low Rochester P, Adams E, Porterfield D, Holden D, McAleer K, Steele B. Cancer plan index: a measure for assessing the quality of cancer plans. JPHMP. 2011; 17(6): E12-E17.

Recommendations  Develop guidance on the use of the Cancer Plan Index to develop or revise plans  Disseminate the Cancer Plan Index to programs  Modify the Cancer Plan Index as Funding Opportunity Announcements evolve Rochester P, Adams E, Porterfield D, Holden D, McAleer K, Steele B. Cancer plan index: a measure for assessing the quality of cancer plans. JPHMP. 2011; 17(6): E12-E17.

OVERVIEW OF THE CANCER PLAN SELF-ASSESSMENT TOOL

Cancer Plan Self-Assessment Tool Structure  Component with description  Component indicators  Nominal choices (yes/no)  Comments  Resources

Plan Components with Description Description of the Description of how the plan will be implemented, Process Used to monitored for progress, updated, and sustained. the Plan Goals and Objectives Identification of goals (broad general statements) and objectives (SMART statements) to be accomplished . Strategies Specific, discrete activities designed to achieve the objectives stated in the plan. Stakeholder Description of how stakeholders will be engaged in the Involvement development, implementation, and evaluation of the cancer plan. Presentation of Data Presentation of data that provides the rationale for Disease Burden implementing the strategies. Reduction of Cancer Identification of strategies tailored to select Disparities highest risk for cancer and cancer mortality. Evaluation Description of how plan progress will be assessed. Additional Items Plan format/style characteristics that enhances readability.

Recommended Use Review Assign Revise Assess Share Document Action Prioritize Planning

Program Examples  Used at the beginning of the revision process to determine the structure of the plan.  Used resources section to inform goals, objectives, and strategies.  Shared with coalition members, workgroups, subcommittees to begin discussion regarding revision.

Testimonials  “The tool proved to be useful in assisting our revision process as it provided a framework of necessary components to include. The resources listed in the tool were also helpful in providing guidance to our subcommittees developing content.”  “Everyone involved in the revision of the Plan found the CPAT very helpful and easy to use. We are grateful to CDC for proving the CPAT to help in revising our now consolidated CCC Plan.”

TRENDS IN PLAN-RELATED PERFORMANCE MEASURES

Trends in Plan-Related Performance Measures Performance Measure Indicator Year 2 Year 3 Year 4 Year 5 Use of Evidence-based interventions 60.4 67.5 64.0 63.0 Implementation of program 68.7 70.6 50.7 69.6

Trends in Plan-Related Performance Measures Performance Measure Indicator Year 2 Year 3 Inclusion and monitoring of adult smoking 88.2 76.5 Inclusion and monitoring obesity 86.8 54.4 Inclusion and monitoring Breast cancer 86.8 75.0 screening Inclusion and monitoring cervical cancer 85.3 69.1 screening/HPV vaccination Inclusion and monitoring colorectal cancer 80.9 70.6 screening

Trends in Plan-Related Performance Measures Performance Measure Indicator Year 4 Year 5 Inclusion and monitoring of adult 26.1 24.6 Inclusion and monitoring obesity 7.2 8.7 Inclusion and monitoring Breast cancer 23.2 14.5 screening Inclusion and monitoring cervical cancer 20.3 23.2 screening/HPV vaccination Inclusion and monitoring colorectal 42.0 44.9 screening

For questions and feedback: ARMoore@cdc.gov For more information please contact Centers for Disease Control and Prevention 1600 Clifton Road NE, Atlanta, GA 30333 Telephone, 1-800-CDC-INFO (232-4636)/TTY: 1-888-232-6348 E-mail: cdcinfo@cdc.gov Web: www.cdc.gov The findings and conclusions in this report are those of the authors and do not necessarily represent the official position of the Centers for Disease Control and Prevention. National Center for Chronic Disease Prevention and Health Promotion Division of Cancer Prevention and Control

The New York State Comprehensive Cancer Control Plan Dashboard Gina M. O’Sullivan, MPH Evaluation Specialist New York State Department of Health

New York State Cancer Consortium Working Together, Reducing Cancer, Saving Lives  Officially formed in 2003 from group that convened to write 1 st NYS Comprehensive Cancer Control Plan  Currently, over 250 members representing over 100 organizations in 38 counties

NYS Comprehensive Cancer Control Plan 2012-2017  Revision of original plan occurred over an 18- month period starting in 2010  Outlines goals, objectives and strategies in six priority areas:  Health Promotion and Cancer Prevention  Early Detection  Treatment  Survivorship  Palliative Care  Healthcare Workforce  Tracking indicators (ex. adolescent cigarette use) were identified to monitor progress towards meeting objectives

Measurable Objectives  Expected to change or be affected through implementation of suggested strategies  Include a baseline measure, data source and measure of improvement  Linked to population-based data sources (BRFSS, ATS, Cancer Registry, etc.) when possible  Essential for evaluating progress

Example 2003-2010 NYS CCC Plan Goal By 2010, increase the number of health care providers who report offering cancer prevention related counseling to their patients to 85% Example 2012-2017 NYS CCC Plan Measureable Objective By 2017, increase the percentage of smokers reporting that their health care providers assisted them with smoking cessation by at least 5 percent (Baseline, 2010: 51.8 percent, NYS Adult Tobacco Survey)

The term dashboard is used to describe a graphic interface that provides a visual presentation of key indicators and organizes information or data in a way that is easy to read and understand.

NYS CCC Plan Dashboard Overview http://www.health.ny.gov/CancerControlDashboard  Interactive web-based visual presentation of tracking indicator data → Currently includes 24 cancer plan tracking indicators in two priority goal areas  Developed in partnership with staff in the NYS Department of Health’s (NYSDOH) Public Health Information Group and Information Technology Services  Officially launched on August 6, 2014

Dashboard Features • About This Site • How-to-Guide • Technical Notes • Data Tables • Baseline Data and Year of Baseline Measure • Most Recent Data vs. 2017 Objective • Annual Progress Status

Monitoring Progress How can we use the NYS CCC Plan Dashboard to evaluate progress? Assess changes to data since baseline Compare current data to 2017 objective Monitor data trends over time