Planning and Assessment Ramapo College Establishing Assessment - - PowerPoint PPT Presentation

Planning and Assessment Ramapo College

Establishing Assessment Plans and Annual Reports

1

Why do we Assess?

• Demonstrate fiscal and human resources are

invested in ways that result in quality outcomes which enable the institution to achieve its mission, vision, and goals

• Evaluate Institutional Effectiveness
• Evaluate Student Outcomes

2

What is Assessment?

• Process for gathering and analyzing information to

gauge your unit’s performance

• Using that information to improve your unit’s

performance

3

How Does Assessment Fit Into the Planning Process?

• Outcomes assessment provides empirical data to

develop annual and long-range plans.

• Assessment results provide factual support for

decisions regarding allocation of resources for annual and long range planning at all levels of the College: program, unit, school.

4

Planning, Budgeting, Assessment Process

5

Institutional Goals

• Advancing Academic Excellence and

Engagement

• Enhance Financial Strength and Institutional

Sustainability

• Improve Internal and External Relations and

Communications

• Cultivate and Support Diversity and Inclusion

6

Benefits of a Culture of Assessment

• Encourages open reflection
• Increases transparency
• Supports innovation and experimentation in

assessment methods

• Promotes a culture of evidence for decision making
• Promotes continuous improvement

7

Three Year Unit Plans

• Simple
• Workable
• Provide meaningful information to guide

decision making and improve unit effectiveness

8

Assessment Tools

• WEAVE is an online system for annually

tracking and reporting the institution’s

• utcomes.
• Employee Evaluation Form

9

Steps in Planning & Assessment

• Defining a program or unit’s mission
• Identifying unit goals
• Developing desired outcomes/objectives
• Establishing measures
• Establishing achievement targets
• Monitoring progress/analysis of findings
• Action Plan
• Using results to make improvements

10

Language of Assessment & Planning

• Mission/Purpose
• Goals
• Outcomes/Objectives
• Achievement Targets
• Measures and Findings
• Action Plan Tracking
• Achievement Summary Analysis
• Annual Reporting (DAR Report)

11

Mission/Purpose

.

• The mission statement should be clear and

brief, consist of the purpose of the unit and a brief list of key responsibilities or services provided.

12

Adult Degree-Completion Program

(Example)

• The Adult Degree-Completion Program allows returning adult

students to apply their life experiences and previously earned college credits to an academic program that will provide them with the skills necessary to succeed in a rapidly changing

• world. These skills include, but are not limited to, critical

thinking, effective communication, global understanding, and applied learning. Upon completing this degree, graduates will be prepared to reenter the workforce or seek job advancement in diverse fields.

13

Athletics

• The Ramapo College Athletic Department will continue to
• perate with integrity while maintaining a highly competitive,

visible and viable athletic program consistent with the overall mission of the College. The Athletic Department will provide

• utstanding support for student-athletes, coaches, and

athletic administrators in order for our student-athletes to achieve success academically, athletically, professionally, and personally during their time at Ramapo College.

14

Entering Mission/Purpose in WEAVE

Each unit will enter its mission statement in the system. Click on Mission/Purpose in the Assessment tab. Enter mission statement, click Save. After saving, the statement will appear and can be edited Review the Mission statement at The beginning of each assessment cycle to be sure it adequately reflects the purpose of the unit The mission statement should be clear and brief, consist of the purpose of the unit and a brief list

• f key responsibilities or services

provided.

15

Goals

• Broad general statements of what the

unit intends to accomplish

• Consistent with and aligned with the

unit/institutional mission statement

• Provide focus or vision for planning
• Warm and fuzzy
• “Aspirations.”
• Like outcomes, focus on end results

Example Ramapo College’s Strategic Planning Goal #1 Advancing Academic Excellence and Engagement

• directly related to the mission
• a broad, general statement
• provides focus for vision and

planning

• clearly aspirational
• focus is on end result

16

Entering Goals in WEAVE

Click on Goals in the Assessment tab. Enter goal statement, click Save. After saving, the statement will appear and can be edited Text can be entered directly from the keyboard or cut- and-pasted from another document

VERY IMPORTANT

Be sure to save information before leaving a screen,

• therwise it will be lost; edits

can be made later.

REMEMBER

Goals are broad general statements

• f what the unit intends to

accomplish; consistent with and aligned with the unit/institutional mission statement; provides focus

• r vision for planning

17

Outcomes/Objectives

Outcomes and Objectives are achieved results Outcomes describe the desired quality (timeliness, accuracy, satisfaction, responsiveness, etc.) of key functions and services within the school or administrative unit. Outcomes and objectives are written in an active tense and use strong verbs like “plan,” “write,” “conduct” and “produce.” Outcomes are demonstrated or achieved and to what standard?

18

Outcomes/Objectives are Specific

• The outcome is associated with key processes and

services provided to students, parents, staff, and

• faculty. The outcomes should be distinctive to the

unit that is conducting the assessment.

19

Outcomes/Objectives are Measurable

• The intended outcome should be one where it is

feasible to collect accurate and reliable data.

• Consider your available resources (e.g., staff,

technology, space, assessment support, institutional level surveys, etc., in determining whether the collection of data is a reasonable expectation).

20

Developing Attainable Outcomes/Objectives

• The following questions might help you formulate and define

aggressive but attainable outcomes for your administrative unit. – What is the unit/school striving for? – What direction do you want to move in? – What would you like to accomplish over the next __year(s) and why? – What would the "perfect" school or administrative unit look like? – How can routine operations be assessed? – Who are the users of school/unit services?

21

Outcomes

• Administrators and staff will use assessment plans to

make decisions or assess the effectiveness of their area.

• The Office of Institutional Research will administer

NSSE in FY2016 and increase response rate by 2%

• The Office of Public Safety will provide safety training
• n campus by using the “Shots Fired” video with

faculty participation of 20%

Entering Outcomes/Objectives in WEAVE

• Click on Outcomes in the

Assessment tab. Enter

• utcomes statement, click
• Save. After saving, the

statement will appear and can be edited

• Text can be entered directly

from the keyboard or cut- and-pasted from another document REMEMBER

Outcomes are specific, measurable, achievable, relevant and time- referenced; 3 to 5 is ideal; not all

• utcomes need to be assessed each

year.

VERY IMPORTANT

Be sure to save information before leaving a screen, otherwise it will be lost; edits can be made later.

23

Measures

• Tools used to determine whether your outcomes

have been achieved.

• Tools that will provide useful and useable

information.

24

Measures

Inventory tools used by the unit:

• What information is collected already
• What assessments are being used
• What assessment is recommended by professional

associations

25

Examples of Assessment Measures

• Satisfaction surveys
• Data system indicators
• Number of complaints
• Program participants
• Average wait time
• Benchmarking best

practices

• Staff training hours
• Professional standards
• Number of applications
• Processing time
• Focus groups
• External reviews
• Dollars raised
• Average service time
• Admissions yields
• Facilities Usage

26

Measures

• For each outcome

– How will progress be assessed? – What measures will be used

• Direct, indirect
• Qualitative, quantitative, objective, subjective

– When will they be assessed?

• Indicate the time frame for assessment, e.g. every

spring semester.

27

Measures and Findings

Measures Sources of evidence from which you gain data or information used to verify the extent to which you achieved your

• utcomes/objectives

Outcome/Objective The College will increase access and support for underrepresented students For example: Measure:

Enrollment Report

• Fin. Aid Grants and Waivers Report

Findings The number of underrepresented Students increased by 3%. Scholarships for underrepresented students increased by 4%.

28

Entering Measures and Findings into WEAVE

• Click on Measures and Findings in the

Assessment tab.

• Click on the gray arrow beside each
• utcome/objective and add findings for each

measure created, not by outcome

• Indicate the extent to which the achievement

target was “Met, Partially Met, Not Met”.

• Click Save.
• At this point, you can edit what you have

written, add findings for another measure, or go to the data entry screen for Action Plans. All Measures need to have Findings for the current planning year entered into the system by September 1st.

• If the Achievement Target was “Not Met” or
• nly “Partially Met”, develop an “Action Plan”

to improve future results

• The reason outcomes are tracked is to discover

where modifications can be made to improve performance.

• Actions refer to the tasks necessary to effect those

modifications.

• Actions to improve performance are desirable even

when targets are met

• If targets are partially met or not met further

actions are required.

VERY IMPORTANT

Be sure to save information before leaving a screen, otherwise it will be lost; edits can be made later.

29

Achievement Targets

• Each achievement target should specify, when

possible, the desired level of performance (level of satisfaction, productivity, efficiency, performance) and time frame.

30

Measureable Achievement Targets

• Increase annual fund contributions by 10% in 2016-

2017

– Measure—Annual fund contributions comparison

• Increase student satisfaction rating for food service

in 2016-2017 from 80% to 90%

– Measure—results of satisfaction survey

• Improve student retention rates by 5% by 2018

– Measure—Enrollment reports

D R A F T 31

Entering Achievement Targets into WEAVE

• The option to establish Achievement

Targets is presented in the Measures and Findings area

• Click on the gray arrow beside each

measure and click on add or edit for each outcome/objective

• Click Save. You will be returned to

the Summary Measures and Findings screen, and your newly entered measure should appear, with options to View, Edit, or Delete.

• You will see the Add Measure button

at the top center of the screen. At this point, you can edit what has been entered, enter a new measure, go to a different data entry screen, or logout.

• Very important: Immediately under

the description of each Measure, you will see a link to Add Findings. If you have completed the data collection for the year, and have results available, you can click on Add Findings to enter that data. See instructions under Findings.)

VERY IMPORTANT

Be sure to save information before leaving a screen, otherwise it will be lost; edits can be made later.

32

Findings

The results of assessment measures

33

EXAMPLE

1. Goal = Conduct research 2. Out./Obj. = Administer N.S.S.E. increase response rate 2% 3. Meas./Find. = Number of sampled students responding compared to last test administration 4.

• Achiev. Target

= Administer N.S.S.E. Survey/Increase response rate 2% 5. Findings a) Met Response rate from 31% to 33% NO FURTHER ACTION REQUIRED b) Partially Met Response rate from 31% to 32% REQUIRES ACTION PLAN c) Not Met No change it remained at 31% REQUIRES ACTION PLAN

34

Analysis of Findings

• How do the results compare to achievement targets?
• Were the targets appropriate?
• What worked well?
• What changes or strategies would make the results

more effective?

• What were the most effective assessment tools

(Note: specific plans for addressing outcomes/objectives that were not met should be listed in the Action Plan)

35

Action Plan

List actions in the Action Plan which might include:

• Modifying processes, operations, or practices of the

unit

• Modifying intended outcomes or measures

36

Make Note Before Writing Action Plan

• Action Plans and Analyses can not be entered into the system

until data collection and analysis have been completed for the measurement period—typically the end of September

• If a unit collects, analyzes, and reports results more frequently

(monthly or by semester), those data can be entered into the system at that time, but what appears online by the end of September must be a summary of the entire year

37

Entering an Action Plan in WEAVE

• Click on Action Plan Tracking in the Assessment tab
• Click on Add Action Plan Enhancement Action tab
• The screen shows the status of the Action Plan

– Planned – In Progress – Finished – On Hold – Terminated

• Text can be entered directly from the keyboard or cut-

and-pasted from another document

• An Action Plan must be completed for all Outcomes

Objectives where SPIF funds are requested. SPIF funding requests will be collected when the Assessment Plan is developed and should not appear in the request for budget funds during the annual budget submission process.

• Measure-Outcome/Objective Relationships – click on

the boxes that correspond to the correct Outcomes which will automatically appear in the box.

• The Condensed Description (50 characters or less) of

the Action Plan.

• Full Description of the actions your unit will be taking
• Projected Completion Date
• Implementation Description
• Priority Level assigned (High, Medium, Low)
• Person/Group Responsible for the action
• Additional Resources Needed to carry out the action—

human, technical, or other

• Budget Amount Requested —Request SPIF funds
• Click Save

38

Achievement Summary/Analysis

• The Analysis section of the system enables the integration and

interpretation of outcome data. It is the most important piece of the outcomes reporting function.

• In the Analysis section, explain what all the findings for this

year mean and how they have been used or will be used to improve attainment of goals

39

Document Repository in WEAVE Upload and store information about your plan

Click on Document Repository in the Assessment tab. Click on the Upload Document tab Click on the Browse button to locate the file you want to upload Enter the name of the file in Document Name text box Description – Purpose and description of the file Expand All—contains the assessment elements with which you wish to associate the file (the file may be associated with more than one element. Click Save.

40

Printing Reports in WEAVE

Select cycle

• FY 2016
• FY 2017(Current)
• FY 2018

Type of Reports Available Full Assessment Reports Audit Reports Data Entry Status (DES) Reports Achievement Status Reports Planning & Budgeting Reports Profile and Association Reports Special Assessment Reports Analysis Question Reports Analysis Answer Profile Annual Reports 41

EXAMPLE

1. Goal = Conduct research 2. Out./Obj. = Administer N.S.S.E. increase response rate 2% 3. Meas./Find. = Number of sampled students responding compared to last test administration 4.

• Achiev. Target

= Administer N.S.S.E. Survey/Increase response rate 2% 5. Findings a) Met Response rate from 31% to 33% NO FURTHER ACTION REQUIRED b) Partially Met Response rate from 31% to 32% REQUIRES ACTION PLAN c) Not Met No change it remained at 31% REQUIRES ACTION PLAN

42