IAAC Meeting JUNE 2020 Agenda Messages from NILOA Excellence in - - PowerPoint PPT Presentation

iaac meeting
SMART_READER_LITE
LIVE PREVIEW

IAAC Meeting JUNE 2020 Agenda Messages from NILOA Excellence in - - PowerPoint PPT Presentation

IAAC Meeting JUNE 2020 Agenda Messages from NILOA Excellence in Assessment Designation Submission Assessment Reporting Update IPAR Website Wrap up of 2018-19 Reporting SACSCOC Update Current status for


slide-1
SLIDE 1

IAAC Meeting

JUNE 2020

slide-2
SLIDE 2

Agenda

Messages from NILOA

Assessment Reporting Update

Wrap up of 2018-19 Reporting

Current status for educational programs

 I-ARC Process for Fall 2020

General Education Assessment Update

Modifications to the GE Humanities data collection

Fine Arts Results

Excellence in Assessment Designation Submission

IPAR Website

SACSCOC Update

QEP

Institutional Effectiveness: Strategic Planning

Surveys and Course Evaluations

slide-3
SLIDE 3

Messages from National Institute for Learning Outcomes Assessment (NILOA)

slide-4
SLIDE 4
slide-5
SLIDE 5

Messages from NILOA

 This is not a test of online education. This is

a triage situation of survival entailing an emergency move to distance or remote instruction.

 Compassion not compliance should drive

decisions at this time. Our decisions in support of students should drive the guidance, regulatory response, and policy decisions – not the other way around.

 Listen to students and be flexible. Learning

is compromised and the semester/term has an asterisks next to it for everyone – faculty and staff as well as students. It’s not about learning online; it’s about learning in a global pandemic crisis.

slide-6
SLIDE 6

Curriculum Mapping Questions from NILOA

What from this term will students need to apply in the summer and fall and how are we setting them up for learning success in rethinking those courses and assignments? Return to Basics: What are the learning outcomes that students need from this course that they will apply elsewhere? Why does this course even exist? What learning that has occurred prior can we build upon? How can we consider this a flipped semester or a flipped summer – where students learn about a concept over the summer and then apply and practice it when they return. (Labs for instance) How can we think about learning from a program perspective? Where does this fit into overall curriculum?

slide-7
SLIDE 7

Assessment Reporting Update

slide-8
SLIDE 8

Steps in the Assessment Reporting Process

Units report by May/June 15, Aug 1 IARC completes reviews by Oct 15 Feedback sent to IAAC reps, dept chairs and units Updates in Nuventive Improve by Dec 15 IA reruns 2019-20 reports; archived for SACS in January

We are here. But we are going to start back here!

slide-9
SLIDE 9

Summary of I-ARC Process Fall 2019- Educational Programs Only

 89 units were reviewed by either the I-

ARC or COB ARC

 We calculated the percentage of No

responses by unit (Number of Nos divided by possible number of Nos).

 Range from 0% No to 93% No.  Grouped units:  18 units with less than 10% No.  14 of these units did not need to

make any updates.

 37 units with more than 40% No –

Received a targeted email with request to meet for consultation.

slide-10
SLIDE 10

Consultations

37 units were targeted for consultation. IA met with 24 (65%) of the targeted group. Meetings were in person and/or by phone. Met multiple times with some units. IA had consultations with 8 other units not in the target group. 32 units received consultations based on the Fall 2019 reviews.

slide-11
SLIDE 11

Use of Review Feedback

Category 2015 2016 2017 2018 2019 No changes needed 14% 18% 28% 20% 16% Changes made based on feedback 42% 52% 60% 61% 66% No changes made 36% 29% 9% 9% 18% Changes made unrelated to feedback 8% 1% 3% 8% 0% Percentage of units with either no changes needed or changes made based on the feedback has increased slightly from 81% in 2018 to 82% in 2019.

slide-12
SLIDE 12

Use of Review Feedback

 In 2019, sixteen units (18%) did not

make changes to their reports based

  • n the review feedback.

 Six of these were in the “target for

consultation” group.

 Two units had consultations.

 New UACs who had no knowledge of

how previous UAC completed report. Only wanted to focus on new assessment plan.

 UAC agreed to update report after

consultation but did not.

 Four units did not have a consultation

after multiple attempts to contact UAC.

slide-13
SLIDE 13

Areas for Improvement and Actions Planned

37 out of the 89 units reviewed (42%) ended up in the “target for consultation” group, which was a large number of units for IA to follow up with.

Action plan: Since this was the first year we were targeting units for consultations, we used a natural breakpoint in the distribution of the % No reviews to put units in the consultation group (>40% No). Next year, as we will look at the distribution to determine a reasonable cut off point for who should get a consultation, we will consider (1) that we are adding in support units to the review process and may need to consult with some of them as well and (2) what is a realistic number of units to provide consultations.

Due to change to I-ARC structure, reviews were completed by October 31, rather than October

  • 15. It was hard to schedule consultations in November/December due to holidays and end of
  • semester. Consultations did carry into January.

Action plan: Reviews of 2019-20 reports should be back to October 15 deadline which will give more time to schedule consultations.

For the 4 units we didn’t have a consultation with, but should have, multiple email contacts were made.

Action plan: Work with IAAC representatives more closely when having trouble reaching units.

slide-14
SLIDE 14

Steps in the Assessment Reporting Process

Units report by May/June 15, Aug 1 IARC completes reviews by Oct 15 Feedback sent to IAAC reps, dept chairs and units Updates in Nuventive Improve by Dec 15 IA reruns 2019-20 reports; archived for SACS in January

We are back here.

slide-15
SLIDE 15

Institutional Assessment

If you collected data from students to assess student learning in the fall or early spring semesters, please report as you normally would by May 15 for 9-month faculty and June 15 for 12-month

  • faculty. If an extension is needed please let us know.

If you are unable to collect data from students in the spring semester as described in your current assessment plan, you can report:

Actions Taken - curricular and pedagogical actions that were taken (including but not limited to moving content

  • nline);

Results - document data collection was interrupted due to the COVID-19 Pandemic;

Analysis of Results – leave blank; and

Actions Planned - briefly describe data that will be collected along with the curricular and pedagogical actions to be implemented, if applicable.

Specialized accrediting agencies may have different recommendations, so we encourage those programs to contact the appropriate agency for guidance.

slide-16
SLIDE 16

Reporting Update

Educational Programs

Total Count Number Complete Percentage Complete

Academic Affairs 1 1 100% Thomas Harriot College of Arts and Sciences 74 52 70% College of Business 19 10 53% College of Education 33 28 85% College of Fine Arts and Communication 12 11 92% College of Health and Human Performance 32 24 75% College of Engineering and Technology 15 8 53% Brody School of Medicine 8 2 25% College of Allied Health Sciences 21 6 29% College of Nursing 4 1 25% School of Dental Medicine 1 0% TOTAL 220 143 65%

Deadlines

  • June 15th rest of

educational programs

  • August 1st support units
slide-17
SLIDE 17

Fall 2020 I-ARC

 I-ARC will review:

 1/3 of Academic Affairs educational programs  1/2 of Health Sciences educational programs  1/2 of support units

 Online training  Potential Reviewers:

 Work with IAAC rep to identify

 Educational Programs  Support Units

 Updates to reports typically due in Nuventive Improve by Dec 15. Will that

work given changes to academic calendar (semester ends Wed. Nov 25?)

slide-18
SLIDE 18

General Education Assessment Update

slide-19
SLIDE 19

Modifications to the GE Humanities Data Collection

 Humanities  The original plan was to collect data in

Spring 2020 semester

 Departments have been given the

  • ption to continue the current plan or

postpone to the Fall 2020 semester

 Data collection completed  Classics (Fall 19 & Spring 2020)  Philosophy (Spring 2020)  Data collection not complete  Religious Studies: collected one

course data in the Spring 2020, will collect more data in Fall 2020

 Foreign Language and

Literature: Fall 2020

 English: Fall 2020

slide-20
SLIDE 20

GE Assessment Schedule (2016-17 - 2019-20)

More information please visit: http://www.ecu.edu/cs-acad/ipar/generaleducation.cfm

Fall 2016 – Spring 2017 Fall 2017 – Spring 2018 Fall 2018 – Spring 2019 Fall 2019 – Spring 2020

Data Collection Mathematics Written Communication Data Collection Natural Sciences Health Promotion/Physical Activity Data Collection Social Sciences Fine Arts Data Collection Humanities Review & Action Plan Mathematics Written Communication Review & Action Plan Natural Sciences Health Promotion/Physical Activity Review & Action Plan Social Sciences Fine Arts Implementation of Action Plan Mathematics Written Communication Implementation of Action Plan Natural Sciences Health Promotion/Physical Activity Departmental Reporting Mathematics Written Communication

slide-21
SLIDE 21

GE Assessment Process (4-Year Cycle)

Year 1 Fall: Orientation Spring: Submission of Syllabi and Student Artifacts Year 2 Summer/Fall: Data Analysis and Dissemination of Results Spring: Submission of Departmental Action Plan Year 3 Implementation of Action Plan Year 4 Submission of Departmental Progress Report

slide-22
SLIDE 22

Fine Arts Assessment: Student Learning Outcomes

SLO 1: Apply knowledge of an area in the fine arts to describe specific artists, works, movements and creative processes and their significance to the human condition.

SLO 2: Analyze diverse genres, styles, and techniques in their appropriate cultural and historical context.

SLO 3: Apply discipline specific knowledge in the fine arts to evaluate the relevance of the fine arts to cultural and personal growth.

slide-23
SLIDE 23

Fine Arts Assessment Results

 Results have been

shared with Deans and Directors

slide-24
SLIDE 24

Fine Arts Assessment Results

Exam Item Mapped to SLO Miss 1 Miss 2 Miss 3 Miss 4 Miss 5 Miss 6

2 50% 3 67% 4 75% 50% 5 80% 60% 6 83% 67% 7 86% 71% 8 88% 75% 9 89% 78% 67% 10 90% 80% 70% 11 91% 82% 73% 12 92% 83% 75% 67% 13 92% 85% 77% 69% 14 93% 86% 79% 71% 15 93% 87% 80% 73% 16 94% 88% 81% 75% 69% 17 94% 88% 82% 76% 71% 18 94% 89% 83% 78% 72% 19 95% 89% 84% 79% 74% 20 95% 90% 85% 80% 75% 70%

slide-25
SLIDE 25

Fine Arts Assessment Results

Percentages of Students Scoring 70% or Better on Closed-ended Questions or Scoring Proficient or above

  • n Essay-Type Questions in Each GE Fine Arts Student Learning Outcomes (N = 2915)
slide-26
SLIDE 26

Fine Arts Assessment Results

Percentages of Students Scoring 70% or Better on Closed-ended Questions or Scoring Proficient or above

  • n Essay-Type Questions in Each GE Fine Arts Student Learning Outcomes by Delivery Mode (N = 2915)
slide-27
SLIDE 27

Fine Arts Assessment Results

Percentages of Students Scoring 70% or Better on Closed-ended Questions or Scoring Proficient or above

  • n Essay-Type Questions in Each GE Fine Arts Student Learning Outcomes by School and Delivery Mode.
slide-28
SLIDE 28

Excellence in Assessment Designation Submission

slide-29
SLIDE 29

EIA Application Update

 NILOA’s Extended Deadline  July 1, 2020  Applications notified of Embargoed Designation Results

 July 31, 2020

 Public announcement of designees

 August 19, 2020

 EIA Designation Application Working Group  Thank you for your feedback and support!

Our ur Re Remainin ing Ta Tasks Website Links Final Revisions/Edits of Narrative

slide-30
SLIDE 30

IPAR Website

slide-31
SLIDE 31

IPAR Website: www.ipar.ecu.edu

slide-32
SLIDE 32

SACSCOC Reaffirmation 2023

slide-33
SLIDE 33

Looking to the Decennial l Revie iew

Class of 2023 Deliverables

  • A Compliance

Certification report

  • A new quality

enhancement plan (QEP)

  • Focused Report
  • Response Report, if

requested

33

Reaffirmation Self- Study Off-site Review Focused Report QEP Onsite Review

Response

Report

SACSCOC

Decision

slide-34
SLIDE 34

Reaffirmation Tim imeline and Im Important Dates

Activities Development Timeline Due Date ECU developing a compliance certification and collecting evidence Summer 2020 –

  • Aug. 2022

Early Sept. 2022 ECU developing a new QEP Fall 2020 – Jan. 2022 6 weeks before

  • n-site review

SACSCOC off-site review

  • Nov. 2022

ECU developing a focused report to provide additional compliance information identified in off-site review

  • Nov. 2022 – Jan.

2023 6 weeks before

  • n-site review

SACSCOC on-site review

  • Jan. 17 – Apr. 14,

2023 ECU developing a response report to on-site findings, if requested

  • Apr. – Aug. 2023

Early Sept. 2023 Reaffirmation decision made by SACSCOC Board

  • Dec. 2023
slide-35
SLIDE 35

The Pri rinciples of f Accreditation

1. Principle of Integrity 2. Mission 3. Basic Eligibility Standard (3 standards) 4. Governing Board (9) 5. Administration and Organization (7) 6. Faculty (7) 7. Institutional Planning & Effectiveness (3) 8. Student Achievement (4) 9. Educational Program Structure and Content (7)

  • 10. Educational Policies, Procedures, & Practices (9)
  • 11. Library & Learning Resources (3)
  • 12. Academic & Student Support Services (6)
  • 13. Financial & Physical Resources (8)
  • 14. Transparency & Institutional Representation (5)

35

slide-36
SLIDE 36

Proposed Workgroup Structure

Academic Council

  • Adm. &

Org. Mission BOT CEO Entities Faculty & Staff Adequacy Qualifications Evaluations Planning & Assessment Edu Programs Content Structure Policies Practices Resources & Services Library IT Academic Support Student Support Finance Financial Resources Physical Resources Institutional Environment Transparency DE Policy Compliance QEP Leadership Committee IPAR Work Group

36

slide-37
SLIDE 37

Quality Enhancement Plan

Well-defined focused topic that enhances student learning Embedded in ongoing, integrated institution-wide planning & evaluation process Presents a clear, comprehensive analysis

  • f topic importance

Have broad-based participation Institutional capacity to complete Have clear timeline and assignment of responsibilities Structure established to assess goal attainment

37

slide-38
SLIDE 38

Proposed QEP Development Tim imeline

Call for QEP Concept Papers: Fall 2020 (due Jan. 2021) Initial Review & Selection: Jan. – Mar. 2021 (to select 2-3 concept papers for development) QEP Proposal Development: Mar. – Aug. 2021 Campus-wide Review and Selection: Fall 2021 (to select one proposal by Dec. 2021) QEP Development and Marketing: Jan. – Dec. 2022 (due six weeks before on-site review)

38

slide-39
SLIDE 39

Quality Enhancement Plan Committee Structure

QEP Coordinating Group (IPAR)

QEP Selection Committee QEP Development Committee QEP Proposal Development Workgroups

slide-40
SLIDE 40

SACSCOC Position Statements

  • Economic Impact During Pandemic
  • https://sacscoc.org/app/uploads/2020/05/Economic-Impact-During-

Pandemic.pdf

  • Educational Quality During Pandemic
  • https://sacscoc.org/app/uploads/2020/05/Educational-Quality-During-

Pandemic.pdf

  • Institutional Planning & Assessment During Pandemic
  • https://sacscoc.org/app/uploads/2020/05/Institutional-Planning-and-

Assessment-During-Pandemic.pdf

Published May 13, 2020

slide-41
SLIDE 41

Institutional Effectiveness

SECTION 7: Institutional Planning and Effectiveness The institution engages in ongoing, comprehensive, and integrated research-based planning and evaluation processes that (a) focus on institutional quality and effectiveness and (b) incorporate a systematic review of institutional goals and outcomes consistent with its mission. (Institutional planning) [CR]

slide-42
SLIDE 42

Strategic Planning Committee

 Paul Schwager, Chair  TJ Mohammed, Academic Affairs  Chris Locklear, Chancellor’s Division  Michael Van Scott, REDE  Sara Thorndike, Admin & Finance  Michelle Brooks, Health Sciences  Beth Ketterman, Health Sciences  Kathy Hill, Student Affairs  Chris Dyba, Advancement  Carolyn Bevillard, Athletics  Puri Martinez, Faculty Senate  Michelle Bone, Staff Senate  Tucker Robbins, SGA

slide-43
SLIDE 43

Strategic Planning Committee Charge

June

Review and select institutional metrics

July

Review reports and provide feedback to Academic Units

August

Review reports and provide feedback to Administrative Units

Jan/Feb

Annually evaluate ECU’s progress on institutional and UNC System metrics, and provide recommendations to the Chancellor

slide-44
SLIDE 44

Academic Unit Strategic Plans

Reports due June 30, 2020

Brody School of Medicine College Allied Health Sciences College Engineering & Technology College Fine Arts & Communication College Health & Human Performance College of Business College of Education College of Nursing Harriot College Arts & Sciences Honors College Joyner Library Laupus Library School of Dental Medicine

slide-45
SLIDE 45

Administrative Divisions/Unit Strategic Plans

 Annual Reports due August 1st

Chancellor's Division Division of Academic Affairs Division of Administration & Finance Division of Health Sciences Division of Research Economic Development & Engagement Division of Student Affairs University Advancement

slide-46
SLIDE 46

Survey Update

slide-47
SLIDE 47

Survey Update

 Survey of Student Opinion of

Instruction

 First summer session

 Survey open June 16 – 22  Instructor reports available on June 30

 11-week and second summer sessions

 Survey open July 24 – 30  Instructor reports available on August 7

 Graduating Senior Survey and

Graduate Student Exit Survey

 2019-2020 reports coming soon  Analytics Portal

 Academic Program Profiles / Students /

Student Satisfaction

 Surveys for summer 2020 graduates will

  • pen July 1