Creating Dashboards of Direct and Creating Dashboards of Direct and - - PowerPoint PPT Presentation

▶
creating dashboards of direct and creating dashboards of
SMART_READER_LITE
LIVE PREVIEW

Creating Dashboards of Direct and Creating Dashboards of Direct and - - PowerPoint PPT Presentation

Oct 26, 2022 190 likes •531 views

Creating Dashboards of Direct and Creating Dashboards of Direct and Creating Dashboards of Direct and Creating Dashboards of Direct and Indirect SLOs Measures in R Indirect SLOs Measures in R Indirect SLOs Measures in R Indirect SLOs Measures

slide-1
SLIDE 1

Creating Dashboards of Direct and Creating Dashboards of Direct and Creating Dashboards of Direct and Creating Dashboards of Direct and Indirect SLOs Measures in R Indirect SLOs Measures in R Indirect SLOs Measures in R Indirect SLOs Measures in R

  • Dr. Chris Boosalis, Dr. Oddmund Myhre, and

Binod Pokhrel, MS ECE

slide-2
SLIDE 2

Introduction

  • Development of an assessment system within a

College of Education

  • Delivering the assessment system campus wide
  • Using dashboards to assist in closing the loop
  • Server architecture, maintenance, security, and

costs

Chris Boosalis – chris.boosalis@csus.edu / Oddmund Myhre – omyhre@csustan.edu

slide-3
SLIDE 3

OUTCOMES

How to retain meaning of assessment measures at multiple levels of the organization? How to track the effects programmatic and curricular changes? How do we close the loop at regular intervals – not just at accreditation time? How to use free and open source tools to manage assessment data?

Chris Boosalis – chris.boosalis@csus.edu / Oddmund Myhre – omyhre@csustan.edu

slide-4
SLIDE 4

University/College Mission University Learning Outcomes Accreditation Requirements

Program Learning Outcomes

Course Learning Outcomes Multiple Measures of Student Learning Chris Boosalis – chris.boosalis@csus.edu / Oddmund Myhre – omyhre@csustan.edu

slide-5
SLIDE 5

Goal: Leaders in Learning

Subject Matter Competence Multicultural Competence Pedagogical Skills Collaborative Skills Technological Skills Ethical Practice Subject Matter Knowledge Data Driven Decision Making Working with English Learners

Making Meaning of Multiple Measures

Chris Boosalis – chris.boosalis@csus.edu / Oddmund Myhre – omyhre@csustan.edu

slide-6
SLIDE 6

Multiple Measures of Learning Outcomes:

  • Employer Surveys
  • Student Surveys
  • Performance Assessments
  • Tests
  • Clinical Evaluations
  • Direct Assessments

CLOSING THE LOOP

Chris Boosalis – chris.boosalis@csus.edu / Oddmund Myhre – omyhre@csustan.edu

slide-7
SLIDE 7

Example

Learning Outcome: Leaders in Learning

Measures of Professional Competency Measures of Professional Engagement Measures of Reflective Practices

Chris Boosalis – chris.boosalis@csus.edu / Oddmund Myhre – omyhre@csustan.edu

slide-8
SLIDE 8

PROFESSIONAL COMPETENCY:

Subject-matter Evaluations Clinical Evaluations Course Assignments Technology Mastery Ethical Practice

Chris Boosalis – chris.boosalis@csus.edu / Oddmund Myhre – omyhre@csustan.edu

slide-9
SLIDE 9

REFLECTIVE LEADERS

Assessment Data-driven Decision Making Intellectual Engagement Lifelong Learning

Chris Boosalis – chris.boosalis@csus.edu / Oddmund Myhre – omyhre@csustan.edu

slide-10
SLIDE 10

ENGAGED PROFESSIONALS

Leadership Collaboration Advocacy Innovation

Chris Boosalis – chris.boosalis@csus.edu / Oddmund Myhre – omyhre@csustan.edu

slide-11
SLIDE 11

STATIC BAR CHARTS

slide-12
SLIDE 12

Improved Assessment within a College

Aligning Direct and Indirect Assessments to Student Learning Outcomes

slide-13
SLIDE 13

Table 1 Hypothetical Alignment of Fictitious Program Standards to an SLO

SLO Elementary Secondary Ed Specialist Nursing Social Work Psychologist Providing essential services to language- minority communities Differentiating instruction for English learners Differentiating instruction for English learners Differentiating instruction for English learners Culturally responsive health care for diverse linguistic groups Culturally responsive services for diverse linguistic groups Culturally responsive therapy for diverse linguistic groups

Table 2 Hypothetical Alignment of Fictitious Program Standards and Fictitious Direct and Indirect Measures

SLO Program Program Standard Direct Measure* Indirect Measure* SLO 1: Providing essential services to language- minority communities Elementary Differentiating instruction for English learners Teaching Performance Assessment, Rubric Element 10 Student Exit Survey, Question 13 Secondary Differentiating instruction for English learners Teaching Performance Assessment, Rubric Element 10 Student Exit Survey, Question 13 Ed Specialist Differentiating instruction for English learners Teaching Performance Assessment, Rubric Element 10 Student Exit Survey, Question 13 Nursing Culturally responsive health care for diverse linguistic groups Clinical Assessment, Rubric Element 12 Program Exit Survey, Question 22 Social Work Culturally responsive services for diverse linguistic groups Clinical Assessment, Rubric Element 13 Clinical Exit Survey, Question 23 Psychologist Culturally responsive therapy for diverse linguistic groups Field Experience Assessment, Rubric Element 14 Field Experience Survey, Question 24

Improved College Improved College Improved College Improved College-

  • Wide

Wide Wide Wide Assessment Assessment Assessment Assessment

slide-14
SLIDE 14

Chris Boosalis – chris.boosalis@csus.edu / Oddmund Myhre – omyhre@csustan.edu

slide-15
SLIDE 15

Chris Boosalis – chris.boosalis@csus.edu / Oddmund Myhre – omyhre@csustan.edu

slide-16
SLIDE 16

Chris Boosalis – chris.boosalis@csus.edu / Oddmund Myhre – omyhre@csustan.edu

slide-17
SLIDE 17

Scaling up to University-wide Assessment

Aligning Direct and Indirect Assessments to Student Learning Outcomes

slide-18
SLIDE 18

HYPOTHETICAL ALIGNMENT OF FICTITIOUS PROGRAM ASSESSMENTS TO AN SLO ACROSS MAJORS

Chris Boosalis – chris.boosalis@csus.edu / Oddmund Myhre – omyhre@csustan.edu

slide-19
SLIDE 19

Chris Boosalis – chris.boosalis@csus.edu / Oddmund Myhre – omyhre@csustan.edu

slide-20
SLIDE 20

Chris Boosalis – chris.boosalis@csus.edu / Oddmund Myhre – omyhre@csustan.edu

slide-21
SLIDE 21

Chris Boosalis – chris.boosalis@csus.edu / Oddmund Myhre – omyhre@csustan.edu

slide-22
SLIDE 22

Chris Boosalis – chris.boosalis@csus.edu / Oddmund Myhre – omyhre@csustan.edu

slide-23
SLIDE 23

Chris Boosalis – chris.boosalis@csus.edu / Oddmund Myhre – omyhre@csustan.edu

slide-24
SLIDE 24

Shiny Server

slide-25
SLIDE 25

System System System System Ubuntu 14.04 LTS 64 bit OS All updates installed Ubuntu Package for R, Rbase Curl and CRAN Repository All dependencies Shiny GoogleVis

Chris Boosalis – chris.boosalis@csus.edu / Oddmund Myhre – omyhre@csustan.edu / Binod Pokhrel – binod.pokhrel@csus.edu

slide-26
SLIDE 26

Operational and maintenance cost Operational and maintenance cost Operational and maintenance cost Operational and maintenance cost

Internal Server

Skilled IT – Minimal running cost Minimal Hardware requirement External Support - $ 200 - $1500 / Year for the server side (Ubuntu)

https://www.ubuntu.com/support/plans-and-pricing

Vendor

  • E.g. Digital Ocean (Monthly recurring cost)

http://deanattali.com/2015/05/09/setup-rstudio-shiny-server-digital-ocean/#sign-up

Chris Boosalis – chris.boosalis@csus.edu / Oddmund Myhre – omyhre@csustan.edu / Binod Pokhrel – binod.pokhrel@csus.edu

slide-27
SLIDE 27

Deployment and Server security Deployment and Server security Deployment and Server security Deployment and Server security

  • Physically Transfer
  • Shared Disk
  • SFTP

Security – Firewall Proper Authentication Regular Log checks

Chris Boosalis – chris.boosalis@csus.edu / Oddmund Myhre – omyhre@csustan.edu / Binod Pokhrel – binod.pokhrel@csus.edu

slide-28
SLIDE 28

Fusion Registry and R

slide-29
SLIDE 29

Fusion Registry – Chris and Matt Nelson (UK)

Chris Boosalis – chris.boosalis@csus.edu / Oddmund Myhre – omyhre@csustan.edu

slide-30
SLIDE 30

Slice and Dice

Chris Boosalis – chris.boosalis@csus.edu / Oddmund Myhre – omyhre@csustan.edu

slide-31
SLIDE 31

SDMX Data – 23,000 Records Parsed

Chris Boosalis – chris.boosalis@csus.edu / Oddmund Myhre – omyhre@csustan.edu

slide-32
SLIDE 32

Chris Boosalis – chris.boosalis@csus.edu / Oddmund Myhre – omyhre@csustan.edu

slide-33
SLIDE 33

Chris Boosalis – chris.boosalis@csus.edu / Oddmund Myhre – omyhre@csustan.edu