Creating Dashboards of Direct and Creating Dashboards of Direct and - PowerPoint PPT Presentation

Creating Dashboards of Direct and Creating Dashboards of Direct and Creating Dashboards of Direct and Creating Dashboards of Direct and Indirect SLOs Measures in R Indirect SLOs Measures in R Indirect SLOs Measures in R Indirect SLOs Measures in R Dr. Chris Boosalis, Dr. Oddmund Myhre, and Binod Pokhrel, MS ECE

Chris Boosalis – chris.boosalis@csus.edu / Oddmund Myhre – omyhre@csustan.edu Introduction • Development of an assessment system within a College of Education • Delivering the assessment system campus wide • Using dashboards to assist in closing the loop • Server architecture, maintenance, security, and costs

Chris Boosalis – chris.boosalis@csus.edu / Oddmund Myhre – omyhre@csustan.edu OUTCOMES How to retain meaning of assessment measures at multiple levels of the organization? How to track the effects programmatic and curricular changes? How do we close the loop at regular intervals – not just at accreditation time? How to use free and open source tools to manage assessment data?

Chris Boosalis – chris.boosalis@csus.edu / Oddmund Myhre – omyhre@csustan.edu University/College Mission University Learning Outcomes Accreditation Requirements Program Learning Outcomes Course Learning Outcomes Multiple Measures of Student Learning

Chris Boosalis – chris.boosalis@csus.edu / Oddmund Myhre – omyhre@csustan.edu Making Meaning of Multiple Measures Technological Skills Collaborative Ethical Skills Practice Subject Pedagogical Matter Skills Knowledge Data Driven Multicultural Decision Competence Making Goal: Subject Working with Leaders in Matter English Competence Learners Learning

Chris Boosalis – chris.boosalis@csus.edu / Oddmund Myhre – omyhre@csustan.edu Multiple Measures of Learning Outcomes: • Employer Surveys CLOSING • Student Surveys • Performance Assessments THE LOOP • Tests • Clinical Evaluations • Direct Assessments

Chris Boosalis – chris.boosalis@csus.edu / Oddmund Myhre – omyhre@csustan.edu Example Measures of Professional Competency Learning Outcome: Leaders in Measures of Measures of Learning Reflective Professional Practices Engagement

Chris Boosalis – chris.boosalis@csus.edu / Oddmund Myhre – omyhre@csustan.edu PROFESSIONAL COMPETENCY: Subject-matter Evaluations Clinical Evaluations Course Assignments Technology Mastery Ethical Practice

Chris Boosalis – chris.boosalis@csus.edu / Oddmund Myhre – omyhre@csustan.edu REFLECTIVE LEADERS Assessment Data-driven Decision Making Intellectual Engagement Lifelong Learning

Chris Boosalis – chris.boosalis@csus.edu / Oddmund Myhre – omyhre@csustan.edu PROFESSIONALS ENGAGED Collaboration Leadership Innovation Advocacy

STATIC BAR CHARTS

Improved Assessment within a College Aligning Direct and Indirect Assessments to Student Learning Outcomes

Table 1 Hypothetical Alignment of Fictitious Program Standards to an SLO SLO Elementary Secondary Ed Specialist Nursing Social Work Psychologist Wide Wide -Wide Wide Providing Differentiating Differentiating Differentiating Culturally Culturally Culturally essential instruction for instruction for instruction for responsive responsive responsive services to English learners English learners English learners health care for services for therapy for language- diverse diverse diverse minority linguistic linguistic linguistic communities groups groups groups - - Improved College- Assessment Assessment Assessment Assessment Improved College Improved College Improved College Table 2 Hypothetical Alignment of Fictitious Program Standards and Fictitious Direct and Indirect Measures SLO Program Program Standard Direct Measure* Indirect Measure* Teaching Performance Differentiating instruction for Student Exit Survey, Elementary Assessment, Rubric Element English learners Question 13 10 Teaching Performance Differentiating instruction for Student Exit Survey, Secondary Assessment, Rubric Element English learners Question 13 10 SLO 1: Providing Teaching Performance essential services Differentiating instruction for Student Exit Survey, Ed Specialist Assessment, Rubric Element to language- English learners Question 13 10 minority Culturally responsive health communities Clinical Assessment, Rubric Program Exit Survey, Nursing care for diverse linguistic Element 12 Question 22 groups Culturally responsive services Clinical Assessment, Rubric Clinical Exit Survey, Social Work for diverse linguistic groups Element 13 Question 23 Culturally responsive therapy Field Experience Assessment, Field Experience Survey, Psychologist for diverse linguistic groups Rubric Element 14 Question 24

Chris Boosalis – chris.boosalis@csus.edu / Oddmund Myhre – omyhre@csustan.edu

Chris Boosalis – chris.boosalis@csus.edu / Oddmund Myhre – omyhre@csustan.edu

Chris Boosalis – chris.boosalis@csus.edu / Oddmund Myhre – omyhre@csustan.edu

Scaling up to University-wide Assessment Aligning Direct and Indirect Assessments to Student Learning Outcomes

Chris Boosalis – chris.boosalis@csus.edu / Oddmund Myhre – omyhre@csustan.edu HYPOTHETICAL ALIGNMENT OF FICTITIOUS PROGRAM ASSESSMENTS TO AN SLO ACROSS MAJORS

Chris Boosalis – chris.boosalis@csus.edu / Oddmund Myhre – omyhre@csustan.edu

Chris Boosalis – chris.boosalis@csus.edu / Oddmund Myhre – omyhre@csustan.edu

Chris Boosalis – chris.boosalis@csus.edu / Oddmund Myhre – omyhre@csustan.edu

Chris Boosalis – chris.boosalis@csus.edu / Oddmund Myhre – omyhre@csustan.edu

Chris Boosalis – chris.boosalis@csus.edu / Oddmund Myhre – omyhre@csustan.edu

Shiny Server

Chris Boosalis – chris.boosalis@csus.edu / Oddmund Myhre – omyhre@csustan.edu / System System System System Ubuntu 14.04 LTS 64 bit OS Binod Pokhrel – binod.pokhrel@csus.edu All updates installed Ubuntu Package for R, Rbase Curl and CRAN Repository All dependencies Shiny GoogleVis

Chris Boosalis – chris.boosalis@csus.edu / Oddmund Myhre – omyhre@csustan.edu / Operational and maintenance cost Operational and maintenance cost Operational and maintenance cost Operational and maintenance cost Binod Pokhrel – binod.pokhrel@csus.edu Internal Server Skilled IT – Minimal running cost Minimal Hardware requirement External Support - $ 200 - $1500 / Year for the server side (Ubuntu) https://www.ubuntu.com/support/plans-and-pricing Vendor -E.g. Digital Ocean (Monthly recurring cost) http://deanattali.com/2015/05/09/setup-rstudio-shiny-server-digital-ocean/#sign-up

Chris Boosalis – chris.boosalis@csus.edu / Oddmund Myhre – omyhre@csustan.edu / Deployment and Server security Deployment and Server security Deployment and Server security Deployment and Server security Binod Pokhrel – binod.pokhrel@csus.edu - Physically Transfer - Shared Disk - SFTP Security – Firewall Proper Authentication Regular Log checks

Fusion Registry and R

Chris Boosalis – chris.boosalis@csus.edu / Oddmund Myhre – omyhre@csustan.edu Fusion Registry – Chris and Matt Nelson (UK)

Chris Boosalis – chris.boosalis@csus.edu / Oddmund Myhre – omyhre@csustan.edu Slice and Dice

Chris Boosalis – chris.boosalis@csus.edu / Oddmund Myhre – omyhre@csustan.edu SDMX Data – 23,000 Records Parsed

Chris Boosalis – chris.boosalis@csus.edu / Oddmund Myhre – omyhre@csustan.edu

Chris Boosalis – chris.boosalis@csus.edu / Oddmund Myhre – omyhre@csustan.edu