Core Competencies for Librarians Engaged in Assessment Presented by - - PowerPoint PPT Presentation

core competencies for librarians engaged in assessment
SMART_READER_LITE
LIVE PREVIEW

Core Competencies for Librarians Engaged in Assessment Presented by - - PowerPoint PPT Presentation

Core Competencies for Librarians Engaged in Assessment Presented by Sue Erickson, Virginia Wesleyan College Based on research conducted by Sarah Passonneau, Iowa State University and Sue Erickson, Virginia Wesleyan College What this webinar


slide-1
SLIDE 1

Core Competencies for Librarians Engaged in Assessment

Presented by Sue Erickson, Virginia Wesleyan College

Based on research conducted by Sarah Passonneau, Iowa State University and Sue Erickson, Virginia Wesleyan College

slide-2
SLIDE 2

What this webinar will cover

Overview of the research conducted on job descriptions to

develop the core competences

Skill areas identified in the research Resources for developing those skills Job template

slide-3
SLIDE 3

What is LLAMA MAES?

LLAMA=Library Leadership, Administration and Management Association,

a division of ALA

MAES=Measurement, Assessment, and Evaluation Section of LLAMA LLAMA is for all types of libraries

slide-4
SLIDE 4

LLAMA MAES

Education Committee formed in 2011 – part of charge:

develop core competencies for assessment librarians

6 library job websites and listservs were reviewed over 18

months

Search terms used: assessment, evaluation, metrics and

strategic

231 job descriptions found with above terms were

analyzed

slide-5
SLIDE 5

Methodology

Content analysis using Atlas.ti 64 codes were developed to identify competencies Codes were analyzed for co-occurrence Code families, super codes and subsequently networks

were developed

slide-6
SLIDE 6

Assessment Librarian positions

44 jobs; all were in academic libraries; most were ARL Top skill areas included :

Assessment Tools Analysis/Analyze Data Collaboration Presentation Assessment Methods Innovative/Dynamic/Creative Assessment Program (long term development of a program of assessment)

slide-7
SLIDE 7

Non-Assessment Jobs with “Assessment”

  • r “Evaluation” in the Job Posting

187 job postings in this category; 87% from

college/university libraries

30% were instruction-oriented 20% were administrative positions (deans, directors,

department heads)

16% public services/reference Instructional and administrative positions had more

detailed assessment responsibilities

slide-8
SLIDE 8

Confirmation of “Culture of Assessment”

Inclusion of assessment in newer job areas, such as

“Emerging Technologies” and “Digital Collections”

Inclusion of assessment in more traditional job areas, such

as archives, access services, cataloging

Core competencies identified in this research can assist

library administrators in developing new positions and reshaping existing ones

slide-9
SLIDE 9

Where are we learning how to “do assessment”?

Not in LIS programs: Askew and Theodore-Shusta found

  • nly 1 formal course on assessment & few programs

requiring research methods

On the job training Courses/seminars Conferences, such as LAC Self-directed learning

slide-10
SLIDE 10

Recommendations for library assessment community

Librarians can use core competencies to identify gaps in

their own skills

Assessment librarians can use our research to advocate for

support for their own professional development

Professional associations could identify gaps in

professional development training

Associations or LIS programs could develop a certificate

program in library assessment

slide-11
SLIDE 11

Recommendations for LLAMA MAES

Reach out to PLA to more effectively research

“assessment” in public libraries

Add existing professional development opportunities to its

Assessment Toolbox

Reach out to LIS educators through the Association of

Library and Information Science Educators (ALISE)

slide-12
SLIDE 12

Top Skill Areas Needed for Assessment:

  • 1. Background & Current Awareness

Historical understanding of the growth of assessment in libraries Historical overview of important librarians and past initiatives Awareness of current national initiatives (LibQUAL+, ROI, NSSE,

IPEDS/NCES, Balanced Scorecard, Value of Academic Libraries, etc.)

Fluency with relevant library standards (ex. ACRL Standards for

Libraries in Higher Education)

Ability to identify resources to help develop skills and network (LLAMA

MAES Assessment Toolbox, conferences, webinars, courses)

slide-13
SLIDE 13

Top Skill Areas Needed for Assessment:

  • 2. Research Methods

Social science research design (focus groups, unobtrusive methods,

etc.)

Survey design (good construction, choosing rating scales, values,

comment boxes)

Developing a good research question Selecting the best method to answer the question Knowledge of influential library assessment methods (LibQUAL+,

SAILS, RAILS, etc.)

IRB training and ethical use of data

slide-14
SLIDE 14

Top Skill Areas Needed for Assessment:

  • 3. Statistical and Analytic Skills

Background on descriptive statistics Introduction to basic statistical models (ex. T-test) and when to use

them

Understanding of quantitative and qualitative methodologies Introduction to basic qualitative coding methods Introduction to quantitative (SAS, SPSS) and qualitative (Atlas.ti,

InVivo) software packages

Introduction to analytic tools (web analytics, learning analytics)

slide-15
SLIDE 15

Top Skill Areas Needed for Assessment:

  • 4. Visualization and Presentation Skills

Basic overview of graphic design rules Overview of different chart types and when to use them Visualization techniques to display qualitative data Slide presentation skills Good structural design (how to present a compelling narrative) Understanding your audience Good oral presentation habits (clear voice, general body language,

hand movements, etc.)

slide-16
SLIDE 16

Top Skill Areas Needed for Assessment:

  • 5. Project Management and People Skills

Basic group dynamic theory Methods to increase collaboration Methods to manage conflict (when different stakeholders want the

assessment results to present divergent “stories”)

Building capacity/buy-in for projects Team management skills Project management skills Methods to optimize creativity and productivity of a group

slide-17
SLIDE 17

Top Ten: Background & Current Awareness

  • 1. Knowledge of the history/background of library

assessment

  • 2. Awareness of national assessment programs and

associations

slide-18
SLIDE 18

POLL QUESTIONS

Do you possess background knowledge in the history of

library assessment?

Do you feel you are up to date in current library

assessment trends?

slide-19
SLIDE 19

Background & Current Awareness Resources

Dow, R. F

. (1998). Using assessment criteria to determine library quality. The Journal of academic librarianship, 24(4), 277-281.

Hernon, P

., Nitecki, D. A., & Altman, E. (1999). Service quality and customer satisfaction: an assessment and future directions. The Journal of Academic Librarianship, 25(1), 9-17.

Lewin, H. S., & Passonneau, S. M. (2012). An analysis of academic research

libraries’ assessment data: A look at professional models and benchmarking

  • data. The Journal of Academic Librarianship, 38(2), 85-93. Reviews and

describes major assessment activities occurring in academic libraries.

ACRL Value of Academic Libraries Toolkit – bibliography of resources ARL-ASSESS listserv

slide-20
SLIDE 20

Top Ten: Research Development

  • 3. Research methods –research question & selection
  • f appropriate methodology
  • 4. Research design – surveys, focus groups,
  • bservational methods
slide-21
SLIDE 21

POLL QUESTIONS

Do you possess skills in devising research questions and

selecting appropriate methods for exploring them?

Do you have skills in research design (survey design, focus

groups, etc.)?

slide-22
SLIDE 22

Research Development Resources

Any social science research methods textbook (Sue’s pick:

The Practice of Social Research by Earl R. Babbie)

For academic librarians, audit a social science research

methods course on your campus (see course listings under in Sociology, Political Science, Psychology)

slide-23
SLIDE 23

Top Ten: Research Methods

  • 5. Statistical analysis (T-test, Chi Square,

descriptive statistics)

  • 6. Quantitative and qualitative methods
slide-24
SLIDE 24

POLL QUESTIONS

Do you have skills in statistical analysis? Are you knowledgeable about qualitative research

methods?

slide-25
SLIDE 25

Research Methods Resources

LLAMA MAES Assessment Toolbox – practical applications of

research methods, and even samples from other institutions

Atomic Learning or Lynda.com for tutorials on specific

applications

slide-26
SLIDE 26

Top Ten: Data Presentation

  • 7. Data visualization (charts, graphs, graphic

design)

  • 8. Oral and written presentation of results
slide-27
SLIDE 27

POLL QUESTIONS

Are you skilled in presenting data visually? Do you have good written and oral communication skills?

slide-28
SLIDE 28

Data Presentation Resources

Books by Edward Tufte (http://www.edwardtufte.com/tufte/) Campus writing centers, writing groups, colleagues as first

readers/proofreaders

slide-29
SLIDE 29

Top Ten: Project Management & Team Leadership

  • 9. Project management
  • 10. Team management/leadership
slide-30
SLIDE 30

POLL QUESTIONS

Are you a skilled project manager? Do you have skills in facilitating/leading/managing teams?

slide-31
SLIDE 31

Project Management & Team Leadership Resources

Triangle Research Libraries Network Management Academy Facilitative leadership - Center for Creative Leadership Project management - Project Management Institute ,

Gantt Project (free software)

Team management – books by James Lewis and others

slide-32
SLIDE 32

Professional Development for Assessment Librarians

Library Assessment Conference Regional conferences (Southeastern LAC, CUNY)

slide-33
SLIDE 33

Hiring the Assessment Librarian: Job Template

COMPETENCIES REQUIRED

Data Presentation Skills Slide show skills, summary skills, graphic skills, chart skills, table skills, clear spoken, concise, logical Data Analysis Skills Qualitative and quantitative; data coding skills, Assessment Methodologies Surveys, unobtrusive methods, focus groups, learning outcomes, ethnographic methods, knowledge of non-traditional user assessment methods (i. e. graffiti boards, comment walls etc.) Knowledge of Assessment Software SAS, SPSS, Atlas.ti, InVIVO, Excel, Access, Other Program Improvement/ Culture of Assessment Strategic Planning, Metrics, Library-wide assessment project/initiatives

slide-34
SLIDE 34

Assessment Librarian Job Template Continued

Communication Excellent oral and written communication skills; presentation skills Team work/ Collaboration Will work with multiple programs Will work closely with program(s) PROGRAM NAME(S) Will work closely with team(s) TEAM NAME(S) Problem solving/Innovative Good problem solving skills, (provide examples if appropriate). Good innovative skills, (provide examples if appropriate). Project Planning Ability to start, manage and complete complex projects Initiative and enterprise Aptitude for initiating new projects that fit in with institutional priorities

slide-35
SLIDE 35

Want more information?

LL&M article Paper in Library Assessment Conference 2014 proceedings Contact: Sue Erickson, serickson@vwc.edu

Sarah Passonneau, spassonn@iastate.edu

slide-36
SLIDE 36

QUESTIONS?

Thank you for participating!