10/8/2019 Exploring a Collaboration Intervention Between SLPs and - - PDF document

10 8 2019
SMART_READER_LITE
LIVE PREVIEW

10/8/2019 Exploring a Collaboration Intervention Between SLPs and - - PDF document

10/8/2019 Exploring a Collaboration Intervention Between SLPs and Third-Grade Teachers to Inform Future Partnerships Mary P. Mitchell, PhD, CCC-SLP Pacific University College of Education School of Communication Sciences and Disorders


slide-1
SLIDE 1

10/8/2019 1

Exploring a Collaboration Intervention Between SLPs and Third-Grade Teachers to Inform Future Partnerships

Mary P. Mitchell, PhD, CCC-SLP Pacific University College of Education School of Communication Sciences and Disorders

Disclosures

  • I do not have any financial relationships to

disclose.

  • I do not have any non-financial relationships to

disclose.

Advance Organizer

1. Discuss the background and rationale for the Mitchell (2017) collaboration intervention study. 2. Define collaboration as it was used in the research. 3. Present the methods and results of the study. 4. Model and practice portions of the collaborative vocabulary intervention. 5. Explore implications for future SLP partnerships in schools. 6. Q & A

slide-2
SLIDE 2

10/8/2019 2

Learner Objectives

Explain the collaboration definition and procedures used by SLPs and third-grade in a vocabulary intervention study. Discuss research findings as it pertains to student vocabulary

  • utcomes and perspectives of collaborating partners.

Discuss implications for practice based on the procedures and findings from the study.

Word-Wondering Ice Breaker Word-Wondering Ice Breaker

abruptly I was at the park yesterday and I saw a turtle

  • walking. For some reason, it abruptly went into its
  • shell. The turtle quickly and suddenly went into its

shell.

slide-3
SLIDE 3

10/8/2019 3

Word-Wondering Ice Breaker

  • How would you scaffold child’s response that

“abruptly” could mean “disturbed”?

  • How might you model or discuss root word and

add-ons for the word “abruptly”?

Word-Wondering Ice Breaker

abruptly = suddenly abrupt

Word-Wondering Ice Breaker

Example sentence using “abruptly”: Non-example of “abruptly” (& reason):

slide-4
SLIDE 4

10/8/2019 4

Word-Wondering Ice Breaker

Word-family activity: The bike’s abrupt stop made me fall off of my bike. The bike’s abruptly stop made me fall off of my bike.

Word-Wondering Ice Breaker

  • We learned one new word so far today. Let’s

review it. What is a synonym for “suddenly”?

  • Nice work fellow word-wonderers!

Background

slide-5
SLIDE 5

10/8/2019 5

Background

  • All of you
  • My story

Problem

Many students are falling short of meeting 21st century literacy skills. Students who are underperforming in literacy across the country are in the majority.

  • Programme for International Student Assessment (PISA;

OECD, 2015)

  • National Assessment of Educational Progress (NAEP; NCES;

2012, 2015, 2017)

  • Student data at the school, district, and state levels
  • Reports from businesses and college regarding

worker/student readiness

Problem

One linchpin to literacy achievement is vocabulary

  • knowledge. Correlational studies over time have shown

this link; students with limited vocabulary knowledge are at a disadvantage for developing into skilled readers, writers, and high academic achievers (Cunningham & Stanovich, 1997; Stanovich, Cunningham, & Freeman, 1984). An explicit focus on robust vocabulary instruction is recommended as part of a comprehensive literacy program (e.g., Foorman et al., 2016), yet robust vocabulary practices are not the norm (Graves, 2016).

slide-6
SLIDE 6

10/8/2019 6

Toward a Solution

There is a need for collaboration between school professionals with literacy teaching expertise to support them.

  • Complex nature of literacy acquisition process (Roth

& Paul, 2006)

  • Increasingly diverse classrooms (Nevin et al., 2009)
  • Current educational policies (Nevin et al., 2009)

Toward a Solution

Many school professionals have expertise to support students acquiring academic literacy proficiency!

  • General education teachers
  • SLPs
  • Literacy specialists/literacy coaches
  • Special education teachers
  • Teachers of English Learners (ELs)

SLP Roles

Activity 1: What are SLPs’ unique contributions to language/literacy collaborations?

slide-7
SLIDE 7

10/8/2019 7

SLP Roles

SLPs are specialists who have expertise in the language underpinnings of written and spoken language, diagnosing language disorders, and providing evidence-based language/literacy interventions (ASHA, 2010). Examples of school-based SLPs’ roles and responsibilities in literacy include: (a) Preventing written language problems by fostering language acquisition and emergent literacy, (b) identifying children at risk for reading and writing problems, (c) assessing reading and writing, (d) providing intervention and documenting outcomes for reading and writing, (e) assuming other roles (e.g., assisting teachers, advocating for effective literacy practices), and (f) supporting the instructional program in collaboration with teachers, specialists, and other school professionals (ASHA, 2001; ASHA, 2010).

Study Purposes

To investigate whether literacy partnerships between SLPs and teachers (using a systematic collaboration protocol) yield better vocabulary outcomes for third grade students than conditions where teachers are not systematically collaborating with SLPs. To examine indicators about progress the users made toward adopting the collaboration protocol in their practice.

(Hattie, 2009)

Research Questions 1-3

When SLPs and teachers implement a vocabulary instructional technique using a systematic collaboration protocol (treatment condition), is there a significant difference in third grade students’

  • vocabulary scores on a synonyms task (RQ1)
  • vocabulary scores on a words-in-context task (RQ2)
  • vocabulary and morpho-syntax judgement scores on a

non-examples task (RQ3) …when compared with the scores of students in classrooms where non-collaborating teachers implement a similar technique (comparison condition)?

slide-8
SLIDE 8

10/8/2019 8

Research Question 4

Do CBAM tools indicate that SLPs and teachers are making progress toward adopting the collaboration protocol?

Theoretical Framework

Vocabulary and Comprehension

  • Instrumentalist Hypothesis

(Anderson & Freebody, 1981)

  • Simple View of Reading (Gough &

Tunmer, 1986 )

  • Comprehensive Approach to

Vocabulary Instruction (Graves, 2016) Language Scaffolding

  • Systemic Functional Linguistics (SFL;

Halliday, 1994)

  • Social Interactionism (Vygotsky,

1978)

Informed both the focus on academic vocabulary as a high impact instructional target around which to collaborate and the instructional technique used. Informed the procedures used in the vocabulary instructional technique.

Theoretical Framework

Collaboration

  • Collaboration (Schrage, 1995)
  • Supported Collaborative Inquiry

(Nelson and Slavit, 2008) The Change Process

  • Concerns Based Adoption Model

(CBAM; Hall & Hord, 1987)

Informed the development of the collaboration protocol. Informed the methods used to gather and analyze adoption progress indicators.

slide-9
SLIDE 9

10/8/2019 9

Not as easy as it sounds!

Defining Collaboration “Active Ingredients” Activate Your Background Knowledge

Activity 2:

  • Based on your experience, what does

collaboration entail?

  • What are the active ingredients?
slide-10
SLIDE 10

10/8/2019 10

Schrage (1995) Definition

“Collaboration is the process of shared creation: two or more individuals with complementary skills interacting to create a shared understanding that none had previously possessed or could have come to own their own” (Schrage, 1995, p. 29).

WHO Definition

Interprofessional Collaborative Practice

  • ASHA adapted the definition of IPP from the World

Health Organization’s (2010) definition.

  • Two or more professionals from different disciplines

working together to provide comprehensive, integrated services in a school environment.

slide-11
SLIDE 11

10/8/2019 11

Friend & Cook (2012)

Characteristics of collaboration in education (Friend & Cook, 2012): (a) voluntary participation (b) parity among participants (c) mutual goals (d) shared responsibility for participation and decision making (e) shared resources (f) shared accountability for outcomes

Mattessich et al. (2001)

Collaboration is a mutually, beneficial and well-defined relationship entered into by two or more organizations to achieve common goals. The relationship includes a commitment to mutual relationships and goals; a jointly developed structure and shared responsibility; mutual authority and accountability for success; and sharing of resources and rewards” (p. 4-5).

Meaningful Distinctions

  • Distinctions between collaboration, cooperation,

coordination, and consultation

  • Co-teaching may be part of a collaboration, however,

by itself does not necessarily imply that the key features defined in the study as a collaboration have been met (Friend & Cook, 2012)

slide-12
SLIDE 12

10/8/2019 12

Innovation Configuration Map (IC map)

Blueprint defining the innovation, or the new practice; defines what “it” is. Describes variable implementation of each key feature.

  • Ideal (and acceptable)
  • Acceptable
  • Not acceptable

(Hall & Hord, 1987, 2015)

Mitchell (2017) Definition

  • Anchored in Schrage (1995)
  • Key features on SLP/Teacher

Shared-Creation Collaboration IC Map informed by multiple sources SLP/Teacher Shared Creation Collaboration IC Map: Key Features

Establish a partnership Plan time commitment and schedule Agree on ground rules Demonstrate a shared understanding

  • f students’ needs, language base of

social interaction and curriculum, and instructional techniques Use curriculum/instruction trouble spots as a basis for establishing instructional targets Select impactful targets for the collaboration content focus Plan student outcome measurement procedures Implement class time activities and techniques SLP models and shares language scaffolding techniques Gather student outcome data Analyze student outcome data

(Mitchell, Ehren, & Towson, 2016)

slide-13
SLIDE 13

10/8/2019 13

Collaboration Intervention Studies Involving SLPs in Elementary Settings

Literature Review

Collaboration Research: SLPs in Literacy Collaborations

Collaboration between teachers and language/literacy specialists, such as speech-language pathologists (SLPs), is a recommended practice to support the literacy needs of students (e.g., Nevin et al., 2009; Paul et al., 2006; Wallach & Ehren, 2004). However,

There is not an

  • perational definition
  • f collaboration.

There is very little research investigating the effects of collaboration between educators on student

  • utcomes.

Treatment fidelity is not reported.

Collaboration Research: SLPs in Literacy Collaborations

Research designs meeting inclusion criteria between SLPs and elementary teachers (K-5) between 1997-2017:

  • Retrospective evaluations (2)
  • Case studies or action research (5)
  • Experimental and quasi-experimental designs (3)
slide-14
SLIDE 14

10/8/2019 14

Study Design Treatment Fidelity 2 or more collaboration treatment AND comparison classrooms 2 or more SLPs in collaborative condition Grades Language-literacy

  • utcomes

Kaufman et

  • al. (1994)

Quasi-experimental; use

  • f control group

(N = 32) No No No 3 Discourse level- metapragmatic awareness Ellis et al. (1995) Quasi-experimental; use

  • f control group

(N = 40) No No No K Word level- basic concepts Farber & Klein (1999) Quasi-experimental; use

  • f control group

(N = 552) No Yes Yes K-1 Word, sentence, and discourse levels-MAGIC subtest components Hadley et al. (2000) Experimental with random assignment; use

  • f control group

(N = 86) No Yes No K-1 Word level- Receptive and expressive vocabulary; Beginning sound awareness; Letter-sound associations Study Design Treatment Fidelity 2 or more collaboration treatment AND comparison classrooms 2 or more SLPs in collaborative condition Grades Language-literacy

  • utcomes

Swenson (2000) Case study N = 1) No No No 2-5 Global language and narrative Throneberg et

  • al. (2000)

Experimental (lack of total random assignment; use of comparison groups) (N = 77) No Yes No K-3 Word level- vocabulary Calvert et al. (2003) Case study; use of comparison groups (N = 144) No Yes No 1-2 Word- phonemic production, basic concepts, vocabulary Discourse- story retell Nelson & Van Meter (2006) Case examples (N = 2) No No No 2-4 Speaking, listening, reading, writing at discourse, sentence, and word levels Study Design Treatment Fidelity 2 or more collaboration treatment AND comparison classrooms 2 or more SLPs in collaborative condition Grades Language-literacy

  • utcomes

Thomas & Lance (2014) Retrospective evaluation (no comparison or control group) (N = 409) No No No K-3 Basic early literacy skills (DIBELS Next) Cohen- Mimram et al. (2016) Retrospective evaluation; use of a comparison group (N = 220) No Yes Yes K Word level- expressive naming Sentence level- sentence repetition Discourse level- narrative

slide-15
SLIDE 15

10/8/2019 15

Summary of Findings in Literature

Positive effects of collaborations of SLPs on language/literacy outcomes

  • In the experimental and quasi-experimental designs,
  • utcomes from the experimental condition were

compared with outcomes from control or comparison conditions.

  • Favorable effects for collaboration condition in terms of

statistical significance; effect sizes rarely reported. Barriers to implementation expressed

Summary of Findings in Literature

Limitations

  • Inadequate definitions and procedures for measuring

fidelity and replication

  • Problems with methodological quality
  • Concerns regarding feasibility
  • Small sample sizes
  • Lack of evidence about the effects of collaborations
  • n student outcomes (Goddard et al., 2007)

Methods & Results

slide-16
SLIDE 16

10/8/2019 16

Methods

  • District (1), schools (2), classrooms (4)
  • Participants: SLPs and Teachers
  • Quasi-experimental (RQ 1-3)
  • Case study (RQ 4)

Design

Research Questions 1-3

  • Group design used to measure the effectiveness of the

participants’ instructional delivery (N = 68)

  • Quasi-experimental with treatment (n = 34) and

comparison group (n = 34) (Shadish, Cook, & Campbell, 2002)

  • Dependent pretest and posttest samples (Shadish,

Cook, & Campbell, 2002) Research Question 4

  • Case study (N = 4)

Design

  • Criterion sampling
  • Teachers- third grade general education teacher with active

teaching license

  • SLPs- practicing in a school with an active state board or

national ASHA license (or at least be in clinical fellowship year)

  • Non-random assignment
  • Teachers- self-selected conditions
  • SLPs- collaboration condition

Intervention timeline

  • Pre-intervention activities: professional learning, word selection
  • Pretest administered before winter break; posttests administered

the week directly following the last week of the intervention

  • Seven consecutive weeks January-March 2017
slide-17
SLIDE 17

10/8/2019 17

Setting: District and Schools

One public school district in the Northwest U.S.

  • Urban public district

Two participating schools

  • Within the same high school boundary in the district
  • Each school had a collaboration/treatment condition

and a comparison condition.

  • Served preschool through eighth grade with a

population under 450. Other comparable demographics included a racial/ethnic diversity, diversity of languages spoken, percentage of students

  • n IEPs (17-19%), percentage of ELs (23-28%), and
  • ffered lunch at no charge to all students.

Setting: Classrooms & Students

School 1 Comparison School 1 Collaboration School 2 Comparison School 2 Collaboration Number of students 28 26 23* 23* (n=8 third graders) Gender distribution 17 male, 11 female 12 male, 14 female 10 male, 13 female 14 male, 9 female Age range (as of 1/1/17) 8;5-9;4 8;5-9;5 8;5-9;5 7;5-9;3 Percent non-white 75% 71% 96% 96% On individualized education plans (IEPs) 7 5 4 2 Receiving language services from SLP 4 1 1 2 Receiving EL services 3 5 6 5 DIBELS Strategic 4 4 5 6 DIBELS Intensive 13 6 6 8

* Movement during study

Participants: Teachers

School 1 Comparison School 1 Collaboration School 2 Comparison School 2 Collaboration Total years teaching 4 1 11 9 Years teaching 3rd grade 1 1 1 1 Highest degree held Bachelors Masters Masters Masters Age range 40-49 30-39 30-39 30-39 Gender Female Female Female Female Race Caucasian Caucasian Caucasian Caucasian Extent of previous language scaffolding

  • r EL preparation

No formal EL preparation Undergraduate background in linguistics; studied Spanish for 14 years; graduate coursework on teaching EL students No formal EL preparation Endorsement in teaching EL and spent full first year teaching EL; ongoing formal preparation over career

slide-18
SLIDE 18

10/8/2019 18

Participants: SLPs

School 1 SLP School 2 SLP Total years as SLP 11 20 Total years as school-based elementary SLP 11 20 Highest degree held Masters Doctorate Age range 30-39 40-49 Gender Female Female Race Caucasian Caucasian Extent of previous language scaffolding or EL preparation Began QTEL* preparation after the study Began QTEL* preparation in the fall; ongoing Extent of previous collaboration with teacher partner in study Began at the beginning of the 2016-17 school year Began at the end of the 2015-16 school year and continued into the current school year

*QTEL: Quality Teaching for English Learners (WestEd, 2010)

Participants

Targets/Subjects: Teachers and SLPs Byproduct: The students who were being taught by the subjects/participants of the study.

  • The effects of the teachers’ and SLPs’ behavior are

measured by student outcome data.

  • Group design is based upon student outcome data,

which is a measure of the effectiveness of the delivery methods.

Intervention Procedures: Collaboration Condition

  • Collaboration process
  • COLLAB Protocol
  • Vocabulary instructional technique
  • Vocabulary Scenario Technique-Teacher + SLP (VST-

T+SLP)

  • Adapted from Ehren, 2008; Ehren, Zadroga, & Proly,

2010; Spielvogel, 2011

slide-19
SLIDE 19

10/8/2019 19

COLLAB Protocol

The COLLAB Protocol has two components:

COLLAB Guiding Steps SLP/Teacher Collaboration Innovation Configuration Map (IC Map)

+ COLLAB Guiding Steps

Choose the process and language-focused content of the

  • partnership. (Steps 1-5)

Obtain student baseline. (6) Lay foundations for language-focused instruction and support through shared planning. (7-9,11-12) Launch the plan. (10, 13) Assess student learning and make adjustments according to students’ needs. (14, 15) Build next steps. (16)

COLLAB Guiding Steps Overview

Collaboration segment

Within the segment Week 1 2 3 4 5 6 7 Before the segment COLLAB Steps 1-6 After the segment COLLAB Steps 15-16

COLLAB Steps 7-9 10 11-12. 13 14 Repeat weekly

slide-20
SLIDE 20

10/8/2019 20

SLP/Teacher Collaboration IC Map: Key Features

Establish a partnership Plan time commitment and schedule Agree on ground rules Demonstrate a shared understanding

  • f students’ needs, language base of

social interaction and curriculum, and instructional techniques Use curriculum/instruction trouble spots as a basis for establishing instructional targets Select impactful targets for the collaboration content focus Plan student outcome measurement procedures Implement class time activities and techniques SLP models and shares language scaffolding techniques Gather student outcome data Analyze student outcome data

Example of Ideal Implementation

Activity 3

  • Reflect on your past or current partnerships with

teachers.

  • What might ideal implementation of ‘implements

class time activities and techniques’ entail?

Key feature: Implement class time activities and techniques

4 (Ideal Implementation) 3 (In Process) 2 (In Process) 1 (In Process) 0 (No Implementation) SLP + Teacher implement in-class activities and techniques based on trouble spots they agreed upon in advance and in response to demonstrated student performance. In the case of whole class teaching (including demonstration lessons), both partners are involved. The SLP may take the instructional lead with the teacher facilitating student connections to background experiences and curriculum. The teacher may also take the lead in behavior management. SLP + Teacher implement in- class collaboration activities and techniques based on to trouble spots they agreed upon in response to demonstrated student performance. In the case of whole class teaching (including demonstration lessons), both partners are involved. The SLP may take the instructional lead; the teacher takes the lead in behavior management and is minimally involved in helping students make connections to their background experiences and curriculum. SLP + Teacher implement the in-class collaboration activities and techniques

  • ne partner planned

based on trouble spots. In the case of whole class teaching (including demonstration lessons), both partners are

  • involved. The SLP may

take the instructional lead with the teacher facilitating student connections to background experiences and curriculum. The teacher may also take the lead in behavior management. Partners attempt to implement activities and techniques based upon suggestions of the other. Partners may not refine instruction based on trouble spots. The SLP gives ideas to the teacher to implement without providing modeling, coaching,

  • r feedback.

OR The teacher tells the SLP what the lesson plan is for the day for the SLP to then build

  • upon. The teacher leads

classroom instruction; SLP follows along and builds upon the instruction when

  • pportunities arise to address

students’ goals. Partners do not attempt to implement activities and techniques based upon suggestions

  • f the other.

Partners do not refine instruction based on trouble spots. (SLP/Teacher Collaboration IC Map (Mitchell, Ehren, & Towson, 2017)

slide-21
SLIDE 21

10/8/2019 21

Intervention Procedures: Collaboration Condition

Collaboration process

  • COLLAB Protocol

Vocabulary instructional technique

  • Vocabulary Scenario Technique-Teacher + SLP (VST-

T+SLP)

  • Adapted from Ehren, 2008; Ehren et al., 2010;

Spielvogel, 2011

Vocabulary Instruction VST: Key Features of all VST Versions

  • 1. Word

consciousness

  • 2. Word selection
  • 3. Morphological

variations

  • 4. Instructor scenario

construction

  • 5. Meaning

exploration

  • 6. Multiple

encounters

  • 7. Scaffolded and

accurate use

  • 8. Student

engagement

  • 9. Cue/Do/Review

instructional protocol

  • 10. Portable Word Wall

(PWW)

  • 11. Progress monitoring
  • 12. Mastery
  • 13. Generalization

VST Intro Day Practice

Target word selection Vocabulary Scenario Technique-Teacher + SLP (Mitchell, Ehren, & Spielvogel, 2017) Activity 4: Protocol & Practice

slide-22
SLIDE 22

10/8/2019 22

Vocabulary I bulary Inst struction ruction VST-T+SLP VST-T+SLP

Intro Intro days (60 days (60 mins/week) /week)

  • Taught 6 words with at least

16 encounters of each word

  • Cue/Do

Do/Review

  • Read the scenario
  • Find meaning clues
  • Think of synonyms
  • Try out one correct

synonym

  • Write the target word and

synonym

  • Write word family variations
  • Generate sentences
  • Write a correct sentence

Rev Review day day (60 min (60 mins/week)

  • Reviewed 6 words from Intro

Days

  • Cue/Do

Do/Review

  • Do Part 1: Co-teaching: non-

examples and word family activities

  • Do Part 2: Teacher led large

group and SLP led small group practice with word family words

  • Explore meanings, students

generate sentences

  • Show your knowledge:

every student responds and receives feedback

VST-T+SLP Review Day Practice

Vocabulary Scenario Technique-Teacher + SLP (Mitchell, Ehren, & Spielvogel, 2017) Activity 4: Protocol & Practice

Vocabulary I bulary Inst struction ruction VST-T+SLP VST-T+SLP

  • Non-example stimulus item (talking points

provided):

  • I

I hesi hesitated in t n the e hal hallway so so I I cou could st stop

  • p and

and talk talk to to my my fr friend. iend.

  • I

I hesi hesitated in t n the e hal hallway beca because I I wasn wasn’t sure h re how to w to get to get to th the e new teacher’ w teacher’s r room.

  • om.
  • Word family stimulus item (talking points provided)
  • The s

The shy girl alwa y girl always hesit ys hesitate te bef before as re asking ng new new peop people if if she can she can play with play with them. them.

slide-23
SLIDE 23

10/8/2019 23

Example of Classroom Word Wall Example of Classroom Word Wall Exhibit Exhibit Example of Porta Example of Portable Word Wall le Word Wall (PWW (PWW) Example of PWW Example of PWW

slide-24
SLIDE 24

10/8/2019 24

Examples of Student Generated Sentences

I was listening to some music and then the music abruptly stopped. I am envious because my sister got ice cream. They remarked that Ms. TEACHER’s belly is big. [pregnant!] My mom insisted that my dad pay child support.

Examples of Student Generated Sentences

  • Let’s persuaded having extra recess.
  • I have to refrain eating apples. [context- allergy]
  • I cease my dog. [context- dog that was running]
  • I astonishment when I seen my nephew. [context-

meeting nephew for the first time]

  • I intended my X-Box today, but I didn’t get the chance.
  • I was gloating to my uncle when I was beating him up in

a game.

  • I exclude rats going in my house.
  • My brother excuse [for excludes] me from his room.

Example of Scaffolding Menu

If you’re confident the student’s answer is incorrect or incomplete, apply any of the choices below that apply to the situation:

  • Show your confusion (Ex- “I’m confused about…I’m not

understanding…”)

  • Ask the student to give you more information to expand on

incomplete answers.

  • Acknowledge the meaning the student was trying to convey, give

him/her the word(s) for that, give him/her an explanation about why his/her example didn’t quite work.

  • Other options…

If the student did not respond, options… If the student’s answer is correct, options…

slide-25
SLIDE 25

10/8/2019 25

Example ample of L Languag nguage S Scaffo affolded lded Interaction teraction

SLP told a story about herself working on a 1,000 piece puzzle. “I finished! I had perseverance.” Students: gestural response that she used the word correctly. Then SLP asked about if this sentence was just right or not quite right: The p e puzzle w le was a a lot o

  • f perseverance.

everance.

  • Gestural response elicited from students.
  • Discussion about whether the word was used the right way or

not.

  • One student independently tried out: The puzzle was a lot of

guts to continue.

  • Teacher: Can the puzzle have guts to continue? NO!

NO! Can a puzzle have action? NO! NO!

  • SLP: How would I change this sentence so that it makes

sense? Students thinking...Who had perseverance? Yo You! u!

  • Teacher: Can you use TEACHER as the subject in the

sentence? What did she have or show? NAME had perseverance on the puzzle.

  • SLP shaping student’s response: NA

NAME had had per perseverance whe when she she did the did the puz puzzle

Intervention P rvention Procedures:

  • cedures:

Comparison Con Comparison Condition ition

Vocabulary Scenario Technique-General Education 16 (VST-GE16) (Ehren et al., 2010; Spielvogel, 2011)

  • Key features from VST IC map: Same
  • Introduction day routine and materials: Same
  • Review day routine and materials: Some

differences (next slide).

Vocabulary I bulary Inst struction ruction VST-GE16 VST-GE16

Intro Intro days (60 days (60 mins/week) /week)

  • Taught 6 words with at

least 16 encounters of each word

  • Cue/Do/

Do/Review

  • Read the scenario
  • Find meaning clues
  • Think of synonyms
  • Try out one correct

synonym

  • Write the target word

and synonym

  • Write word family

variations

  • Generate sentences
  • Write a correct

sentence

Revi view ew d day ( y (60 m mins/week ns/week)

  • Reviewed 6 words from Intro

Days

  • Cue/Do

Do/Review

  • Do Part 1: Teacher led practice

with word family words

  • Explore meanings, students

generate sentences

  • Show your knowledge:

every student responds and receives feedback DO Part 2: For remainder of 60 minutes, teacher implemented any review activity of her choosing.

slide-26
SLIDE 26

10/8/2019 26

Data Collection: Approvals Data Collection: Approvals

 UCF IRB (Exempt human research)  School District  Principals

Data Collection: Instrumentation Data Collection: Instrumentation

RQs 1 1-3: S Studen udent O Outcomes: R

  • mes: Resear

archer er-c

  • creat

ated ed m measur asures b es based sed

  • n
  • n pre

previo ious voca vocabula lary rese research

  • RQ 1: Synonyms (SYN) measure (19 questions)
  • RQ 2: Words-in-Context (WIC) measure (20 questions)
  • RQ 3: Non-Examples (NON-EX) measure (18 questions)

RQ4: A Adopt

  • ption P
  • n Prog
  • gress I

ss Indicat dicators: R : Resear arch-validated t

  • validated tool
  • ls o

s of the C e Concer ncerns-B

  • Bas

ased A ed Adop

  • ption M
  • n Model (

del (CBAM; H M; Hall & & Hord, 1978, 201 2015)

  • SLP/Teacher Collaboration Innovation Configuration Map

(IC Map)

  • Levels of Use (LoU)
  • Stages of Concern Questionnaire (SoCQ)

Sample Ques Sample Question: Synonyms tion: Synonyms

Directions: Circle the synonym of the underlined word. cease cease a) stop b) go quickly c) go slowly d) repeat

slide-27
SLIDE 27

10/8/2019 27

Sample Ques Sample Question: Words tion: Words-in- in- Context Context

Directions: Complete the sentences using the word box choices for each group of sentences. Choose the be best word from the list

  • f answer choices and draw a line from your word choice answer

dot to the sentence dot.

Answ Answer Choi Choice ces maneu neuvers . re remarks . fierceness ceness . di dispute utes . re regrets .  1) It took 1) It took a a few few car careful ______ ________ ____ ____ ____ ___ _ the toy the toy uns unstuck ck.  2) 2) The b brothers hers have l loud ud abou about who whose tur turn it it is to clean is to clean the d the dish shes.  3) 3) The s e students ma ts made pl de playful l abou about thei their teach teacher’s craz crazy sock socks.

Sample Ques Sample Questio tion: Non-Exam : Non-Example

Directions: Put an X on the line in front of the sentence that does not make sense.

1) ______ ______ My mo mom s m specula eculates t that t the h e hole le i in my my sock ca ck came f me from my cat’s cat’s teet teeth. ______ ______ Anytim ime I I ca can’t f t find my nd my pi pink s sock, ck, I I specula eculate that my t my ca cat som something to d to do wit with it. it. ______ ______ I I looked do down t the h e hall a ll at my my ca cat and s d specula eculated ed her hol hole in m in my soc sock!

CBAM Tools: Behavioral CBAM Tools: Behavioral Indi Indica cators rs

Use Use and and Fide Fideli lity SLP/Teacher Collaboration IC Map LoU as determined by recordings and responses to LoU branching interview questions

Use Users VI VI Re Rene newal V I V Integration IVB Refinem emen ent IVA IVA Rout Routine III III Mechan anic ical al Nonu Nonusers II II Prep Preparatio ion I Orienta tati tion N Nonuse

Lo LoU o

  • f the

the I Inno nnovation (H (Hall & & Hord, 2015 2015, p.

  • p. 108)

108)

slide-28
SLIDE 28

10/8/2019 28

CBAM Tools: Behavioral CBAM Tools: Behavioral Indi Indica cators rs

Branching nching i intervie terview

1.Did you use the COLLAB Protocol? (If yes, ask #2; if no, LoU 0, I, II) 2.Did you make any changes in your use of the COLLAB Protocol? (If yes, user oriented LoU III (Mechanical); if nothing unusual, LoU IVA (Routine); if impact-oriented, LoU IVB, V, VI) 3.Did you coordinate your use of the innovation with other users, including another not in your original group of users? (If yes, LoU V; if no, LoU IVB, V) 4.Did you explore making major modifications or replacing the innovation? (If yes, LoU VI; if no, LoU IVB or V)

CBAM Tools: Affective CBAM Tools: Affective Indi Indica cators rs

  • Stages of Concern Questionnaire (35-item

questionnaire)

  • SoC Quick Scoring Device (convert raw scores to relative

intensities; plot relative intensities for visual analysis)

  • Concerns categories: Unrelated, Self, Task, Impact

Example of a question about Task concerns

(Hall &

& Hord, 2015 2015)

I am conce I am concerned abou about my my inability ility to m to manage nage all all that that the COLL the COLLAB Protoc

  • tocol
  • l r

requires. quires. 1 1 2 2 3 3 4 4 5 5 6 7 7 Irrelevant Not true

  • f

me now Somewhat true of Me now Very true

  • f

me now

Data Collectio Data Collection: n: Assessment Proced Assessment Procedures ures

slide-29
SLIDE 29

10/8/2019 29

Results Results

  • Dosage
  • Missing Data and Intention to

Treat

  • Propensity Score Matching
  • Questions 1-3: Statistical

Analyses

  • Question 4: Adoption

Indicators

  • Fidelity of Implementation &

Inter-rater Reliability

Dosag Dosage

  • All 13 intr

All 13 introducti tion ses sessions and and 7 7 rev review sess sessions com complete ted in in both c classr ssroom

  • oms

s

  • VST I

T Intro troducti tion Da Days ys in in both C th Condi nditions ns

  • Average session length (instructional time) ranged from 30-

36 minutes

  • VST-

T-T+SLP T+SLP R Review D ew Days A Aver erage S age Session L ion Leng ngth W th Weeks 1 eks 1-6

  • Schoo1 1: 68 mins (Review days divided into 2 sessions;

extra session time reflected in transitions)

  • School 2: 52 mins (Review day took place in 1 session;

literacy block was 50 minutes)

  • VST-

T-GE16 GE16 R Revi view D ew Days A ys Aver erag age S e Sessi ssion

  • n Leng

ngth W Weeks 1 s 1-6

  • 60 mins (recorded VST-GE16 and teacher-chosen activities

and logs reported by teachers)

  • All st

All students incl included in in ana analysis is (atte (attended at at leas least half half of

  • f intr

intro sess sessions, half half of

  • f review sess

sessions, and and had had ex exposure t to half half of

  • f

tau taught w words)

Miss Missing Data and Intent Data and Intentio ion To n To Treat (ITT) Treat (ITT)

Collaborat aboration C ion Cond ndit ition M Missing D ing Data

  • Pretest missing data: 5 students
  • Posttest missing data: 1 student missing NON-EX posttest

Comparison C mparison Cond ndit ition M Missing D ing Data

  • Pretest missing data: 5 students missing absent for tasks

1-2 pretests; 4 missing for task 3 pretest

  • Posttest missing data: 1 student

(ITT (ITT)

  • Expectation-Maximization (EM) algorithm
slide-30
SLIDE 30

10/8/2019 30

Propensity Score Matchin Propensity Score Matching

What it What it is: is:

  • Statistics procedure to match students from the

collaboration condition with students from the comparison condition based on predetermined characteristics (Thoemmes, 2016). Rat Rationale:

  • The propensity score allows researchers to analyze

nonrandomized observations, such that it resembles some characteristics of random assignment (Austin, 2011).

Matched Groups Matched Groups

Collabo llaboratio ration Compariso parison n IEP n IEP n Lan n Lang Impa Impairment n EL n EL n Gif n Gifted n DIBE n DIBELS Co Core n DIBE n DIBELS St Strategic n DI DIBELS BELS Intensi tensive 5 1 7 1 18 7 9 4 8 1 15 9 10 Tot Total 34 34

RQ1-3 Analys RQ1-3 Analyses es

  • 1. Two-

Two-Factor Spli r Split Plot A t Plot Analys ysis of

  • f Varia

riance (A (ANO NOVA VA)

  • Statistics assumptions: independence, normality,

sphericity, homogeneity of variance

  • Within-group factor (time; pretest to posttest)
  • Between-group factor (condition; collaboration vs.

comparison)

  • Interaction between within-group (time) and between-

group (condition) factors

  • Cohens f (entered value of partial eta squared into

G*Power calculator for repeated measures) 2.

  • 2. Effe

Effect Size Sizes with with Each Each Con Conditio ion

  • Cohen’s d = mean difference / standard deviation of the

difference scores

(Loma max & x & Ha Hahs-Vaughn, hn, 2012) 2012)

slide-31
SLIDE 31

10/8/2019 31

SYN SYN Two-F Two-Facto tor Split- Split-Plot ANOVA t ANOVA

With Within-group fac factor: There wa was a statistically significant difference in SYN scores from pretest to posttest within the entire matched group.

  • F (1,66) = 122.49, p = .000, power =

100%, Cohen’s f = 1.36 (large) Between een-gro roup f factor: : There wa was not s not a statistically significant difference in SYN scores between groups.

  • F (1,66) = 1.17, p = .284, power = 19%,

Cohen’s f = .13 (small) M SE M SE

95% Co 95% Conf nfid idence I Interval Lower

SYN T SYN Time (p (pre re) 5.95 .6 5.22 6.67 SYN T SYN Time (p (post) 12.13 .5 11.02 13.24 Gr Group: Co Colla llaborat ration 9.44 .5 8.38 10.51 Gr Group: Co Compari mparison 8.63 .5 7.57 9.69

Esti Estimate mated Ma Margi rginal Means al Means (N = 68)

SYN SYN Two-F Two-Facto tor Split- Split-Plot ANOVA t ANOVA

Interact teraction ion o

  • f within

within- grou group and betw p and between- gr grou

  • up fact

p factor

  • rs:

s: There was was not not a statistically significant interaction between time and group

  • n SYN scores.
  • F (1,66)= .380
  • p = .540
  • power= 9%
  • Cohen’s f = .08

SYN SYN Effec Effect Siz Size Compa Comparis ison

(Hattie, 2009)

Co Colla llaborat ration

  • n Co

Compari mparison Pre Pretest M: M: 6.1 6.18 SD: 3.22 M : M : 5.7 5.71 SD: 2.75 Post Posttest M: M: 12. 12.71 SD: 5.14 M: M: 11. 11.55 SD: 3.93 Effec Effect size size withi within ea each ch grou group d = 1.4 = 1.4 (l (large) d d = 1.2 = 1.27

slide-32
SLIDE 32

10/8/2019 32

WIC Two-Factor WIC Two-Factor Split-P Split-Plot A lot ANOV OVA

With Within-group fac factor: There wa was a statistically significant difference on WIC scores from pretest to posttest within the entire matched group.

  • F (1,65) = 54.08, p = .000, power =

100%, Cohen’s f = .91 (large) Between een-gro roup f factor: : There wa was a statistically significant difference in WIC scores between groups.

  • F (1,65) = 4.26, p = .043, power =

53%, Cohen’s f = .26 (medium) M SE M SE 95% 95% Conf nfidence Int Interval Lowe wer WIC WIC T Time (p (pre re) 5.1 .34 4.51 5.88 WIC WIC T Time (p (post) 9.1 .58 7.94 10.26 Gr Group: Co Colla llaborat ration 7.9 .56 6.85 9.07 Gr Group: Co Compari mparison 6.3 .56 5.20 7.46

Esti Estimate mated Ma Margi rginal Means al Means (N = 67)

WIC Two-Factor WIC Two-Factor Split-P Split-Plot A lot ANOV OVA

Interact teraction ion o

  • f within

within- grou group and betw p and between-g

  • group

fact factor

  • rs:

s: There was was a statistically significant interaction between time and group on WIC scores.

  • F (1,65) = 5.27
  • p = .025
  • power = 62%
  • Cohen’s f = .28

(medium)

WIC Effect WIC Effect Size Compa Size Comparison

  • n

(Hattie, 2009)

Co Colla llaborat ration

  • n

Co Compari mparison Pre Pretest M = M = 5.4 5.40 SD = 3.13 M = M = 4.9 4.99 SD= 2.44 Post Posttest M = M = 10. 10.53 SD = 5.02 M = M = 7.6 7.67 SD = 4.45 Effec Effect size size withi within ea each ch grou group d d = 1.3 = 1.34 d = .56 = .56

slide-33
SLIDE 33

10/8/2019 33

NON-E NON-EX Two-Factor Two-Factor Split-P Split-Plot A lot ANOV OVA

With Within-group fac factor: There wa was s a statistically significant difference on NON-EX scores from pretest to posttest within the entire matched group.

  • F (1,65) = 36.32, p = .000, power =

100%, Cohen’s f = .75 (large) Between een-gro roup f factor: : There wa was not s not a statistically significant difference in NON-EX scores between groups.

  • F (1,65) = 1.82, p = .182, power =

26%, Cohen’s f = .17 (small) M SE M SE 95% 95% Conf nfidence Int Interval Lowe wer NONEX NONEX T Time me (p (pre re) 5.70 .34 5.03 6.37 NONEX NONEX T Time me (p (post) 8.57 .50 7.57 9.56 Gr Group: Co Colla llaborat ration 7.61 .49 6.62 8.59 Gr Group: Co Compari mparison 6.66 .50 5.66 7.66

Esti Estimate mated Ma Margi rginal Means al Means (N = 67)

NON-E NON-EX Two-Factor Two-Factor Split-P Split-Plot A lot ANOV OVA

Interact teraction ion o

  • f within

within- grou group and betw p and between- gr grou

  • up fact

p factor

  • rs:

s: There was was not not a statistically significant interaction between time and group.

  • F (1,65) = 1.57
  • p = .215
  • power = 23%
  • Cohen’s f = .16 (small)

NON-EX E N-EX Effect fect Size C Comparis arison

  • n

(H (Hattie, 2009 2009)

Co Colla llaborat ration

  • n

Co Compari mparison Pre Pretest M = M = 5.8 5.88 SD = 2.82 M = M = 5.5 5.53 SD = 2.67 Post Posttest M = M = 9.3 9.34 SD = 4.34 M = M = 7.8 7.80 SD = 3.76 Effec Effect size size withi within ea each ch condit itio ion d = .84 = .84 (l (large) d = .63 = .63

slide-34
SLIDE 34

10/8/2019 34

Adoption Progres Adoption Progress Indica Indicators tors: : Fidelity Fidelity

The collaborating pairs achieved 94% 94% and 96% 96% fidelity of the collaboration process as measured by the SLP/Teacher Collaboration IC map!

Adopti Adoption Progr Progress ss Indi Indica cato tors: LoU LoU

Branching inte intervie iew (Ha (Hall & & Hor Hord, 2015) 2015) 1.Did you use the COLLAB Protocol? (If yes, ask #2; if no, LoU 0, I, II)

  • 3. Did you coordinate your use of the innovation with other users,

including another not in your original group of users? (If yes, LoU V; if no, LoU IVB, V)

  • 4. Did you explore making major modifications or replacing the

innovation? (If yes, LoU VI; if no, LoU IVB or V)

  • 2. Did you make any changes in your use of the COLLAB

Protocol? (If (If yes yes, use user orie

  • riented LoU

LoU III (Me III (Mechanical); ; if if not nothing unu unusual, LoU IV LoU IVA (Rou A (Routine); if impact-oriented, LoU IVB, V, VI)

Adopti Adoption Progr Progress ss Indi Indica cato tors: SoC SoC

Im Impact 6 Re 6 Refo focusing Focus is on the exploration of more universal benefits (e.g., major replacement more powerful alternative). 5 Co Colla llaborat ration Focus is on coordination and cooperation with others users. 4 C Conseque uence nce Focus is on impact on “clients” in the immediate sphere of influence. Tas Task 3 Ma 3 Mana nagement Focus is on processes and tasks of using the innovation and the best resources; concerns are related to efficiency, organizing, managing, and time demands. Se Self 2 Pe 2 Pers rsonal Individual is uncertain about the demands of the innovation, his/her to meet those demands, and his/her role within the innovation. 1 Info 1 Informational A general awareness of the innovation and interest in learning more about it is indicated. Unre Unrelated 0 Unc 0 Unconcerned Little concern about or involvement with the innovation is indicated.

Sta Stages of

  • f Con

Concern (H (Hall & & Hord, 2015 2015, p.

  • p. 86)

86)

slide-35
SLIDE 35

10/8/2019 35

Adopti Adoption Progr Progress ss Indi Indica cato tors: SoC SoC Adopti Adoption Progr Progress ss Indi Indica cato tors: SoC SoC

For All Stakeholders

Implications for Practice

slide-36
SLIDE 36

10/8/2019 36

Implications f plications for r Prac actice: tice: Colla Collabo bora ratio tion

Collaborators can choose from a variety of language-focused content and techniques around which to collaborate Collaboration is one option as a process for creating highly interactive language-scaffolded learning environments:

  • High quality professional learning
  • Coaching around language targets and instructional

techniques

Implications for Practice

Getting Started

  • Define your schema. How are you and your partners

defining collaboration? What are your expectations for the partnership, your students, and for each other?

  • Your ideas for integrating your definition into practice
  • Activity 5

High Quality Professional Learning

Supporting the change process

  • Advocating for what adult learners need through

the ongoing change process (i.e., modeling,

  • bservation, feedback, and tailored supports)

when adopting a new practice

  • Resources needed
  • Activity 5
slide-37
SLIDE 37

10/8/2019 37

High Quality Professional Learning

Creative professional learning models

  • Face to face
  • Online
  • Remote
  • Hybrid

Q & A Post Organizer

1. Discussed the background and rationale for the Mitchell (2017) collaboration intervention study. 2. Defined collaboration as it was used in the research. 3. Presented the methods and results of the study. 4. Modeled and practiced portions of the collaborative vocabulary intervention. 5. Explored implications for future SLP partnerships in schools. 6. Q & A

slide-38
SLIDE 38

10/8/2019 38

References References

American Speech-Language-Hearing Association. (2001). Roles and responsibilities of speech- language pathologists with respect to reading and writing in children and adolescents [Guidelines]. Available from www.asha.org/policy American Speech-Language-Hearing Association (ASHA) (2010). Roles and responsibilities of speech-language pathologists in schools [Professional Issues Statement]. Retrieved from www.asha.org/policy Anderson, R. C., & Freebody, P. (1981). Vocabulary knowledge. In J. T. Guthrie (Ed.), Comprehension and teaching: Research reviews (pp. 77–117). Newark, DE: International Reading Association. Austin, P. C. (2011). An introduction to propensity score methods for reducing the effects of confounding in observational studies. Multivariate Behavioral Research, 46, 399- 424. Beck, I. L., McKeown, M. G., & Kucan, L. (2013). Bringing words to life: Robust vocabulary instruction (2nd ed.). New York: The Guilford Press. Calvert, L, Kocher, C., Paul, P., Throneberg, R., & Davidson, P. (2003). Collaborative or pull-out intervention: Practice and progress at one elementary school. SIG 16 Perspectives

  • n

School-Based Issues, 4, 8-13. Cohen-Mimram, R., Reznik-Nevit, L., & Korona-Gaon, S. (2016). An activity-based language intervention program for Kindergarten children: A retrospective evaluation. Early Childhood Education, 44, 69-78. Cunningham, A. E., & Stanovich, K. E. (1997). Early reading acquisition and its relation to reading experience and ability 10 years later. Developmental Psychology, 33(6), 934-945.

References References

Ehren, B. J. (2008). STRUCTURE Your Reading. Winter Springs, FL: Student Success Initiatives. Ehren, B. J., Zadroga, C., & Proly, J. L. (2010, November). Value added by SLPs to vocabulary instruction with older students. Paper presented at the convention of the American Speech-Language-Hearing Association, Philadelphia, PA. Ellis, L., Schlaudecker, C., & Regimbal, C. (1995). Effectiveness of a collaborative consultation approach to basic concept instruction with kindergarten

  • children. Language, Speech, and Hearing Services in Schools, 26, 69-74.

Farber, J. G., & Klein, E. R. (1999). Classroom-based assessment of a collaborative intervention program with kindergarten and first grade students. Language, Speech, and Hearing Services in Schools, 30, 83-91. Foorman, B., Beyler, N., Borradaile, K., Coyne, M., Denton, C. A., Dimino, J., Furgeson, J., Hayes, L., Henke, J., Justice, L., Keating, B., Lewis, W., Sattar, S., Streke, A., Wagner, R., & Wissel, S. (2016). Foundational skills to support reading for understanding in kindergarten through 3rd grade (NCEE 2016-4008). Washington, DC: National Center for Education Evaluation and Regional Assistance (NCEE), Institute of Education Sciences, U.S. Department of

  • Education. Retrieved from

the NCEE website: http://whatworks.ed.gov. Friend, M. & Cook, L. (2012). Interactions: Collaboration skills for school professionals (7th Ed). Upper Saddle River, NJ: Prentice-Hall. Goddard, Y. L., & Goddard, R. D., & Tschannen-Moran, M. (2007). A theoretical and empirical investigation of teacher collaboration for school improvement and student achievement in public elementary schools. Teachers College Record, 109(4), 877-896. 257-285.

References References

Gough, P. B., & Tunmer, W. E. (1986). Decoding, reading, and reading disability. Remedial and Special Education, 7, 6–10. Graves, M. F. (2016). The vocabulary book: Learning and instruction (2nd ed.). New York: Teachers College Press. Hadley, P. A., Simmerman, A., Long, M., & Luna, M. (2000). Facilitating language development for inner-city children: Experimental evaluation of a collaborative, classroom-based intervention. Language, Speech, and Hearing Services in Schools, 31, 280-295. Hall, G. E., & Hord, S. M. (1987). Change in schools: Facilitating the process. Albany: State University of New York Press. Hall, G. E., & Hord, S. M. (2015). Implementing change: Patterns, principles, and potholes (4th ed.). Upper Saddle River, NJ: Pearson Education, Inc. Halliday, M. A. K. (1994). An introduction to functional grammar (2nd ed.). London: Edward Arnold. Hattie, J. (2009). Visible learning: A synthesis of over 800 meta-analyses relating to

  • achievement. New York: Routledge.

Kaufman, S. S., Prelock, P. A., Weiler, E. M., Creaghead, N. A., & Connelly, C. A. (1994). Metapragmatic awareness of explanation adequacy: Developing skills for academic success from a collaborative communication skills unit. Language, Speech, and Hearing Services in Schools, 25, 174-180.

slide-39
SLIDE 39

10/8/2019 39

References References

Lomax, R.G. & Hahs-Vaughn, D. L. (2012). An introduction to statistical concepts. (3rd ed.). New York: Routledge/Taylor Francis. Mattessich, P. W., Murray-Close, M., & Monsey, B. R. (2001). Collaboration: What makes it work? (2nd Ed) St. Paul, MN: Wilder Publishing Center. Mitchell, M. P. (2017). Effects of collaboration between speech-language pathologists and third-grade teachers on student vocabulary outcomes (Doctoral dissertation). Retrieved from UCF Dissertations and Theses. (ucfl.035330164) Mitchell, M. P, Ehren, B. J., & Spielvogel, J. H. (2017). Vocabulary Scenario Technique- Teacher+SLP (VST-T+SLP). Unpublished protocol. Orlando, FL. Mitchell, M. P., Ehren, B. J., & Towson, J. A. (2016). SLP/Teacher Collaboration Innovation Configuration Map. Unpublished instrument. Orlando, FL. Note: Renamed SLP/Teacher Shared-Creation Collaboration Innovation Configuration Map (2019). National Center for Education Statistics (2012). NAEP achievement levels. Retrieved from https://nces.ed.gov/nationsreportcard/achievement.aspx. National Center for Education Statistics (2012). The nation’s report card: Writing 2011 (NCES 2012- 470). Washington, DC: Institute of Education Sciences, U.S. Department of Education. National Center for Education Statistics. (2015). The Nation’s Report Card: Reading 2015. Washington, DC: Author. Retrieved from www.nationsreportcard.gov. Nelson, T., & Slavit, D. (2008, Winter). Supported teacher collaborative inquiry. Teacher Education Quarterly, 99-116. Nelson, N. W., & Van Meter, A. M. (2006). Partnerships for Literacy in a Writing Lab

  • Approach. Topics in Language Disorders, 26, 55-69.

References References

Nevin, A. I., Thousand, J. S., & Villa, R. A. (2009). Collaborative teaching for educators: What does the research say? Teaching and Teacher Education, 25, 569-575. Organisation for Economic Co-operation and Development (OECD). (2013). Lessons from PISA 2012 for the United States, Strong Performers and Successful Reformers in Education, OECD Publishing. Parks, A. (2012). Understanding the central themes of the Common Core standards and the need to develop digital literacy and 21st century skills in today’s classrooms. The Learning Project. Retrieved from https://www.daleadershipinstitute.com/sites/daleadershipinstitute/files/Digital- Literacy-Common-Core-white-paper-121029.pdf Paul, D. R., Blosser, J., & Jakubowitz, M. D. (2006). Principles and challenges for forming successful literacy partnerships. Topics in Language Disorders, 26(1), 5-23. Roth, F. P., & Paul, D. R. (2006). Foreword. Topics in Language Disorders, 26(1), 2-4. Schrage, M. (1995). No More Teams! Mastering the Dynamics of Creative Collaboration. New York: Currency Doubleday. Shadish, W. R., Cook, T. D., & Campbell, D. T. (2002). Experimental and quasi-experimental designs for general causal inferences. Belmont, CA: Wadsworth Cengage Learning.

References References

Spielvogel, J. H. (2011). Curriculum vocabulary acquisition of 4th graders using a language- sensitive teaching approach. (Unpublished master’s thesis) The University of Central Florida, Orlando, Florida, United States. Stanovich, K.E., Cunningham, A.E., & Feeman, D.J. (1984). Intelligence, cognitive skills, and early reading progress. Reading Research Quarterly, 19, 278-303. Swenson, N. C. (2000). Comparing traditional and collaborative settings for language intervention. Communication Disorders Quarterly, 22(1), 12-18. Thoemmes, F. (2016). PS Matching in SPSS (Version 3.04). Retrieved from https://sourceforge.net/projects/psmspss/ Thomas, D., & Lance, D. M. (2014). Effects of school-wide intervention on literacy learning: The SLPs support. SIG 16 Perspectives on School Based Issues, 15, 45-53. Throneburg, R., Calvert, L., Sturm, J., Paramboukas, A., & Paul, P. (2000). A comparison of service delivery models: Effects on curricular vocabulary skills in the school

  • setting. American Journal of Speech-Language Pathology, 9(1), 10–20.

Vygotsky, L. S. (1978). Mind in society: The development of higher psychological processes (M. Cole, V. John-Steiner, & E. Soubrman, Eds.). Cambridge, MA: Harvard University Press. Wallach, G. P., & Ehren, B. J. (2004). Collaborative models of instruction and intervention. In E.

  • R. Silliman, & L. C. Wilkinson (Eds.), Language and literacy learning in schools, (pp.

39- 59). New York: Guilford.

slide-40
SLIDE 40

10/8/2019 40

References

WestEd (2010). Quality teaching for English learners. Retrieved from https://qtel.wested.org/. World Health Organization. (2010). Framework for action on interprofessional education & collaborative practice. Geneva, Switzerland: Author. Available from http://whqlibdoc.who.int/hq/2010/WHO_HRH_HPN_10.3_eng.pdf Image Slide 5 Active Ingredients- https://www.flickr.com/photos/punkjr/488487553/ Image Slide 26 Share Your Story- https://www.publicdomainpictures.net/en/view-image.php?image=172087&picture=share-your-story

Additional Slides

Fidelity of Implementation & Inter-rater Reliability

Assessment Procedures and Scoring Fidelity Inter-rater Reliability Administration of pretests and posttests Order- 100% Example items- 100% Task items – 83% pretest; 100% posttests 94% Scoring of pretests and posttests N/A SYN: 100% WIC: 100% NON-EX: 99.8% Data entry verification: 100% Scoring SoCQ N/A 100%

slide-41
SLIDE 41

10/8/2019 41

Fidelity of Implementation & Inter-rater Reliability

Intervention Procedures Fidelity Inter-rater Reliability SLP/Teacher Collaboration IC map 94%, 96% 100% COLLAB Steps Steps 1-6: 92%, 100% Steps 7-14: 56%, 78% Steps 10-13: 79%, 88% Steps 15-16: 2/3 pts, 2/3 pts 98% LoU Determination N/A Consensus during discussion Collaboration: VST-T+SLP Ave Intro day adherence: 92%, 95% Ave Review day adherence: 84%, 80% Intro days: agreement by class ranged from 96-100% Review days: agreement by class was 98% and 92% Comparison: VST-GE16 Ave Intro day adherence: 96%, 91% Ave Review day adherence: 93%, 77% Intro days: agreement by class ranged from 96-100% Review days: agreement by class 97% and 88%

Discussion ussion RQ1 RQ1: SYN SYN

Key find Key findings

  • Main effect from pretest to posttest
  • Large effect sizes in each of the conditions

Imp Implic ications

  • Robust vocabulary instruction
  • Continuum of what it means to know a word
  • SYN task demands did not require syntactic

processing.

  • What about students with LLD?

Previous r evious research search: R Robust v ust vocabulary i cabulary instru structi ction o

  • n

defi fini niti tional al ou

  • utco

tcome m meas asur ures

slide-42
SLIDE 42

10/8/2019 42

RQ2 RQ2: WIC WIC

Key find Key findings:

  • Statistically significant interaction on WIC outcomes
  • Larger effect sizes in the collaboration condition

Imp Implic ications

  • SLP contributions to creating highly scaffolded language-

environments

  • Metalinguistic processing demands
  • What about students with LLD?

Previous r evious research search: R Robust v ust vocabu cabulary i lary instru ruct ction on

  • n conte

ntext t (cloze s ze sent ntenc ence) o ) outcomes m

  • mes measur

asures es

RQ3 RQ3: NON- NON-EX EX

Key find Key findings:

  • Main effect from pretest to posttest
  • Larger effect sizes in the collaboration condition

Imp Implic ications

  • SLP contributions to creating highly scaffolded language-

environments

  • Metalinguistic processing demands
  • What about students with LLD?

Previous r evious research search: R Robust v ust vocabu cabulary i lary instru ruct ction on

  • n conte

ntext t (sentenc tence a e anomaly) o aly) outcome

  • me measures

es

RQ4: A 4: Adoption P

  • ption Progress
  • gress Indicators

dicators

During t ring the s e stud udy

  • Fidelity and use: High fidelity of the COLLAB Protocol and

Routine use were possible after 7 weeks

  • Concerns: Higher demands on management because of the

nature of the study Aft After the the stu study

  • Fidelity and use: As reported by collaborators; plan to continue

the partnership with some modifications to the COLLAB Guiding Steps; modifications may result in lower fidelity on the IC map

  • Concerns: management concerns, but also some refocusing

concerns; ongoing committee work led by one of the SLPs to facilitate collaborative language services in classrooms

  • More research needed to look at adoption indicators over a

longer period of time

slide-43
SLIDE 43

10/8/2019 43

RQ4: A 4: Adoption P

  • ption Progress
  • gress Indicators

dicators

Social V ial Validity ty Goal Goals for for coll collaboration: met met Proc

  • ced

edur ures es Acceptable: accountability, structure of the Guiding Steps (weekly repetition), co-teaching aspect Needs improvement: time to implement all of the Guiding Steps was difficult to manage (how could it be done with multiple teachers?), COLLAB Guiding Steps template was complex and overwhelming, uncertainty around how to use the COLLAB Protocol without so many supports built in as part of the study Outc Outcomes Ongoing monitoring of student generalization (are they using the words in their spoken and written language)? Questions about how to best serve students who struggle. Students who need above and beyond supports (e.g., IEP) will still need intensive supports beyond scaffolds in the classroom environment resulting from collaboration.

Limita tati tion

  • ns
  • 1. Non-random assignment
  • 2. Small sample of students
  • 3. Some missing data
  • 4. Time variability with session

length between classes

  • 5. Some missing and incomplete

attendance logs

  • 6. Limited number of students

with LLD and EL in each condition

  • 7. Researcher-created

vocabulary measures

  • 8. Small number of SLP and

teacher collaboration pairs

  • 9. Potential for researcher bias

(researcher’s professional connections with SLPs)

  • 10. Researcher was in some

classrooms as support role during parts of pretest and posttest administration when assessors out sick

  • 11. Potential for contamination

when other adults were in classroom during VST sessions

  • 12. No control group (or

comparison “typical instruction”) group

Implicat plications for ions for P Practice: ce: Collab llaborat ration

  • n

Th There a are e vario rious i s impli plications f ns for u use of

  • f the C

e COLLAB LLAB Protoc

  • col
  • l i

in s school

  • ol s

settings gs.

  • SLP/Teacher Collaboration IC map is intended to

be flexible enough for use with any grade level and with any literacy instructional focus.

  • Application within Multi-Tiered System of

Support (MTSS) and Response to Intervention (RTI models)

  • Informs some of the roles of SLP in RTI
  • Utility within interdisciplinary and discipline-

specific Professional Learning Communities (PLCS)

  • Potential for use in action research
slide-44
SLIDE 44

10/8/2019 44

Implications for Practice: Vocabulary Instruction

The VST is one evidence-based option for vocabulary instruction in a comprehensive literacy program.

  • Standards for academic vocabulary knowledge at all grade levels are

integrated throughout the Common Core State Standards.

  • Teaching academic vocabulary is a recommended practice for

intensifying literacy instruction. The VST can be used a lens to clarify what robust vocabulary instruction entails.

  • In recruiting efforts, there was a resistance to incorporate vocabulary
  • instruction. There was a perception that teaching vocabulary only means

teaching specific words (seen as a discreet skill).

  • Vocabulary instruction requires highly interactive practice with a focus on

nuance that is often missed (requires modeling and practice).

  • All participants described new language-scaffolding habits they developed

as a result of teaching vocabulary using the VST.

Recommendations f mmendations for r Future R re Research search

Research A ch Agenda N enda Needed: eded: Effects o cts of Colla llaboration

  • ration

betwee tween E n Educators o ucators on Student O ent Outcomes tcomes

  • A variety of grades, language-focused targets and

techniques and literacy outcomes

  • SLPs and teacher collaboration where partners determine

their own instructional focus, techniques, and assessment procedures

  • SLPs and teacher collaboration involving a greater

number of SLP and teacher pairs

  • Different combinations of language/literacy experts on

student outcomes (e.g., SLPs and special education teachers, special education teachers and general education teachers, etc.).

Recommendations f mmendations for r Future R re Research search

  • Use of the protocol specifically with students who struggle

(e.g., in classrooms where students are clustered by ability level)

  • Effective collaboration models that have a likely chance of

being used by SLPs and teachers in their settings.

  • Dosage!
  • More trials are needed to fine tune the SLP/Teacher

Collaboration IC map with input from experts in educational collaboration.

  • Use of SLP/Teacher Collaboration IC map with modified

COLLAB Guiding Steps or other versions of guiding steps (e.g., from existing theoretical collaboration models)

slide-45
SLIDE 45

10/8/2019 45

Recommendations f mmendations for r Future R re Research search

  • Research investigating the extent to which language scaffolding

habits changed as a result of collaborating with an SLP.

  • Continued research on the VST used with different age groups;

analysis should incorporate analysis of student performance in by under-researched population (e.g., LLD, EL).

  • Fut

Future rese research are areas in in voca vocabulary rese research

  • Interventions in their authentic settings
  • Dosage and intensity
  • Content validity of researcher-created assessments
  • Assessments that measure effects of vocabulary instruction
  • n syntax (e.g., Foorman et al., 2016).

Limit mitations &

  • ns & Delim

limit itat ations ions

Limitatio mitations

  • 1. Recruitment yielded only

2 collaboration pairs of SLPs and teachers

  • 2. No random assignment
  • 3. Small sample size of

students (n = 34 collaboration; n = 34 comparison)

  • 4. Small sample size of

subgroups (LLD, EL)

  • 5. Some missing pretest

and posttest data

  • 6. Researcher-created

instruments Delimitatio limitations: s:

  • 1. Decision to study literacy

partnerships between SLPs and teachers

  • 2. Decision to incorporate a

word study intervention

  • 3. Decision to study effects
  • n third grade students
  • 4. Inclusion criteria to

participate in the collaboration condition

  • 5. All students included in

analysis (not just LLD)

  • 6. Typical classroom setting

used

Assumptions sumptions

  • Collaborating SLPs and teachers will design word study instruction,

scaffold academic language, and intensify instruction differ erently a ently as part

  • f a
  • f a proce
  • cess of shar
  • f shared creat

creation than individual educators would do alone.

  • Students who struggle with literacy have fewe

fewer Tier Tier Two Two/ac academic voca vocabu bulary (Beck et al., 2013) words in their academic vocabulary repertoire.

  • The word study instruction and language scaffolding within the

collaboration intervention will support students’ ability to mak make mean meaning ing fro from, and and use use, acad academi emic vocab vocabulary words when reading, writing, speaking, and listening (Beck et al., 2013).

  • The more academic language knowledge of vocabulary individuals have,

and the more skills they have to glean meaning from word structure and content, the more the more avai available d desi signs the they have have for for makin making mean meaning (NLG, 1996).

  • Building an academic vocabulary will serve as a fou

foundation for for acq acquiring new vocabulary lary knowledge a e and w d word s study s y skills ills (Lane & Allen, 2010).

slide-46
SLIDE 46

10/8/2019 46

Si Signifi gnifican ance ce

Problem Attemp ttempte ted Solution De Defini ning ng active ingredients and impleme implementi ting them with fidelity

  • Developed blueprint that defines active

ingredients/key features.

  • Developed guiding steps to achieve fidelity of

active ingredients. Asse sessi ssing th ng the effec effectiveness of the collaboration

  • Investigated effects of independent variable:

Instructional condition (Collaboration/Treatment Comparison) on dependent variables (student

  • utcomes on 3 vocabulary measures).

Determin inin ing p g practicabi bility lity

  • Measured indicators of progress toward adoption

through the use of research validated tools to measure adoption of new practices in research).

Summ Summar ary of Partic

  • f Particip

ipan ant t Activ Activities es

Collaboration aboration/Trea Treatment T tment Teachers hers and and SLP SLPs Comp Comparison Teach Teachers Be Befo fore In Interv rventio tion  Professional learning modules  SoCQ  COLLAB Steps 1-5  Teachers rated vocabulary  Pretests (COLLAB Step 6)  Professional learning modules  Teachers rated vocabulary words  Pretests

Summ Summar ary of Partic

  • f Particip

ipan ant t Activ Activities es

Colla llabo borati ration/

  • n/Tre

reatm atment nt Teache hers rs a and S SLPs Ps Compari arison T Teache hers rs Du Duri ring In Interventio Repeated for Weeks 1-6  COLLAB Steps 7-14; 30 minutes/week for beyond class-time activities  Introduced 6 vocabulary words (VST- total of 60 minutes  Reviewed 6 vocabulary words (VST-T+SLP); total of 60 minutes  Displayed classroom word wall exhibit for additional 60 minutes each week Week 7  Only COLLAB Steps 10 and 13  Introduced and reviewed 3 words instead of  Displayed classroom word wall exhibit for additional 60 minutes each week Repeated for Weeks 1-6  Introduced 6 vocabulary words GE-16); total of 60 minutes  Reviewed 6 vocabulary words GE16 and teacher choice); total of minutes  Displayed classroom word wall for additional 60 minutes each Week 7  Same as above, except introduced and reviewed 3 words instead of 6  Displayed classroom word wall for additional 60 minutes each Aft After In Interventio  Posttests (COLLAB Step 15)  COLLAB Step 16  SoCQ  Posttests