EMAresearch.org mSuccess: A smartphone-based growth mindset and social belonging intervention Tim Steenbergh, Doug Daugherty, Chris Devers & Lorne Oke 36 th Annual Conference on the First Year Experience
Try the App • Search RealLife Exp on the App Store or Google Play • Download the app • Create a free account • Go to Download Page • Select FYE2017 for conference experience • Select FYE 2017 mSuccess Demo for mSuccess intervention
Disclosure Drs. Daugherty, Oke and Steenbergh own equity in LifeData LLC, a mobile software provider. www.lifedatacorp.com
Acknowledgements We are gratefully acknowledge the following individuals who helped us conduct this study. Brian Tietje Cal Poly Amy Baldwin & Kurt Boniecki University of Central Arkansas Gwen Sharp & Tony Scinta Nevada State College Ian Slater Indiana Wesleyan University
Session Overview • Background: Mobile tech, GMS, and SB • Description: A first year mobile intervention • Findings: Grades & retention • Discussion
E cological M omentary A ssessment Data gathering strategies designed to offer greater clarity by repeatedly assessing people in the context of everyday life.
Billy Mills
Surveys are like pictures Billy Mills, 1964 Olympic Gold Medalist- 10,000m
EMA is like a movie
Reactivity The tendency to change our behavior when it’s measured
Ecological Momentary Intervention • Intervention strategies delivered in the moment and context of daily life. • Can be used with a wide range of audiences to provide virtual coaching / mentoring.
Background Our Story: • Interests in positive psychology, student success and mobile technology. • Recognized the potential of EMA/EMI. • Sought digital strategy for implementation and turned to the app world. • Connected mobile to GMS & SB.
iHabit 2012 LifeData 2017
mSuccess Components Growth Mindset (GMS) “Some people assume that a person is born smart, average, or dumb. But research shows that the brain is more like a muscle - it gets stronger when you exercise it .” (Dweck, 2008)
mSuccess Components Social Belonging “Almost all freshmen at IWU and other schools worry about fitting in and being accepted by other students. So this is a common concern .” (adapted from Walton & Cohen, 2011)
mSuccess Check-In
Social Belonging Prompts
Growth Mindset Prompts
mSuccess 2015 (v.1.0) • 71 students recruited from several remedial English/Math classes for at-risk freshmen • Offered $10 for participation and an additional $15 for completion of the posttest • Smartphone-app intervention provided in the first 2 weeks of the semester with booster session offered in Week 7.
mSuccess 2015 Findings • First semester GPA was positively correlated with – engagement with app-delivered GMS material ( r = .25, p < .05) – engagement with SB material ( r = .32, p < .01) – overall app use ( r = .30, p < .01). • Stronger correlations between app engagement and GPA ( r =.47, p < .05) for 23 minority students. • No difference in retention rates for students who received intervention vs. those who did not
mSuccess 2016 • Further adapted GMS/SB intervention for mobile delivery • Invited other like-minded colleagues to join in mSuccess 2016.
Study Design SB+GMS Randomization (n=385) New Students (N=767) Control (n=382)
mSuccess 2016- IWU
Study Design SB+GMS 200 App Downloads (n=385) Randomization New Students (N=767) Control 170 App (n=382) Downloads
Study Demographics- Race 350 300 250 200 150 100 50 0 Asian Black Hawaii/ Hispanic Multiple Intern'l White Pac.Isl. Participated Declined
Study Demographics- Gender 300 250 200 150 100 50 0 Female Male Participated Declined
Study Demographics- First Gen 250 200 150 100 50 0 Not First Generation First Generation Participated Declined
12-Day Intervention SB+GMS Engaged • 2 notifications/ day • GMS Prompts M,W,F 128/200 (64%) • SB Prompts T,R,S Control Engaged • 2 notifications/ day • General Information 110/170 (65%) Prompts Mon-Sat
Fall Semester GPA 3.9 t 53 = 2.66, p < .01 3.7 t 368 =1.26, p = .10 3.41 3.5 3.27 3.3 3.16 3.1 2.92 2.9 2.7 2.5 Control mSuccess Control mSuccess Minorities (=55) All ( N =370)
Spring Semester Retention Rates 100% χ 2 1 =2.04, p = .15 χ 2 1 =1.13, p = .29 94% 95% 92% 90% 90% 85% 83% 80% 75% 70% Control mSuccess Control mSuccess All ( N =370) Minorities ( n =55)
App Engagement (Average Notifications Completed) 20 15 9.5 10 6.7 5 0 Control mSuccess t 236 = 3.10, p <.01
mSuccess Engagement- Race (Average Notifications Completed) 10 8.7 8 6.4 6 4 2 0 White Minority t 125 = 1.45, p =.07
mSuccess Engagement- Gender (Average Notifications Completed) 20 15 10 7.5 6.4 5 0 Female Male t 126 = .85, p =.40
mSuccess Engagement- First Gen (Average Notifications Completed) 20 15 10 5 0 No Yes t 126 = .84, p =.40
Discussion • Mobile GMS+ SB intervention showed promise • Greater benefit for minority students- similar to previous findings (mSuccess, 2015; Walton & Cohen, 2011) • Benefits of mobile interventions GPA of European-American – Cost-effective and African-American Students Receiving Social – Scalable Belonging Intervention – Easily tailored – Allow EMA Walton & Cohen, 2011
Discussion • Mobile GMS+ SB intervention showed promise • Greater benefit for minority students- similar to previous findings (mSuccess, 2015; Walton & Cohen, 2011) • Benefits of mobile interventions – Cost-effective – Scalable – Easily tailored – Allow EMA
Real-Time Monitoring Self-Efficacy mSuccess 1 100 Self-Efficacy Control 1 100
Discussion • Relatively low engagement with GMS + SB content appeared impactful • Implementation strategies are critical for engagement – Email invitations were less successful, in-person invitations linked to FYE had higher participation – Need more research on factors related to mobile engagement
Replication • Plan to launch mSuccess 2017 at IWU • Contact us if you’d like to learn more about opportunities to participate in mSuccess 2017: tim.steenbergh@indwes.edu lorne.oke@indwes.edu doug.daugherty@indwes.edu
Every passion has its destiny. - Billy Mills
Try the App • Search RealLife Exp on the App Store or Google Play • Download the app • Create a free account • Go to Download Page • Select FYE2017 for conference experience • Select FYE 2017 mSuccess Demo for mSuccess intervention
Recommend
More recommend
