Industry/University Cooperative Research Centers Research Updates from NCSU IUCRC Evaluation Team IUCRC Evaluation Project 1 June 2013
Recent Evaluation Work Products Industry/University Cooperative Research Centers Graduated Center Case CRCs and Technical Innovation Studies Dr. McGowen’s Sustainability Study IUCRC Economic Impacts Directors & Human Capital Report IUCRC Evaluation Project June 2013 2
Industry/University Cooperative Research Centers Program Sustainability for Cooperative Research Centers: A Longitudinal Analysis Lindsey McGowen, Ph.D. North Carolina State University June 7, 2013 June 2013 IUCRC Evaluation Project 3
Purpose Industry/University Cooperative Research • To assess the current status of Centers formerly funded Centers • To identify sources of variability in Center sustainability – Within Center change vs. between Center differences • To determine what factors predict program sustainability over time June 2013 IUCRC Evaluation Project 4
Predictors in Multiple Domains Industry/University Cooperative Research Centers • Environmental • Alignment across – Social, political, and economic levels is key for program sustainability • Organizational • Variables at each level – Resource base, infrastructure, should be tailored to stakeholder support • Program the program – Fit, adaptability, Environment implementation, resources, staff support Organization • Individual Program – Champion, leadership, Individual leadership transitions June 2013 IUCRC Evaluation Project 5
New for this Study: New DVs, New IVs, New Analyses Industry/University Cooperative Research • Extended assessment of DVs over time Centers • New DVs – New continued activity measures • New IVs – Added new psycho-social predictors in the program domain – Added new individual domain variables • New analytical approach – MLM – Predict changes over time – Test the life cycle perspective by measuring IVs over time • Average level (mean) and trajectory (slope) June 2013 IUCRC Evaluation Project 6
Design Industry/University Cooperative Research Centers • Descriptive & Predictive Time-series Design IVs (Mean & Slope) Grad DVs Years -2 -1 0 1 2 3 4… 2009 2011 2011 2012 IVs O O O X Status O O O O… O O O O Other DVs O O • Staggered cohort Grad Year Anchored – Effects timing of data collection relative to years since funding ended June 2013 IUCRC Evaluation Project 7
Sample Industry/University • Participants Cooperative Research Centers – Sampling Criteria (N = 83; new N = 14) • Center received an NSF I/UCRC operating grant; • Center no longer funded by an NSF I/UCRC operating grant; • Center graduated and merged with a newer Center; • Center has not received NSF I/UCRC money for at least 1 year June 2013 IUCRC Evaluation Project 8
RQ1: What is the status of I/UCRCs after their grants end? Industry/University Cooperative Research Centers 90.00% Status is changing over time. Need to test this 79.50% statistically… 80.00% 70.00% 62.90% 59.10% 60.00% 50.00% 40.90% 37.10% 40.00% 30.00% 20.50% 20.00% 10.00% 0.00% 1 Year post-NSF Status 2009 Status 2012 Status Operating Not Operating June 2013 IUCRC Evaluation Project 9
RQ3: To what extent has the Center sustained itself in terms of continued program activities, structures, and outcomes? Industry/University Cooperative Research Centers Table 6. Descriptive Statistics for Continued Program Activities, Structures and Outcomes for Sustained Centers Compared to Actively Funded I/UCRCs Sustained Centers Currently funded I/UCRCs N M SD N M SD df F Continued Activities 46 0.73 0.37 48 0.89 0.15 93 7.99** Continued Structures Faculty 41 14.29 11.6 54 13.59 11.44 94 0.09 Members 41 47.2 185.39 54 19.07 15.01 94 1.24 Budget (in thousands) 40 3500.62 5575.32 54 2118.53 3031.28 93 2.38 % Overhead Discount 41 39.71 16.07 54 43.88 10.24 94 2.38 Continued Outcomes Graduate Students 40 26.13 30.82 54 28.85 40.99 93 0.13 Graduate Degrees 39 41.44 95.5 54 8.78 13.76 92 6.16* Publications 40 80.47 174.34 54 21.67 28.36 93 5.95* Presentations 38 66.95 125.26 54 30.76 28.18 91 4.22* IP 40 6.95 14.95 54 1.95 3.19 93 5.68* * p < .05, ** p < .01 Changing model; only the strong survive June 2013 IUCRC Evaluation Project 10
Program Impacts Industry/University Cooperative Research Centers Total Budget Total Members 250 200 2500 150 100 2000 50 0 1500 02 03 04 05 06 07 08 09 10 11 12 Total Students 1000 3000 2000 500 1000 0 0 02 03 04 05 06 07 08 09 10 11 12 02 03 04 05 06 07 08 09 10 11 12 June 2013 IUCRC Evaluation Project 11
RQ4: What factors predict current Center status? Industry/University Cooperative Research Centers Table 8. Logistic Regression Predicting Current Status Exp(B) Tolerance VIF Individual Centered Slope % Director time spent on other 1.12* 0.99 1.02 Environmental Level Centered Mean US industry spending on R&D (1Bill) 1.02*** 0.99 1.01 Centered Slope US industry spending on R&D (1Bill) 1.08* 1 1 Nagelkerke R 2: 0.29 Model χ 2 (3): 18.28*** *** p < .01. ** p < .05. * p < .1 • Full model accounted for 29% of the variance in current status • For each additional % increase in the slope of time the director spent on other activities the odds of a Center being currently sustained increase by 12%. • For each additional billion dollars in the average level of US industry spending on R&D the odds of a Center being currently sustained increase by 2%. • For each additional % increase in the slope of US industry spending on R&D the odds of being sustained increase by 8% June 2013 IUCRC Evaluation Project 12
RQ5: What predicts Center status? Industry/University Cooperative Research Centers Table 9. Logistic MLM Predicting Average Center Status Controlling for Years Funded and Years Since Graduation Estimate SE Odds Ratio LCI UCI Fixed Effects Continued Activities Level, β 0 Intercept, γ 00 7.94 4.74 2817.58* 1.15 6904300.96 Control Variables Years Funded , γ 01 0.23 0.27 1.26 0.81 1.98 Years Since Graduation , γ 02 -0.46 0.36 0.63 0.35 1.13 Program Domain Centered Mean Graduates Hired by Members , γ 05 2.2 1.28 1.11 74.04 9.07* Random Effects: Center Level, t 00 36.57*** 2 Random Effects: Time Level, σ 0.10*** Deviance 60.19 *** p < .01. ** p < .05. * p < .1 • For each additional student hired by a member firm, Centers are 9.07 times more likely to continuing operating on average. • Model accounted for 66.73% of the within Center change and 78.38% of the between Center differences in the odds of continuing to operate on average. June 2013 IUCRC Evaluation Project 13
RQ5: What predicts change in Center status over time and between Center differences in change? Industry/University Cooperative Research Table 10. Logistic MLM Predicting Change in Center Status Over Time, • The odds of a center Centers Controlling for Yrs Funded and Yrs Since Grad. continuing to operate Estimate SE Odds Ratio LCI UCI Fixed Effects over time are higher for Continued Activities Level, β 0 those Intercept, γ 00 0.21 27.31 1.23 0.00 4.00 Control Variables • With more years of Years Funded, γ 02 1.49 0.67 4.42** 1.47 13.31 I/UCRC funding Years Since Graduation, γ 03 1.65 2.33 5.22 0.11 241.2 Individual Domain • With more members Centered Director Turnover, γ 04 -6.85 2.83 0.001** 0.00 0.11 Program Domain • Graduating when US Centered Mean Members, γ 05 1.69 0.91 5.41* 1.21 24.19 industry spending Environmental Domain on R&D is increasing Centered Slope US Industry 0.74 0.38 2.10** 1.13 3.9 Spending on R&D ($1Bill) , γ 06 • The odds of continuing Change Slope β 1 to operate over time Intercept (Time), γ 10 -4.36 0.03 0.01*** 0.01 0.01 Random Effects: Center Level, t 00 are lower for those with 530.86*** 2 Random Effects: Time Level, σ 0.003*** more director turnover Deviance -- June 2013 IUCRC Evaluation Project 14 *** p < .01. ** p < .05. * p < .1
Discussion: Overview Industry/University Cooperative Research • Centers Study extends state of knowledge about program sustainability – Extends theory to CRCs – Examines change over time using MLM – Tests a lifecycle framework • Descriptive results show that 60% of Centers are still operating – Only a small decrease in N of Centers operating since 2009 • Continued activity, structure, and outcome measures reflect different levels of sustainability multidimensional construct • Predictive analyses were able to account for significant within and between Center variance – New variables measuring stakeholder support and leadership characteristics were significant predictors of various sustainability outcomes – Supports a levels of analysis frame work significant predictors in each domain June 2013 IUCRC Evaluation Project 15
Recommend
More recommend
