Evaluation of Impact
- f
e-Infrastructure Investments : a UK view point
Jane Nicholson, Head of Research Infrastructure and International, Engineering and Physical Sciences Research Council, UK
Evaluation of Impact of e-Infrastructure Investments : a UK view - - PowerPoint PPT Presentation
Evaluation of Impact of e-Infrastructure Investments : a UK view point Jane Nicholson, Head of Research Infrastructure and International, Engineering and Physical Sciences Research Council, UK Over view What is EPSRC and how do we define
Evaluation of Impact
e-Infrastructure Investments : a UK view point
Jane Nicholson, Head of Research Infrastructure and International, Engineering and Physical Sciences Research Council, UK
One of the seven UK Research Councils that work together as RCUK EPSRC is the main UK government agency for funding research and training in engineering and the physical sciences EPSRC invests around £850m a year in world class research and training to promote future economic development and improved quality
EPSRC is key to tackling challenges such as energy security, climate change, our ageing population, crime and economic resilience EPSRC is generating the fundamental knowledge and skilled people essential to business, government and other research organisations
Our strategy has 3 clear goals Delivering impact Shaping capability Developing leaders
We will ensure excellent research and talented people deliver maximum impact for the health, prosperity and sustainability of the UK We will build strong partnerships with
research and inform our direction We will promote excellence and impact, and ensure it is visible to all
WE SUPPORT AROUND
ACADEMIC RESEARCHERS OUR £4BN PORTFOLIO HAS LEVERAGED AN ADDITIONAL
IN BUSINESS AND COLLABORATOR CONTRIBUTIONS WE HAVE SUPPORTED
HIGHLY SKILLED POSTGRADUATES TO INDUSTRY AND THE PUBLIC SECTOR OVER THE PAST DECADE AROUND
OF OUR PORTFOLIO IS MULTIDISCIPLINARY SECTORS DEPENDENT ON ENGINEERING AND THE PHYSICAL SCIENCES ACCOUNT FOR
OF GDP AND
OF MANUFACTURING EXPORTS WE COLLABORATE WITH MORE THAN
COMPANIES AND MORE THAN
PUBLIC BODIES INCLUDING 12 GOVERNMENT DEPARTMENTS
RCUK Managing agent for provision of shared national HPC systems Ran core programme of RCUK e Science programme Have previously joint funded with JISC the development of the National Grid Service (UK NGI in EGI) Fund software development activities in Engineering and Physical Sciences Fund research programmes of users of e-infrastructures
HECToR – the UK National HPC service. Based on a 366 TF Cray XT6 system plus 114TF Cray XT4 System. Operated by EPCC, University
provided by NAG Ltd. Funded by EPSRC,NERC and BBSRC
EPSRC funds the The Software Sustainability Institute (SSI). Run by researchers from the University of Edinburgh, Manchester and Southampton , it works in partnership with research communities to identify key software that needs to be sustained. SSI’s vision is to make software useful for future generations of researchers by improving usability, maintainability and quality. This increases research productivity by enabling more people to use software, delivers added value by leveraging our expertise and connections, and ensures researchers can continue to use their chosen software as a cornerstone of their research. SSI works with groups to facilitate the self-sustainability of research software within the communities that develop and use it, drawing on a skilled team based at the Universities of Edinburgh, Manchester and Southampton. This team includes talented individuals with a breadth of experience in software development, project and programme management, publicity and dissemination, and community engagement.
EPSRC sponsored researchers achieve a higher citation rate of 1.6 compared to the UK average
Figures from 2009/10 Annual Report
Around 12,300 of the highly-skilled postgraduates supported by EPSRC have moved on into careers in industry and the public sector in the past decade Career Path studies - comparision of average salaries vs. PhD salaries First Destination statistics for PhD students – working with learned societies to track career paths Number of research students who have used facilities – e.g, use of National Grid Service
Figures from 2009/10 Annual Report
Nearly 40% of the research and training we fund is directly involved in collaboration with industry To date, 132 follow-on projects worth £11.5 million have been supported Our Partnership with the Technology Strategy Board has led to over 270 research projects being sponsored and a joint portfolio of over £250 million Our 28 Strategic Partners bring in £77 million of additional funding
Figures from 2009/10 Annual Report The prototype magnetometer.
HECToR has 1400 UK academic registered users :40% of the users from the Engineering and Physical sciences area have industrial collaborators Over 800 attendees on HECToR training courses to date , OMII has delivered 111 training events to 2000+ researchers The Taverna workflow tool supported by the e-Science programme has had 65,000 downloads and has been used by 350 organisations and 23 companies in 35 countries. The EPSRC funded OMII has supported software deployment on NGS sites plus on Lyceum, Legion,ECDF and Iridis campus infrastructures plus on TeraGrid, NAREGI, D-Grid and EGEE
Funding to the University of Newcastle by the e-Science Programme led to substantial regional impact through collaboration with Arjuna
have worked for Arjuna, one PhD, many MScs and a Business Development Manager have returned from Arjuna to Newcastle University, and the institutionalised network of knowledge transfer to local companies has led to “cutting-edge technologies:” e.g. web services, grids and clouds and the regional involvement of Red Hat, Amazon and Microsoft. Newcastle University estimates that Arjuna/RedHat have contributed ~£16M GVA to the regional economy.
Nationally, the Distributed Aircraft Maintenance Environment Project (DAME) partnered with Rolls-Royce, Data Systems and Solutions and Cybula Ltd to use e-Science to reduce engine maintenance times and to improve the interoperation of the maintenance team. The technologies developed are now used on Rolls-Royce Trent engines and the result was a spin-off company: Oxford Bio-Signals (OBS).
Two EPSRC funded EngD students from the University of Southampton developed the technology used in the building of Amy William’s gold medal winning skeleton sled
Credit: Sarah Winterflood/UK Sport
Aircraft pressure relief valves are used to protect the fuel tanks of wide-body civil aircraft from over-pressurization. The relief valve
underside side of the wing skin. At typical approach speeds of around Mach 0.3, the flow past the cylindrical cavity can become unsteady. This produces an unwanted tonal contribution to the airframe landing
in consultation with Airbus France, as part of the EU programme AeroTraNet. Dept of Engineering, University of Leicester, UK
Medical science is increasingly turning to computational models to study the possible effects of drugs and surgical interventions, before moving on to patient trials. One active area of research is in heart modelling. Researchers at the Oxford e-Research Centre (OeRC) and EPCC (University of Edinburgh), will be using HECToR to optimise heart-modelling
integration of computer simulation with the operating theatre and could, ultimately, lead to personalised medicine.
NAG HPC experts, working under Research Council Funded NAG’s Computational Science and Engineering (CSE) support service for HECToR, the UK’s national academic supercomputing facility, have
architectures, resulting in a performance increase of a factor of four, potentially saving £760k in computing resources on HECToR for a single one year research project, with several million pounds of savings when applied to future research on HECToR and other supercomputers used to run CASINO.
Dr Andrew Coward, who is the manager of the Global Ocean Modelling Consortium on HECToR estimated that their group used around 6M AUs running NEMO last year. Reducing the wall clock time of NEMO by up to 25% will result in a saving in notional cost of AUs by as much as £95,000 per year (up to £400,000 for the remainder of the service), for
Other consortia using NEMO on HECToR have used around 40M AUs
main code base, then these other users could benefit too, leading to the possibility of multi‐million pound savings overall.
UK e Science Programme funding for projects ran from 2001- 2007 Total of £250+M investment made by six UK Research Councils. Review planned for after close of programme to be able to evaluate impact and longevity of actions. Review took place December 2009. International review approach chosen given breadth and range of research supported plus desire for independent view of progress
International Panel formed of 16 academics and industrialists Data and evidence of activity collected to produce a comprehensive data summary. Panel spent a week in UK in December 2009 – interacting with researchers, stakeholders and produced a report of findings and recommendations. RCUK grateful to Prof. Dan Atkins ( panel chair) and the Panel for the time and energy they put into the review and report preparation.
The role of the review panel was to: assess the impact of the programme on research areas nationally and internationally, on broader wealth creation and quality of life, and on e- Science itself; assess and compare the quality of the UK research base in e-Science with the rest of the world via triangulation of data, panel and community perception; comment on the added value of this programme; and present findings and recommendations about the strength, weakness and opportunities for the future to the Research community and Councils.
What has been the impact (accomplished and potential) of the UK e- Science Programme? To what extent has the research undertaken through the e-Science Programme benefited the UK economy and our global competitiveness? To what extent did the research undertaken through the UK e-Science Programme address key technological/societal challenges? What evidence is there to show that the UK e-Science Programme supported the development of a creative and adventurous research base and portfolio?
The Panel identified three ways in which projects had a substantial economic impact : Direct involvement of industry from the inception of the project University led linkages with industry during and after development of new technologies Entreprennurial investigators The panel also assessed science quality, outcomes for human capital and made recommendation for the future.
Programme attracted £20 million in industrial collaboration and £7.1 M cash and in kind industry transfer Programme resulted in 138 stakeholder collaborations 30 licenses or patents 14 spin off companies 103 key results taken up by industry
Improvements in prediction of extratropical storms by numerical weather prediction using storm identification and tracking software led to a reduction of in the flood and wind related damage due to storms Comment in other areas e.g.healthcare still to early to identify the full effect. “
Knowing who your “users” are. Measuring the importance of the contribution of the use of e-infrastructure to the final science output. Identifying the added value of the infrastructure investment – benefit of 1PT vs. 900TF computer etc. Capturing the data over long time periods
For effective evaluation of impact need to use a range of approaches to be able to capture the benefit of investment in e infrastructures For both quantitative and qualitative information need to start capturing this from the start of projects and programmes – trying to find information retrospectively is hard and extremely time consuming Need to include both quantitative and qualitative metrics to be able to demonstrate the whole range of impacts Need to collect this information often beyond the life of project so an on going activity For e-infrastructure can exploit e-tools to capture data if plan for this in advance.
The more you know the user base of the infrastructure the easier identifying evidence of impact be it academic, social or economic will be. Reports and Information on EPSRC available at http://www.epsrc.ac.uk and examples of case studies at http://www.impactworld.org.uk