CREDC: Research Lifecycle Support Framework SEEMITA PAL & KEVIN GLASS CREDC Pacific Northwest Industry Workshop November 29 th , 2017
Goal of This Presentation What we hope to accomplish Develop the case for the Research Lifecycle Support Framework Develop the case for Verification and Validation Provide an overview of the Framework What we would like from you Suggestions for improvement CREDC Pacific Northwest Industry Workshop March 29, 2017 2
Motivation Packaging & Identification sharing of of industry Guide researchers research needs outputs throughout the project lifecycle to Integration of produce verifiable, Validation of existing user research & reproducible and requirements standards reusable research catering to the Utilization of Adoption of industry needs tools, verified methods & processes datasets March 29, 2017 3 CREDC Pacific Northwest Industry Workshop
Role of the Framework in Guiding Researchers Streamlined procedure What is the Early detection of faults importance of this research activity? Improvement of quality What constitutes Less rework the right solution ? Reduced costs What resources Aids technology are available? transition CREDC Pacific Northwest Industry Workshop March 29, 2017 4
What Constitutes the Right Solution? Verification Validation “building the system “building the right the right way?” system?” CREDC Pacific Northwest Industry Workshop March 29, 2017 5
Sample Resources Software-Focused Hardware-Focused Development tools Power system models and specifications (synthetic or real) Build automation Compilers Measurement devices Debugger Protection devices Integrated Development Realistic power grid use-cases Environment Datasets (synthetic or real) Testing Frameworks *Unit Power system tools for simulation, modeling and “Realistic” simulation or in situ optimization tests Networking protocols Security analysis tools Network simulators March 29, 2017 6 CREDC Pacific Northwest Industry Workshop
The Framework Repository managed • V&V- what, why, when, how? by UIUC: V&V • Pointers to domain- Guidebook specific information From CREDC activities • Simplified V&V test • Codebase plan template • Assumptions • Topologies • Use cases • Datasets • List of available • Side products (tools / resources (IT & OT) Appendix: codes) Resources • Packaging & sharing • Lessons learned procedure CREDC Pacific Northwest Industry Workshop March 29, 2017 7
Dual Benefits Researchers Leadership Streamlines approach to project Accommodate industry input into execution requirements Leverage existing work Incorporate accepted standards and procedures Verify the design and development process Alignment of activities to sector needs Provide list of resources Stimulate investment in EDS Easy to follow and implement cyber security Good teaching tool Maximize return on investment Researchers can appeal the Provide actionable feedback to programmatic evaluation researchers outcome CREDC Pacific Northwest Industry Workshop March 29, 2017 8
V&V Guidebook CREDC Pacific Northwest Industry Workshop March 29, 2017 9
V&V through the Research Lifecycle Research lifecycle has been divided into 4 Smart Grid Levels (SGLs) for easy identification and tracking of levels SGL 4 SGL 3 SGL 1 SGL 2 Concept Development & Field testing Lab Testing Formulation Integration Verify Verify To be done with Validation principles development industry partner testing process User Develop Acceptance Verify V&V test plan testing concept CREDC Pacific Northwest Industry Workshop March 29, 2017 10
Steps in Different SGLs SGL 1 SGL 2 SGL 3 Steps ( Concept ( Development & ( Lab Formulation) Integration) Testing) Determine stakeholder requirements * Develop domain-specific use-cases * * Unit tests * Code reviews * Integration tests * Boundary testing, input validation & * output validation Cybersecurity assessment * System tests * User acceptance tests * CREDC Pacific Northwest Industry Workshop March 29, 2017 11
Implementation & Evolution of Framework CREDC Pacific Northwest Industry Workshop March 29, 2017 12
Framework Adoption First quarter after Framework adoption Identify SGL of the project Determine parts of the framework that fit the project-specific needs Select at least one of the following approaches for leveraging the Framework in the project lifecycle Review of V&V test plan by CREDC peers Review of use-cases and project codes by CREDC peers V&V testing based on guidebook Last quarter of project lifecycle Inform how the Framework was utilized Report the results CREDC Pacific Northwest Industry Workshop March 29, 2017 13
V&V Framework Evolution First quarter after Framework adoption: Provide initial feedback regarding what additional support is desired Last quarter of project lifecycle: Provide feedback regarding how the Framework fit in the lifecycle, and lessons learned What worked What didn’t work https://www.emaze.com/@ACRZIOTC/evolution-of-computers March 29, 2017 14 CREDC Pacific Northwest Industry Workshop
Thank You! Kevin Glass Seemita Pal Software Developer Power Systems Engineer - Cyber Pacific Northwest National Laboratory Pacific Northwest National Laboratory kevin.glass@pnnl.gov seemita.pal@pnnl.gov (509) 371-6238 (509) 372-4106 CREDC Pacific Northwest Industry Workshop March 29, 2017 15
Recommend
More recommend
