CREDC: Research Lifecycle Support Framework SEEMITA PAL & - - PowerPoint PPT Presentation

▶

Mar 31, 2023 174 likes •335 views

CREDC: Research Lifecycle Support Framework SEEMITA PAL & KEVIN GLASS CREDC Pacific Northwest Industry Workshop November 29 th , 2017 Goal of This Presentation What we hope to accomplish Develop the case for the Research Lifecycle

SLIDE 1

CREDC: Research Lifecycle Support Framework

SEEMITA PAL & KEVIN GLASS

CREDC Pacific Northwest Industry Workshop

November 29th, 2017

SLIDE 2

What we hope to accomplish

Develop the case for the Research Lifecycle Support Framework Develop the case for Verification and Validation Provide an overview of the Framework

What we would like from you

Suggestions for improvement

Goal of This Presentation

March 29, 2017 2 CREDC Pacific Northwest Industry Workshop

SLIDE 3

Motivation

Identification

f industry

needs Integration of existing research & standards Utilization of tools, methods & datasets Adoption of verified processes Validation of user requirements Packaging & sharing of research

utputs

March 29, 2017 3

Guide researchers throughout the project lifecycle to produce verifiable, reproducible and reusable research catering to the industry needs

CREDC Pacific Northwest Industry Workshop

SLIDE 4

Role of the Framework in Guiding Researchers

Streamlined procedure Early detection of faults Improvement of quality Less rework Reduced costs Aids technology transition

March 29, 2017 4

What is the importance of this research activity? What constitutes the right solution? What resources are available?

CREDC Pacific Northwest Industry Workshop

SLIDE 5

What Constitutes the Right Solution?

March 29, 2017 5

“building the system the right way?” “building the right system?”

Verification Validation

CREDC Pacific Northwest Industry Workshop

SLIDE 6

Development tools

Build automation Compilers Debugger Integrated Development Environment

Testing Frameworks

*Unit

“Realistic” simulation or in situ tests Security analysis tools Power system models and specifications (synthetic or real) Measurement devices Protection devices Realistic power grid use-cases Datasets (synthetic or real) Power system tools for simulation, modeling and

ptimization

Networking protocols Network simulators Software-Focused Hardware-Focused

March 29, 2017 6

Sample Resources

CREDC Pacific Northwest Industry Workshop

SLIDE 7

The Framework

March 29, 2017 7

V&V- what, why,

when, how?

Pointers to domain-

specific information

Simplified V&V test

plan template V&V Guidebook

List of available

resources (IT & OT)

Packaging & sharing

procedure Appendix: Resources

From CREDC activities

Codebase
Assumptions
Topologies
Use cases
Datasets
Side products (tools /

codes)

Lessons learned

Repository managed by UIUC:

CREDC Pacific Northwest Industry Workshop

SLIDE 8

Streamlines approach to project execution Leverage existing work Verify the design and development process Provide list of resources Easy to follow and implement Good teaching tool Researchers can appeal the programmatic evaluation

utcome

Accommodate industry input into requirements Incorporate accepted standards and procedures Alignment of activities to sector needs Stimulate investment in EDS cyber security Maximize return on investment Provide actionable feedback to researchers

Researchers Leadership

March 29, 2017 8

Dual Benefits

CREDC Pacific Northwest Industry Workshop

SLIDE 9

March 29, 2017 9

V&V Guidebook

CREDC Pacific Northwest Industry Workshop

SLIDE 10

V&V through the Research Lifecycle

Research lifecycle has been divided into 4 Smart Grid Levels (SGLs) for easy identification and tracking of levels

March 29, 2017 10

Validation testing Develop V&V test plan Verify development process User Acceptance testing Verify concept Verify principles

Lab Testing Field testing Development & Integration Concept Formulation

To be done with industry partner

SGL 1 SGL 2 SGL 3 SGL 4

CREDC Pacific Northwest Industry Workshop

SLIDE 11

Steps in Different SGLs

Steps

SGL 1

(Concept

Formulation)

SGL 2

(Development &

Integration)

SGL 3

(Lab

Testing)

Determine stakeholder requirements

*

Develop domain-specific use-cases

* *

Unit tests

*

Code reviews

*

Integration tests

*

Boundary testing, input validation &

utput validation

*

Cybersecurity assessment

*

System tests

*

User acceptance tests

*

March 29, 2017 11 CREDC Pacific Northwest Industry Workshop

SLIDE 12

March 29, 2017 12

Implementation & Evolution

f Framework

CREDC Pacific Northwest Industry Workshop

SLIDE 13

Framework Adoption

First quarter after Framework adoption

Identify SGL of the project Determine parts of the framework that fit the project-specific needs Select at least one of the following approaches for leveraging the Framework in the project lifecycle

Review of V&V test plan by CREDC peers Review of use-cases and project codes by CREDC peers V&V testing based on guidebook

Last quarter of project lifecycle

Inform how the Framework was utilized Report the results

March 29, 2017 13 CREDC Pacific Northwest Industry Workshop

SLIDE 14

V&V Framework Evolution

First quarter after Framework adoption: Provide initial feedback regarding what additional support is desired Last quarter of project lifecycle: Provide feedback regarding how the Framework fit in the lifecycle, and lessons learned

What worked What didn’t work

March 29, 2017 14

https://www.emaze.com/@ACRZIOTC/evolution-of-computers

CREDC Pacific Northwest Industry Workshop

SLIDE 15

March 29, 2017 15

Thank You!

Kevin Glass

Software Developer Pacific Northwest National Laboratory kevin.glass@pnnl.gov (509) 371-6238

Seemita Pal

Power Systems Engineer - Cyber Pacific Northwest National Laboratory seemita.pal@pnnl.gov (509) 372-4106

CREDC Pacific Northwest Industry Workshop