APPLICATION GUIDANCE PER-005 System Personnel Training MRO PER-005 - - PowerPoint PPT Presentation

application guidance
SMART_READER_LITE
LIVE PREVIEW

APPLICATION GUIDANCE PER-005 System Personnel Training MRO PER-005 - - PowerPoint PPT Presentation

S TANDARDS C OMMITTEE M I D W E S T R E L I A B I L I T Y O R G AN I Z AT I O N APPLICATION GUIDANCE PER-005 System Personnel Training MRO PER-005 Subject Matter Expert (SME)Team Decem ber 1 5 , 2 0 1 1 Promoting RELIABILITY and Mitigating


slide-1
SLIDE 1

STANDARDS COMMITTEE

M I D W E S T R E L I A B I L I T Y O R G AN I Z AT I O N

Promoting RELIABILITY and Mitigating RISKS to the Bulk Power System

APPLICATION GUIDANCE

PER-005 System Personnel Training

MRO PER-005 Subject Matter Expert (SME)Team

Decem ber 1 5 , 2 0 1 1

slide-2
SLIDE 2

2

STAN DARDS COM M I T T EE

M I D W E S T R E L I A B I L I T Y O R G A N I Z A T I O N The MRO Subject Matter Expert Team is an industry stakeholder group which includes subject matter experts from MRO member organizations in various technical areas. Any materials, guidance, and views from stakeholder groups are meant to be helpful to industry participants; but should not be considered approved or endorsed by MRO staff or its board of directors unless specified.

Disclaimer The Midwest Reliability Organization (MRO) Standards Committee (SC) is committed to providing training and non-binding guidance to industry stakeholders regarding existing and emerging Reliability Standards. Any materials, including presentations, were developed through the Standards Committee by Subject Matter Experts from member organizations within MRO. The materials have been reviewed by MRO staff and provide reasonable application guidance for the standard(s) addressed. Ultimately, demonstrating compliance depends on a number of factors including the precise language of the standard, the specific facts and circumstances, and quality of evidence. These documents may be reproduced or distributed to any person or entity only in its entirety.

2

slide-3
SLIDE 3

3

STAN DARDS COM M I T T EE

M I D W E S T R E L I A B I L I T Y O R G A N I Z A T I O N The MRO Subject Matter Expert Team is an industry stakeholder group which includes subject matter experts from MRO member organizations in various technical areas. Any materials, guidance, and views from stakeholder groups are meant to be helpful to industry participants; but should not be considered approved or endorsed by MRO staff or its board of directors unless specified.

Guidance to meet a minimum level of compliance

  • Clarify training terminology
  • Explain how requirements are interrelated
  • Identify key processes (to be documented)
  • Identify key outcomes (to be documented)

Goals of the SME Team

3

slide-4
SLIDE 4

4

STAN DARDS COM M I T T EE

M I D W E S T R E L I A B I L I T Y O R G A N I Z A T I O N The MRO Subject Matter Expert Team is an industry stakeholder group which includes subject matter experts from MRO member organizations in various technical areas. Any materials, guidance, and views from stakeholder groups are meant to be helpful to industry participants; but should not be considered approved or endorsed by MRO staff or its board of directors unless specified.

4

PER-0 0 5 SME Team Mem bers

Carla Fitzpatrick, Omaha Public Power District Chris Bellefy, Minnesota Power John Pettingill, Xcel Energy – Northern States Power Pat Matson, Madison Gas and Electric Rich Cobb, Midwest ISO Robert Kieborz, Nebraska Public Power Ron Bauer, American Transmission Company Steve Zimmerman, Wisconsin Public Service Will Behnke, Alliant Energy

slide-5
SLIDE 5

5

STAN DARDS COM M I T T EE

M I D W E S T R E L I A B I L I T Y O R G A N I Z A T I O N The MRO Subject Matter Expert Team is an industry stakeholder group which includes subject matter experts from MRO member organizations in various technical areas. Any materials, guidance, and views from stakeholder groups are meant to be helpful to industry participants; but should not be considered approved or endorsed by MRO staff or its board of directors unless specified.

  • 1. Title: System Personnel Training
  • 2. Number: PER-005-1
  • 3. Purpose: To ensure that System Operators performing real-time, reliability-

related tasks on the North American Bulk Electric System (BES) are competent to perform those reliability related tasks. The competency of System Operators is critical to the reliability of the North American Bulk Electric System.

  • 4. Applicability:

4.1. Functional Entities:

4.1.1 Reliability Coordinator. 4.1.2 Balancing Authority. 4.1.3 Transmission Operator.

Purpose & Applicability of PER-0 0 5

5

slide-6
SLIDE 6

6

STAN DARDS COM M I T T EE

M I D W E S T R E L I A B I L I T Y O R G A N I Z A T I O N The MRO Subject Matter Expert Team is an industry stakeholder group which includes subject matter experts from MRO member organizations in various technical areas. Any materials, guidance, and views from stakeholder groups are meant to be helpful to industry participants; but should not be considered approved or endorsed by MRO staff or its board of directors unless specified.

(ADDIE)

(R.1.) Use a systematic approach to training

Analysis – identifies the “requirements”

  • Create list of Operator tasks
  • Conduct annual updating of task list

Design – identifies the “specifications”

  • Create learning objectives (aligned with tasks)

Development – creates the “training solution”

  • Create training materials (aligned with objectives)

Implementation – is the “actual delivery”

  • Deliver training identified (aligned with objectives)
  • Provide 32 hours of EOP training annually
  • Train using simulator technology (where applicable)
  • Verify operator capabilities (on current tasks)
  • Verify operator capabilities (on new tasks)

Evaluation – is the “continuous improvement”

  • Conduct annual evaluation of training program

Requirements of PER-005

6

slide-7
SLIDE 7

7

STAN DARDS COM M I T T EE

M I D W E S T R E L I A B I L I T Y O R G A N I Z A T I O N The MRO Subject Matter Expert Team is an industry stakeholder group which includes subject matter experts from MRO member organizations in various technical areas. Any materials, guidance, and views from stakeholder groups are meant to be helpful to industry participants; but should not be considered approved or endorsed by MRO staff or its board of directors unless specified.

Complying with PER-005 requirements 1.1 through 3.1 provides most of the documentation you need for this requirement.

  • Document your Processes

 Polices  Procedures  Plans  Process maps, etc

  • Document your Outcomes

 Training records  Schedules  Evaluation feedback  Curriculum, etc

R1 . System atic Approach to Training

7

slide-8
SLIDE 8

8

STAN DARDS COM M I T T EE

M I D W E S T R E L I A B I L I T Y O R G A N I Z A T I O N The MRO Subject Matter Expert Team is an industry stakeholder group which includes subject matter experts from MRO member organizations in various technical areas. Any materials, guidance, and views from stakeholder groups are meant to be helpful to industry participants; but should not be considered approved or endorsed by MRO staff or its board of directors unless specified.

List of task action statements (units of assigned work) Measurable: numerical results (e.g. within normal operating limits) Observable: can be verified as correct or not (e.g. in accordance with procedure) Suggest grouping related tasks (e.g. voltage control, emergency operations, etc)

R1 .1 List of BES com pany-specific reliability-related tasks

8

slide-9
SLIDE 9

9

STAN DARDS COM M I T T EE

M I D W E S T R E L I A B I L I T Y O R G A N I Z A T I O N The MRO Subject Matter Expert Team is an industry stakeholder group which includes subject matter experts from MRO member organizations in various technical areas. Any materials, guidance, and views from stakeholder groups are meant to be helpful to industry participants; but should not be considered approved or endorsed by MRO staff or its board of directors unless specified.

Develop processes for how you:

  • Determine if it occurs in real time
  • Determine if reliability related
  • Validate the tasks you have identified
  • Determine which tasks need qualification training
  • Determine which tasks need continuing training

R1 .1 . “reliability-related” tasks

9

slide-10
SLIDE 10

10

STAN DARDS COM M I T T EE

M I D W E S T R E L I A B I L I T Y O R G A N I Z A T I O N The MRO Subject Matter Expert Team is an industry stakeholder group which includes subject matter experts from MRO member organizations in various technical areas. Any materials, guidance, and views from stakeholder groups are meant to be helpful to industry participants; but should not be considered approved or endorsed by MRO staff or its board of directors unless specified.

10

Task Survey

slide-11
SLIDE 11

11

STAN DARDS COM M I T T EE

M I D W E S T R E L I A B I L I T Y O R G A N I Z A T I O N The MRO Subject Matter Expert Team is an industry stakeholder group which includes subject matter experts from MRO member organizations in various technical areas. Any materials, guidance, and views from stakeholder groups are meant to be helpful to industry participants; but should not be considered approved or endorsed by MRO staff or its board of directors unless specified.

11

Task Check Sheet

slide-12
SLIDE 12

12

STAN DARDS COM M I T T EE

M I D W E S T R E L I A B I L I T Y O R G A N I Z A T I O N The MRO Subject Matter Expert Team is an industry stakeholder group which includes subject matter experts from MRO member organizations in various technical areas. Any materials, guidance, and views from stakeholder groups are meant to be helpful to industry participants; but should not be considered approved or endorsed by MRO staff or its board of directors unless specified.

Two parts to the requirement Part 1: address changes as they occur

  • Create filter for identifying process or task changes
  • Document the changes (e.g. tools, steps, references, criteria,
  • bjectives, etc)
  • Document your validation process
  • Perform capability assessment within six months (see R2.1.)

Part 2: review the entire task list

R1 .1 .1 update BES com pany- specific reliability-related tasks…

12

slide-13
SLIDE 13

13

STAN DARDS COM M I T T EE

M I D W E S T R E L I A B I L I T Y O R G A N I Z A T I O N The MRO Subject Matter Expert Team is an industry stakeholder group which includes subject matter experts from MRO member organizations in various technical areas. Any materials, guidance, and views from stakeholder groups are meant to be helpful to industry participants; but should not be considered approved or endorsed by MRO staff or its board of directors unless specified.

Objectives include a condition, action and criterion Tasks drive the learning objectives Learning objectives drive the training materials

R1 .2 …design and develop learning

  • bjectives and training m aterials

based on the task list created in R1 .1

13

slide-14
SLIDE 14

14

STAN DARDS COM M I T T EE

M I D W E S T R E L I A B I L I T Y O R G A N I Z A T I O N The MRO Subject Matter Expert Team is an industry stakeholder group which includes subject matter experts from MRO member organizations in various technical areas. Any materials, guidance, and views from stakeholder groups are meant to be helpful to industry participants; but should not be considered approved or endorsed by MRO staff or its board of directors unless specified.

14

Task Check Sheet

slide-15
SLIDE 15

15

STAN DARDS COM M I T T EE

M I D W E S T R E L I A B I L I T Y O R G A N I Z A T I O N The MRO Subject Matter Expert Team is an industry stakeholder group which includes subject matter experts from MRO member organizations in various technical areas. Any materials, guidance, and views from stakeholder groups are meant to be helpful to industry participants; but should not be considered approved or endorsed by MRO staff or its board of directors unless specified.

R1 .2 Learning objectives & training m aterials

elearning Course – Evacuation Procedure

  • Describe triggers requiring evacuation
  • List items to bring from Control Center
  • List who to contact before leaving
  • Describe where to report

Drill – Evacuation to Backup Control Center

  • Contact Security Operations Center (within 1 minute)
  • Contact back-up control center site (within 1 minute)
  • Transfer phones to Backup Control Center (within 1 minute)
  • Gather items to carry from Control Center (within 2 minute)

15

slide-16
SLIDE 16

16

STAN DARDS COM M I T T EE

M I D W E S T R E L I A B I L I T Y O R G A N I Z A T I O N The MRO Subject Matter Expert Team is an industry stakeholder group which includes subject matter experts from MRO member organizations in various technical areas. Any materials, guidance, and views from stakeholder groups are meant to be helpful to industry participants; but should not be considered approved or endorsed by MRO staff or its board of directors unless specified.

“Deliver” represents the Implementation Phase of ADDIE Delivery can include scheduling of participants, classroom preparation, sign-in of participants, pre-assessment, student engagement, student assessment, making evaluations available, and recordkeeping

R1 .3 …deliver the training established in R1 .2

16

slide-17
SLIDE 17

17

STAN DARDS COM M I T T EE

M I D W E S T R E L I A B I L I T Y O R G A N I Z A T I O N The MRO Subject Matter Expert Team is an industry stakeholder group which includes subject matter experts from MRO member organizations in various technical areas. Any materials, guidance, and views from stakeholder groups are meant to be helpful to industry participants; but should not be considered approved or endorsed by MRO staff or its board of directors unless specified.

Evaluation Phase of ADDIE Aggregate the course evaluations Other input (surveys, interviews, advisors, etc) Show how feedback is used in program changes

R1 .4 conduct an annual evaluation …to identify any needed changes to the training program and shall im plem ent the changes identified

17

slide-18
SLIDE 18

18

STAN DARDS COM M I T T EE

M I D W E S T R E L I A B I L I T Y O R G A N I Z A T I O N The MRO Subject Matter Expert Team is an industry stakeholder group which includes subject matter experts from MRO member organizations in various technical areas. Any materials, guidance, and views from stakeholder groups are meant to be helpful to industry participants; but should not be considered approved or endorsed by MRO staff or its board of directors unless specified.

Capability Verification is part of ADDIE Implementation phase Processes:

  • How to verify; who can perform verification; what to do when someone

fails a verification

Outcomes:

  • Training records showing successful completion of tasks
  • Supervisor check sheets showing task completed
  • Results of learning assessments

R2 . verify each of its System Operator’s capabilities to perform each assigned task…

18

slide-19
SLIDE 19

19

STAN DARDS COM M I T T EE

M I D W E S T R E L I A B I L I T Y O R G A N I Z A T I O N The MRO Subject Matter Expert Team is an industry stakeholder group which includes subject matter experts from MRO member organizations in various technical areas. Any materials, guidance, and views from stakeholder groups are meant to be helpful to industry participants; but should not be considered approved or endorsed by MRO staff or its board of directors unless specified.

Elements: Condition, Action statement, Criteria Measurable: “Given a System Operating Limit violation on the transmission system, implement the correct procedure for the circumstances to mitigate loading to within normal operating limits.” Observable: “Given a tag submitted for scheduling, ensure that all transmission rights are assigned to the tag per the company Tariff and in compliance with NERC and NAESB standards.”

Perform ance Measure Exam ples

19

slide-20
SLIDE 20

20

STAN DARDS COM M I T T EE

M I D W E S T R E L I A B I L I T Y O R G A N I Z A T I O N The MRO Subject Matter Expert Team is an industry stakeholder group which includes subject matter experts from MRO member organizations in various technical areas. Any materials, guidance, and views from stakeholder groups are meant to be helpful to industry participants; but should not be considered approved or endorsed by MRO staff or its board of directors unless specified.

20

Capability Verification Checklist

slide-21
SLIDE 21

21

STAN DARDS COM M I T T EE

M I D W E S T R E L I A B I L I T Y O R G A N I Z A T I O N The MRO Subject Matter Expert Team is an industry stakeholder group which includes subject matter experts from MRO member organizations in various technical areas. Any materials, guidance, and views from stakeholder groups are meant to be helpful to industry participants; but should not be considered approved or endorsed by MRO staff or its board of directors unless specified.

How do trainers assess capabilities? See the methodology described previously under requirement, R2. It describes how to determine that an existing task has changed sufficiently to require a new capability verification assessment. What level of documentation is recommended? Use the same documentation used to meet requirement R1.1.1. (update task list) and requirement R2 (verify capabilities).

R2 .1 W ithin six m onths…verify each of its System Operator’s capabilities to perform the new or m odified tasks

21

slide-22
SLIDE 22

22

STAN DARDS COM M I T T EE

M I D W E S T R E L I A B I L I T Y O R G A N I Z A T I O N The MRO Subject Matter Expert Team is an industry stakeholder group which includes subject matter experts from MRO member organizations in various technical areas. Any materials, guidance, and views from stakeholder groups are meant to be helpful to industry participants; but should not be considered approved or endorsed by MRO staff or its board of directors unless specified.

“At least every 12 months” “applicable to its organization” “reflects emergency operations topics”

R3 . …provide each of its System Operators w ith at least 3 2 hours of em ergency operations training

22

slide-23
SLIDE 23

23

STAN DARDS COM M I T T EE

M I D W E S T R E L I A B I L I T Y O R G A N I Z A T I O N The MRO Subject Matter Expert Team is an industry stakeholder group which includes subject matter experts from MRO member organizations in various technical areas. Any materials, guidance, and views from stakeholder groups are meant to be helpful to industry participants; but should not be considered approved or endorsed by MRO staff or its board of directors unless specified.

Applicability:

  • Authority or control over facilities with IROLs
  • Has established guides to mitigate IROL violations

Simulation Technology – replicates the operational behavior of the BES during normal and emergency conditions.

R3 .1 …provide each System Operator w ith em ergency operations training using sim ulation technology

23

slide-24
SLIDE 24

24

STAN DARDS COM M I T T EE

M I D W E S T R E L I A B I L I T Y O R G A N I Z A T I O N The MRO Subject Matter Expert Team is an industry stakeholder group which includes subject matter experts from MRO member organizations in various technical areas. Any materials, guidance, and views from stakeholder groups are meant to be helpful to industry participants; but should not be considered approved or endorsed by MRO staff or its board of directors unless specified.

(ADDIE)

(R.1.) Use a systematic approach to training

Analysis – identifies the “requirements”

  • Create list of Operator tasks
  • Conduct annual updating of task list

Design – identifies the “specifications”

  • Create learning objectives (aligned with tasks)

Development – creates the “training solution”

  • Create training materials (aligned with objectives)

Implementation – is the “actual delivery”

  • Deliver training identified (aligned with objectives)
  • Provide 32 hours of EOP training annually
  • Train using simulator technology (where applicable)
  • Verify operator capabilities (on current tasks)
  • Verify operator capabilities (on new tasks)

Evaluation – is the “continuous improvement”

  • Conduct annual evaluation of training program

Requirements of PER-005

24

slide-25
SLIDE 25

25

STAN DARDS COM M I T T EE

M I D W E S T R E L I A B I L I T Y O R G A N I Z A T I O N The MRO Subject Matter Expert Team is an industry stakeholder group which includes subject matter experts from MRO member organizations in various technical areas. Any materials, guidance, and views from stakeholder groups are meant to be helpful to industry participants; but should not be considered approved or endorsed by MRO staff or its board of directors unless specified.

Conclusion

PER-005 requirements are interrelated as part of a systematic approach to training. Consider going beyond the specifics of each individual requirement, when needed, to maintain this systematic approach.

25

slide-26
SLIDE 26

26

STAN DARDS COM M I T T EE

M I D W E S T R E L I A B I L I T Y O R G A N I Z A T I O N The MRO Subject Matter Expert Team is an industry stakeholder group which includes subject matter experts from MRO member organizations in various technical areas. Any materials, guidance, and views from stakeholder groups are meant to be helpful to industry participants; but should not be considered approved or endorsed by MRO staff or its board of directors unless specified.

This presentation and white paper can be found on MRO’s website at:

http://www.midwestreliability.org/STA_standards_committee_sme.html

If you have any questions following this workshop, please send them to:

mro-sme-teams@midwestreliability.org

Questions

26