Welcome 2018 Board of Examiners
Examiner Training – Day 1
Welcome 2018 Board of Examiners Examiner Training Day 1 - - PowerPoint PPT Presentation
Welcome 2018 Board of Examiners Examiner Training Day 1 Introductions Name Company What is your intention for examiner training? What are you famous for? 2 Team Agreement How can we make this a successful training course?
Examiner Training – Day 1
2
How can we make this a successful training course? We will . . .
3
Framework
to applicants at all levels
software
4
5 5
6
them improve
final feedback report
the applicant
7
Complete Pre-work & Training
Independent
Review Consensus Review Site Visit Review Finalize Feedback Report
8
Review for Conflict Review the Framework Read the Application Log on to the system Create Key Factor List Click “Done”! Prepare Consensus items Participate in Consensus meeting Prepare Site Visit issues Complete Site Visit Prepare Final Scorebook
12 process items
(ADLI)
strength and OFI
5 results items
(LeTCI)
strength and OFI
9
Find a partner and compare your analysis
10
11
please give us a copy before we begin the next module.
evaluation form, too.
12
TM Overview
vision and live the values
15
16
excellence systems
18
excellence
and agility
innovation
results
19
20
21
the way the organization operates
assessment?”
the applicant
22
your assigned items.
for Green Gateway, select the 4 to 6 KFs that are most relevant to each of your assigned items.
are most important to this applicant based on the assigned key factors?
the see in the applicant’s response.
Table Assigned Items 1 1.1 and 1.2 2 2.1 and 2.2 3 3.1 and 3.2 4 4.1 and 4.2 5 5.1 and 5.2 6 6.1 and 6.2 7 1.1 and 1.2 8 2.1 and 2.2
23
24
25
“around the most significant five”
26
27
28
29
Core Competencies
An organization’s areas of greatest expertise. Core competencies are those strategically important, possibly specialized capabilities that are central to fulfilling your mission or that provide an advantage in your marketplace
Work Systems
How your organization’s work is accomplished, consisting
you need to develop and produce products, deliver them to your customers, and succeed in your marketplace.
30
31
Customer Engagement
Your customers’ investment in or commitment to your brand and product offerings... Characteristics of engaged customers include retention, brand loyalty, willingness to make an effort to do business – and increase their business – with you, and willingness to actively advocate for and recommend your brand and product offerings.
Customer Satisfaction Dissatisfaction
32
33
34
4.1 Measurement, Analysis, and Improvement of Organizational Performance
a. Performance Measurement b. Performance Analysis and Review c. Performance Improvement
Now includes projecting performance and identifying opportunities for continuous improvement and innovation
4.2 Information and Knowledge Management
a. Data and Information b. Organizational Knowledge NO LONGER INCLUDES IT MANAGEMENT
35
36
37
38
6.1 Work Processes
c. Supply-Chain Management
6.2 Operational Effectiveness
c. Safety and Emergency Preparedness
39
40
41
42
To whom do Green Gateway’s plant managers report?
43
Kelley Molavi
“None of us are as smart as all of us.”
Ken Blanchard
Complete Pre-work & Training
Independent
Review Consensus Review Site Visit Review Finalize Feedback Report
45
independent review of every item
46
47
in Scorebook Navigator
key factors
consensus stage
48
July/August 2018 Sept./Oct. 2018
Sunday Monday Tuesday Wednesday Thursday Friday Saturday Sunday Monday Tuesday Wednesday Thursday Friday Saturday
22 23 24 25 26 27 28 2 3 4 5 6 7 8 29 30 31 1 2 3 4 9 10 11 12 13 14 15 5 6 7 8 9 10 11 16 17 18 19 20 21 22 12 13 14 15 16 17 18 23 24 25 26 27 28 29 19 20 21 22 23 24 25 30 1 2 3 4 5 6 26 27 28 29 30 31 1 7 8 9 10 11 12 13
Assignment
Independent Review
Meeting
Site Visit
report due
49
50
SYNTHESIZE
Synthesize team members’ IR into 6-10 comment topics Develop rationale
WRITE
Draft 6-10 feedback comments based on your chosen topics Balance strengths and OFIs
SCORE
Score the item based
review
REVISE
Revise comments based on feedback from your backup Provide feedback to your partner
PREPARE
Prepare to present your items during the team’s consensus meeting
51
52
53
54
55
56
57
is repeatable and based on reliable data and information (i.e., systematic)
58
The extent to which…
relevant and important to the organization
(work units, processes, employee groups, locations, stakeholders)
59
and improvement
through innovation
relevant work units and processes in your
60
61
The extent to which
identified in other Criteria items
are complementary across processes and work units
actions, are harmonized across processes and work units to support organization-wide goals.
62
63
64
sequence.
does the cartoon address?
aloud to the class.
67
68
69
70
71
72
73
74
75
Step 1: Synthesize
77
SYNTHESIZE
Synthesize team members’ IR into 6-10 comment topics Develop rationale
WRITE
Draft 6-10 feedback comments based on your chosen topics Balance strengths and OFIs
SCORE
Score the item based
review
REVISE
Revise comments based on feedback from your backup Provide feedback to your partner
PREPARE
Prepare to present your items during the team’s consensus meeting
Analysis
Breaking a complex topic into smaller parts to gain a better understanding of it
Synthesis
The process of integrating materials you have gathered and then creating your own information
78
Strength and OFI comments for:
Gaps
important is not addressed (KF)
79
6–10 pieces of information . . . not necessarily those that have already been written as feedback- ready comments.
to every applicant!
80
future improvement
81
82
Relevance to Applicant (examples & key factors) Process/Results Evaluation Factors Criteria Requirements = value- added feedback
83
For proposed strengths and OFIs:
scoring range or award level
independent review worksheets (show initials of team members)
84
For observations not used:
85
Item Ref. Comment Topics Rationale a(1) + PES used to assess workforce capability and capacity (A) Identified by JH (double), KM, MH, erased conflicting OFI a(2) + 12-step systematic approach for hiring, placement, and retention of employees (A, D) Identified by AY, KM, JH, key Criteria requirement b(1) + Multiple approaches for workforce health, safety, and accessibility (A) Identified by KM, AY, MH, key Criteria requirement b(1) ‒ Not clear how workplace environments differ for OSHA requirements, safety, or temporary employees (I) GAP (key factors). Identified by AY a,b ‒ Missing cycles of learning for many workforce processes (L) Addresses L, identified by AY
86
87
Item Ref. Comment Topics Rationale a(1) + PES used to assess workforce capability and capacity (A) Identified by JH (double), KM, MH, erased conflicting OFI a(2) + 12-step systematic approach for hiring, placement, and retention of employees (A, D) Identified by AY, KM, JH, key Criteria requirement b(1) + Multiple approaches for workforce health, safety, and accessibility (A) Identified by KM, AY, MH, key Criteria requirement b(1) ‒ Not clear how workplace environments differ for OSHA requirements, safety, or temporary employees (I) GAP (key factors). Identified by AY a,b ‒ Missing cycles of learning for many workforce processes (L) Addresses L, identified by AY
88
Table Item 1 1.1 2 2.1 3 3.1 4 6.1 5 1.1 6 2.1 7 3.1 8 6.1
89
Step 1 (10 min.)
commonalities and conflicts
Step 2 (30 min.)
strength and OFI comments
Note: Don’t write feedback-ready comments yet!
90
91
Step 2: Write Comments
93
SYNTHESIZE
Synthesize team members’ IR into 6-10 comment topics Develop rationale
WRITE
Draft 6-10 feedback comments based on your chosen topics Balance strengths and OFIs
SCORE
Score the item based
review
REVISE
Revise comments based on feedback from your backup Provide feedback to your partner
PREPARE
Prepare to present your items during the team’s consensus meeting
words
criteria language
prescriptive
well the application is written
94
what it does well
improve
the application
94
Is the comment Criteria-based? Is it insightful? T = Start with the “topic sentence” or main point E = Give 1 – 2 supporting examples from the application S = Explain the “so what” (relevance) to the applicant by linking the comment to a key factor T = Try it out loud!
95
96
97
Item Ref. Comment Topics Rationale a(1) + PES used to assess workforce capability and capacity (A) Identified by JH (double), KM, MH, erased conflicting OFI a(2) + 12-step systematic approach for hiring, placement, and retention of employees (A, D) Identified by AY, KM, JH, key Criteria requirement b(1) + Multiple approaches for workforce health, safety, and accessibility (A) Identified by KM, AY, MH, key Criteria requirement b(1) ‒ Not clear how workplace environments differ for OSHA requirements, safety, or temporary employees (I) GAP (key factors). Identified by AY a,b ‒ Missing cycles of learning for many workforce processes (L) Addresses L, identified by AY
5.1a(1)
Comment: Using the Performance Evaluation System (PES), the applicant demonstrates a systematic approach to assessing workforce capability and capacity needs. The PES assesses associates' skills, competencies, and certifications to produce a comprehensive Training Matrix (Figure 5.1-1). Directors validate associate capacity on an annual basis by matching time studies to job descriptions and work flow. The applicant's systematic approach for assessing workforce capability and capacity needs may help the applicant meet seasonal workforce demands and address its strategic challenge of workforce retention. Rationale: Identified by JH (double), KM, MH, erased conflicting OFI
5.1a(2)
Comment: The applicant deploys a 12-step process for recruiting, hiring, placing, and retaining new workforce members. The collaborative process between the Human Resources (HR) Department and the organization's directors begins with HR receiving an approved position requisition. Resumes from potential candidates are solicited through recruiting agencies, and print and
assigned a mentor and undergo 30-, 60-, and 90-day reviews to monitor progress and support retention efforts. The applicant's approach for recruiting, hiring, placing, and retaining new workforce members reinforces the organization's core competency
Rationale: Identified by AY, KM, JH, key Criteria requirement
not clear”
“not clear”!
deployment is lacking)
100
OBLIGATION
101
Item Ref. Comment Topics Rationale a(1) + PES used to assess workforce capability and capacity (A) Identified by JH (double), KM, MH, erased conflicting OFI a(2) + 12-step systematic approach for hiring, placement, and retention of employees (A, D) Identified by AY, KM, JH, key Criteria requirement b(1) + Multiple approaches for workforce health, safety, and accessibility (A) Identified by KM, AY, MH, key Criteria requirement b(1) ‒ Not clear how workplace environments differ for OSHA requirements, safety, or temporary employees (I) GAP (key factors). Identified by AY a,b ‒ Missing cycles of learning for many workforce processes (L) Addresses L, identified by AY
5.1b(1)
Comment: It is unclear if the applicant’s processes or measures for ensuring the health, security, and accessibility of its workforce are tailored for different workplace environments. For example, there is no mention of addressing OSHA compliance or maintaining air quality (Figure P.1-7) differently in various areas of the facility such as the shop floor, shipping/receiving, or office areas. No health or security distinctions are made for different workplace environments
5). Consideration of the unique needs of different workplace environments may help the applicant ensure it provides a healthy workplace for all associates while effectively managing
Rationale: GAP (key factors), identified by AY
102
5.1a,b
Comment: It is unclear if the applicant engages in systematic cycles
the applicant identifies examples of process changes that were implemented during cycles of improvement, it is unclear if these changes were the result of a systematic evaluation of processes, or were reactive to events or circumstances. Systematic evaluation and improvement of the organization's workforce environment processes may assist the applicant in creating new value through innovation and quality improvement. Rationale: addresses L – identified by AY
103
Amanda Yanez
Table Item 1 1.1 2 2.1 3 3.1 4 6.1 5 1.1 6 2.1 7 3.1 8 6.1
104
team (either a strength or an OFI) Independently…
105
106
Find a partner: Review each other’s comments and provide written feedback in the right-hand column:
107
Step 3: Score
109
SYNTHESIZE
Synthesize team members’ IR into 6-10 comment topics Develop rationale
WRITE
Draft 6-10 feedback comments based on your chosen topics Balance strengths and OFIs
SCORE
Score the item based
review
REVISE
Revise comments based on feedback from your backup Provide feedback to your partner
PREPARE
Prepare to present your items during the team’s consensus meeting
applicant’s key factors
the applicant
110
Navigator and on p.34 in Framework booklet)
111
112
113
approaches responsive to the majority of the overall requirements, which are well-deployed across most work units. The applicant demonstrates that some of its processes have undergone cycles of improvement; however, it is not evident whether a fact-based systematic evaluation and improvement process is utilized to make these process improvements, or if they are reactive in nature. Workforce environment approaches are in the early stages of integration with overall organizational needs.
114
Table Item 1 1.1 2 2.1 3 3.1 4 6.1 5 1.1 6 2.1 7 3.1 8 6.1
116
Individual Exercise:
1. Review your team’s 6-10 comments paying special attention to A-D-L-I 2. Determine the scoring range that “best fits” the item 3. Score the item
As a Table:
1. Share your item score and scoring rationale with your team 2. Reach consensus on the item score 3. Report out
117
118
What is the difference between the scoring guidelines for approach in the 70-85% range versus the 90-100% range? Answer: “well” deployed (70-85%) vs. “fully” deployed (90-100%).
119
“If everyone is moving forward together,
then success takes care of itself.”
Henry Ford
121
“we decided” or “they decided”?
122
SYNTHESIZE
Synthesize team members’ IR into 6-10 comment topics Develop rationale
WRITE
Draft 6-10 feedback comments based on your chosen topics Balance strengths and OFIs
SCORE
Score the item based
review
REVISE
Revise comments based on feedback from your backup Provide feedback to your partner
PREPARE
Prepare to present your items during the team’s consensus meeting
123
124
Examiner Item Lead Back-up Other 1 1.1, 1.2, 7.4 6.1, 6.2, 7.1 Team leader 2 2.1, 2.2 5.1, 5.2, 7.3 Scorebook editor 3 3.1, 3.2, 7.2 4.1, 4.2, 7.5 Back-up team leader 4 4.1, 4.2, 7.5 3.1, 3.2, 7.2 Criteria cop 5 5.1, 5.2, 7.3 2.1, 2.2 Arrange logistics 6 6.1, 6.2, 7.1 1.1, 1.2, 7.4 Time keeper
125
categories
126
shorter sentences.
127
128
voice is heard
129
130
Resources:
Ground Rules:
131
+’s and Δ’s 2 key learnings per table Homework: read TNCPE