PERFORMANCE ASSESSMENT
Assoc. Prof. Dr. Kenneth F. Rodrigues Biotechnology Research Institute
LICENSE
This work is licensed under aCreative Commons Attribution-ShareAlike 4.0 International License.
Attribution — You must give appropriate credit, provide a link to the license, and indicate if changes were made. You may do so in any reasonable manner, but not in any way that suggests the licensor endorses you or your use.
ShareAlike — If you remix, transform, or build upon the material, you must distribute your contributions under the same license as the original.
INTRODUCTION
Biorisk Performance pertains to improving biorisk
management by recording, measuring, and evaluating organizational actions and outcomes to reduce biorisk.
OBJECTIVES
This module has been designed to introduce you to:
1. The concept of Performance Assessment.
2. Setting goals.
3. Measuring performance.
Learning Outcomes
Upon completion of this module, you should be able to:
1. Establish goals.
2. Assess performance based on attainment of goals.
3. Improve performance.
RECAP OF THE AMP
MODEL
AMP
RISK
ASSESSMENT
RISK
MITIGATION PERFORMANCE
ASSESSMENT
PERFORMANCE
CONCEPT OF PERFORMANCE
Biorisk Management System Performance: The way in which a biorisk management system
functions to manage or minimize biorisk.
CONCEPT OF PERFORMANCE
INTENDED OUTCOMES. OBSERVED OUTCOMES.
EXAMPLE
Intended Outcome (Planned)
Observation (Actual)
Corrective Action
Number of incidents: less than 5 6 Revision of SOP & Training
Number of accidents: less than 3 0 Not required
Spills in the laboratory: 0 1 Revision of SOP & Training
CHARACTERISTICS OF BRM SYSTEM PERFORMANCE
• Result of all the activities and efforts of all people in a facility.
• Actual BRM system performance may not match the planned level of risk management effectiveness.
• Performance measurement – assess the differences.
• Performance changes over time: a sustained level of performance
requires a continual effort.
CONCEPT
OF PERFORMANCE
INPUT
STEPS
OUTPUT
CONCEPT
OF PERFORMANCE
1. Are the steps physically possible?
2. Are they the right steps?
3. Is the actual output equal to the desired output?
4. Is the output the right measurement for the process?
EXAMPLE
INPUT STEPS OUTPUT
To mitigate the risk of exposure of laboratory workers to
Mycobacterium tuberculosis using appropriate Administrative
Controls and Personal Protective Equipment (PPEs).
Preliminary health screening of laboratory workers.
A standard operating procedure (SOP) for the appropriate use of PPEs.
Post project screening of laboratory workers.
One (1) of the five (5) laboratory workers at your facility tested positive for Mycobacterium tuberculosis.
Accident analysis and corrective action.
BENEFITS OF PERFORMANCE ASSESSMENT
• Is the BRM system meeting stated benchmarks?
• Which components of meet benchmarks?
• Which do not? Why?
• Performance assessment provides evidence of monitoring.
• Certification and accreditation.
• Prevents accidents and incidents.
• Reduces cost of operation.
MEASURING PERFORMANCE
"Measurement is the first step that leads to control and eventually to improvement. If you can't
measure something, you can't understand it. If you can't
understand it, you can't control it.
If you can't control it, you can't improve it.“
– H. James Harrington
MEASURING BRM
PERFORMANCE:
CHALLENGES
What went wrong?
Post incident and
accident analysis.
PERFORMANCE MEASUREMENT
Biorisk management
performance measurement is
an integral part of the overall
biorisk management system –
Not a stand-alone function or
process.
L ABORATORY BIORISK MANAGEMENT
Performance measurement and analysis –
“The organization shall ensure that appropriate data are determined, collected and analyzed to assess the suitability and effectiveness of the biorisk management system and to evaluate where continual improvement of the system can be made.” - C.W.A 15793
MANAGEMENT REVIEW
“Top management shall review the
organization’s biorisk management system at planned intervals, to ensure its continuing suitability, adequacy and effectiveness. The
review shall include assessing opportunities for improvement and the need for changes to the system, procedures, policies and objectives.”
PLANNING FOR PERFORMANCE
ASSESSMENT
Planning a performance assessment will answer many questions before undertaking
measurements and analysis and ensure that you focus on the most critical elements of the assessment.
POLICY
• Establishes commitment and intent.
• Does NOT specify HOW to implement.
• Translate policy into roles and responsibilities.
• Stating specific goals.
• Setting objectives to accomplish those goals.
Observable and measurable end result.
OBJECTIVES
These are the steps we need to take, within a fixed timeframe, to
move towards and achieve the goal.
SMART OBJECTIVES
• Specific
• Measurable
• Attainable
• Reasonable
• Time-based
PERFORMANCE
INDICATORS (METRICS)
Observable measures: how many times? How much?
Can be applied regularly and consistently.
Can be used to trace deviations from expected performance.
Provide warning before an incident.
LEADING PERFORMANCE INDICATORS
• Processes
• Culture
• Behavior
• Protective Barriers
LAGGING INDICATORS
Lagging Performance Indicators
• Incidents
• Accidents
• Near Misses
• Enforcement Actions
IDEAL INDICATORS
• Relevant to organization.
• Objective and practical.
• Immediate and reliable .
• Cost effective.
• Sense of ownership.
• Guide future corrective actions.
• Provides new opportunities for
improvement.
IDEAL INDICATORS
• Select indicators on what needs to be measured.
• Indicators must be measurable (quantifiable).
• Indicators should be able to measure the BRM performance priorities.
• Examine all levels of the laboratory BRM.
• Indicators must be adaptable.
• Do not select indicators based on ease of measurement.
EXAMPLES OF SAFETY
PERFORMANCE INDICATORS
• Extent to which procedures established in the safety management system are applied by employees.
• Extent of training: frequency and scope.
• Availability of appropriate PPEs.
• Audits: frequency and scope.
• Aligned to current standards, codes or practices, guidelines.
• Specific indicators for the facility.
MEASURING INDICATORS
• Judicious use of indicators
• Metrics must be established
• Indicators are based on method of data collection, the information available.
• How will the data be presented?
• Who will use the data?
COLLECTING DATA
• Timeframe.
• The level of performance.
• Method of data collection.
• Cost of data collection.
• Intruisiveness and disruptions to normal operations.
REVIEWING
PERFORMANCE ANALYSIS
Involves time and resources.
Dedicated personnel.
Designated timeframe.
CONTINUAL
IMPROVEMENT
The performance management system itself should be reviewed periodically.
• Are the measured relevant to BRM priorities?
• Are the measures providing performance insights?
• Are new measures required?
• Will of this assist in achieving the institutional goals?
SUMMARY
• Performance assessment is critical to the establishment of a sound laboratory biorisk management system.
• Translate your organizations policies into goals and objectives.
• Establish metrics for measurement of performance.
• If you cannot achieve a specific goal: investigate why?
• Take necessary corrective action.
• Monitor the impact of the corrective action.
