Professional Documents
Culture Documents
PSM Slideshow - Module 5, Day 4 and 5
PSM Slideshow - Module 5, Day 4 and 5
PROCESS SAFETY
MANAGEMENT -
Auditing
2 Days Training Course
• Day 1:
o Module 1: PSM Introduction and Overview
• Day 2:
o Module 2: 4 Pillars of PSM and Pillar 1 & 2 Elements
• Day 3:
o Module 3: Pillar 3 and Module 4: Pillar 4 Elements
• Day 4 and 5:
o Module 5: Auditing RBPSM
• Day 6:
o Module 6: SIL and LOPA
• Day 7: Consolidation and Tests
• Day 8: Site visit
2
Main Objectives
3
Course Objectives
• Exercises
4
ISO 19011 - Auditing Std
• Auditor Evaluation Process • Impartiality
• Competence Requirements • Confidentiality
• Evaluate competence • Fair and truthful
• Maintain and improve • Evidence-based
competence
7. Auditor 4. Principles
Competence
5. Audit
Activities
Program
6. Audit
• Initiate activities
• Plan Audit • Program Objectives
• Conduct Audit • Establish Program
• Prepare and Distribute • Implement Program
Report • Monitor and Review
• Follow up Program
5
Auditing - Types
First party audit : Conducted by, or on behalf of, the
organization itself for management review and other internal
purposes
Second party audit : Audits of contractors/suppliers
undertaken by or on behalf of a purchasing organization.
This may include the assessment of companies or divisions
supplying goods or services to others within the same
group.
Third party audits: Audits of organisations undertaken by
an independent certification body or registrar or similar third
party organization.
Limited scope audits: Any request of client to audit part of
standard, specific problem or a specific area. Assurance
Audits, Follow up Audits, Systems Audits, Pre- Audits.
6
Terms and Definitions
9
Audit Program
10
Audit Program
11
Audit Program
• An audit schedule should be prepared for carrying out internal
management system audits. The audits should cover the entire
operation which is subject to the management system, and assess
conformity.
• The frequency and coverage of management system audits should
be related to following:
– the risks associated with the failure of the various elements of the
management system,
– available data on the performance of the management system,
– the output from management reviews, and
– the extent to which the management system or the environment in which it
operates are subject to change.
12
Audit Activities
• Initiate the Audit
– Establish contact with the client / auditee
– Confirm the audit scope and feasibility
• Plan the Audit
– Establish the audit team
– Develop audit plan
– Prepare audit work documents
• Conduct the Audit
– Opening meeting
– Conduct document review
– Communicate during the audit
– Obtain physical evidence
– Record audit findings
– Prepare audit conclusions
– Present audit findings (Closing presentation)
13
Audit Activities
• Reporting
– Prepare the audit report
– Distribute the audit report
– Follow up on audit
14
Audit Plan
An Audit Plan should contain the following:
• Auditee
• Date of audit
• Scope of audit
• Auditors (indicating lead auditor)
• Schedule of activities illustrating the following:
o Activities per day and time of day
o Auditor(s) arrival
o Induction / Orientation Training
o Opening Meeting
o Planning / Confirmation session
o Systems audit (documentation) per element
o Field verification / compliance audits indicating specific areas of the site
o Communication sessions or feedback meetings
o Auditor consolidations (daily / final)
o Feedback / Closing Meeting
o ** All above activities should indicate auditor and auditee involvement
Conducting the Audit
Gathering Evidence:
Field audit : The management system audit requires examining, on a sample basis,
audit evidence to support conclusions on compliance with the relevant standards,
and the effectiveness of the system.
The purpose of sampling is to focus audit efforts on the areas of potential risk of
non-compliance
Sample selection: While there are no hard fast rules around the necessary
sampling intensity, a sample size of 10% to 20% is generally appropriate
Interviews:
Interviews are one of the important means of collecting information and
should be carried out in a manner adapted to the situation.
Consider the following:
• Interviews should be held with persons from appropriate levels.
• Interviews should be conducted during normal working hours and,
where practical, at the normal workplace .
• Put the Interviewee at ease.
• The reason for the interview and any note taking should be
explained.
• Interviews can be initiated by asking the persons to describe their
work.
• Questions that bias the answers should be avoided.
• The results from the interview should be summarized and reviewed.
• The interviewed persons should be thanked for their participation.
17
Conducting the Audit
Audit Findings:
• Audit evidence should be evaluated against the audit criteria to
generate the audit findings.
• Findings can indicate either conformity or non-conformity.
• Audit findings can identify an opportunity for improvement.
• Non-conformities and their supporting audit evidence should be
recorded.
• Non-conformities may be graded (Observation/Minor/ Major)
• In grading the non-compliance, the auditor should consider:
o The legal requirements;
o The magnitude of the event(s) or condition(s) leading to the non-
compliance;
o Standard requirements;
o The severity of the consequences (potential or real); and
o The frequency of occurrence
18
Audit Report
20
Reasons why audits fail
Scenario:
• Company ABC, a chemical processing plant, has a
scheduled internal audit. The company provided the incident
register for perusal to the auditor. A series of ammonia leaks
registered. The last incident was 6 months ago. The following
controls were implemented 3 months ago:
– SIL2 rated pipeline pressure measurement systems and instruments,
monitored from the central control room
– Operating pressures were decreased from 450kPa to 350kPa
– Fixed gas monitors and alarms along the pipeline and tanks
• How does the auditor measure the effectiveness of the
controls?
22
Group Discussion 2
23
Group Discussion 3
Interviews:
1. A maintenance technician is busy performing a sensor change on one of
the gas lines in the plant. He did not isolate the gas energy since the
line is not used during that time of the day, but only during night shift.
The possibility exist that there might be gas in the pipe. The Safety
Manager and Plant Engineer is accompanying you.
– How would you handle the situation and
– What questions would you ask to who?
2. During an interview with the controller in the control room, you realise
that the limits on the pressure monitoring system has not been set
accurately. The Shift Manager and a Safety Officer
accompanied you to the control room.
– What questions do you ask the controller
– Do you approach the Shift Manager and what would you
ask him?
3. How would you test if the people in the control room are f amiliar with the
Emergency Response Plan for a gas leak? (Classroom discuss)
24
RBPSM AUDIT
RBPSM AUDIT
25
Process Safety – Why Audit
26
RBPSM AUDIT
Over view of PSM Auditing (Compliance Audit)
28
RBPSM AUDIT
The audit Is to include an evaluation of the design and
effectiveness of the process safety management system
and a field inspection of the safety and health condition
and practices to verify that the employer’s system are
effectively implemented.
Planning
Staffing
The selection of effective audit team members is critical to the
success of the program. Team members should be chosen for their
experience, knowledge, and training and should be familiar with the
processes and with auditing techniques, practices and procedures.
The size of the team will vary depending on the size and complexity
of the process under consideration. For a large, complex, highly
instrumented plant, it may be desirable to have team members with
expertise in process engineering and design, process chemistry,
instrumentation and computer controls, electrical hazards and
classifications, safety and health disciplines, maintenance,
emergency preparedness, warehousing or shipping, and process
safety auditing. The team may use part-time members to provide for
the depth of expertise required as well as for what is actually done
or followed, compared to what is written.
31
RBPSM AUDIT
Evaluation
33
RBPSM AUDIT
Corrective Action
35
RBPSM AUDIT
36
RBPSM AUDIT
37
RBPSM AUDIT
38
RBPSM AUDIT
Pre-Audit Activities
Audit Scope
The audit scope refers to the chemical process facility boundaries. Within the
boundary, the PSM subject areas will be verified for implementation. PSM audits
can vary considerably in scope. Defining the audit scope is critical and requires that
it is clearly communicated to management, since they bear ultimate responsibility
for any deficiencies in implementation. Setting the scope also helps focus the
auditor‟s attention; it is also important for auditors to be consistent and for them to
prevent misleading interpretations (which can easily arise outside of the
implementation scope).
A number of factors need to be evaluated when defining the audit scope:
Company policies
Regulatory requirements
Resource limitations
Time availability
The size and the complexity of the process
Risk of the process(es)
The scope of the audit may cover the overall facility by one comprehensive audit or
several segregated audits over a defined period.
39
RBPSM AUDIT
Audit Frequency
1. Complexity and/or risk of the process. This is the most significant factor in
determining the frequency of the audit. The more complex or the higher risk
(consequence of occurrences multiplied by the likelihood) the operation is, the
more frequent your audit should be.
2. Maturity Level of the PSM Program. The less established and immature the PSM
program, the more frequent your audit should be.
3. Previous PSM Audit Results. If results from previous audits indicate large gaps in
the implementation then the audit frequency should be increased.
4. Incident History. If accidents and near misses are experienced often, then the
frequency should be increased.
5. Corporate Policy. Most corporations have internal policies that predefine audit
frequency. 40
RBPSM AUDIT
41
RBPSM AUDIT
Audit Team Members Training
The PSM audit coordinator does or coordinates the detailed audit training for new
auditors and refresher training for current auditors. Detailed PSM audit training
should include:
42
RBPSM AUDIT
Refresher training will consist of only one-to-two hours and should cover:
A summary of the site PSM implementation and audit structures, current status,
and scope of work
Changes in PSM implementation and PSM audit programs since the last audit
A review of auditor‟s roles, responsibilities and activities.
Once training is given to all the auditors a brief meeting should be held among all the
auditors to cover:
43
RBPSM AUDIT
Planning and Scheduling
Planning starts with the assignment of the PSM audit sponsor. This should occur at
least three months prior to the audit. It is preferred to provide such training a year in
advance to allow for preparation and communication to take place. The pre-audit
schedule includes team appointment, team training, communications, and audit
preparation status reviews. Compliance audits typically take between one-to-two
week of data gathering activities and meetings. Activities during the audit period
includes the audit of each individual PSM element, individual element audit review
meeting with the element administrator, draft report issuance, and the overall
opening and closing review meetings with senior management. Time should be
allocated after the audit for the preparation of the audit final report. The preparation
of the final audit should include alterations required once the draft audit report is
returned from the site‟s PSM coordinator.
It is important to periodically update all personnel involved in the audit on the current
preparation status so they may prepare their data in conjunction.
44
RBPSM AUDIT
45
RBPSM AUDIT
46
RBPSM AUDIT
47
RBPSM AUDIT
Before starting the element implementation review, the first interview for each
element should be with the element administrator. The element administrator
should begin by explaining how the element is set up and applied at the site.
Points to be discussed further should be noted during the narrative, with a
natural follow on to the detailed questions.
The audit team then makes onsite visits and review documents generated by the
application of the element management system for each PSM element.
Appropriate personnel at all levels within the organization are met and
interviewed in order to obtain a balanced view of how things measure. These
observations may also identify areas, which should be investigated further.
Questions should be asked based on the actual documentation found, on-site
observations, and the interviews themselves. 48
RBPSM AUDIT
Data Evaluation
When the element audit is complete, but before data is evaluated, the audit team
holds a review meeting with the site PSM element administrator. The meeting
should:
1. Confirm data accuracy.
2. Highlight key findings.
3. Correct any mistakes or misunderstandings.
4. Identify areas of disagreement.
The element team leader evaluates the data with team members. They need to:
1. Discuss individual findings with the aim of preparing a consistent final checklist.
2. Review all findings and working paper comments, to ensure fieldwork
completeness.
3. Discuss the areas of disagreement with the element administrator and reach a
team position.
4. Complete all sections of the checklist including the summary page and ratings.
5. Share findings with other teams to ensure feedback from interacting elements
does not conflict.
49
RBPSM AUDIT
Audit teams should meet with the site PSM coordinator to:
1. Discuss team findings for each element and align team feedback with the aim of
preparing consistent final checklists for all elements.
2. Ensure that a common style and approach is adopted.
3. Resolve any disagreements on the audit findings.
As each element audit checklist is completed the team leader prepares the closing
presentation in consultation with his team and the site PSM coordinator.
Audit team leaders should meet with the PSM coordinator and PSM sponsor
in a final meeting to review the closing presentation to:
1. Check that all information is included so that no “surprises” are brought to light in
any subsequent report or discussions.
2. Confirm that the presentation accurately reflects the “tone” as well as correctness
of the strengths, findings, and observations.
3. Confirm that language used in the presentation conveys the right message to
management.
4. Ensure that all members agree with the content of presentation.
50
RBPSM AUDIT
Audit Critique
By the end of the audit period, the auditors, site element administrators,
and other personnel directly involved in the audit are recommended to
critique the audit process and identify areas for improvement. The critique
could be done through a brainstorming session or forms developed for this
purpose may be used. All critique forms, or minutes of the brainstorming
session, should be handed to and evaluated by the site PSM coordinator
with the objective of improving future audits. The audit critique should be
part of the feedback in the closing presentation.
51
RBPSM AUDIT
Closing Meeting with Senior Management
The Lead PSM Auditor should make a formal presentation of audit findings and observations
to management. Summaries are prepared beforehand with similar findings grouped under
common headings.
Attendees for the closing presentation should include the site Manager (may even be a group
or affiliate president, if their office is present at the site), Senior Management, the PSM
sponsor, and the PSM coordinator. The closing presentation should cover the following:
1. Audit team membership.
2. Audit focus.
3. Current element rating compared to target and the last Audit rating.
4. Current strengths.
5. Areas for improvement and recurring observations from previous audits.
6. General conclusions and suggestions.
7. Audit critique summary.
8. An overall summary
9. Target date for issuance of final report.
General questions for clarification are answered. The PSM sponsor and/or senior
management should endorse the audit findings. Any comments from this presentation should
be documented by the lead PSM auditor and incorporated into the final report.
52
RBPSM AUDIT
53
RBPSM AUDIT
54
RBPSM AUDIT
The audit team members were originally selected for their knowledge and
experience and should have valuable suggestions to offer. However, these will be
„suggestions for consideration‟ or „observations‟ (as they are routinely called in
the USA) rather than findings and recommendations because:
Follow-Up Activities
The audit report becomes part of the ongoing cycle of PSM implementation
and future audits under the responsibility of the PSM coordinator, with
follow up included as part of the progress towards an effective PSM
management program.
The audit findings are translated into actions with the following suggested
activities and responsibilities:
Audit findings and observations are prioritized by the site PSM element
administrators in consultation with operations department managers
and other affected managers.
An appropriate action plan (follow up and target completion dates) is
defined within two-three months of the audit. his is the responsibility of the
site PSM element administrators in consultation with operations department
managers and other affected managers.
Agreed action is taken by the site element administrators.
Periodic follow up reports summarizing action plan status are issued by
56
the site PSM coordinator.
RBPSM AUDIT
57
RBPSM AUDIT
58
RBPSM AUDIT
59
RBPSM AUDIT
60
RBPSM AUDIT
61
RBPSM AUDIT
62
RBPSM AUDIT
63
RBPSM AUDIT
64
RBPSM AUDIT
65
RBPSM AUDIT
66
RBPSM AUDIT
67
RBPSM AUDIT
68
RBPSM AUDIT
OPERATING PROCEDURES
1. Identify who is responsible for developing written procedures that address the
following:
3. Describe the system in place to ensure that operating procedures are reviewed,
updated when necessary, and annually certified.
69
RBPSM AUDIT
4. Determine how the requirements of the following safe work practices are
communicated:
70
RBPSM AUDIT
71
RBPSM AUDIT
iii. actions to take in response to an exposure
iv. quality control for raw materials
v. control of inventory levels
vi. any special or unique hazards
d. Safety systems and their functions
i. description of the purpose (e.g., design intent)
ii. how they are activated
iii. special or unique limitations (e.g., design-basis limitations)
2. Interview employees who work in and maintain the process to confirm that
operating procedures are readily accessible and are in all designated locations
4. Through document review, field observations, and/or interviews, verify that the
following work practices are in place and are being followed (e.g., signs in place,
permits posted, logs maitained
72
RBPSM AUDIT
73
RBPSM AUDIT
KEY PERFORMANCE INDICATORS AND TARGETS’s SAMPLES
74
RBPSM AUDIT
75
RBPSM AUDIT
76
RBPSM AUDIT
77
RBPSM AUDIT
78
RBPSM AUDIT
79
RBPSM AUDIT
80
RBPSM AUDIT
81
Group Exercise 1
82
Exercise - Audit Plan
Company:
Auditors:
Scope:
Audit Date:
Day 1:
Time Activity Detail Area Auditee Auditor
83
Group Exercise 2
84
Group Exercise 3
Making findings:
Formulate findings for the following scenarios:
1. Critical control valve inspections are overdue by 3 months.
2. The training matrix include all training courses schedule and
completed by all employees. PSM is not on the list.
3. A new earthling system was installed on a 20,000 lt tank to prevent
static discharge during filling. The system also involves earthling of the
tanker trucks delivering the chemical. A certain flow rate was prescribed
to reduce static build-up through the pipes. During the audit, you
observed that the operator did not earth the truck and pumped the
chemical at maximum flow rate (above the prescription).
85
Group Exercise 4
1. Hi volumes of ammonia in the tank farms with the main wind direction
blowing from the farm straight to the dense residential area of a newly
developed real estate.
2. Excessive dust build-up in the roof of the power generation plant where
a complex conveyor system is operating 24/7.
3. Age of the nitrogen pipelines. The pipelines are heavily corroded. The
plant is near the ocean and exposed to high humidity levels and salt in
the air.
Consider all relevant RBPSM elements applicable in all the cases above.
86
Practical
87
End of Module 5
Thank you
88