Professional Documents
Culture Documents
Lecture 11 - Six Sigma 1 - FMEA
Lecture 11 - Six Sigma 1 - FMEA
Failure
Mode
Effects
Analysis
(FMEA)
FMEA – Part
of an Overall
Risk
Management
Framework
2
Number 1 Rule of Risk
Management
All Products Fail!
◼ Determining how they fail, when they will fail,
and why they are failing will allow a designer
to incorporate failure as an acceptable design
constraint.
◼ Failure is ALWAYS a Design
Requirement/Criteria
◼ “All stakeholders need to understand that the
use of a medical device entails some degree
of risk” – ISO 14971
3
Design Failure - When the Product
Fails?
Design failure has a direct effect on customer
perception of product quality. Product failure is
acceptable if customers perceive it as acceptable
such as:
• Infant Mortality –
failures don’t
usually affect the
customer, except
DOA
• Useful life – Low
“constant” failure
rate (failures here
are problems!)
• End of Life Wear
Out – failures
here are normally
acceptable
5
Causes of Reliability Curve Failure
Early Failure Chance Failure Wear Out Failure
(Infant Mortality) (Useful Life) (End of Life)
- Acts of God
6
Quiz – Reliability Curve
C. I don’t know?
7
What is an FMEA?
• FMEA stands for Failure Modes and Effects
Analysis
• Methodology of FMEA:
– To identify ways the product or process
can fail and then plan to prevent those
failures.
– Assess the failures to determine actions
that would eliminate the chance of
occurrence
– Document the potential failures and the
potential effects they could have.
• FMEA is a very useful tool and can be extremely helpful for design and development teams
while evaluating materials, components, and sub-assemblies comprising medical devices.
• But FMEA is more of a reliability tool rather than a risk management system.
• A medical device might never exhibit a failure mode yet still has risks!
Ref: IEC 60812, Analysis techniques for system reliability — Procedures for failure mode and effects analysis (FMEA) 8
FMEA – Quantitative Assessment?
◼ Risk per ISO 14971 is
defined as “the
combination of the
probability of
occurrence of harm and
the severity of that
harm”.
9
Boeing 787 Dreamliner –
FMEA Example
10
Quiz I - Definitions
This definition applies to “overall process
which of the following: comprising a risk
A. Risk Assessment analysis and a risk
B. Risk Management evaluation”
C. Risk Control
D. Risk Estimation
11
Quiz II - Definitions
The following is a
definition of what? “the combination of the
A. Risk probability of occurrence
B. Hazard of harm and the severity
C. Harm of that harm”.
D. Hazardous Situation
12
Quiz III - Definitions
This definition applies to “physical injury or
which of the following:
damage to the health of
A. Risk people, or damage to
B. Hazard property or the
C. Harm environment”
D. Residual Risk
13
Quiz IV - Definitions
The following items are • Electromagnetic Energy
examples of: • Mechanical Energy
A. Risks • Vibration
• Biological
B. Hazards
• Bacteria
C. Harm • Viruses
D. Hazardous Situation • Chemical
14
History of FMEA
• Created by the aerospace industry in the 1960s.
• In 1974 the Navy developed MIL-STD-1629 on FMEA’s.
• Ford began using FMEA in 1972.
• Incorporated by the “Big Three” auto companies in 1988.
• Automotive Industry Action Group (AIAG) and American
Society for Quality(ASQ) standards in 1993.
• Late 1990’s, early 2000’s risk management in medical device
industry
• Latest – Medical device transition from FMEA risk management
as part of Design verification (CFR 820.30) activities to a fully
integrated Risk Management framework (as per ISO
14971:2012).
15
What is a ‘Failure Mode’
16
What is an ‘Effect’
17
What is a ‘Cause’
18
What is a ‘Control’
19
Quiz - Definitions
20
Types Of FMEA
– Project/Program: Identifies what can go wrong with a
major project
– Design: Identifies what can go wrong with the design of
a product or service. Consideration for System,
Subsystem, Component.
– Process: Identifies what can go wrong in the
manufacturing and assembling of components.
– Use (or Misuse): Identifies what can go wrong with the
end user using your device.
21
FMEA Manufacturing Risks
• Where do Manufacturing ‘Risks’ come from?
22
FMEA Steps
23
Example Risk
Chart
25
Risk Priority Numbers, RPN
RPN = SEV x OCC x DET
27
Example Severity Definitions Medical
Device
Source: Risk Analysis and Design Controls for Medical Devices. Geetha Rao
28
More Detailed - Rating Definitions
29
Worked Example - Automotive
Design FMEA
30
Worked Example - Function
Item Action Results
C O D
Current
Potential Response &
Potential Potential S l c Design e R
Cause(s)/ Recommended Target
Failure Effect(s) of e a c t P S O D R
Controls
Mechanism(s) Actions Complete Action
Mode Failure v s u e N E C E P
Of Failure Date Taken
s r c V C T N
Function Preven Detect
t
• EXAMPLES:
• HVAC system does not heat vehicle or defog windows
• HVAC system takes more than 5 minutes to heat vehicle
• HVAC system does heat cabin to 70 degrees in below zero
temperatures
• HVAC system cools cabin to 50 degrees
• HVAC system activates rear window defogger
32
Worked Example - Effect(s) of
Failure
Item Action Results
C O D
Current
Potential Response &
Potential Potential S l c Design e R
Cause(s)/ Recommended Target
Failure Effect(s) of e a c t P S O D R
Controls
Mechanism(s) Actions Complete Action
Mode Failure v s u e N E C E P
Of Failure Date Taken
s r c V C T N
Function Prevent Detect
• EXAMPLE:
• Cannot see out of front window
• Air conditioner makes cab too cold
• Does not get warm enough
• Takes too long to heat up
33
Worked Example - Severity
Item Action Results
C O D
Current
Potential Response &
Potential Potential S l c Design e R
Cause(s)/ Recommended Target
Failure Effect(s) of e a c t P S O D R
Controls
Mechanism(s) Actions Complete Action
Mode Failure v s u e N E C E P
Of Failure Date Taken
s r c V C T N
Function PreventDetect
• EXAMPLE:
• Cannot see out of front window – severity ?
• Air conditioner makes cab too cold – severity ?
• Does not get warm enough – severity 5
• Takes too long to heat up – severity 4
34
Effect Criteria: Severity of Effect Defined Ranking
May endanger operator. Failure mode affects safe vehicle operation and / or
Hazardous:
involves noncompliance with government regulation. Failure will occur WITHOUT 10
Without Warning
Severity
warning.
May endanger operator. Failure mode affects safe vehicle operation and / or
Hazardous: With
involves noncompliance with government regulation. Failure will occur WITH 9
Warning
Definitions
warning.
Major disruption to production line. 100% of product may have to be scrapped.
Very High 8
Vehicle / item inoperable, loss of primary function. Customer very dissatisfied.
(AIAG) High
Minor disruption to production line. Product may have to be sorted and a portion
(less than 100%) scrapped. Vehicle operable, but at a reduced level of 7
performance. Customer dissatisfied.
Minor disruption to production line. A portion (less than 100%) may have to be
Moderate scrapped (no sorting). Vehicle / item operable, but some comfort / convenience 6
item(s) inoperable. Customers experience discomfort.
Minor disruption to production line. 100% of product may have to be reworked.
Low Vehicle / item operable, but some comfort / convenience item(s) operable at 5
reduced level of performance. Customer experiences some dissatisfaction.
Minor disruption to production line. The product may have to be sorted and a
Very Low portion (less than 100%) reworked. Fit / finish / squeak / rattle item does not 4
conform. Defect noticed by most customers.
Minor disruption to production line. A portion (less than 100%) of the product may
Minor have to be reworked on-line but out-of-station. Fit / finish / squeak / rattle item 3
does not conform. Defect noticed by average customers.
Minor disruption to production line. A portion (less than 100%) of the product may
Very Minor have to be reworked on-line but in-station. Fit / finish / squeak / rattle item does 2
not conform. Defect noticed by discriminating customers.
None No effect. 1
35
Severity Definitions - Manufacturing
36
Quiz – Severity Rating
What should the Severity rating be for cannot see
out of front window?
A. Severity of 1-2
B. Severity of 3-4
C. Severity of 5- 6
D. Severity of 7- 8
E. Severity of 9- 10
37
Quiz – Severity Rating
What should the Severity rating be for Air conditioner makes cab too
cold?
A. Severity of 1-2
B. Severity of 3-4
C. Severity of 5- 6
D. Severity of 7- 8
E. Severity of 9- 10
38
Classification: Severity & Occurrence
Item Action Results
C O Current D
Potential Response &
Potential Potential S l c Design e R
Cause(s)/ Recommended Target
Failure Effect(s) of e a c t P S O D R
Controls Action
Mechanism(s) Actions Complete
Mode Failure v s u e N E C E P
Of Failure Date Taken
s r c V C T N
Function Prevent Detect
• EXAMPLE:
• Cannot see out of front window – severity ?
• incorrect vent location – Occurrence ?
• Air conditioner makes cab too cold – Severity = 5
• Incorrect routing of vent hoses (too close to heat source) – Occurrence 6
39
SRL Safety/Regulatory/Legal
Class Column Symbol Table
WFF Warranty/Field Failure
Classification: 10 SRL SRL SRL SRL SRL SRL SRL SRL SRL
Severity & 9 SRL SRL SRL SRL SRL SRL SRL SRL SRL
1 2 3 4 5 6 7 8 9 10
Occurrence
40
Worked Example - Cause(s) of
Failure
Item Action Results
C O D
Current
Potential Response &
Potential Potential S l c Design e R
Cause(s)/ Recommended Target
Failure Effect(s) of e a c t P S O D R
Controls
Mechanism(s) Actions Complete Action
Mode Failure v s u e N E C E P
Of Failure Date Taken
s r c V C T N
Function Prevent Detect
• EXAMPLE:
• Incorrect location of vents
• Incorrect routing of vent hoses (too close to heat source)
• Inadequate coolant capacity for application 41
Worked Example - Occurrence
Item Action Results
C O D
Current
Potential Response &
Potential Potential S l c Design e R
Cause(s)/ Recommended Target
Failure Effect(s) of e a c t P S O D R
Controls
Mechanism(s) Actions Complete Action
Mode Failure v s u e N E C E P
Of Failure Date Taken
s r c V C T N
Function Prevent Detect
• EXAMPLE:
• Incorrect location of vents – occurrence ?
• Incorrect routing of vent hoses (too close to heat source) – occurrence ?
• Inadequate coolant capacity for application – occurrence 2 42
Occurrence Probability (AIAG)
Probability of Failure Possible Failure Rates Cpk Ranking
Very High: 1 in 2 < 0.33 10
Failure is almost inevitable 1 in 3 0.33 9
High: Generally associated with
1 in 8 0.51 8
processes similar to previous
B. Occurrence of 3-4
C. Occurrence of 5- 6
D. Occurrence of 7- 8
E. Occurrence of 9- 10
44
Quiz – Occurrence Rating
What should the Occurrence rating be for Incorrect routing of vent
hoses (too close to the heat source)?
A. Occurrence of 1-2
B. Occurrence of 3-4
C. Occurrence of 5- 6
D. Occurrence of 7- 8
E. Occurrence of 9- 10
45
Worked Example - Current Design
Controls
Item Action Results
C O Current D
Potential Response &
Potential Potential S l c Design e R
Cause(s)/ Recommended Target
Failure Effect(s) of e a c t P S O D R
Controls Action
Mechanism(s) Actions Complete
Mode Failure v s u e N E C E P
Of Failure Date Taken
s r c V C T N
Function Prevent Detect
• Preventive controls are those that help reduce the likelihood that a failure mode or cause will
occur – affects occurrence value
• Detective controls are those that find problems that have been designed into the product –
assigned detection value
• If detective and preventive controls are not listed in separate columns, they must include an
indication of the type of control
• EXAMPLE:
• Engineering specifications (P) – preventive control
• Historical data (P) – preventive control
• Functional testing (D) – detective control
• General vehicle durability (D) – detective control
46
Current Process Controls
• The mechanisms that either prevent to the extent possible the
failure mode from occurring or detect the failure modes should
it occur.
• Consider 3 types of process controls
– prevent the cause/mechanism or failure mode/effect from occurring,
or reduce their rate of occurrence.
– detect the cause/mechanism and lead to corrective actions,
– detect the failure mode.
• Examples
– SPC, Inspections, Monitoring, Training, Preventive Maintenance, etc.
47
Worked Example - Detection
Item Action Results
C O D
Current
Potential Response &
Potential Potential S l c Design e R
Cause(s)/ Recommended Target
Failure Effect(s) of e a c t P S O D R
Controls
Mechanism(s) Actions Complete Action
Mode Failure v s u e N E C E P
Of Failure Date Taken
s r c V C T N
Function Prevent Detect
• EXAMPLE:
• Engineering specifications – no detection value
• Historical data – no detection value
• Functional testing – detection 3
• General vehicle durability – detection 5
48
Detection Probabilities (AIAG)
Detection Criteria: Liklihood the existence of a defect will be Ranking
detected by test content before product advances to
next or subsequent process
50
Quiz – Detection Rating
What should the Detection rating be for Incorrect routing of vent hoses
(too close to heat source)?
A. Detection of 1-2
B. Detection of 3-4
C. Detection of 5- 6
D. Detection of 7- 8
E. Detection of 9- 10
51
RPN (Risk Priority Number)
Item Action Results
C O D
Current
Potential Response &
Potential Potential S l c Design e R
Cause(s)/ Recommended Target
Failure Effect(s) of e a c t P S O D R
Controls
Mechanism(s) Actions Complete Action
Mode Failure v s u e N E C E P
Of Failure Date Taken
s r c V C T N
Function PreventDetect
52
Recommended Actions
Item Action Results
C O D
Current
Potential Response &
Potential Potential S l c Design e R
Cause(s)/ Recommended Target
Failure Effect(s) of e a c t P S O D R
Controls
Mechanism(s) Actions Complete Action
Mode Failure v s u e N E C E P
Of Failure Date Taken
s r c V C T N
Function Prevent Detect
53
Responsibility & Target
Completion Date
Item Action Results
C O D
Current
Potential Response &
Potential Potential S l c Design e R
Cause(s)/ Recommended Target
Failure Effect(s) of e a c t P S O D R
Controls
Mechanism(s) Actions Complete Action
Mode Failure v s u e N E C E P
Of Failure Date Taken
s r c V C T N
Function Prevent Detect
54
Action Results
Item Action Results
C O D
Current
Potential Response &
Potential Potential S l c Design e R
Cause(s)/ Recommended Target
Failure Effect(s) of e a c t P S O D R
Controls
Mechanism(s) Actions Complete Action
Mode Failure v s u e N E C E P
Of Failure Date Taken
s r c V C T N
Function Prevent Detect
• Action taken must detail what actions occurred, and the results of those actions
• Actions must be completed by the target completion date
• Unless the failure mode has been eliminated, severity should not change
• Occurrence may or may not be lowered based upon the results of actions
• Detection may or may not be lowered based upon the results of actions
• If severity, occurrence or detection ratings are not improved, additional
recommended actions must be defined
55
Corrective Action Effectiveness
• Type of Action • Effectiveness %
• Improve or introduce 0
inspection 0-30
• Do it better next time 30-60
• Improve product 30-60
documentation
30-60
• Improve process
30-60
documentation
60-100
• Add to common errors list
60-100
• Education / Training
60-100
• Redesign / Rewrite Test Code
60-100
• Redesign part / subassembly
• Tool / (Avoid or Remove)
• Improve System or Production
Note: Action taken may include multiple Corrective Actions from the above list.
Ref: Stamatis D.H. (2003), Failure Mode and Effect Analysis: FMEA from Theory to Execution 56
ASQ Quality Press. 2nd Edition.
Additional Slides
Medical Device Example
57
Risk Analysis Example
Collagen Meniscus Implant
Menisci play a fundamental role in the knee joint.
The Collagen Meniscus Implant (CMI®) is a biological
and completely absorbable implant made from highly
purified collagen with a porous structure.
58
Risk Management Tables - Collagen
Meniscus Implant
59
Risk Analysis - Collagen Meniscus
Implant
60
Risk Analysis - Collagen Meniscus
Implant
Per Stamatis
(2003),
Effectiveness
Low
61
FMEA – Response to FDA Letter
St. Jude Medical Implantable Electronic Systems Division, Sylmar, CA.
Update in response to FDA-483 (November 7th 2012)
Inspectional observations and Warning Letter (January 10, 2013)
62
Risk Management
Framework and EN ISO
14971:2012 Standard
FMEA
63
Blank FMEA Form
Failure Mode and Effects Analysis
(Project FMEA) FMEA Number:
1 2 3 Page of
System/Component: Design Responsibility: 4 5Prepared by:
FMEA Date (Orig.) (Rev.)
Core Team:
Action Results
Item / O D
Process S Potential Cause(s)/ c e R. Responsibility & O D
Potential Failure Potential Effect(s) of Current Design Current Design Recommended S c e
e Mechanism(s) of c t P. Target Completion
Mode Failure Controls Prevention Controls Detection Action(s) ActionsTaken e c t
v Failure u e N. Date
Function r c v u e
6 r c
Action Results
Item / O D
Process S Potential Cause(s)/ c e R. Responsibility & O D
Potential Failure Potential Effect(s) of Current Design Current Design Recommended S c e
e Mechanism(s) of c t P. Target Completion
Mode Failure Controls Prevention Controls Detection Action(s) ActionsTaken e c t
v Failure u e N. Date
Function r c v u e
r c
7 8 9 10 11 12
Action Results
Item / O D
Process S Potential Cause(s)/ c e R. Responsibility & O D
Potential Failure Potential Effect(s) of Current Design Current Design Recommended S c e
e Mechanism(s) of c t P. Target Completion
Mode Failure Controls Prevention Controls Detection Action(s) ActionsTaken e c t
v Failure u e N. Date
Function r c v u e
r c
13 15 16 17
14
66
Possible Product Failure Modes
67