Source: "What is DOE?"; E-Chip, Inc.,www.echip.

com 1
Design o E!periments "DOE#

2
E!perimen $an Engineer

%ot going to wor& in a 'a(?

%ot intereste$ in research?

)'an to wor& in $esign an$*or

pro$uction?

Wh+ shou'$ +ou (e concerne$ with

e!perimentation?
3
E!perimenta' ,na'+sis in
)ro$uct -ea'i.ation
DEVELOPMENT DEVELOPMENT
Research
Design
(properties, processes)
(concepts, performance)
PRODUCTION PRODUCTION
Vai!ation
"#
(processes, performance) (monitoring)
4
E!perimentation
What we 'earn rom an e!periment ma+ $epen$ on
where we 'oo&, how we 'oo&, an$ the scope o our /iew0
1he 2'in$ 3an an$ the E'ephant
5
E!perimentation

E!perimenter4s irst goa': 5n$erstan$

the process0

E!periments - use$ to stu$+ eects o

parameters as the+ are set at /arious
'e/e's
S+stem
Signa'
actors
3easure$
response
Contro' actors
%oise actors
6
Cost o E!perimentation

-esources "peop'e, e6uipment, etc.#

1ime

3ateria' "unprocesse$ or unusa('e

pro$uct#

5sa('e pro$uct that is not (eing

pro$uce$
7
,pproaches to
E!perimentation

2ui'$-test-i!

One-actor-at-a-time "the c'assica'

approach#

Designe$ e!periments "DOE#

8
,pproaches to E!perimentation:
"2angun-57i-8i!# 2ui'$-1est-8i!

2ui'$-test-i!
2ui'$-test-i!

the tin&erer4s approach

9poun$ it to it, paint it to match:

impossi('e to &now i true optimum

achie/e$

+ou 6uit when it wor&s0

consistent'+ s'ow

re6uires intuition, 'uc&, rewor&

reoptimi.ation an$ continua' ire-ighting

9
,pproaches to E!perimentation:
One-8actor-at-a-1ime

One-actor-at-a-time
One-actor-at-a-time

proce$ure "; 'e/e' e!amp'e#

run a'' actors at one con$ition

repeat, changing con$ition o one actor

continuing to ho'$ that actor at that con$ition, rerun with

another actor at its secon$ con$ition

repeat unti' a'' actors at their optimum con$itions

s'ow, e!pensi/e: man+ tests

can miss interactions0

10
One-8actor-,t-,-1ime
)rocess: <ie'$ = "temperature, pressure#
>?@ +ie'$
A?@ +ie'$
3a! +ie'$: A?@ at BCC, 1>? psi?
11
One-8actor-,t-,-1ime
)rocess: <ie'$ = "temperature, pressure#
, (etter /iew o the ma!imum +ie'$0
Optimi.e$ +ie'$ is o/er CA@
12
,pproaches to E!perimentation:
DOE

Design o E!periments "DOE#

Design o E!periments "DOE#

, statistics-(ase$ approach to $esigne$

e!periments

, metho$o'og+ to achie/e a pre$icti/e

&now'e$ge o a comp'e!, mu'ti-/aria('e
process with the ewest tria's possi('e

,n optimi.ation o the e!perimenta'

process itse'
13
3a7or ,pproaches to DOE

8actoria' Design

1aguchi 3etho$

-esponse Surace Design

14
DOE - 8actoria' Designs

8u'' actoria'

simp'est $esign to create, (ut e!treme'+ ineicient

each actor teste$ at each con$ition o the actor

num(er o tests, %: % = +
!

where + = num(er o con$itions, ! = num(er
o actors

e!amp'e: C actors, ; con$itions each,

% = ;
C
= ;AD tests

resu'ts ana'+.e$ with ,%OE,

cost: resources, time, materia's, F

15
DOE - 8actoria' Designs - ;
>
1ria' , 2 C
1 Go Go Go
; Go Go Hi
> Go Hi Go
I Go Hi Hi
A Hi Go Go
D Hi Go Hi
B Hi Hi Go
C Hi Hi Hi
16
DOE - 8actoria' Designs

8ractiona' actoria'

9'ess than u'':

con$ition com(inations are chosen to

pro/i$e suicient inormation to $etermine
the actor eect

more eicient, (ut ris& missing interactions

17
DOE J 8actoria' Designs
"8ractiona': B actor, ; 'e/e'; 1;C C#
1ria' , 2 C D E 8 K
1 Go Go Go Go Go Go Go
; Go Go Go Hi Hi Hi Hi
> Go Hi Hi Go Go Hi Hi
I Go Hi Hi Hi Hi Go Go
A Hi Go Hi Go Hi Go Hi
D Hi Go Hi Hi Go Hi Go
B Hi Hi Go Go Hi Hi Go
C Hi Hi Go Hi Go Go Hi
18
DOE - 1aguchi 3etho$

1aguchi $esigns create$ (eore $es&top

computers were common

pre-create$, cata'oge$ $esigns inten$e$ to 6uic&'+

in$ a set o con$itions that meet the criteria o
success

pre/ious s'i$e an e!amp'e o an GC temp'ate

Designs cannot support response surace

mo$e's an$ are 'imite$ to on'+ pre$icting at
the points where $ata was ta&en
19
DOE - -esponse Surace:
-S3

Koa': $e/e'op a mo$e' that $escri(es a

continuous cur/e, or surace, that
connects the measure$ $ata ta&en at
strategica''+ important p'aces in the
e!perimenta' win$ow
20
DOE - -esponse Surace:
-S3

-S3 uses a 'east-s6uares cur/e-it

"regression ana'+sis# to:

ca'cu'ate a s+stem mo$e' (what is the process?)

test its /a'i$it+ (does it fit?)

ana'+.e the mo$e' (how does it behave?)

$on! % f(temperat&re, press&re, !&ration)
' % a
(
) a
*
T ) a
+
P ) a
,
D
) a
**
T
+
) a
++
P
+
) a
,,
D
+
) a
*+
TP ) a
*,
TD ) a
+,
PD
21
E!perimenta' Design )rocess
1. Determine the goa's
;. Deine the measures o success
>. Eeri+ easi(i'it+ "rough estimate#
I. Design the e!periment "precise estimate#
A. -un the e!periment
D. Co''ect an$ ana'+.e the $ata
B. Determine an$ /eri+ the response
C. ,ct on the resu'ts
22
E!perimenta' Design )rocess
1. Determine the goa's

$oing so oten 'ea$s to:

goa's are too man+ to co/er in a sing'e stu$+

goa's that seeme$ concrete are actua''+ /er+

negotia('e

once consensus achie/e$, a /a'i$

e!perimentation strateg+ can (e $e/e'ope$

p'an the action to (e ta&en i the e!periment is a

success or a ai'ure
23
E!perimenta' Design )rocess
;. Deine the measures o success

once the goa's are set, how $o we &now when

we are meeting them?

measures must (e metric an$ reer to an intrinsic

eature o the process or pro$uct

6ua'itati/e 9goo$*(a$: cannot (e mo$e'e$

inc'u$ing a 'arge num(er o responses 7ust to see

how the+ change oten $i/erts ocus rom the
responses that are critica' to meeting the goa's
24
E!perimenta' Design )rocess
>. Eeri+ easi(i'it+ "rough estimate#

use a power ca'cu'ation to $etermine

whether an+ inormation can (e oun$
with a reasona('e num(er o tria's

a unction o the amount o noise associate$

with a response

the more noise in the process, the more tria's

re6uire$ to see a change in the $esire$
parameter
25
E!perimenta' Design )rocess
>. Eeri+ easi(i'it+ "rough estimate#

e!amp'e: how man+ runs nee$e$ to o(ser/e

changes o A,??? psi in the tensi'e strength o a
p'astic e!tru$e$ part?
-eso'ution "psi# %um(er o runs
1???? A
A??? ;;
;A?? L?
1;A? >D;
26
E!perimenta' Design )rocess
I. Design the e!periment "precise
estimate#

I$enti+ the contro's to (e /arie$

3a&e the $esign

Determine whether the num(er o

e!periments is too 'arge

I necessar+, use a screening $esign to sit

through to in$ the critica' ew
27
E!perimenta' Design )rocess
A. -un the e!periment

, tas& in resource management

Comp'ete the wor& as eicient'+ an$ as

eecti/e'+ as possi('e
28
E!perimenta' Design )rocess
D. Co''ect an$ ana'+.e the $ata

2est to e!amine the $ata as a who'e

,na'+sis o a set o $ata has signiicant

a$/antage o/er contrasting the resu'ts
(etween two $ata points

,(i'it+ to in$ suspect $ata is great'+

enhance$

I there is a choice as to or$er, +ou ma+

wish to o(tain the most critica' $ata irst
29
E!perimenta' Design )rocess
B. Determine an$ /eri+ the response

, -esponse Surace gi/es +ou the a(i'it+

to pre$ict, with statistica' 'imits, the
(eha/ior o the process at an+ point
within the $esign win$ow

Com(ining pre$ictions rom se/era'

responses a''ows +ou to simu'taneous'+
optimi.e or se/era' &e+ speciications
30
E!perimenta' Design )rocess
C. ,ct on the resu'ts

Koa's set ear'ier i$entiie$ what was to (e

$one i success o(taine$ J $o it0

I no action is ta&en, wh+ was the e!periment

$one?

Comp'ete the $ocumentation o the

e!periment
31
Summar+

E!perimenter4s irst goa': 5n$erstan$

the process0
32
Summar+ "cont.#

1he cost o e!perimentation

-esources "peop'e, e6uipment, etc.#

1ime

3ateria' "unprocesse$ or unusa('e

pro$uct#

5sa('e pro$uct that is not (eing pro$uce$

33
Summar+ "cont.#

,pproaches to e!perimentation

2ui'$-test-i!

One-actor-at-a-time "the c'assica' approach#

Designe$ e!periments "DOE#

3a7or approaches to DOE

8actoria' Design "u'', ractiona'#

1aguchi 3etho$

-esponse Surace Design

34
Summar+ "cont.#

8u'' actoria'

simp'est $esign to create, (ut e!treme'+ ineicient

each actor teste$ at each con$ition o the actor

resu'ts ana'+.e$ with ,%OE,

cost: resources, time, materia's, F

1aguchi 3etho$

1aguchi $esigns create$ (eore $es&top

computers were common

Designs cannot support response surace mo$e's

an$ are 'imite$ to on'+ pre$icting at the points
where $ata was ta&en
35
Summar+ "cont.#

-esponse Surace 3o$e'ing

Koa': $e/e'op a continuous cur/e or

surace that mo$e's the eects o
parameters at $ierent 'e/e's
A.D
A.A
A.I
A.>
A.;
ECHI)
L?
C?
B?
D?
A?
Sensiti.erM;
A?
D?
B?
C?
L?
Sensiti.erM1
Spee$
D+e = ;A?.?
-eactionMtime = 1A?.?
36
Summar+ "cont.#

E!perimenta' Design process

Determine the goa's

Deine the measures o success

Eeri+ easi(i'it+ "rough estimate#

Design the e!periment "precise estimate#

-un the e!periment

Co''ect an$ ana'+.e the $ata

Determine an$ /eri+ the response

,ct on the resu'ts

Source: "What is DOE?"; E-Chip, Inc.,www.echip.com >B
E%D