Professional Documents
Culture Documents
DOE Guide
DOE Guide
DOE Guide
Design of Experiments
Guide
Therealvoyageofdiscoveryconsistsnotinseekingnew
landscapes,butinhavingneweyes.
MarcelProust
JMP,ABusinessUnitofSAS
SASCampusDrive
Cary,NC27513
12.1
Thecorrectbibliographiccitationforthismanualisasfollows:SASInstituteInc.2015.
JMP12DesignofExperimentsGuide.Cary,NC:SASInstituteInc.
JMP12DesignofExperimentsGuide
Copyright2015,SASInstituteInc.,Cary,NC,USA
ISBN9781629594422(Hardcopy)
ISBN9781629594446(EPUB)
ISBN9781629594453(MOBI)
ISBN9781629594439(PDF)
Allrightsreserved.ProducedintheUnitedStatesofAmerica.
For a hard-copy book:Nopartofthispublicationmaybereproduced,storedinaretrieval
system,ortransmitted,inanyformorbyanymeans,electronic,mechanical,photocopying,
orotherwise,withoutthepriorwrittenpermissionofthepublisher,SASInstituteInc.
For a web download or e-book:Youruseofthispublicationshallbegovernedbytheterms
establishedbythevendoratthetimeyouacquirethispublication.
Thescanning,uploading,anddistributionofthisbookviatheInternetoranyothermeans
withoutthepermissionofthepublisherisillegalandpunishablebylaw.Pleasepurchase
onlyauthorizedelectroniceditionsanddonotparticipateinorencourageelectronicpiracy
ofcopyrightedmaterials.Yoursupportofothersrightsisappreciated.
U.S. Government License Rights; Restricted Rights:TheSoftwareanditsdocumentationis
commercialcomputersoftwaredevelopedatprivateexpenseandisprovidedwith
RESTRICTEDRIGHTStotheUnitedStatesGovernment.Use,duplicationordisclosureof
theSoftwarebytheUnitedStatesGovernmentissubjecttothelicensetermsofthis
Agreementpursuantto,asapplicable,FAR12.212,DFAR227.72021(a),DFAR227.72023(a)
andDFAR227.72024and,totheextentrequiredunderU.S.federallaw,theminimum
restrictedrightsassetoutinFAR52.22719(DEC2007).IfFAR52.22719isapplicable,this
provisionservesasnoticeunderclause(c)thereofandnoothernoticeisrequiredtobe
affixedtotheSoftwareordocumentation.TheGovernmentsrightsinSoftwareand
documentationshallbeonlythosesetforthinthisAgreement.
SASInstituteInc.,SASCampusDrive,Cary,NorthCarolina275132414.
March2015
July2015
SASandallotherSASInstituteInc.productorservicenamesareregisteredtrademarksor
trademarksofSASInstituteInc.intheUSAandothercountries.indicatesUSA
registration.
Otherbrandandproductnamesaretrademarksoftheirrespectivecompanies.
Technology License Notices
ScintillaCopyright19982014byNeilHodgson<neilh@scintilla.org>.
AllRightsReserved.
Permissiontouse,copy,modify,anddistributethissoftwareanditsdocumentationfor
anypurposeandwithoutfeeisherebygranted,providedthattheabovecopyright
noticeappearinallcopiesandthatboththatcopyrightnoticeandthispermission
noticeappearinsupportingdocumentation.
NEILHODGSONDISCLAIMSALLWARRANTIESWITHREGARDTOTHISSOFTWARE,INCLUDING
ALLIMPLIEDWARRANTIESOFMERCHANTABILITYANDFITNESS,INNOEVENTSHALLNEIL
HODGSONBELIABLEFORANYSPECIAL,INDIRECTORCONSEQUENTIALDAMAGESORANY
DAMAGESWHATSOEVERRESULTINGFROMLOSSOFUSE,DATAORPROFITS,WHETHERINAN
ACTIONOFCONTRACT,NEGLIGENCEOROTHERTORTIOUSACTION,ARISINGOUTOFORIN
CONNECTIONWITHTHEUSEORPERFORMANCEOFTHISSOFTWARE.
TelerikRadControls:Copyright20022012,Telerik.UsageoftheincludedTelerik
RadControlsoutsideofJMPisnotpermitted.
ZLIBCompressionLibraryCopyright19952005,JeanLoupGaillyandMarkAdler.
MadewithNaturalEarth.Freevectorandrastermapdata@naturalearthdata.com.
PackagesCopyright20092010,StphaneSudre(s.sudre.free.fr).Allrightsreserved.
Redistributionanduseinsourceandbinaryforms,withorwithoutmodification,are
permittedprovidedthatthefollowingconditionsaremet:
Redistributionsofsourcecodemustretaintheabovecopyrightnotice,thislistof
conditionsandthefollowingdisclaimer.
Redistributionsinbinaryformmustreproducetheabovecopyrightnotice,thislistof
conditionsandthefollowingdisclaimerinthedocumentationand/orothermaterials
providedwiththedistribution.
NeitherthenameoftheWhiteBoxnorthenamesofitscontributorsmaybeusedto
endorseorpromoteproductsderivedfromthissoftwarewithoutspecificpriorwritten
permission.
THISSOFTWAREISPROVIDEDBYTHECOPYRIGHTHOLDERSANDCONTRIBUTORSASISAND
ANYEXPRESSORIMPLIEDWARRANTIES,INCLUDING,BUTNOTLIMITEDTO,THEIMPLIED
WARRANTIESOFMERCHANTABILITYANDFITNESSFORAPARTICULARPURPOSEARE
DISCLAIMED.INNOEVENTSHALLTHECOPYRIGHTOWNERORCONTRIBUTORSBELIABLEFOR
ANYDIRECT,INDIRECT,INCIDENTAL,SPECIAL,EXEMPLARY,ORCONSEQUENTIALDAMAGES
(INCLUDING,BUTNOTLIMITEDTO,PROCUREMENTOFSUBSTITUTEGOODSORSERVICES;LOSS
OFUSE,DATA,ORPROFITS;ORBUSINESSINTERRUPTION)HOWEVERCAUSEDANDONANY
THEORYOFLIABILITY,WHETHERINCONTRACT,STRICTLIABILITY,ORTORT(INCLUDING
NEGLIGENCEOROTHERWISE)ARISINGINANYWAYOUTOFTHEUSEOFTHISSOFTWARE,
EVENIFADVISEDOFTHEPOSSIBILITYOFSUCHDAMAGE.
iODBCsoftwareCopyright19952006,OpenLinkSoftwareIncandKeJin
(www.iodbc.org).Allrightsreserved.
Redistributionanduseinsourceandbinaryforms,withorwithoutmodification,are
permittedprovidedthatthefollowingconditionsaremet:
Redistributionsofsourcecodemustretaintheabovecopyrightnotice,thislistof
conditionsandthefollowingdisclaimer.
Redistributionsinbinaryformmustreproducetheabovecopyrightnotice,thislist
ofconditionsandthefollowingdisclaimerinthedocumentationand/orother
materialsprovidedwiththedistribution.
NeitherthenameofOpenLinkSoftwareInc.northenamesofitscontributorsmay
beusedtoendorseorpromoteproductsderivedfromthissoftwarewithoutspecific
priorwrittenpermission.
THISSOFTWAREISPROVIDEDBYTHECOPYRIGHTHOLDERSANDCONTRIBUTORSASISAND
ANYEXPRESSORIMPLIEDWARRANTIES,INCLUDING,BUTNOTLIMITEDTO,THEIMPLIED
WARRANTIESOFMERCHANTABILITYANDFITNESSFORAPARTICULARPURPOSEARE
DISCLAIMED.INNOEVENTSHALLOPENLINKORCONTRIBUTORSBELIABLEFORANYDIRECT,
INDIRECT,INCIDENTAL,SPECIAL,EXEMPLARY,ORCONSEQUENTIALDAMAGES(INCLUDING,
BUTNOTLIMITEDTO,PROCUREMENTOFSUBSTITUTEGOODSORSERVICES;LOSSOFUSE,
DATA,ORPROFITS;ORBUSINESSINTERRUPTION)HOWEVERCAUSEDANDONANYTHEORYOF
LIABILITY,WHETHERINCONTRACT,STRICTLIABILITY,ORTORT(INCLUDINGNEGLIGENCEOR
OTHERWISE)ARISINGINANYWAYOUTOFTHEUSEOFTHISSOFTWARE,EVENIFADVISEDOF
THEPOSSIBILITYOFSUCHDAMAGE.
bzip2,theassociatedlibrarylibbzip2,andalldocumentation,areCopyright
19962010,JulianRSeward.Allrightsreserved.
Redistributionanduseinsourceandbinaryforms,withorwithoutmodification,are
permittedprovidedthatthefollowingconditionsaremet:
Redistributionsofsourcecodemustretaintheabovecopyrightnotice,thislistof
conditionsandthefollowingdisclaimer.
Theoriginofthissoftwaremustnotbemisrepresented;youmustnotclaimthatyou
wrotetheoriginalsoftware.Ifyouusethissoftwareinaproduct,anacknowledgment
intheproductdocumentationwouldbeappreciatedbutisnotrequired.
Alteredsourceversionsmustbeplainlymarkedassuch,andmustnotbe
misrepresentedasbeingtheoriginalsoftware.
Thenameoftheauthormaynotbeusedtoendorseorpromoteproductsderivedfrom
thissoftwarewithoutspecificpriorwrittenpermission.
THISSOFTWAREISPROVIDEDBYTHEAUTHORASISANDANYEXPRESSORIMPLIED
WARRANTIES,INCLUDING,BUTNOTLIMITEDTO,THEIMPLIEDWARRANTIESOF
MERCHANTABILITYANDFITNESSFORAPARTICULARPURPOSEAREDISCLAIMED.INNOEVENT
SHALLTHEAUTHORBELIABLEFORANYDIRECT,INDIRECT,INCIDENTAL,SPECIAL,
EXEMPLARY,ORCONSEQUENTIALDAMAGES(INCLUDING,BUTNOTLIMITEDTO,
PROCUREMENTOFSUBSTITUTEGOODSORSERVICES;LOSSOFUSE,DATA,ORPROFITS;OR
BUSINESSINTERRUPTION)HOWEVERCAUSEDANDONANYTHEORYOFLIABILITY,WHETHER
INCONTRACT,STRICTLIABILITY,ORTORT(INCLUDINGNEGLIGENCEOROTHERWISE)ARISING
INANYWAYOUTOFTHEUSEOFTHISSOFTWARE,EVENIFADVISEDOFTHEPOSSIBILITYOF
SUCHDAMAGE.
RsoftwareisCopyright19992012,RFoundationforStatisticalComputing.
MATLABsoftwareisCopyright19842012,TheMathWorks,Inc.ProtectedbyU.S.
andinternationalpatents.Seewww.mathworks.com/patents.MATLABandSimulink
areregisteredtrademarksofTheMathWorks,Inc.See
www.mathworks.com/trademarksforalistofadditionaltrademarks.Otherproductor
brandnamesmaybetrademarksorregisteredtrademarksoftheirrespectiveholders.
libopcisCopyright2011,FlorianReuter.Allrightsreserved.
Redistributionanduseinsourceandbinaryforms,withorwithoutmodification,are
permittedprovidedthatthefollowingconditionsaremet:
Redistributionsofsourcecodemustretaintheabovecopyrightnotice,thislistof
conditionsandthefollowingdisclaimer.
Redistributionsinbinaryformmustreproducetheabovecopyrightnotice,thislist
ofconditionsandthefollowingdisclaimerinthedocumentationand/orother
materialsprovidedwiththedistribution.
NeitherthenameofFlorianReuternorthenamesofitscontributorsmaybeusedto
endorseorpromoteproductsderivedfromthissoftwarewithoutspecificprior
writtenpermission.
THISSOFTWAREISPROVIDEDBYTHECOPYRIGHTHOLDERSANDCONTRIBUTORSASIS
ANDANYEXPRESSORIMPLIEDWARRANTIES,INCLUDING,BUTNOTLIMITEDTO,THE
IMPLIEDWARRANTIESOFMERCHANTABILITYANDFITNESSFORAPARTICULARPURPOSE
AREDISCLAIMED.INNOEVENTSHALLTHECOPYRIGHTOWNERORCONTRIBUTORSBE
LIABLEFORANYDIRECT,INDIRECT,INCIDENTAL,SPECIAL,EXEMPLARY,OR
CONSEQUENTIALDAMAGES(INCLUDING,BUTNOTLIMITEDTO,PROCUREMENTOF
SUBSTITUTEGOODSORSERVICES;LOSSOFUSE,DATA,ORPROFITS;ORBUSINESS
INTERRUPTION)HOWEVERCAUSEDANDONANYTHEORYOFLIABILITY,WHETHERIN
CONTRACT,STRICTLIABILITY,ORTORT(INCLUDINGNEGLIGENCEOROTHERWISE)ARISING
INANYWAYOUTOFTHEUSEOFTHISSOFTWARE,EVENIFADVISEDOFTHEPOSSIBILITY
OFSUCHDAMAGE.
libxml2Exceptwhereotherwisenotedinthesourcecode(e.g.thefileshash.c,list.c
andthetriofiles,whicharecoveredbyasimilarlicencebutwithdifferentCopyright
notices)allthefilesare:
Copyright19982003DanielVeillard.AllRightsReserved.
Permissionisherebygranted,freeofcharge,toanypersonobtainingacopyofthis
softwareandassociateddocumentationfiles(theSoftware),todealintheSoftware
withoutrestriction,includingwithoutlimitationtherightstouse,copy,modify,merge,
publish,distribute,sublicense,and/orsellcopiesoftheSoftware,andtopermitpersons
towhomtheSoftwareisfurnishedtodoso,subjecttothefollowingconditions:
Theabovecopyrightnoticeandthispermissionnoticeshallbeincludedinallcopiesor
substantialportionsoftheSoftware.
THESOFTWAREISPROVIDEDASIS,WITHOUTWARRANTYOFANYKIND,EXPRESSOR
IMPLIED,INCLUDINGBUTNOTLIMITEDTOTHEWARRANTIESOFMERCHANTABILITY,
FITNESSFORAPARTICULARPURPOSEANDNONINFRINGEMENT.INNOEVENTSHALLTHE
DANIELVEILLARDBELIABLEFORANYCLAIM,DAMAGESOROTHERLIABILITY,WHETHER
INANACTIONOFCONTRACT,TORTOROTHERWISE,ARISINGFROM,OUTOFORIN
CONNECTIONWITHTHESOFTWAREORTHEUSEOROTHERDEALINGSINTHESOFTWARE.
Exceptascontainedinthisnotice,thenameofDanielVeillardshallnotbeusedin
advertisingorotherwisetopromotethesale,useorotherdealingsinthisSoftware
withoutpriorwrittenauthorizationfromhim.
GettheMostfromJMP
Whetheryouareafirsttimeoralongtimeuser,thereisalwayssomethingtolearn
aboutJMP.
VisitJMP.comtofindthefollowing:
liveandrecordedwebcastsabouthowtogetstartedwithJMP
videodemosandwebcastsofnewfeaturesandadvancedtechniques
detailsonregisteringforJMPtraining
schedulesforseminarsbeingheldinyourarea
successstoriesshowinghowothersuseJMP
ablogwithtips,tricks,andstoriesfromJMPstaff
aforumtodiscussJMPwithotherusers
http://www.jmp.com/getstarted/
Contents
Design of Experiments Guide
1
Introduction to DOE
Overview of Design of Experiment Platforms ...................................... 33
10
DefineResponsesandFactors ................................................... 55
SpecifytheModel .............................................................. 56
GeneratetheDesign ............................................................ 57
EvaluatetheDesign ............................................................. 58
MaketheTable ................................................................. 58
PrinciplesandGuidelinesforExperimentalDesign ................................... 59
EffectHierarchy ................................................................ 59
EffectHeredity ................................................................. 59
EffectSparsity .................................................................. 59
CenterPoints,ReplicateRuns,andTesting ........................................ 60
Custom Designs
Construct Designs That Meet Your Needs ......................................... 63
OverviewofCustomDesign ........................................................ 65
ExampleofaCustomDesign ....................................................... 66
CreatetheDesign ............................................................... 68
AnalyzetheData ............................................................... 77
CustomDesignWindow ........................................................... 83
Responses ..................................................................... 83
Factors ........................................................................ 85
DefineFactorConstraints ....................................................... 91
Model ......................................................................... 95
AliasTerms .................................................................... 96
DesignGeneration .............................................................. 97
Design ........................................................................ 100
DesignEvaluation ............................................................. 100
OutputOptions ............................................................... 101
CustomDesignOptions ........................................................... 102
SaveXMatrix ................................................................. 106
NumberofStarts .............................................................. 108
DesignSearchTime ............................................................ 108
SetDeltaforPower ............................................................ 109
TechnicalDetails .................................................................. 110
DesignswithRandomizationRestrictions ........................................ 110
CovariateswithHardtoChangeLevels ......................................... 119
11
12
Screening Designs
................................................................................. 231
13
14
11 Mixture Designs
................................................................................. 305
12 Covering Arrays
Detecting Component Interaction Failures ....................................... 333
OverviewofCoveringArrays ...................................................... 335
15
14 Space-Filling Designs
.................................................................................. 379
16
17
16 Nonlinear Designs
.................................................................................. 429
17 Taguchi Designs
.................................................................................. 449
18 Evaluate Designs
Explore Properties of Your Design ................................................ 461
OverviewofEvaluateDesign ...................................................... 463
ExampleofEvaluateDesign ....................................................... 464
AssessingtheImpactofLostRuns .............................................. 464
EvaluatingPowerRelativetoaSpecifiedModel .................................. 471
EvaluateDesignLaunchWindow .................................................. 473
EvaluateDesignWindow .......................................................... 473
Factors ........................................................................ 475
Model ........................................................................ 475
AliasTerms ................................................................... 476
Design ........................................................................ 476
18
19 Augmented Designs
................................................................................. 499
19
Column Properties
Understanding Column Properties Assigned by DOE ............................. 559
AddingandViewingColumnProperties ............................................ 561
ResponseLimits .................................................................. 562
ResponseLimitsExample ...................................................... 564
EditingResponseLimits ........................................................ 567
DesignRole ...................................................................... 570
DesignRoleExample .......................................................... 570
Coding ........................................................................... 573
LowandHighValues .......................................................... 573
CodingColumnPropertyandCenterPolynomials ................................ 574
20
Technical Details
The Model and Alias Matrices .................................................... 599
TheModelMatrix ................................................................ 601
TheAliasMatrix .................................................................. 601
DesignswithHardorVeryHardFactorChanges ................................. 602
DesignswithIfPossibleEffects ................................................. 602
C References
Index
Design of Experiments Guide .................................................... 609
Chapter 1
Learn about JMP
Documentation and Additional Resources
Thischapterincludesthefollowinginformation:
bookconventions
JMPdocumentation
JMPHelp
additionalresources,suchasthefollowing:
otherJMPdocumentation
tutorials
indexes
Webresources
Figure 1.1TheJMPHelpHomeWindowonWindows
Contents
FormattingConventions .......................................................... 23
JMPDocumentation.............................................................. 23
JMPDocumentationLibrary .................................................... 24
JMPHelp .................................................................... 28
AdditionalResourcesforLearningJMP ............................................. 28
Tutorials ..................................................................... 29
SampleDataTables ............................................................ 29
LearnaboutStatisticalandJSLTerms............................................ 29
LearnJMPTipsandTricks...................................................... 30
Tooltips ...................................................................... 30
JMPUserCommunity ......................................................... 30
JMPerCable.................................................................. 30
JMPBooksbyUsers ........................................................... 31
TheJMPStarterWindow ....................................................... 31
Chapter 1
Design of Experiments Guide
23
Formatting Conventions
Thefollowingconventionshelpyourelatewrittenmaterialtoinformationthatyouseeon
yourscreen.
Sampledatatablenames,columnnames,pathnames,filenames,fileextensions,and
foldersappearinHelveticafont.
Helvetica boldformattingindicatesitemsthatyouselecttocompleteatask:
buttons
checkboxes
commands
listnamesthatareselectable
menus
options
tabnames
textboxes
Thefollowingitemsappearinitalics:
wordsorphrasesthatareimportantorhavedefinitionsspecifictoJMP
booktitles
variables
scriptoutput
FeaturesthatareforJMPProonlyarenotedwiththeJMPProicon
ofJMPProfeatures,visithttp://www.jmp.com/software/pro/.
.Foranoverview
Note: SpecialinformationandlimitationsappearwithinaNote.
Tip: HelpfulinformationappearswithinaTip.
JMP Documentation
JMPoffersdocumentationinvariousformats,fromprintbooksandPortableDocument
Format(PDF)toelectronicbooks(ebooks).
24
Chapter 1
Design of Experiments Guide
AllbooksarealsocombinedintoonePDFfile,calledJMPDocumentationLibrary,for
convenientsearching.OpentheJMPDocumentationLibraryPDFfilefromtheHelp > Books
menu.
YoucanalsopurchaseprinteddocumentationandebooksontheSASwebsite:
http://www.sas.com/store/search.ep?keyWords=JMP
Document Purpose
Document Content
DiscoveringJMP
Ifyouarenotfamiliar
withJMP,starthere.
IntroducesyoutoJMPandgetsyou
startedcreatingandanalyzingdata.
UsingJMP
LearnaboutJMPdata
tablesandhowto
performbasic
operations.
CoversgeneralJMPconceptsand
featuresthatspanacrossallofJMP,
includingimportingdata,modifying
columnsproperties,sortingdata,and
connectingtoSAS.
BasicAnalysis
Performbasicanalysis
usingthisdocument.
DescribestheseAnalyzemenuplatforms:
Distribution
FitYbyX
MatchedPairs
Tabulate
Howtoapproximatesampling
distributionsusingbootstrappingand
modelingutilitiesarealsoincluded.
Chapter 1
Design of Experiments Guide
Document Title
Document Purpose
Document Content
EssentialGraphing
Findtheidealgraph
foryourdata.
DescribestheseGraphmenuplatforms:
GraphBuilder
OverlayPlot
Scatterplot3D
ContourPlot
BubblePlot
ParallelPlot
CellPlot
Treemap
ScatterplotMatrix
TernaryPlot
Chart
25
Thebookalsocovershowtocreate
backgroundandcustommaps.
Profilers
Learnhowtouse
interactiveprofiling
tools,whichenableyou
toviewcrosssections
ofanyresponse
surface.
CoversallprofilerslistedintheGraph
menu.Analyzingnoisefactorsis
includedalongwithrunningsimulations
usingrandominputs.
Designof
ExperimentsGuide
Learnhowtodesign
experimentsand
determineappropriate
samplesizes.
CoversalltopicsintheDOEmenuand
theScreeningmenuitemintheAnalyze>
Modelingmenu.
26
Chapter 1
Design of Experiments Guide
Document Title
Document Purpose
Document Content
FittingLinearModels
LearnaboutFitModel
platformandmanyof
itspersonalities.
Describesthesepersonalities,all
availablewithintheAnalyzemenuFit
Modelplatform:
SpecializedModels
Learnaboutadditional
modelingtechniques.
StandardLeastSquares
Stepwise
GeneralizedRegression
MixedModel
MANOVA
LoglinearVariance
NominalLogistic
OrdinalLogistic
GeneralizedLinearModel
DescribestheseAnalyze>Modeling
menuplatforms:
Partition
Neural
ModelComparison
Nonlinear
GaussianProcess
TimeSeries
ResponseScreening
TheScreeningplatformintheAnalyze>
ModelingmenuisdescribedinDesignof
ExperimentsGuide.
Multivariate
Methods
Readabouttechniques
foranalyzingseveral
variables
simultaneously.
DescribestheseAnalyze>Multivariate
Methodsmenuplatforms:
Multivariate
Cluster
PrincipalComponents
Discriminant
PartialLeastSquares
Chapter 1
Design of Experiments Guide
Document Title
Document Purpose
Document Content
QualityandProcess
Methods
Readabouttoolsfor
evaluatingand
improvingprocesses.
DescribestheseAnalyze>Qualityand
Processmenuplatforms:
Reliabilityand
SurvivalMethods
ConsumerResearch
Learntoevaluateand
improvereliabilityina
productorsystemand
analyzesurvivaldata
forpeopleand
products.
Learnaboutmethods
forstudyingconsumer
preferencesandusing
thatinsighttocreate
betterproductsand
services.
27
ControlChartBuilderandindividual
controlcharts
MeasurementSystemsAnalysis
Variability/AttributeGaugeCharts
ProcessCapability
ParetoPlot
Diagram
DescribestheseAnalyze>Reliabilityand
Survivalmenuplatforms:
LifeDistribution
FitLifebyX
RecurrenceAnalysis
DegradationandDestructive
Degradation
ReliabilityForecast
ReliabilityGrowth
ReliabilityBlockDiagram
Survival
FitParametricSurvival
FitProportionalHazards
DescribestheseAnalyze>Consumer
Researchmenuplatforms:
Categorical
MultipleCorrespondenceAnalysis
FactorAnalysis
Choice
Uplift
ItemAnalysis
28
Chapter 1
Design of Experiments Guide
Document Title
Document Purpose
Document Content
ScriptingGuide
Learnabouttaking
advantageofthe
powerfulJMP
ScriptingLanguage
(JSL).
Coversavarietyoftopics,suchaswriting
anddebuggingscripts,manipulating
datatables,constructingdisplayboxes,
andcreatingJMPapplications.
JSLSyntaxReference
ReadaboutmanyJSL
functionsonfunctions
andtheirarguments,
andmessagesthatyou
sendtoobjectsand
displayboxes.
Includessyntax,examples,andnotesfor
JSLcommands.
Note: TheBooksmenualsocontainstworeferencecardsthatcanbeprinted:TheMenuCard
describesJMPmenus,andtheQuickReferencedescribesJMPkeyboardshortcuts.
JMP Help
JMPHelpisanabbreviatedversionofthedocumentationlibrarythatprovidestargeted
information.YoucanopenJMPHelpinseveralways:
OnWindows,presstheF1keytoopentheHelpsystemwindow.
Gethelponaspecificpartofadatatableorreportwindow.SelecttheHelptool from
theToolsmenuandthenclickanywhereinadatatableorreportwindowtoseetheHelp
forthatarea.
WithinaJMPwindow,clicktheHelpbutton.
SearchtheHelpathttp://jmp.com/support/help/(Englishonly).
Tutorials(seeTutorialsonpage 29)
Sampledata(seeSampleDataTablesonpage 29)
Indexes(seeLearnaboutStatisticalandJSLTermsonpage 29)
Chapter 1
Design of Experiments Guide
TipoftheDay(seeLearnJMPTipsandTricksonpage 30)
Webresources(seeJMPUserCommunityonpage 30)
JMPerCabletechnicalpublication(seeJMPerCableonpage 30)
BooksaboutJMP(seeJMPBooksbyUsersonpage 31)
JMPStarter(seeTheJMPStarterWindowonpage 31)
29
Tutorials
YoucanaccessJMPtutorialsbyselectingHelp > Tutorials.ThefirstitemontheTutorialsmenu
isTutorials Directory.Thisopensanewwindowwithallthetutorialsgroupedbycategory.
IfyouarenotfamiliarwithJMP,thenstartwiththeBeginners Tutorial.Itstepsyouthroughthe
JMPinterfaceandexplainsthebasicsofusingJMP.
TherestofthetutorialshelpyouwithspecificaspectsofJMP,suchascreatingapiechart,
usingGraphBuilder,andsoon.
LetsyousearchforinformationaboutJSLfunctions,objects,anddisplay
boxes.YoucanalsoeditandrunsamplescriptsfromtheScriptingIndex.
Scripting Index
30
Chapter 1
Design of Experiments Guide
Tooltips
JMPprovidesdescriptivetooltipswhenyouplaceyourcursoroveritems,suchasthe
following:
Menuortoolbaroptions
Labelsingraphs
Textresultsinthereportwindow(moveyourcursorinacircletoreveal)
FilesorwindowsintheHomeWindow
CodeintheScriptEditor
JMPer Cable
TheJMPerCableisayearlytechnicalpublicationtargetedtousersofJMP.TheJMPerCableis
availableontheJMPwebsite:
http://www.jmp.com/about/newsletters/jmpercable/
Chapter 1
Design of Experiments Guide
31
TodisplaytheJMPStarterautomaticallywhenyouopenJMPonWindows,selectFile >
Preferences > General,andthenselectJMP Starter fromtheInitialJMPWindowlist.On
Macintosh,selectJMP > Preferences > Initial JMP Starter Window.
32
Chapter 1
Design of Experiments Guide
Chapter 2
Introduction to DOE
Overview of Design of Experiment Platforms
TheJMPDOEplatformshelpyoutodesignexperiments.Mostoftheplatformsfocuson
constructingdesignsofvarioustypes.Otherplatformssupportthedesigneffort.Thischapter
givesaquickoverviewofeachoftheplatformsfoundundertheDOEmenu.
DesignConstructionPlatforms
Constructsdesignsthatfitawidevarietyofsettings.Customdesignstendto
bemorecosteffectiveandflexiblethanapproachesbasedexclusivelyonclassicaldesigns.
Custom Design
Customdesignsaccommodatevarioustypesoffactors,constraints,anddisallowed
combinations.Youcanspecifywhicheffectsarenecessarytoestimateandwhichare
desirabletoestimate,giventhenumberofruns.Youcanspecifyanumberofrunsthat
matchesthebudgetforyourexperimentalsituation.Customdesignsalsosupport
hardtochangeandveryhardtochangefactors,allowingyoutoconstructsplitplotand
relateddesigns.
TheCustomDesignplatformconstructsmanyspecialdesigntypes:
screening
responsesurface
mixture
randomblock
splitplot
splitsplitplot
twowaysplitplot
Youcanconstructclassicalscreening,responsesurface,andmixturedesignsusingother
platforms.However,theCustomDesignplatformgivesyouflexibilitythatisnotavailable
intheotherplatforms.Constructingdesignsforsplitplotsituationscanbedoneonly
usingtheCustomDesignplatform.
Definitive Screening Design Constructsscreeningdesignsforcontinuousandtwolevel
categoricalfactors.Definitivescreeningdesignsareusefulifyoususpectactiveinteractions
orcurvature.Definitivescreeningdesignsenableyoutoidentifythesourceofstrong
34
Introduction to DOE
Chapter 2
Design of Experiments Guide
nonlineareffectswhileavoidingcompleteconfoundingbetweenanyeffectsupthrough
thesecondorder.
Definitivescreeningdesignsaresmall.Theyhaveroughlytwiceasmanyrunsasthereare
factors.Continuousfactorsaresetatthreelevels.Definitivescreeningdesignssupport
groupingrunsintoblocks.Thenumberofblocksisuserspecified.
Screening Design Constructsscreeningdesignsforcontinuous,discretenumeric,and
categoricalfactorswithanarbitrarynumberoflevels.Whenstandarddesignsexist,you
havetwooptions:
Choosefromalistofclassicalscreeningdesigns.Thesedesignsallowtwolevel
continuousfactorsorthreelevelcategoricalordiscretecontinuousfactors.
Generateadesignthatisorthogonalornearlyorthogonalformaineffects.
Nearorthogonaldesignsallowforcategoricalanddiscretenumericfactorswithany
numberoflevels,aswellastwolevelcontinuousfactors.Thesedesignsfocuson
estimatingmaineffectsinthepresenceofnegligibleinteractions.
Formanyscreeningsituations,standarddesignsarenotavailable.Inthesesituations,you
canconstructnearorthogonalscreeningdesigns.
Response Surface Design Constructsdesignsthatmodelaquadraticfunctionofcontinuous
factors.Tofitthequadraticeffects,responsesurfacedesignsrequirethreesettingsforeach
factor.JMPprovidesresponsesurfacedesignsforuptoeightfactors.
YoucanchoosefromalistofCentralCompositeorBoxBehnkendesigns.When
appropriate,CentralCompositedesignsthatblockorthogonallyareincludedinthelist.
VariousmodificationstoCentralCompositedesignsaresupported.
Full Factorial Design Constructsfullfactorialdesignsforanynumberofcontinuousor
categoricalfactors,bothwitharbitrarilymanylevels.Afullfactorialdesignhasarunat
everycombinationofsettingsofthefactors.Fullfactorialdesignstendtobelarge.The
numberofrunsequalstheproductofthenumbersoffactorlevels.
Constructsdesignsthatyouusewhenfactorsareingredientsinamixture.In
amixtureexperiment,achangeintheproportionofoneingredientrequiresthatoneor
moreoftheremainingingredientschangetomaintainthesum.Choosefromamong
severaldesigntypes,includingsomeclassicalmixturedesignapproaches:optimal,
simplexcentroid,simplexlattice,extremevertices,ABCD,andspacefilling.Foroptimal,
extremevertices,andspacefillingmixturedesigns,youcanspecifylinearinequality
constraintstolimitthedesignspace.
Mixture Design
andothersystems.Astrengthtcoveringarrayhasthepropertythateverycombinationof
levelsofeverytfactorsappearsinatleastonerun.Coveringarraysallowforanynumber
ofcategoricalfactors,eachwithanarbitrarynumberoflevels.Disallowedcombinations
canbespecified.
Chapter 2
Design of Experiments Guide
Introduction to DOE
35
factorsinachoicedesignareproductattributes.Thedesignarrangesproductprofiles,
whicharecombinationsofvariousattributes,inpairsoringroupsofthreeorfour.The
experimentconsistsofhavingrespondentsindicatewhichprofileinapairofprofilesthat
theyprefer.Youcangenerateachoicedesignthatreflectspriorinformationaboutthe
productattributes.
Space Filling Design Constructsdesignsforsituationswherethesystemofinterestis
deterministicorneardeterministic.Astandardapplicationinvolvescreatingasimpler
surrogatemodelofahighlycomplexdeterministiccomputersimulationmodel.
Inadeterministicsystem,thereisnovariation.Thegoalistominimizethedifference
betweenthefittedmodelandthetruemodel(bias).Spacefillingdesignsattempttomeet
thisgoaleitherbyspreadingthedesignpointsoutasfarfromeachotheraspossibleorby
spacingthepointsevenlyoverthedesignregion.
JMPprovidessevenspacefillingdesignapproaches.Oneoftheseapproaches,thefast
flexiblefillingdesign,accommodatescategoricalfactorswithanynumberoflevelsand
supportslinearconstraints.
Accelerated Life Test Design Constructsandaugmentsdesignsusefulfortestingproductsat
extremeconditionswhichareintendedtoacceleratefailuretime.Useexperimentalresults
topredictreliabilityundernormaloperatingconditions.
ThelifedistributioncanbelognormalorWeibull.Designscanincludeoneortwo
acceleratingfactors.Iftherearetwoacceleratingfactors,youcanchoosetoincludetheir
interaction.Youcanspecifypriordistributionsfortheaccelerationmodelparameters.
DoptimalandtwotypesofIoptimaldesignsareavailable.
Nonlinear Design Constructsandaugmentsdesignsthatyouusetofitmodelsthatare
nonlinearintheirparameters.Youcanconstructadesignusingestimatesfromamodelfit
toexistingdata.Youcanalsoconstructadesignbyapplyingpriorknowledgeifyoudonot
havemodelbasedestimates.
Taguchi Arrays Constructsdesignsthatyouuseforsignaltonoiseanalysis.Thedesignsare
basedonTaguchisinnerandouterarrayapproach.Controlfactorsettingsconstitutethe
innerarrayandnoisefactorsettingsformtheouterarray.Themeanandsignaltonoise
ratioaretheresponsesofinterest.
AnalternativetousingaTaguchiarrayistoconstructacustomdesignthatincludes
controlfactors,noisefactors,andcontrolbynoiseinteractions.Suchdesigns,called
combinedarrays,aregenerallymorecosteffectiveandinformativethanTaguchiarrays.
SupportingPlatforms
Providesdiagnosticsforanexistingexperimentaldesign.TheEvaluate
Designplatformprovidesvariouswaysforyoutoassessthestrengthsandlimitationsof
Evaluate Design
36
Introduction to DOE
Chapter 2
Design of Experiments Guide
yourdesign.Theplatformcanbeusedwithanydatatable,notonlydesignscreatedusing
JMP.
Severaldiagnosticsareprovided:
poweranalysis
predictionvarianceplots
estimationefficiencyforparameters
thealiasmatrix,showingthebiasstructureformodeleffects
acolormapshowingabsolutecorrelationsamongeffects
designefficiencyvalues
Addsrunstoexistingdesignsinsuchawaythattheresultingdesignis
optimal.AugmentDesignenablesyoutoconductexperimentsinaniterativefashion.You
canreplicatethedesign,addcenterpoints,createafoldoverdesign,addaxialpoints,add
pointstocreateaspacefillingdesign,oraugmentthedesignwithaspecifiednumberof
runs.Youcangrouprunsintoblockstodistinguishtheoriginalrunsfromtheaugmented
runs.Youcanaddmodeleffectsthatwerenotintheoriginalmodelandspecify
estimabilityrequirementsfortheseeffects.
Augment Design
situations:oneormoresamplemeans,astandarddeviation,oneortwoproportions,
countsperunit(Poissonmean),andsigmaqualitylevel.Fortheseoptions,youspecifytwo
ofthreequantitiestocomputethethird.Thesethreequantitiesarethedifferenceyouwant
todetect,thesamplesize,andthepower.Ifyousupplyonlyoneofthesevalues,aplotof
therelationshipbetweentheothertwovaluesisprovided.
Youcancomputethesamplesizerequiredforareliabilitytestplan,whereyourgoalisto
estimatefailureprobabilities.Youcanalsocomputethesamplesizerequiredfora
reliabilitydemonstration,whereyourgoalistodemonstratethataproductmeetsor
exceedsaspecifiedstandard.
Chapter 3
Starting Out with DOE
Example and Key Concepts
Adesignedexperimentisacontrolledsetoftestsdesignedtomodelandexplorethe
relationshipbetweenfactorsandoneormoreresponses.JMPincludesavarietyoftoolsthat
enableyoutocreateefficientexperimentaldesignsthatworkforyoursituation.Inparticular,
theseclassesofdesignsareavailable:
TheCustomDesignplatformcustomizesadesignforyouruniquesituation.Itconstructs
designsthataccommodateanynumberoffactorsofanytypeandfactorsthataredifficult
tochange(splitplotsituations).Youcontrolthenumberofruns.
TheDefinitiveScreeningDesignplatformconstructsaninnovativeclassofscreening
designswheremaineffectsarenotaliasedwitheachotherorwithtwowayinteractions.
Thesedesignsalsoallowestimationofquadraticterms.
TheScreeningDesign,ResponseSurfaceDesign,FullFactorialDesign,MixtureDesign,
andTaguchiArraysplatformsconstructtraditionalexperimentaldesigns.
TheCoveringArray,ChoiceDesign,SpaceFillingDesign,AcceleratedLifeTestDesign,
andNonlinearDesignplatformsconstructspecializeddesigntypes.
TheEvaluateDesignandAugmentDesignplatformsprovidetoolsforevaluatingand
augmentingexistingdesign.TheSampleSizeandPowerplatformaddressessamplesizeand
powercalculationsforspecializedsituations.
ThischapterpresentsanexamplethatillustratestheJMPapproachtoDOE.Thischapteralso
discussestheframeworkforDOE,theworkflowthatsupportsdesigncreation,andprinciples
thatarefundamentaltoDOE.
Figure 3.1ExampleofaProfilerPlot
Contents
OverviewofExperimentalDesignandtheDOEWorkflow............................. 39
TheCoffeeStrengthExperiment.................................................... 40
DefinetheStudyandGoals ..................................................... 40
CreatetheDesign ............................................................. 42
RuntheExperiment ........................................................... 48
AnalyzetheData .............................................................. 49
TheDOEWorkflow:Describe,Specify,Design ....................................... 54
DefineResponsesandFactors................................................... 55
SpecifytheModel............................................................. 56
GeneratetheDesign........................................................... 57
EvaluatetheDesign ........................................................... 58
MaketheTable................................................................ 58
PrinciplesandGuidelinesforExperimentalDesign................................... 59
EffectHierarchy............................................................... 59
EffectHeredity................................................................ 59
EffectSparsity ................................................................ 59
CenterPoints,ReplicateRuns,andTesting........................................ 60
Chapter 3
Design of Experiments Guide
39
Identify goal,
responses, and
factors.
Specify
Identify effects
for an assumed
model.
Design
Generate a
design and
evaluate it for
suitability.
Collect
Fit
Determine a
model that best
fits experimental
data.
Predict
YouperformthefirstthreestepsintheDOEplatforms.Theendresultisadesignthatcanbe
runinyourworkenvironment.Foradetaileddescriptionoftheworkflowforthesethree
steps,seeTheDOEWorkflow:Describe,Specify,Designonpage 54.
Describe Determinethegoalofyourexperiment.Identifyresponsesandfactors.
Yourgoalmightbetoidentifyactivefactors,tofindoptimalfactorsettings,ortobuilda
predictivemodel.
Determineorspecifyanassumedmodelthatyoubelieveadequatelydescribesthe
physicalsituation.
Specify
Yourassumedmodelisaninitialmodelthatideallycontainsalltheeffectsthatyouwantto
estimate.Insomeplatforms,youcanexplicitlybuildthemodelofinterest.Inothers,the
modelisimplicitinthechoicesthatyoumake.Forexample,intheScreeningDesign
platform,youmightselectamodelwithagivenresolution.Theresolutionofthedesign
determineswhicheffectsareconfounded.Confoundingofeffectspotentiallyleadsto
ambiguityaboutwhicheffectistrulyactive.
Generateadesignthatisconsistentwithyourassumedmodel.Evaluatethisdesign
tounderstanditsstrengthsandlimitations,andtoensurethatitprovidestheinformation
thatyouneed,givenyourmodelandgoals.
Design
TheDesignEvaluationorDesignDiagnosticsoutlineinthedesigngenerationplatform
giveyouinsightaboutthepropertiesofyourdesign.
Thenextstepisthedatacollectionphase,wheretheexperimentisrunundercontrolled
conditions.
Collect Conducteachofthetrialsandrecordtheresponsevalues.
40
Chapter 3
Design of Experiments Guide
Afteryourunyourexperiment,scriptsinthegenerateddatatablehelpyoufitamodelusing
platformssuchasFitModelandScreening.Dependingonyourgoal,themodelcanhelpyou
identifyactiveeffectsorfindoptimalsettings.
Fit
Fityourassumedmodeltotheexperimentaldata.
UsetheJMPmodelingplatformstofitandrefineyourmodel.Insomesituations,you
mightneedtoaugmentthedesignandperformadditionalrunstoresolvemodel
ambiguity.
Predict
Useyourrefinedmodeltoaddressyourexperimentalgoals.
Determinewhicheffectsareactive,findfactorlevelstooptimizeresponses,orbuilda
predictivemodel.
Designedexperimentsaretypicallyusedsequentiallytoconstructprocessknowledge.A
designstrategyoftenbeginswithascreeningdesigntonarrowthelistofpotentiallyactive
factors.Thentheidentifiedfactorsarestudiedindesignsthatfocusonbuildingabetter
understandingofinteractionsandquadraticeffects.Sometimesthereisaneedtoaugmenta
designtoresolveambiguitiesrelatingtothefactorsresponsibleforeffects.Thestepsoutlined
inthissectionrelatetoconductingandanalyzingasingleexperiment.However,youmay
requireasequenceofexperimentstoachieveyourgoals.
TheexampleinTheCoffeeStrengthExperimentonpage 40explicitlyillustratesthestepsin
theDOEworkflowprocess.Italsoshowshowtouseadatatablescripttoanalyzeyour
experimentaldata.ManyexamplesintheDesignofExperimentsGuideillustrateboththe
workflowthatsupportsagooddesignandtheanalysisoftheexperimentaldatafromthe
study.
DefinetheStudyandGoalsonpage 40
CreatetheDesignonpage 42
RuntheExperimentonpage 48
AnalyzetheDataonpage 49
Chapter 3
Design of Experiments Guide
41
Response
TheresponseiscoffeeStrength.Itismeasuredastotaldissolvedsolids,usingarefractometer.
Thecoffeeisbrewedusingasinglecupcoffeedripperandmeasuredfiveminutesafterthe
liquidisreleasedfromthegrounds.
Previousstudiesindicatethatastrengthreadingof1.3ismostdesirable,thoughthestrength
isstillacceptableifitfallsbetween1.2and1.4.
Factors
Fourfactorsareidentifiedforthestudy:Grind,Temperature,Time,andCharge.Coffeeis
brewedatthreestationsintheworkarea.Toaccountforvariationduetobrewinglocation,
Stationisincludedinthestudyasablockingfactor.Thefollowingdescribesthefactors:
Grindisthecoarsenessofthegrind.Grindissetattwolevels,MediumandCoarse.
TemperatureisthetemperatureindegreesFahrenheitofthewatermeasuredimmediately
beforepouringitoverthegrounds.Temperature issetat195and205degreesFahrenheit.
Time isthebrewingtimeinminutes.Timeissetat3or4minutes.
Charge istheamountofcoffeeplacedintheconefilter,measuredingramsofcoffeebeans
perounceofwater.Charge issetat1.6and2.4.
Stationisthelocationwherethecoffeeisbrewed.Thethreestationsarelabeledas1,2,and
3.
Table 3.1summarizesinformationaboutthefactorsandtheirsettings.Thefactorsandlevels
arealsogivenintheCoffee Factors.jmpsampledatatable,locatedintheDesign Experiment
folder.
Table 3.1FactorsandRangeofSettingsforCoffeeExperiment
Factor
Role
Range of Settings
Grind
Categorical
Medium
Coarse
Temperature
Continuous
195
205
Time
Continuous
Charge
Continuous
1.6
2.4
Station
Blocking
Notethefollowing:
Grindiscategoricalwithtwolevels.
Temperature,Time,andChargearecontinuous.
Stationisablockingfactorwiththreelevels.
42
Chapter 3
Design of Experiments Guide
Allfactorscanbevariedandresetforeachrun.Therearenohardtochangefactorsforthis
experiment.
TheapparatususedinrunningthecoffeeexperimentisshowninFigure 3.3.Thisisthesetup
atoneofthethreebrewingstations.Thetwootherstationshavethesametypeofequipment.
Figure 3.3CoffeeExperimentApparatus
NumberofRuns
Basedontheresourcesandtimeavailable,youdeterminethatyoucanconduct12runsinall.
Sincetherearethreestations,youconduct4runsateachstation.
DefineResponsesandFactorsonpage 55
SpecifytheModelonpage 56
GeneratetheDesignonpage 57
EvaluatetheDesignonpage 58
MaketheTableonpage 58
Chapter 3
Design of Experiments Guide
43
4. ClickunderLower Limitandtype1.2.
5. ClickunderUpper Limitandtype1.4.
6. LeavetheareaunderImportanceblank.
Becausethereisonlyoneresponse,thatresponseisgivenImportance1bydefault.
ThecompletedResponsesoutlineappearsinFigure 3.5.
Factors
Enterfactorseithermanuallyorfromapreexistingtablethatcontainsthefactorsand
settings.Ifyouaredesigninganewexperiment,youmustfirstenterthefactorsmanually.
OnceyouhavesavedthefactorstoadatatableusingtheSaveFactorsoption,youcanload
themusingthesavedtable.
Forthisexample,youcanchooseeitheroption.SeeEnteringFactorsManuallyonpage 43or
seeEnteringFactorsUsingLoadFactorsonpage 45.
EnteringFactorsManually
1. ClickAdd Factor > Categorical > 2 Level.
2. TypeGrindoverthedefaultNameofX1.
44
Chapter 3
Design of Experiments Guide
NotethatRoleissettoCategorical,asrequested.TheChangesattributeissettoEasyby
default,indicatingthatGrindsettingscanberesetforeveryrun.
3. ClickthedefaultValues,L1andL2,andchangethemtoCoarseandMedium.
4. Type3nexttoAdd N Factors. ThenclickAdd Factor > Continuous.
5. Typethefollowingnamesandvaluesoverthedefaultentries:
Temperature (195and205)
Time (3and4)
Charge(1.6and2.4)
6. ClickAdd Factor > Blocking > 4 runs per block.
Recallthatyourrunbudgetallowsfor12runs.Youwanttobalancetheserunsamongthe
threestations.
7. TypeStationoverthedefaultNameofX5.
NoticethatRoleissettoBlockingandthatonlyonesettingforValuesappears.Thisis
becauseJMPcannotdeterminethenumberofblocksuntilthedesirednumberofrunsis
specified.OnceyouspecifytheNumberofRunsintheDesignGenerationoutline,JMP
updatesthenumberoflevelsforStationtowhatisrequired.
ThecompletedFactorsoutlineisshowninFigure 3.5.
Figure 3.5CompletedResponsesandFactorsOutlines
8. ClickContinue.
ThefollowingoutlinesareaddedtotheCustomDesignwindow:
DefineFactorConstraints(notusedinthisexample)
Chapter 3
Design of Experiments Guide
45
Model
AliasTerms
DesignGeneration
EnteringFactorsUsingLoadFactors
Toenterfactorsusingatablecontainingfactorinformation,proceedasfollows:
1. FromtheCustomDesignredtrianglemenu,selectLoad Factors.
2. SelectHelp > Sample Data LibraryandopenDesign Experiment/Coffee Factors.jmp.
Afterloadingthefactors,theCustomDesignwindowisupdated.Thefollowingoutlines
areaddedtotheCustomDesignwindow:
DefineFactorConstraints(notusedinthisexample)
Model
AliasTerms
DesignGeneration
DefineFactorConstraints
TheDefineFactorConstraintsoutlineappearsonceyouhaveenteredyourfactorsmanually
andclickedContinue,oronceyouhaveloadedthefactorsfromthefactortable.Addingfactor
constraints,ifyouhaveany,ispartoftheResponsesandFactorsstep.Sincethereareno
constraintsonfactorsettingsforthisdesign,leavethisoutlineunchanged.
Specify the Model
ModelOutline
Figure 3.7showstheModeloutline.TheModeloutlineiswhereyouspecifyyourassumed
model,whichcontainstheeffectsthatyouwanttoestimate.SeeSpecifyonpage 39.Thelist
thatappearsbydefaultshowsallmaineffectsasNecessary,indicatingthatthedesignis
capableofestimatingallmaineffects.Becauseyourmaininterestatthispointisinthemain
effectsofthefactors,youdonotaddanyeffectstotheModeloutline.
46
Chapter 3
Design of Experiments Guide
Figure 3.6ModelOutlinewithMainEffectsOnly
Chapter 3
Design of Experiments Guide
47
1. ClickMake Design.
TheDesignandDesignEvaluationoutlinesareaddedtotheCustomDesignwindow.The
OutputOptionspanelalsoappears.
TheDesignoutlineshowsthedesign(Figure 3.8).IfyoudidnotfollowthestepsinSteps
toDuplicateResults(Optional)onpage 46,yourdesignmightbedifferentfromtheone
inFigure 3.8.Thisisbecausethealgorithmbeginswitharandomstartingdesign.
Figure 3.8DesignforCoffeeExperiment
1. ClickMake Table.
ThedatatableshowninFigure 3.10opens.Keepinmindthat,ifyoudidnotfollowthe
stepsinStepstoDuplicateResults(Optional)onpage 46,yourdesigntablemightbe
different.Yourdesigntablerepresentsanotheroptimaldesign.
48
Chapter 3
Design of Experiments Guide
Figure 3.10CustomDesignTable
NotetheasterisksintheColumnspaneltotherightofthefactorsandresponse.Theseindicate
columnpropertiesthathavebeensavedtothecolumnsinthedatatable.Thesecolumn
propertiesareusedintheanalysisofthedata.Formoreinformation,seeFactorsonpage 85
andFactorColumnPropertiesonpage 90.
Chapter 3
Design of Experiments Guide
49
50
Chapter 3
Design of Experiments Guide
AnalyzetheModel
TheEffectSummaryandActualbyPredictedPlotreportsgivehighlevelinformationabout
themodel.
Figure 3.13EffectSummaryandActualbyPredictedPlotforFullModel
Notethefollowing:
TheActualbyPredictedPlotshowsnoevidenceoflackoffit.
Themodelissignificant,asindicatedbytheActualbyPredictedPlot.Thenotation
P = 0.0041,shownbelowtheplot,givesthesignificanceleveloftheoverallmodeltest.
TheEffectSummaryreportshowsthatCharge,Station,andTimearesignificantatthe0.05
level.
TheEffectSummaryreportalsoshowsthatTemperatureandGrindarenotsignificant.
ReducetheModel
BecauseTemperatureandGrindappearnottobeactive,theycontributerandomnoisetothe
model.Refitthemodelwithouttheseeffectstoobtainmorepreciseestimatesofthemodel
parametersassociatedwiththeactiveeffects.
1. IntheModelSpecificationwindow,selectTemperatureandGrindintheConstructModel
Effectslist.
2. ClickRemove.
Chapter 3
Design of Experiments Guide
51
3. ChangetheEmphasistoEffect Screening.
TheEffectScreeningemphasispresentsreports(suchasthePredictionProfiler)thatare
usefulforanalyzingexperimentaldesigns.
4. ClickRun.
Figure 3.14PartialResultsforReducedModel
Notethefollowing:
TheEffectTestsreportshowsthatallthreeeffectsremainsignificant.
TheScaledEstimatesreportfurtherindicatesthattheStation[1]andStation[3]meansdiffer
significantlyfromtheaverageresponseofStrength.
NotethattheEstimatesthatappearintheParameterEstimatesreportareidenticaltotheir
counterpartsintheScaledEstimatesreport.Thisisbecausetheeffectsarecoded.See
Codingonpage 573intheColumnPropertiesappendix.
TheestimateoftheStation[3]effectonlyappearsintheScaledEstimatesreport,where
nominalfactorsareexpandedtoshowestimatesforalltheirlevels.
TheParameterEstimatesreportgivesestimatesforthemodelcoefficientswherethemodel
isspecifiedintermsofthecodedeffects.
52
Chapter 3
Design of Experiments Guide
ExploretheModel
ThePredictionProfilerappearsatthebottomofthereport.
Figure 3.15PredictionProfiler
Recallthat,indesigningyourexperiment,yousetaresponseGoalofMatchTargetwithlimits
of1.2and1.4.JMPusesthisinformationtoconstructadesirabilityfunctiontoreflectyour
specifications.Formoredetails,seeFactorsonpage 85.
NotethefollowinginFigure 3.15:
ThefirsttwoplotsinthetoprowofthegraphshowhowStrengthvariesforoneofthe
factors,giventhesettingoftheotherfactor.Forexample,whenChargeis2,thelineinthe
plotforTimeshowshowpredictedStrengthchangeswithTime.
ThevaluestotheleftofthetoprowofplotsgivethePredictedStrength (inred)anda
confidenceintervalforthemeanStrength fortheselectedfactorsettings.
TherightmostplotinthetoprowshowsthedesirabilityfunctionforStrength.The
desirabilityfunctionindicatesthatthetargetof1.3ismostdesirable.Desirabilitydecreases
asyoumoveawayfromthattarget.Desirabilityiscloseto0atthelimitsof1.2and1.4.
Theplotsinthebottomrowshowthedesirabilitytraceforeachfactoratthesettingofthe
otherfactor.
ThevaluetotheleftofthebottomrowofplotsgivestheDesirabilityoftheresponsevalue
fortheselectedfactorsettings.
Explorevariousfactorsettingsbydraggingthereddashedverticallinesinthecolumnsfor
TimeandCharge.Sincetherearenointeractionsinthemodel,theprofilerindicatesthat
increasingChargeincreasesStrength.Also,Strengthseemstobemoresensitivetochangesin
ChargethantochangesinTime.
Chapter 3
Design of Experiments Guide
53
SinceStationisablockingfactor,itdoesnotappearinthePredictionProfiler.However,you
mightliketoseehowpredictedStrengthvariesbyStation.ToincludeStationinthePrediction
Profiler,followthesesteps:
1. FromthePredictionProfilerredtrianglemenu,selectReset Factor Grid.
AFactorSettingswindowappearswithcolumnsforTime,Charge,andStation.Under
Station,noticethattheboxcorrespondingtoShowisnotselected.Thisindicatesthat
StationisnotshowninthePredictionProfiler.
2. SelecttheboxunderStationintherowcorrespondingtoShow.
3. DeselecttheboxunderStationintherowcorrespondingtoLock Factor Setting.
Figure 3.16FactorSettingsWindow
4. ClickOK.
PlotsforStationappearinthePredictionProfiler.
5. ClickineitherplotaboveStationtoinsertadashedredverticalline.
6. MovethedashedredverticallinetoStation1.
Figure 3.17PredictionProfilerShowingResultsforStation1
54
Chapter 3
Design of Experiments Guide
7. MovethedashedredverticallinetoStation3.
Figure 3.18PredictionProfilerShowingResultsforStation3
ThepredictedStrengthinthecenterofthedesignregionforStation1is1.44.ForStation3,
thepredictedStrengthisabout1.18.Themagnitudeofthedifferenceindicatesthatyou
needtoaddressStationvariability.BettercontrolofStationvariationshouldleadtomore
consistentStrength.OnceStationconsistencyisachieved,youcandeterminecommon
optimalsettingsforTimeandCharge.
Theprocessthatyouusedtoconstructthedesignforthecoffeeexperimentfollowedthesteps
intheDOEworkflow.ThenextsectiondescribestheDOEworkflowinmoredetail.
CustomDesign
DefinitiveScreeningDesign
ScreeningDesign
ResponseSurfaceDesign
FullFactorialDesign
MixtureDesign
CoveringArray
SpaceFillingDesign
TaguchiArrays
Chapter 3
Design of Experiments Guide
55
Threespecialpurposeplatformsdiffersubstantially:ChoiceDesigns,AcceleratedLifeTest
Design,andNonlinearDesign.Thesethreeplatformsarenotaddressedinthissection.
ThissectiondescribesthestepsintheDOEworkflow.Italsodiscussestheirimplementationin
thevariousdesignplatforms.
1. DefineResponsesandFactorsonpage 55.
2. SpecifytheModelonpage 56
3. GeneratetheDesignonpage 57
4. EvaluatetheDesignonpage 58
5. MaketheTableonpage 58
Youidentifytheresponsesandfactorsofinterest.
Youdetermineyourgoalsfortheexperiment.Doyouwanttomaximizetheresponse,or
hitatarget?Whatisthattarget?Ordoyousimplywanttoidentifywhichfactorshavean
effectontheresponse?
Youidentifyfactorsettingsthatdescribeyourexperimentalrangeordesignspace.
Whentheyopen,mostoftheJMPDOEplatformsdisplayoutlineswhereyoucanlistyour
responsesandyourfactors.TheResponsesoutlineiscommonacrossplatforms.Thereyou
insertyourresponsesandadditionalinformation,suchastheresponsegoal,lowerlimit,
upperlimit,andimportance.
TheFactorsoutlinevariesacrossplatforms.Thisistoaccommodatethetypesoffactorsand
specificdesignsituationsthateachplatformaddresses.Incertainplatforms,onceresponses
andfactorsareentered,aDefineFactorConstraintsoutlineappearsafteryouclickContinue.
Inthisoutline,youcanconstrainthevaluesofthefactorsthatareavailableforthedesign.
Figure 3.19showstheResponsesandFactorsoutlineusingtheCustomDesignplatformfor
constructingthedesignintheBox Corrosion Split-Plot.jmpsampledatatable,locatedinthe
Design Experimentfolder.AlsoshownistheDefineFactorConstraintsoutline,whichappears
onceyouclickContinue.TheDefineConstraintsoutlineenablesyoutospecifyrestrictions
thatyourfactorsettingsmustsatisfy.
56
Chapter 3
Design of Experiments Guide
Figure 3.19ResponsesandFactorsforBoxCorrosionSplitPlotExperiment
Chapter 3
Design of Experiments Guide
57
Figure 3.20ModelOutlineforBoxCorrosionSplitPlotExperiment
58
Chapter 3
Design of Experiments Guide
Chapter 3
Design of Experiments Guide
59
Effect Hierarchy
Inregressionmodeling,theprincipleofeffecthierarchymaintainsthatmain(firstorder)effects
tendtoaccountforthelargestamountsofvariationintheresponse.Secondordereffects,that
is,interactioneffectsandquadraticterms,arenextintermsofaccountingforvariation.Then
comehigherorderterms,inhierarchicalorder.
Herearetheimplicationsformodeling:maineffectsaremorelikelytobeimportantthan
secondordereffects;secondordereffectsaremorelikelytobeimportantthanthirdorder
effects;andsoon,forhigherorderterms.
Effect Heredity
Theprincipleofeffectheredityrelatestotheinclusioninthemodeloflowerordercomponents
ofhigherordereffects.Themotivationforthisprincipleisobservationalevidencethatfactors
withsmallmaineffectstendnottohavesignificantinteractioneffects.
Strongeffectheredityrequiresthatalllowerordercomponentsofamodeleffectbeincludedin
themodel.Supposethatathreewayinteraction(ABC)isinthemodel.Thenallofits
componentmaineffectsandtwowayinteractions(A,B,C,AB,AC,BC)mustalsobeinthe
model.
Weakeffectheredityrequiresthatonlyasequenceoflowerordercomponentsofamodeleffect
beincluded.Ifathreewayinteractionisinthemodel,thenthemodelmustcontainoneofthe
factorsinvolvedandonetwowayinteractioninvolvingthatfactor.Supposethatthe
threewayinteractionABCisinthemodel.ThenifBandBCarealsointhemodel,themodel
satisfiesweakeffectheredity.
Forcontinuousfactors,effectheredityensuresthatthemodelisinvarianttochangesinthe
locationandscaleofthefactors.
Effect Sparsity
Theprincipleofeffectsparsityassertsthatmostofthevariationintheresponseisexplainedby
arelativelysmallnumberofeffects.Screeningdesigns,wheremanyeffectsarestudied,rely
heavilyoneffectsparsity.Experienceshowsthatthenumberofrunsusedinascreening
designshouldbeatleasttwicethenumberofeffectsthatarelikelytobesignificant.
60
Chapter 3
Design of Experiments Guide
Chapter 3
Design of Experiments Guide
61
besignificantinthissecondcase,thelackoffitmeansquaremustbe19timeslargerthanthe
pureerrormeansquare.Itisalsotruethatthelackoffittestissensitivetooutliers.
FordetailsabouttheLackofFittest,seetheStandardLeastSquareschapterintheFitting
LinearModelsbook.
DeterminingtheNumberofRuns
Inindustrialapplications,eachrunisoftenverycostly,sothereisincentivetominimizethe
numberofruns.Toestimatethefixedeffectsofinterest,youneedonlyasmanyrunsasthere
aretermsinthemodel.Todeterminewhethertheeffectsareactive,youneedareasonable
estimateoftheerrorvariance.Unlessyoualreadyhaveagoodestimateofthisvariance,
consideraddingatleast4runstothenumberrequiredtoestimatethemodelterms.
62
Chapter 3
Design of Experiments Guide
Chapter 4
Custom Designs
Construct Designs That Meet Your Needs
UsetheCustomDesignplatformtoconstructoptimaldesignsthatarecustombuiltforyour
specificexperimentalsetting.Generally,acustomdesignismorecosteffectivethanadesign
obtainedusingalternativemethods.Youcanperformthefollowingtasks:
Enterfactorsofmanydifferenttypes.
Specifyconstraintsonthedesignspace.
Indicatewhicheffectsarenecessarytoestimateandwhicharedesirabletoestimate,if
possible,giventhenumberofruns.
Specifyanumberofexperimentalrunsthatmatchesyourbudget.
TheCustomDesignplatformconstructsawidevarietyofdesigns,includingthesespecial
designtypes:Screening,ResponseSurface,Mixture,RandomBlock,SplitPlot,SplitSplitPlot,
andTwoWaySplitPlot.
ThischaptercontainsadetailedexampleofhowtousetheCustomDesignplatform,followed
byinformationabouttheplatform.SeealsotheExamplesofCustomDesignschapteron
page 127.
Figure 4.1ColorMapforAbsoluteCorrelations
Contents
OverviewofCustomDesign ....................................................... 65
ExampleofaCustomDesign ...................................................... 66
CreatetheDesign ............................................................. 68
AnalyzetheData .............................................................. 77
CustomDesignWindow .......................................................... 83
Responses .................................................................... 83
Factors ....................................................................... 85
DefineFactorConstraints ...................................................... 91
Model ....................................................................... 95
AliasTerms................................................................... 96
DesignGeneration ............................................................ 97
Design ...................................................................... 100
DesignEvaluation ............................................................ 100
OutputOptions .............................................................. 101
CustomDesignOptions .......................................................... 102
SaveXMatrix ................................................................ 106
NumberofStarts ............................................................. 108
DesignSearchTime .......................................................... 108
SetDeltaforPower........................................................... 109
TechnicalDetails................................................................ 110
DesignswithRandomizationRestrictions ....................................... 110
CovariateswithHardtoChangeLevels ......................................... 119
NumbersofWholePlotsandSubplots .......................................... 120
OptimalityCriteria........................................................... 120
DEfficiency................................................................. 124
CoordinateExchangeAlgorithm............................................... 125
Chapter 4
Design of Experiments Guide
Custom Designs
Overview of Custom Design
65
Continuous
Discretenumeric(withanynumberoflevels)
Categorical(withanynumberoflevels)
Blocking(withanarbitrarynumberofrunsperblock)
Covariate
Mixture
Constant
Uncontrolled
SpecifytheRegionofOperability
Youcanrestrictyourexperimentalregiontoreflectyouroperatingconditionsusinglinear
factorconstraintsordisallowedcombinations.Inparticular,restrictionscanbespecifiedfor
categorical,continuous,anddiscretenumericfactors.SeeDefineFactorConstraintson
page 91.
SpecifyFactorswithHardtoChangeLevels
Forcontinuous,discretenumeric,categorical,andmixturefactors,youcanindicatetwolevels
ofdifficulttochangefactors.Thesedifficultylevelsarerepresentedbywholeplotsorwhole
plotsandsplitplots.Youcanalsospecifyhardtochangecovariates.
SpecifytheEffectsofPrimaryInterest
Youcanexplicitlyspecifyyourassumedmodel.Yourassumedmodelisaninitialmodelthat
ideallycontainsalltheeffectsthatyouwanttoestimate.Yourmodelcancontainany
combinationofmaineffects,interactions,responsesurfaceeffects,andpolynomialeffects(up
tothefifthpower).Youcanspecifytheeffectsforwhichestimabilityisnecessaryandthosefor
whichestimabilityisdesired.CustomDesignusesaBayesianoptimalityapproachtoestimate
effectswhoseestimabilityisdesired,subjecttothenumberofruns.SeeModelonpage 95.
66
Custom Designs
Example of a Custom Design
Chapter 4
Design of Experiments Guide
SpecifytheNumberofRuns
TheCustomDesignplatformenablesyoutospecifythenumberofrunsthatmatchesthe
budgetforyourexperimentalsituation.Theplatformindicatestheminimumnumberofruns
thatcanbeusedtoestimatetherequiredeffectsandprovidesadefaultnumberofruns.These
valuescanserveasaguidefordeterminingafeasiblenumberofruns.SeeDesign
Generationonpage 97.
ConstructtheAppropriateDesignType
CustomDesigncanconstructawidevarietyofdesigntypes.Theseincludeclassicaldesigns
andrandomblockdesigns.Forexamplesofdifferentdesigntypes,seetheExamplesof
CustomDesignschapteronpage 127.
ConstructanOptimalDesign
Givenyourspecificrequirements,theCustomDesignplatformconstructsadesignthatis
optimal.Thealgorithmsupportsseveraloptimalitycriteria:
Doptimality
Ioptimality
BayesianDandIoptimality(usingIfPossibleeffects)
Aliasoptimality
SeeOptimalityCriteriaonpage 120.
Designsareconstructedusingthecoordinateexchangealgorithm(MeyerandNachtsheim,
1995).SeeCoordinateExchangeAlgorithmonpage 125.
Chapter 4
Design of Experiments Guide
Custom Designs
Example of a Custom Design
67
Theratingsfollowa0 20scale,where0istheworstand20isthebest.Rating,thevariable
consistingoftheexpertsratings,istheresponseofinterest.Youwanttoidentifythe
winerelatedfactorsthatmaximizetheresponse.
BlockingFactor
Ablockingfactorisusedtoaccountforvariationthatisnotnecessarilyofdirectinterest.A
blockingfactorisparticularlyeffectivewhenobservationstakenatonefactorlevelare
expectedtobemoresimilarthanobservationsatdifferentlevels.Inyourexperiment,ratings
byoneexpertarelikelytohavesimilarcharacteristicsandtodifferfromratingsbyadifferent
expert.Yet,youareinterestedinwhichpropertiesofthewineleadtohighratingsbyall
experts.
Becauseeachratertasteseightwines,Raterisablockingfactorwitheightrunsperblock.For
thisexperiment,onlythesefiveratersareofconcern.Youarenotinterestedingeneralizingto
alargerpopulationofraters.
ProcessFactors
Youhaveidentifiednineprocessfactorsforthestudy.Theseincludethegrapevariety,the
fieldonwhichthegrapesweregrown,andsevenotherfactorsrelatedtoprocessing.Youcan
experimentwithanycombinationofthesefactors.Also,thefactorscanbevariedatwillas
partoftheexperiment.Relativetotheexperiment,thesefactorsareallEasytochange.For
informationaboutspecifyingfactorchanges,seeChangesandRandomBlocksonpage 88.
ThefactorsandtheirlevelsappearinTable 4.1.Notethatallofthesefactorsarecategorical.
ThefactorsandtheirlevelsarealsogiveninthefactortableWine Factors.jmpintheDesign
ExperimentfolderofSample Data.
Toexperimentwithallpossiblecombinationsofthesefactorswouldrequireastaggering
8
4 2 = 1024 runs.However,inthisexample,youareabletoconstructacompellingdesignin
only40runs.
Table 4.1ProcessFactorsandLevelsforWineTastingExperiment
Factor
Levels
Variety
Bernard
Dijon
Field
De-Stem
No
Yes
Yeast
Cultured
Wild
Temperature
High
Low
Press
Hard
Soft
68
Custom Designs
Example of a Custom Design
Chapter 4
Design of Experiments Guide
Levels
Barrel Age
New
2Years
Barrel Seasoning
Air
Kiln
Filtering
No
Yes
Responsesonpage 68
Factorsonpage 69
Modelonpage 71
AliasTermsonpage 71
StepstoDuplicateResults(Optional)onpage 72
DesignGenerationonpage 72
Designonpage 73
DesignEvaluationonpage 74
OutputOptionsonpage 76
ForinformationaboutthecompleteDOEworkflow,seeTheDOEWorkflow:Describe,
Specify,Designonpage 54intheStartingOutwithDOEchapter.
Responses
Addyourresponse,theresponseGoal,and,ifappropriate,theLowerLimit,UpperLimit,and
Importance.Here,theresponseisRating.
1. SelectDOE > Custom Design.
2. DoubleclickYunderResponseNameandtypeRating.
NotethatthedefaultGoalisMaximize.Becauseyouwanttomaximizethetasterating,do
notchangethegoal.
3. ClickunderLowerLimitandtype0.
Theleastdesirableratingis0.
Chapter 4
Design of Experiments Guide
Custom Designs
Example of a Custom Design
69
4. ClickunderUpperLimitandtype20.
Themostdesirableratingis20.
5. LeavetheareaunderImportanceblank.
Becausethereisonlyoneresponse,thatresponseisgivenImportance1bydefault.
Figure 4.2onpage 70showsthecompletedResponsesoutline.
Factors
Enterfactorseithermanuallyorautomaticallyusingapreexistingtablethatcontainsthe
factorsandsettings.
Ifyouaredesigninganewexperiment,youmustfirstenterthefactorsmanually.See
EnteringFactorsManuallyonpage 69.
OnceyouhavesavedthefactorsusingtheSaveFactorsoption,youcanloadthem
automaticallyusingthesavedtable.SeeEnteringFactorsUsingLoadFactorson
page 70.
BothmethodsaddthesefouroutlinestotheCustomDesignwindow:DefineFactor
Constraints,Model,AliasTerms,andDesignGeneration.
EnteringFactorsManually
1. First,addtheblockingfactor,Rater.ClickAdd Factor> Blocking > 8 runs per block.
2. TypeRateroverthedefaultName ofX1.
NotethatRoleissettoBlocking.NotealsothatonlyonesettingforValuesappears.Thisis
becausethenumberofblockscannotbedetermineduntilthedesirednumberofrunsis
specified.OnceyouspecifytheNumberofRunsintheDesignGenerationoutline,the
numberoflevelsforRaterupdatestowhatisrequired.
3. ClickAdd Factor> Categorical > 2 Level.
4. TypeVarietyoverthedefaultNameofX2.
NotethatRoleissettoCategorical,asrequested,andthatChangesissettoEasyby
default.
5. ClickL1andL2andchangethemtoBernardandDijon.
6. ClickAdd Factor > Categorical > 4 Level.
7. TypeFieldoverthedefaultNameofX3.
8. ClickL1,L2,L3,andL4,andchangethemto1,2,3,and4.
9. ClickAdd Factor>Categorical > 2 Level.
10. TypeDe-StemoverthedefaultNameofX4.
70
Custom Designs
Example of a Custom Design
Chapter 4
Design of Experiments Guide
11. ClickL1andL2andchangethemtoNoandYes.
Addtherestofthefactorsasfollows:
12. Type6nexttoAdd N Factors,andthenclickAdd Factor > Categorical > 2 Level.
13. Typethefollowingnamesandvaluesoverthedefaultones:
Yeast(CulturedandWild)
Temperature(HighandLow)
Press(HardandSoft)
Barrel Age(NewandTwoYears)
Barrel Seasoning(AirandKiln)
Filtering(NoandYes)
ThecompletedFactorsoutlineappearsinFigure 4.2.
Figure 4.2CompletedResponsesandFactorsOutlines
14. ClickContinue.
ThefollowingoutlinesareaddedtotheCustomDesignwindow:
DefineFactorConstraints(notusedinthisexample)
Model
AliasTerms
DesignGeneration
EnteringFactorsUsingLoadFactors
Toenterfactorsusingatablecontainingfactorinformation,proceedasfollows:
Chapter 4
Design of Experiments Guide
Custom Designs
Example of a Custom Design
71
1. FromtheCustomDesignredtrianglemenu,selectLoad Factors.
2. SelectHelp > Sample Data LibraryandopenDesign Experiment/Wine Factors.jmp.
Afterloadingthefactors,theCustomDesignwindowautomaticallyupdates.Thefollowing
outlinesareaddedtotheCustomDesignwindow:
DefineFactorConstraints(notusedinthisexample)
Model
AliasTerms
DesignGeneration
Model
TheModeloutlineshowsallmaineffectsasNecessary,indicatingthatthedesignneedstobe
capableofestimatingallmaineffects.Forthisexample,yourassumedmodelreflectsyour
interestinmaineffectsonly.However,ifyouwantedtoestimateothereffects,youcouldadd
themtotheModeloutline.SeeModelonpage 95.
Figure 4.3ModelOutline
Alias Terms
TheAliasTermsoutlinespecifiestheeffectstobeshownintheAliasMatrix,whichappears
later.SeeAliasMatrixonpage 75.TheAliasMatrixshowsthealiasingrelationships
betweentheModeltermsandtheeffectslistedintheAliasTermsoutline.OpentheAlias
Termsoutlinenodetoverifythatalltwofactorinteractionsarelisted.
72
Custom Designs
Example of a Custom Design
Chapter 4
Design of Experiments Guide
Figure 4.4PartialViewoftheAliasTermsOutline
Chapter 4
Design of Experiments Guide
Custom Designs
Example of a Custom Design
73
2. ClickMake Design.
TheDesignandDesignEvaluationoutlinesareaddedtotheCustomDesignwindow.The
OutputOptionspanelalsoappears.
Design
TheDesignoutlineshowstherunsinthedesignthatyouhaveconstructed.Later,youareable
torandomizetheorderunderOutputOptions.Fornow,verifythatthisdesignisappropriate
foryourexperiment.Forexample,checkthateachoffiveRatersevaluateseightwines,thatall
necessaryfactorsareshown,andthatnoneofthesettingsrepresentinfeasiblecombinations.
Figure 4.5DesignforWineExperiment
74
Custom Designs
Example of a Custom Design
Chapter 4
Design of Experiments Guide
Design Evaluation
TheDesignEvaluationoutlineprovidesdifferentwaystoevaluateyourdesign.
Note: FordetailsabouttheDesignEvaluationoutline,seetheEvaluateDesignschapteron
page 461chapter.
Forthisexample,opentheDesignEvaluationoutline,andexaminetheColorMapon
Correlations,theAliasMatrix,andDesignDiagnostics.
ColorMaponCorrelations
TheColorMaponCorrelationsshowstheabsolutecorrelationsbetweeneffects.
Figure 4.6ColorMaponCorrelations
Themaineffectsarerepresentedbythe15termsintheupperleftcornerofthemap.Thedeep
bluecolorcorrespondingtothecorrelationsofmaineffectswithothermaineffectsindicate
correlationsof0.Thismeansthatallmaineffectsareorthogonalandcanbeestimated
independently.
Chapter 4
Design of Experiments Guide
Custom Designs
Example of a Custom Design
75
TheonlyredinFigure 4.6isonthemaindiagonal.Thecolorindicatesabsolutecorrelationsof
one,reflectingthateachtermisperfectlycorrelatedwithitself.Itfollowsthatnomaineffectis
completelyconfoundedwithanytwowayinteraction.Infact,theabsolutevaluesofthe
correlationsofmaineffectswithtwowayinteractionsarefairlylow.Thismeansthatestimates
ofmaineffectsmightbeonlyslightlybiasedbythepresenceofactivetwowayinteractions.
Tip: Positionyourmousepointerovercellsinthecolormaptoseetheabsolutecorrelations
betweeneffects.
AliasMatrix
IntheAliasMatrix,modeleffectsarelistedinthecolumnontheleft.Foragivenmodeleffect,
acolumnentryindicatesthedegreetowhichthecolumneffect(ifactive)biasestheestimateof
themodeleffect.
Figure 4.7PartialViewofAliasMatrix
Forexample,considerthemodeleffectBarrel Seasoning.IfVariety*Pressisactive,thenthe
expectedvalueoftheestimatefortheBarrel Seasoningeffectdiffersfromanunbiasedestimate
ofthateffect.Theamountbywhichitdiffersisequalto0.4timestheeffectofVariety*Press.
Therefore,whatappearstobeasignificantBarrel Seasoningestimatedeffectcouldinrealitybe
asignificantVariety*Presseffect.
DesignDiagnostics
TheDesignDiagnosticsoutlineprovidesinformationabouttheefficiencyofthedesign.
Efficiencymeasurescompareyourdesigntoatheoreticallyoptimaldesign,whichmightnot
exist.Theefficiencyvaluesareratios,expressedaspercents,oftheefficiencyofyourdesignto
theefficiencyofthisoptimaldesign.Fordetailsabouttheefficiencymeasures,seeEstimation
Efficiencyonpage 487intheEvaluateDesignschapter.
76
Custom Designs
Example of a Custom Design
Chapter 4
Design of Experiments Guide
Figure 4.8DesignDiagnosticsOutline
NoticethattheD,G,andAefficiencyvaluesareall100%.Becauseyourdesignisorthogonal
formaineffects,thedesignisoptimalforthemaineffectsmodelrelativetoallthreeefficiency
criteria.
ThefirstlineintheDesignDiagnosticsoutlineindicatesthatyourdesignwasconstructedto
optimizetheDefficiencycriterion.Formoredetails,seetheOptimalityCriteriondescription
inCustomDesignOptionsonpage 102.Inthiscase,yourdesignhasDEfficiencyof100%.
Output Options
SpecifytheorderofrunsinyourdatatableusingtheOutputOptionspanel.Thedefault
selection,Randomize within Blocks,isappropriateforthisexample.SimplyclickMake Table.
ACustomDesigntableiscreatedandopens,similartotheoneinFigure 4.9.
Note: Yourtablemightlookdifferentbecausethealgorithmthatcreatesitusesarandom
startingdesign.ToobtaintheprecisetableshowninFigure 4.9,seeDesignonpage 73.
Figure 4.9CustomDesignTable
Chapter 4
Design of Experiments Guide
Custom Designs
Example of a Custom Design
77
Notethefollowing:
IntheTablepanel,theModelscriptandtheDOEDialogscriptareaddedduringthe
designcreationprocess.TheModelscriptopensaFitModelwindowcontainingthe
effectsthatyouspecifiedasNecessaryintheCustomDesigndialog.TheDOEDialog
scriptrecreatesthewindowusedtogeneratethedesigntable.
IntheColumnspanel,theasteriskstotherightofthefactorsandresponseindicatecolumn
propertiesthathavebeensavedtothecolumnsinthedatatable.Thesecolumnproperties
areusedintheanalysisofthedata.Fordetailsaboutcolumnproperties,seeFactorson
page 85andFactorColumnPropertiesonpage 90.
NoticethatRater,theblockingfactor,isaddedasafixedeffect,ratherthanasarandom
blockeffect.Thisisappropriatebecausethefiveraterswerespecificallychosenandarenot
arandomsamplefromalargerpopulation.
78
Custom Designs
Example of a Custom Design
Chapter 4
Design of Experiments Guide
3. ClickRun.
Interpret the Full Model Results
Theresultsareshownbelow.
Figure 4.11PartialModelFitResults
Notethefollowing:
TheActualbyPredictedPlotshowsnoobviousevidenceoflackoffit.
Chapter 4
Design of Experiments Guide
Custom Designs
Example of a Custom Design
79
Themodelissignificant,asindicatedbytheActualbyPredictedPlotandbythePvalue
beneathit.
TheEffectTestsreportindicatesthatsevenofthemodeltermsaresignificantatthe0.05
level.Field,Temperature,andBarrel Agearenotsignificant.
TheEffectSummaryreportliststheseeffectsindecreasingorderofsignificance.Larger
LogWorthvaluescorrespondtohigherPValuesandgreatersignificance.
80
Custom Designs
Example of a Custom Design
Chapter 4
Design of Experiments Guide
Figure 4.12ProfilerforReducedModel
IfyouwanttoseetheProfilertracesforthelevelsofRater,performthefollowingsteps:
1. FromthePredictionProfilerredtrianglemenu,selectReset Factor Grid.
AFactorSettingswindowappearswithcolumnsforallofthefactors,includingRater.The
boxunderRaterandnexttoShowisnotchecked.ThisindicatesthatRaterisnotshownin
thePredictionProfiler.
2. ChecktheboxunderRaterintherowcorrespondingtoShow.
3. DeselecttheboxunderRaterintherowcorrespondingtoLock Factor Setting.
4. ClickOK.
TheProfilerupdatestoshowaplotforRater.
5. ClickineitherplotaboveRater.
Figure 4.13ProfilerforReducedModelShowingRater
Adashedverticalredlineappears.Dragthislinetoseethetracesforeachoftheraters.
Chapter 4
Design of Experiments Guide
Custom Designs
Example of a Custom Design
81
2. Toseepredictedratingsforallruns,savethePredictionFormula.FromtheResponse
Ratingredtrianglemenu,selectSave Columns > Prediction Formula.
AcolumncalledPred Formula Ratingisaddedtothedatatable.Notethatoneoftheruns,
row33,wasgiventhemaximumratingof20byRater5.Thepredictedratingforthatrun
byRater5is19.550.Buttherow33trialwasrunattheoptimalsettings.Thepredicted
valueof19.925givenforthesesettingsinthePredictionProfilerisobtainedbyaveraging
thepredictedratingsforthatrunoverallfiveraters.
Lock a Factor Level
Whenyoumaximizeddesirability,youlearnedthattheoptimalratingisachievedwiththe
Dijonvarietyofgrapes.SeeFigure 4.14.Yourmanagerpointsoutthatitwouldbe
costprohibitivetoreplantthefieldsthataregrowingBernardgrapeswithyoungDijonvines.
Therefore,youneedtofindoptimalprocesssettingsandthepredictedratingforBernard
grapes.
1. IntheVarietyplotofthePredictionProfiler,dragthereddashedverticallinetoBernard.
2. PressControlandclickinoneoftheVarietyplots.
TheFactorSettingswindowappears.
3. SelectLock Factor SettingandclickOK.
82
Custom Designs
Example of a Custom Design
Chapter 4
Design of Experiments Guide
4. FromthePredictionProfilerredtrianglemenu,selectMaximize Desirability.
Figure 4.15PredictionProfilerwithOptimalSettingsforBernardVariety
Theoptimalsettingsareunchangedbecausethemodelcontainsnointeractionterms.The
predictedratingatthesesettingsis17.975.
Summary
Inyourwinetastingexperiment,usingonly40runs,youhaveidentifiedsix(outofnine)
factorsthathaveaneffectonratingsforPinotNoirgrapes.Youfoundthatyoucouldachievea
predictedratingof19.925(outofapossible20)attheoptimalsettingsforthosefactors.You
alsoidentifiedoptimalsettingsforbothvarietiesofgrapes.
Inthissection,youconstructedadesignusingtheoutlinesintheCustomDesignwindow.The
nextsectionexplainseachoutlineandthedesignstepsinmoredetail.
Chapter 4
Design of Experiments Guide
Custom Designs
Custom Design Window
83
Continue
Make
Design
Design
Design Evaluation
Output Options
Make
Table
ThissectiondescribestheoutlinesintheCustomDesignwindow.
Responses
UsetheResponsesoutlinetospecifyoneormoreresponses.
Figure 4.17ResponsesOutline
TheResponsesoutlinecontainsthefollowingbuttons:
84
Custom Designs
Custom Design Window
Chapter 4
Design of Experiments Guide
EntersasingleresponsewithagoaltypeofMaximize,MatchTarget,
Minimize,orNone.IfyouselectMatchTarget,enterlimitsforyourtargetvalue.Ifyou
selectMaximizeorMinimize,enteringlimitsisnotrequiredbutcanbeuseful.
Add Response
Remove Removestheselectedresponses.
Entersadditionalresponsessothatthenumberthatyouenteristhe
totalnumberofresponses.IfyouhaveenteredaresponseotherthanthedefaultY,the
GoalforeachoftheadditionalresponsesistheGoalassociatedwiththelastresponse
entered.Otherwise,theGoaldefaultstoMatchTarget.ClicktheGoaltypeinthetableto
changeit.
Number of Responses
Response Name
response,minimizeyourresponse,matchatarget,orthatyouhavenoresponsegoal.JMP
assignsaResponseLimitscolumnproperty,basedonthesespecifications,toeachresponse
columninthedesigntable.Itusesthisinformationtodefineadesirabilityfunctionforeach
response.TheProfilerandContourProfilerusethesedesirabilityfunctionstofindoptimal
factorsettings.Forfurtherdetails,seetheProfilersbookandResponseLimitson
page 562intheColumnPropertiesappendix.
AGoalofMaximizeindicatesthatthebestvalueisthelargestpossible.Ifthereare
naturallowerorupperbounds,youcanspecifytheseastheLowerLimitorUpper
Limit.
AGoalofMinimizeindicatesthatthebestvalueisthesmallestpossible.Ifthereare
naturallowerorupperbounds,youcanspecifytheseastheLowerLimitorUpper
Limit.
AGoalofMatchTargetindicatesthatthebestvalueisaspecifictargetvalue.The
defaulttargetvalueisassumedtobemidwaybetweentheLowerLimitandUpper
Limit.
AGoalofNoneindicatesthatthereisnogoalintermsofoptimization.Nodesirability
functionisconstructed.
Note: IfyourtargetresponseisnotmidwaybetweentheLowerLimitandtheUpper
Limit,youcanchangethetargetafteryougenerateyourdesigntable.Inthedatatable,
opentheColumnInfowindowfortheresponsecolumn(Cols>Column Info)andenterthe
desiredtargetvalue.
Chapter 4
Design of Experiments Guide
Custom Designs
Custom Design Window
85
Importance Whenyouhaveseveralresponses,theImportancevaluesthatyouspecifyare
usedtocomputeanoveralldesirabilityfunction.Thesevaluesaretreatedasweightsfor
theresponses.Ifthereisonlyoneresponse,thenspecifyingtheImportanceisunnecessary
becauseitissetto1bydefault.
EditingtheResponsesOutline
IntheResponsesoutline,notethefollowing:
Doubleclickaresponsetoedittheresponsename.
Clickthegoaltochangeit.
Clickonalimitorimportancevaluetochangeit.
Formultipleresponses,youmightwanttoentervaluesfortheimportanceweights.
Factors
AddfactorsintheFactorsoutline.
Figure 4.18FactorsOutline
86
Custom Designs
Custom Design Window
Add Factor
Chapter 4
Design of Experiments Guide
Selectthefactortype.Fordetails,seeFactorTypesonpage 87.
Remove Removestheselectedfactors.
Note: IfyouattempttoremoveallfactorsafterclickingtheContinueorBackbutton,one
continuousfactorremains.Youcandeleteitafteryouaddnewfactors.
Add N Factors Addsmultiplefactors.Enterthenumberoffactorstoadd,clickAdd Factor,
andthenselectthefactortype.RepeatAdd N Factorstoaddmultiplefactorsofdifferent
types.
Tip: WhenyouhavecompletedtheFactorsoutline,considerselectingSave Factorsfromthe
redtrianglemenu.Thissavestheresponsenames,goals,limits,andimportancevaluesina
datatablethatyoucanlaterreload.
Factors Outline
TheFactorsoutlinecontainsthefollowingcolumns:
Thenameofthefactor.Whenadded,afactorisgivenadefaultnameofX1,X2,andso
on.Tochangethisname,doubleclickitandenterthedesiredname.
Name
Role SpecifiestheDesignRoleofthefactor.TheDesignRolecolumnpropertyforthefactor
issavedtothedatatable.Thispropertyensuresthatthefactortypeismodeled
appropriately.
Changes IndicateswhetherthefactorlevelsareEasy,Hard,orVeryHardtochange.Clickon
thedefaultvalueofEasytochangeit.WhenyouspecifyfactorsasHardorVeryHardto
change,yourdesignreflectstheserestrictionsonrandomization.Afactorcannotbe
designatedasVeryHardunlesstheFactorslistcontainsafactordesignatedasHard.The
FactorChangescolumnpropertyissavedtothedatatable.Formoredetails,seeChanges
andRandomBlocksonpage 88.
Theexperimentalsettingsforthefactors.ToinsertValues,clickonthedefaultvalues
andenterthedesiredvalues.
Values
EditingtheFactorsOutline
IntheFactorsoutline,notethefollowing:
Toeditafactorname,doubleclickthefactorname.
Categoricalfactorshaveadownarrowtotheleftofthefactorname.Clickthearrowto
addalevel.
Toremoveafactorlevel,clickthevalue,clickDelete,andclickoutsidethetextbox.
TomodifytheentryunderChanges,clickthevalueintheChangescolumnandselectthe
appropriateentry.
Toeditavalue,clickthevalueintheValuescolumn.
Chapter 4
Design of Experiments Guide
Custom Designs
Custom Design Window
87
Factor Types
Tochooseafactortype,clickAdd FactorinCustomDesign.
Note: ADesignRolecolumnpropertycontainingeachfactorsroleisaddedtothatfactors
columninthedesigntablethatisgenerated.TheDesignRolecolumnpropertyensuresthat
thefactorismodeledcorrectly.
Continuous Numericdatatypesonly.Acontinuousfactorisafactorthatyoucan
conceptuallysettoanyvaluebetweenthelowerandupperlimitsyousupply,giventhe
limitationsofyourprocessandmeasurementsystem.
Discrete Numeric Numericdatatypesonly.Adiscretenumericfactorcanassumeonlya
discretenumberofvalues.Thesevalueshaveanimpliedorder.
Thedefaultvaluesforadiscretenumericfactorwithklevels,where k 2 ,aretheintegers
1 2 k .Thedefaultvaluesforadiscretenumericfactorwith k = 2 levelsare1and1.
Replacethedefaultvalueswiththesettingsthatyouplantouseinyourexperiment.
Note: Notalllevelsofadiscretenumericfactorappearinthedesign.Thelevelsthat
appeararedeterminedbyyourspecificationsintheModeloutline.
Intheassumedmodel,theeffectsforadiscretenumericfactorwithklevelsinclude
polynomialtermsinthateffectthroughorderk1.Forkgreaterthan6,powersuptothe5th
levelareincluded.TheEstimabilityforpolynomialeffects(powersoftwoorhigher)isset
toIfPossible.Thisallowsthealgorithmtousethemultiplelevelsaspermittedbytherun
size.Ifthepolynomialtermsarenotincluded,thenamaineffectsonlydesigniscreated.
Formoredetailsabouthowdiscretenumericfactorsaretreatedintheassumedmodel,see
Modelonpage 95.
FitModeltreatsadiscretenumericfactorasacontinuouspredictor.TheModelscriptthat
issavedtothedesigntabledoesnotcontainanypolynomialtermsofordergreaterthan
two.
Eithernumericorcharacterdatatypes.Thedatatypeintheresultingdatatable
iscategorical.Thevalueorderingofthelevelsistheorderofthevalues,asenteredfrom
lefttoright.ThisorderingissavedintheValueOrderingcolumnpropertyafterthedesign
datatableiscreated.
Categorical
Blocking Eithernumericorcharacterdatatypes.Ablockingfactorisaspecialtypeof
categoricalfactorthatcanenterthemodelonlyasamaineffect.Whenyoudefinea
blockingfactor,youspecifythenumberofrunsperblock.TheRunsPerBlockcolumn
propertyissavedtothedesigntable.TheDefaultrunsizealwaysassumesthatthereareat
leasttwoblocks.Ifyouspecifyarunsizethatisnotanintegermultipleofthenumberof
runsperblock,JMPtriestobalancethedesigntotheextentpossible.Inbalancingthe
design,JMPensuresthatthereareatleasttworunsperblock.
88
Custom Designs
Custom Design Window
Chapter 4
Design of Experiments Guide
Covariate Eithernumericorcharacterdatatypes.Thevaluesofacovariatefactorare
measurementsonexperimentalunitsthatareknowninadvanceofanexperiment.
Covariatevaluesareselectedtoensuretheoptimalityoftheresultingdesignrelativetothe
optimalitycriterion.SeeChangesandRandomBlocksonpage 88andCovariateswith
HardtoChangeLevelsonpage 119.
JMPobtainsthecovariatefactorsandtheirvaluesfromadatatablethatcontainsthe
measuredcovariatesfortheavailableexperimentalunits.Makethisdatatableyourcurrent
datatable.WhenyouselectCovariate,alistofcolumnsinthecurrentdatatableopens,and
youselectthecolumnscontainingcovariatesfromthislist.
Note: YoucannotspecifyaNumberofRunsorNumberofWholePlotsthatexceedsthe
numberofrowsinthecovariatesdatatable.
Mixture Continuousfactorsthatrepresentingredientsinamixture.Thevaluesforamixture
factormustsumtoaconstant.Bydefault,thevaluesforallmixturefactorssumtoone.To
setthesumofthemixturecomponentstosomeotherpositivevalue,selectAdvanced
Options > Mixture Sumfromtheredtrianglemenu.TheMixturecolumnpropertyissaved
tothedatatable.
Eithernumericorcharacterdatatypes.Aconstantfactorisafactorwhosevalues
arefixedduringanexperiment.ConstantfactorsarenotincludedintheModeloutlineor
intheModelscriptthatissavedtothedatatable.
Constant
Uncontrolled Eithernumericorcharacterdatatypes.Anuncontrolledfactorisonewhose
valuescannotbecontrolledduringanexperiment,butitisafactorthatyouwantto
includeinthemodel.AnemptycolumnwithaContinuousModelingTypeiscreatedin
thedesigntable.YoucanchangethecolumnsDataTypeandModelingTypeinthe
ColumnInfowindowifrequired.Enteryourdatainthiscolumn.Uncontrolledfactorsare
includedintheModeloutlineandtheModelscriptthatissavedtothedatatable.
Changes and Random Blocks
Specifyingtherelativedifficultyofchangingafactorfromruntorunisusefulinindustrial
experimentation.Itisoftenconvenienttomakeseveralrunswhilekeepingfactorsthatare
hardtochangefixedatsomesetting.AChangesvalueofHardresultsinasplitplotdesign.A
ChangesvalueofVeryHardresultsinasplitsplitplotdesignoratwowaysplitplotdesign.
YoucansetChangesforContinuous,DiscreteNumeric,Categorical,andMixturefactorsto
HardandVeryHard.TosetafactortoVeryHard,thelistmustcontainanotherfactorthatis
settoHard.
YoucansetChangesforaCovariatefactortoHard.Inthiscase,allothercovariatesarealsoset
toHardandtheremainingfactorsaresettoEasy.Thealgorithmrequiresacombinationof
rowexchangeandcoordinateexchange.Forthisreason,evenmoderatelysizeddesignsmight
takesometimetogenerate.
Chapter 4
Design of Experiments Guide
Custom Designs
Custom Design Window
89
FordesignswithHardorVeryHardtochangefactors,CustomDesignstrivestofindadesign
thatisoptimal,givenyourspecifiedoptimalitycriterion.SeeOptimalityCriteriaon
page 120.Fordetailsaboutthemethodologyusedtogeneratesplitplotdesigns,seeJonesand
Goos(2007).Fordetailsrelatingtodesignswithhardtochangecovariates,seeJonesandGoos
(2014,toappear).
Figure 4.19showsasplitsplitplotscenario,usingthefactorsfromtheCheese Factors.jmp
sampledatatable(locatedintheDesignExperimentfolder).
Figure 4.19FactorsandDesignGenerationOutlineforaSplitSplitPlotDesign
IfyouassignChangesasHardforoneormorefactors,butnofactorshaveChangesassigned
asVeryHard,acategoricalfactorcalledWhole Plotsisaddedtothedesign.Thissituation
resultsinasplitplotdesign:
EachlevelofWhole Plotscorrespondstoablockofconstantsettingsofthehardtochange
factors.
TheModelscriptinthedesigntableappliestheRandomEffectattributetothefactor
Whole Plots.
ThefactorWhole PlotsisassignedtheDesignRolecolumnpropertywithavalueof
RandomBlock.
90
Custom Designs
Custom Design Window
Chapter 4
Design of Experiments Guide
WhenyoudesignateChangesasbothHardandVeryHard,categoricalfactorscalledSubplots
andWhole Plotsareaddedtothedesign.Thissituationresultsinasplitsplitplotdesign:
EachlevelofSubplotscorrespondstoablockofconstantsettingsofthehardtochange
factors.
EachlevelofWhole Plotscorrespondstoablockofconstantsettingsofthe
veryhardtochangefactors.
TheModelscriptinthedesigntableappliestheRandomEffectattributetotheWhole Plots
andSubplotseffects.
Thelevelsofthehardtochangefactorareassumedtobenestedwithinthelevelsofthe
veryhardtochangefactorbydefault.
Inthedesigntable,bothofthefactorsWhole PlotsandSubplotsareassignedtheDesign
RolecolumnpropertywithavalueofRandomBlock.
indefiningthefactordeterminesthevalueofitsDesignRolecolumnproperty.Whenyou
addarandomblockunderDesignGeneration,thatfactorisassignedtheRandomBlock
value.TheDesignRolepropertyreflectshowthefactorisintendedtobeusedinmodeling
theexperimentaldata.DesignRolevaluesareusedintheAugmentDesignplatform.For
details,seeDesignRoleonpage 570intheColumnPropertiesappendix.
Chapter 4
Design of Experiments Guide
Custom Designs
Custom Design Window
91
youspecifyunderChangesdeterminesthevalueofitsFactorChangescolumnproperty.
TheFactorChangespropertyreflectshowthefactorisusedinmodelingtheexperimental
data.FactorChangesvaluesareusedintheAugmentDesignandEvaluateDesign
platforms.Fordetails,seeFactorChangesonpage 585intheColumnProperties
appendix.
IftheRoleisContinuous,DiscreteNumeric,acontinuousCovariate,or
Uncontrolled,theCodingcolumnpropertyforthefactorissaved.Thisproperty
transformsthefactorvaluessothatthelowandhighvaluescorrespondto1and+1,
respectively.Fordetails,seeCodingonpage 573intheColumnPropertiesappendix.
Coding
IftheRoleisCategoricalorBlocking,theValueOrderingcolumnpropertyfor
thefactorissaved.Thispropertydeterminestheorderinwhichlevelsofthefactorappear.
Fordetails,seeValueOrderingonpage 588intheColumnPropertiesappendix.
Value Ordering
Mixture IftheRoleisMixture,theMixturecolumnpropertyforthefactorissaved.This
propertyindicatesthelimitsforthefactorandthemixturesum.Italsoenablesyouto
choosethecodingforthemixturefactors.Fordetails,seeMixtureonpage 579inthe
ColumnPropertiesappendix.
RunsPerBlock Forablockingfactor,indicatesthemaximumallowablenumberofrunsin
eachblock.WhenaBlockingfactorisspecifiedintheFactorsoutline,theRunsPerBlock
columnpropertyissavedforthatfactor.Fordetails,seeRunsPerBlockonpage 594inthe
ColumnPropertiesappendix.
OnlyavailableforfactorswithaRoleofContinuousorMixture.SeeSpecifyLinear
Constraints.
Use Disallowed Combinations Filter Definessetsofconstraintsbasedonrestrictingvaluesof
individualfactors.YoucandefinebothANDandORconstraints.SeeUseDisallowed
CombinationsFilter.
Use Disallowed Combinations Script Definesdisallowedcombinationsandotherconstraints
asBooleanJSLexpressionsinascripteditorbox.SeeUseDisallowedCombinations
Script.
92
Custom Designs
Custom Design Window
Chapter 4
Design of Experiments Guide
design.Entercoefficientvaluesforthefactorsandselectthedirectionoftheinequalityto
reflectyourlinearconstraint.Specifytheconstrainingvalueintheboxtotherightofthe
inequality.Toaddmoreconstraints,clickAddagain.
Note: TheAddoptionisdisabledifyouhavealreadyconstrainedthedesignregionby
specifyingaSphereRadius.
Remove Last Constraint Removesthelastconstraint.
Checkstheconstraintsforconsistency.Thisoptionremovesredundant
constraintsandconductsfeasibilitychecks.AJMPalertappearsifthereisaproblem.If
constraintsareequivalenttoboundsonthefactors,aJMPalertindicatesthattheboundsin
theFactorsoutlinehavebeenupdated.
Check Constraints
factorsettingsappears.Anexpressionthatdescribestherangeusinganinequalityappears
abovetheslider.Youcanspecifydisallowedsettingsbydraggingthesliderarrowsorby
clickingontheinequalityboundsintheexpressionandenteringyourdesiredconstraints.
Intheslider,asolidbluehighlightrepresentsthedisallowedvalues.
Categorical Factor Foracategoricalfactor,thepossiblelevelsaredisplayedeitheraslabeled
blocksor,whenthenumberoflevelsislarge,aslistentries.Selectaleveltodisallowit.To
Chapter 4
Design of Experiments Guide
Custom Designs
Custom Design Window
93
selectmultiplelevels,holdtheControlkey.Theblockorlistentriesarehighlightedto
indicatethelevelsthathavebeendisallowed.Whenyouaddacategoricalfactortothe
DisallowedCombinationspanel,thenumberoflevelsofthecategoricalfactorisgivenin
parenthesesfollowingthefactorname.
DisallowedCombinationsOptions
Thecontrolpanelhasthefollowingcontrols:
Clearsalldisallowedfactorlevelsettingsthatyouhavespecified.Thisdoesnotclear
theselectedfactors.
Clear
combinationoffactorlevelsspecifiedwithinanANDgroupisdisallowed.
ToaddafactortoanANDgrouplateron,clickthegroupsoutlinetoseeahighlighted
rectangle.SelectANDandaddthefactor.
Toremoveasinglefactor,selectDeletefromitsredtrianglemenu.
OR OpenstheAddFilterFactorslist.SelectedfactorsbecomeaseparateANDgroup.For
ANDgroupsseparatedbyOR,acombinationisdisallowedifitisspecifiedinatleastone
ANDgroup.
RedTriangleOptionsforFactors
AfactorcanappearinseveralORgroups.AnoccurrenceofthefactorinaspecificORgroupis
referredtoasaninstanceofthefactor.
Delete RemovestheselectedinstanceofthefactorfromtheDisallowedCombinationspanel.
Clear Selection
Clearsanyselectionforthatinstanceofthefactor.
Deselectstheselectedvaluesandselectsthevaluesnotpreviouslyselected
forthatinstanceofthefactor.
Invert Selection
Availableonlyforcategoricalfactors.Changestheappearanceofthedisplay.
Optionsinclude:
Display Options
Blocks Displayshowseachlevelasablock.
List Displayshowseachlevelasamemberofalist.
Single Category Display showseachlevel.
Check Box Display addsacheckboxnexttoeachvalue.
Availableonlyforcategoricalfactors.Providesatextboxbeneaththefactornamewhere
youcanenterasearchstringforlevelsofthefactor.PresstheEnterkeyorclickoutsidethe
textboxtoperformthesearch.OnceFindisselected,thefollowingFindoptionsappearin
theredtrianglemenu:
Find
94
Custom Designs
Custom Design Window
Chapter 4
Design of Experiments Guide
Clear FindclearstheresultsoftheFindoperationandreturnsthepaneltoitsoriginal
state.
Match Caseusesthecaseofthesearchstringtoreturnthecorrectresults.
Containssearchesforvaluesthatincludethesearchstring.
Does not containsearchesforvaluesthatdonotincludethesearchstring.
Starts withsearchesforvaluesthatstartwiththesearchstring.
Ends withsearchesforvaluesthatendwiththesearchstring.
Use Disallowed Combinations Script
UsethisoptiontodisallowparticularcombinationsoffactorlevelsusingaJSLscript.This
optioncanbeusedwithcontinuousfactorsormixedcontinuousandcategoricalfactors.
Thisoptionopensascriptwindowwhereyouinsertascriptthatidentifiesthecombinations
thatyouwanttodisallow.ThescriptmustevaluateasaBooleanexpression.Whenthe
expressionevaluatesastrue,thespecifiedcombinationisdisallowed.
Whenformingtheexpressionforacategoricalfactor,usetheordinalvalueofthelevelinstead
ofthenameofthelevel.Ifafactorslevelsarehigh,medium,andlow,specifiedinthatorder
intheFactorsoutline,theirassociatedordinalvaluesare1,2,and3.Forexample,supposethat
youhavetwocontinuousfactors,X1andX2,andacategoricalfactorX3withthreelevels:L1,
L2,andL3,inorder.Youwanttodisallowlevelswherethefollowingholds:
e
X1
+ 2X 2 0andX 3 = L2
(Inthefigure,unnecessaryparentheseswereremovedbyparsing.)Noticethatfunctionscan
beenteredaspartoftheBooleanexpression.
Chapter 4
Design of Experiments Guide
Custom Designs
Custom Design Window
95
Model
Specifyyourassumedmodel(whichcontainsalltheeffectsthatyouwanttoestimate)inthe
Modeloutline.Foreacheffectthatyouspecify,youcandesignatethateffectsEstimability.The
EstimabilityvalueindicateswhetheritisNecessarytoestimatethateffect,orifyouare
contenttoestimatethateffectIfPossible.
WhentheModeloutlineopens,formostfactorsonlythemaineffectsappear.Ifyouhave
enteredadiscretenumericfactor,polynomialtermsalsoappear.TheEstimabilityof
secondandhigherordertermsissettoIf Possible.Ifyouwanttoensurethatthesetermsare
estimable,changetheirEstimabilitytoNecessary.
Note: Youcanensurethattheestimabilityofdiscretenumericpolynomialtermsisalwaysset
toNecessary.SelectFile > Preferences > Platforms > DOE.CheckDiscreteNumericPowersSet
toNecessary.
Figure 4.21ModelOutline
Whenyouconstructyourdesigntable,JMPsavesaModelscripttothedatatable.Exceptfor
discretenumericfactors,theModelscriptcontainstheeffectsshownintheModeloutline.For
adiscretenumericfactor,theModelscriptcontainsonlyitsmaineffectandquadraticterm.
TheModeloutlinecontainsthefollowingbuttonsandfields:
Main Effects Addsmaineffectsforallfactorsinthemodel,andpolynomialtermsfordiscrete
numericfactors.
Interactions Addsinteractioneffects.IfnofactorsareselectedintheFactorsoutline,select
2nd,3rd,4th,or5thtoaddallappropriateinteractionsuptothatorder.Addinteractions
uptoagivenorderforspecificfactorsbyselectingthefactornamesintheFactorsoutline,
selectingInteractions,andthenspecifyingtheappropriateorder.Interactionsbetween
nonmixtureandmixturefactors,andinteractionswithblockingandconstantfactors,are
notadded.
RSM Addsinteractionandquadratictermsuptothesecondorder(responsesurfacemodel
terms)forcontinuousfactors.CategoricalfactorsarenotincludedinRSMterms.Main
effectsfornonmixturefactorsthatinteractwithallthemixturefactorsareremoved.
96
Custom Designs
Custom Design Window
Chapter 4
Design of Experiments Guide
Addsspecificinteractionterms.SelectfactornamesintheFactorsoutlineandeffect
namesintheModeloutline.ClickCrosstoaddthecrossedtermstotheModeloutline.
Cross
Addspolynomialterms.IfnofactornamesareselectedintheFactorsoutline,adds
polynomialtermsforallcontinuousfactors. IffactornamesareselectedintheFactors
outline,addspolynomialtermsforonlythosefactors.Select2nd,3rd,4th,or5thtoadd
polynomialtermsofthatorder.
Powers
specifyamixturemodelwiththirddegreepolynomialterms.
Remove Term Removesselectedeffects.
Name
Nameoftheeffect.
Estimability Adesignationofyourneedtoestimatetheeffect.
IfEstimabilityissettoNecessary,thealgorithmensuresthattheeffectisestimable.
IfEstimabilityissettoIfPossible,thealgorithmattemptstomakethateffectestimable,
aspermittedbythenumberofrunsthatyouspecify.
Exceptforpolynomialtermsfordiscretenumericfactors,alleffectsarespecifiedas
Necessarybydefault.ClickaneffectsEstimabilityvaluetochangeit.
BayesianDOptimalityandEstimationofIfPossibleEffects
TheBayesianDOptimaldesignapproachobtainspreciseestimationofallNecessaryterms
whileprovidingomnibusdetectability(andsomeestimability)forIf Possibleterms.Formore
detail,seeResponseSurfaceExperimentsonpage 150intheExamplesofCustomDesigns
chapterandBayesianDOptimalityonpage 121.
Alias Terms
Itispossiblethateffectsnotincludedinyourassumedmodelareactive.IntheAliasTerms
outline,addpotentiallyactiveeffectsthatarenotinyourassumedmodelbutmightbiasthe
estimatesofmodelterms.Onceyougenerateyourdesign,theAliasMatrixoutlineappears
underDesignEvaluation.TheAliasMatrixentriesrepresentthedegreeofbiasimpartedto
modelparametersbytheeffectsthatyouspecifiedintheAliasTermsoutline.Fordetails,see
theTheAliasMatrixonpage 601intheTechnicalDetailsappendix.
Bydefault,theAliasTermsoutlineincludesalltwowayinteractioneffectsthatarenotinyour
Modeloutline(withtheexceptionoftermsinvolvingblockingfactors).Addtermsusingthe
buttons.ForadescriptionofhowtousethesebuttonstoaddeffectstotheAliasTermstable,
seeModelonpage 95.
Chapter 4
Design of Experiments Guide
Custom Designs
Custom Design Window
97
Forexample,supposethatyouspecifyadesignwiththreecontinuousfactors.Yourassumed
model,specifiedintheModeloutline,containsonlythosethreemaineffects.Youcanafford
onlysixruns.Youwanttoseehowestimatesofthemaineffectsmightbebiasedbyactive
twowayinteractionsandthethreewayinteraction.
TheAliasTermstableincludesalltwowayinteractionsbydefault.Youcanaddthethreeway
interactionbyselectingInteractions > 3rd.
Figure 4.22AliasTermsOutline
OnceyouspecifysixrunsintheDesignGenerationoutlineandclickMake Design,theDesign
Evaluationoutlineappears.OpentheDesignEvaluationoutlineandtheAliasMatrixoutline.
SeeFigure 4.23.
Figure 4.23AliasMatrix
TheAliasMatrixindicatesthateachmaineffectispartiallyaliasedwithtwoofthe
interactions.SeeAliasMatrixonpage 488intheEvaluateDesignschapterandTheAlias
Matrixonpage 601intheTechnicalDetailsappendix.
Design Generation
TheDesignGenerationoutlinegivesyouchoicesrelatingtothesizeandstructureofthe
design.Typically,theinputareahastwoparts:
Designstructureoptions
Numberofrunsoptions
98
Custom Designs
Custom Design Window
Chapter 4
Design of Experiments Guide
Figure 4.24DesignGenerationOutline
DesignStructureOptions
Group runs into random blocks of size (Notavailableifablockingfactorisspecified)To
constructarandomblockdesign,enterthenumberofrunsthatyouwantineachblock.
Whenyouspecifythesamplesize,afactorcalledRandom Blockiscreated.Itslevelsdefine
blocksofasizethatisconsistentwiththeblocksizethatyouentered,giventhespecified
numberofruns.Ifthenumberofrunsisanintegermultipleoftheblocksize,theblock
sizesequalyourspecifiedvalue.
Number of Whole Plots Appearswhenyouspecifyahardorveryhardtochangefactor.The
factorWhole Plotscorrespondstotheveryhardtochangefactors(splitsplitplotdesign),
ifthereareany,otherwisetothehardtochangefactors(splitplotdesign).JMPsuggestsa
valueforthenumberofwholeplotsthatmaximizestheinformationaboutthecoefficients
inthemodel.Or,youcanenteravalueforthenumberofwholeplots.Fordetails,see
NumbersofWholePlotsandSubplotsonpage 120.
Number of Subplots
Appearswhenyouspecifyaveryhardtochangefactor.Thefactor
Subplotscorrespondstothehardtochangefactorsinthesplitsplitplotdesign.JMP
suggestsvaluesforthenumberofwholeplotsandsubplotsthatmaximizetheinformation
aboutthecoefficientsinthemodel.Or,youcanenteravalueforthenumberofsubplots.
Fordetails,seeNumbersofWholePlotsandSubplotsonpage 120.
Hard to change factors can vary independently of Very Hard to change factors Selectthis
optiontocreateastripplot(alsoknownastwowaysplitplotorsplitblock)design.This
optioncreatesadesignwherethehardtochangefactorsarerandomizedwithinthelevels
oftheveryhardtochangefactors.Theyarenotnestedwithintheveryhardtochange
factors.
Chapter 4
Design of Experiments Guide
Custom Designs
Custom Design Window
99
Mixturefactortype.Specifyhowmanyadditionalrunsyouwanttoaddascenterpointsto
thedesign.Acenterpointisarunwhosesettingforeachcontinuousfactorismidway
betweenthehighandlowsettings.SeeCenterPoints,ReplicateRuns,andTestingon
page 60intheStartingOutwithDOEchapter.
Ifadesigncontainsbothcontinuousandothertypesoffactors,centerpointsmightnotbe
balancedrelativetothelevelsoftheotherfactors.CustomDesignchoosesthecenterpoints
tomaximizetheD,I,oraliasefficiencyofthedesign.
Number of Replicate Runs Specifythenumberofreplicatetrialsthatyouwanttoaddtothe
design.Thisdoesnotreplicatetheentiredesign,butchoosestheoptimaldesignpointsto
replicate.SeeCenterPoints,ReplicateRuns,andTestingonpage 60intheStartingOut
withDOEchapter.
NumberofRunsOptions
Minimum Alowerboundonthenumberofrunsnecessarytoavoidfailuresindesign
generation.WhenyouselectMinimum,theresultingdesignissaturated.Thereareno
degreesoffreedomforerror.
Note: IfyouselecttheMinimumnumberofruns,therewillbenoerrortermfortesting.
Youwillnotbeabletotestparameterestimates.Thischoiceisappropriateonlywhenthe
costofadditionalrunsisprohibitive.
Suggeststhenumberofruns.Thisvalueisbasedonheuristicsforcreatingabalanced
designwithatleastfourrunsmorethantheMinimumnumberofruns.
Default
Specifythenumberofrunsthatyouwant.EnterthatvalueintotheNumber of
Runstextbox.Thisoptionenablesyoutobalancethecostofadditionalrunsagainstthe
User Specified
potentialgainininformation.
Number of Runs ThisistheonlyoptionthatappearswhenacovariatefactorwithChanges
settoEasyisspecified.Thenumberofrunsshownisthenumberofrowsinthedatatable
associatedwithyourcovariateorcovariates.Youcanspecifyasmallernumberofruns.In
thatcase,thecovariaterunsthatareselectedoptimizethedesigncriterion.
MakeDesign
OnceyouhavecompletedtheDesignGenerationoutline,clickMake Design.CustomDesign
generatesthedesign,presentsitintheDesignoutline,andprovidesevaluationinformationin
theDesignEvaluationoutline.TheOutputOptionspanelalsoappears,allowingyoutocreate
thedesigntable.
100
Custom Designs
Custom Design Window
Chapter 4
Design of Experiments Guide
Note: Sometimesseveraldesignscanoptimizetheoptimalitycriterion.Whenthisisthecase,
thedesignalgorithmmightgeneratedifferentdesignswhenyouclicktheBack andMake
Designbuttonsrepeatedly.
Design
TheDesignoutlineshowstherunsforadesignthatisoptimal,giventheconditionsthatyou
havespecified.Therunsmightnotappeartobeproperlyrandomized.YoucanselectRun
OrderoptionsintheOutputOptionspanelbeforegeneratingyourdesigntable.
Design Evaluation
TheDesignEvaluationoutlineprovidesanumberofwaystoevaluatethepropertiesofthe
generateddesign.OpentheDesignEvaluationoutlinetoseethefollowingoptions:
Power Analysis Enablesyoutoexploreyourabilitytodetecteffectsofgivensizes.
Prediction Variance Profile Showsthepredictionvarianceovertherangeoffactorsettings.
Fraction of Design Space Plot
Showshowmuchofthemodelpredictionvarianceliesbelow
(orabove)agivenvalue.
Prediction Variance Surface Showsasurfaceplotofthepredictionvarianceforanytwo
continuousfactors.
Estimation Efficiency Foreachparameter,givesthefractionalincreaseinthelengthofa
confidenceintervalcomparedtothatofanidealized(orthogonal)design,whichmightnot
exist.Alsogivestherelativestandarderroroftheparameters.
Givescoefficientsthatindicatethedegreebywhichthemodelparametersare
biasedbyeffectsthatarepotentiallyactive,butnotinthemodel.Youspecifytheterms
representingpotentiallyactiveeffectsintheAliasTermstable.SeeTheAliasMatrixon
page 601intheTechnicalDetailsappendix.
Alias Matrix
intensityscale.
Design Diagnostics Indicatestheoptimalitycriterionusedtoconstructthedesign.Alsogives
efficiencymeasuresforyourdesign.SeeOptimalityCriterioninCustomDesignOptions
onpage 102andOptimalityCriteriaonpage 120.
Note: TheDesignDiagnosticsoutlinedoesnotprovidethefollowingstatisticswhenthe
modelincludesfactorswithChangessettoHardorVeryHardorwithEstimabilitysetto
IfPossible:DEfficiency,GEfficiency,AEfficiency.
FormoredetailsabouttheDesignEvaluationoutline,seeDesignEvaluationonpage 476in
theEvaluateDesignschapter.
Chapter 4
Design of Experiments Guide
Custom Designs
Custom Design Window
101
Output Options
UsetheOutputOptionspaneltoperformthefollowingtasks:
specifyhowyouwantthecustomdesigndatatabletoappear
constructthedesigntable
returntoapreviouspointintheCustomDesignwindow
Inmostcases,theOutputOptionspanelappearsasshowninFigure 4.25.
Figure 4.25OutputOptionsPanel
TheOutputOptionspanelcontainstheseoptions:
RunOrderonpage 101
MakeTableonpage 101
Backonpage 102
RunOrder
TheRun Orderoptionsdeterminetheorderoftherunsinthedesigntable.Choicesincludethe
following:
Keep the Same RowsinthedesigntableareinthesameorderasintheDesignoutline.
Sort Left to Right
Columnsinthedesigntablearesortedfromlefttoright.
Randomize Rowsinthedesigntableareinrandomorder.
Sort Right to Left Columnsinthedesigntablearesortedfromrighttoleft.
Randomize within Blocks
Rowsinthedesigntableareinrandomorderwithintheblocks.
MakeTable
ClickMake Tabletoconstructthecustomdesigndatatable.IntheCustomDesigntable,the
Tablepanel(intheupperleft)cancontainscripts,asappropriategivenyourdesign.The
ModelandDOEDialogscriptsarealwaysprovided.Torunascript,selectRun Scriptfromthe
redtrianglemenu.
102
Custom Designs
Custom Design Options
Chapter 4
Design of Experiments Guide
Figure 4.26CustomDesignTableShowingScripts
Possiblescriptsincludethefollowing:
Screening RunstheAnalyze>Modeling>Screeningplatform.
Model RunstheAnalyze>Fit Model platform.Themodeldescribedbythescriptis
determinedbyyourchoicesintheModeloutlineandbythetypeofdesign.
ShowsmodelconstraintsthatyouenteredintheDefineFactorConstraintsoutline
usingtheSpecify Linear Constraints option.
Constraint
table.Thescriptalsocontainstherandomseedusedtogenerateyourdesign.
Back
TheBackbuttontakesyoubacktowhereyouwerebeforeclickingMakeDesign.Youcan
makechangestothepreviousoutlinesandregeneratethedesign.
Note: IfyouattempttoremoveallfactorsafterclickingtheBackbutton,onecontinuousfactor
remains.Youcandeletethecontinuousfactorafternewfactorsareadded.
Save Responses
Load Responses
LoadsresponsesthatyouhavesavedusingtheSaveResponsesoption.
Chapter 4
Design of Experiments Guide
Custom Designs
Custom Design Options
103
levels.Afactorscolumncontainscolumnpropertiesassociatedwiththefactor.Saving
factorsallowsyoutoquicklyloadthemintoaDOEwindow.
Note: Itispossibletocreateafactorstablebytypingdataintoanemptytable,but
remembertoassigneachcolumnanappropriateDesignRole.Dothisbyrightclickingon
thecolumnnameinthedatagridandselectingColumn Properties > Design Role.Inthe
DesignRolearea,selecttheappropriaterole.
Load Factors
LoadsfactorsthatyouhavesavedusingtheSaveFactorsoption.
definedintheDefineFactorConstraintsorLinearConstraintsoutline.TheSave
Constraintsoptioncreatesadatatablethatcontainsacolumnforeachconstraint.Saving
constraintsallowsyoutoquicklyloadthemintoaDOEwindow.
Theconstrainttablecontainsacolumnforeachlinearconstraint.Thefirstrowscontainthe
coefficientsforeachfactor.Thelastrowcontainstheinequalitybound.Eachconstraints
columncontainsacolumnpropertycalledConstraintStatethatidentifiestheconstraintasa
lessthanoragreaterthanconstraint.SeeColumnPropertiesonpage 559inthe
ColumnPropertiesappendix.
(Unavailableforsomeplatforms)Loadsfactorconstraintsthatyouhave
savedusingtheSaveConstraintsoption.
Load Constraints
randomcomponent.Theseactionsinclude:
simulatingresponsesusingtheSimulateResponsesoption
randomizingRunOrderfordesignconstruction
selectingastartingdesignfordesignsbasedonrandomstarts.
Toreproduceadesignorsimulatedresponses,entertherandomseedusedtogenerate
them.Fordesignsusingrandomstarts,settheseedbeforeclickingMakeDesign.To
controlsimulatedresponsesorrunorder,settheseedbeforeclickingMakeTable.
NotethattherandomseedassociatedwithadesignisincludedintheDOEDialogscript
thatissavedtothedesigndatatable.
Addsresponsevaluestothedesigntablethatisgenerated.Selectthis
optionbeforeyouclickMakeTable.InthedesigntablethatresultsfromclickingMake
Table,theresponsecolumnscontainsimulatedvalues.
Simulate Responses
Forcertaintypesofdesigns,aSimulateResponseswindowliststhecoefficientsanderror
standarddeviationusedtosimulatetheresponsevalues.Youcanreplacethesecoefficients
104
Custom Designs
Custom Design Options
Chapter 4
Design of Experiments Guide
andclickApplytoseeyoursimulatedresponsevaluesinthedatatable.Thedefaultvalues
forthecoefficientsareeither1or1.Thedefaultvaluefortheerrorstandarddeviationis1.
SomeplatformsallowyoutosetAnticipatedCoefficientsaspartofPowerAnalysisunder
DesignEvaluation.Fortheseplatforms,thedefaultvaluesintheSimulateResponses
windowarethevaluesthatyouspecifyasAnticipatedCoefficientsandAnticipatedRMSE
(ErrorStd)inthePowerAnalysisoutline.Ifitisnotpossibletofitthemodelspecifiedin
thedatatablesModelscript,theinterceptandcoefficientshavedefaultvaluesof0.
Note: Youcansetapreferencetoalwayssimulateresponses.SelectFile > Preferences >
Platforms > DOE.CheckSimulateResponses.
Save X Matrix SavesscriptscalledMomentsMatrixandModelMatrixtothedesigndata
table.Thesescriptscontainthemomentsanddesignmatrices.Usetheseinscriptsthatyou
write.SeeSaveXMatrixonpage 106.
Optimality Criterion
Changesthedesignoptimalitycriterion.Thedefaultcriterion,
Recommended,specifies Doptimalityforalldesigntypes,unlessyouaddedquadratic
effectsusingtheRSMbuttonintheModeloutline.FormoreinformationabouttheD,I,
andaliasoptimaldesigns,seeOptimalityCriteriaonpage 120.
Note: Youcansetapreferencetoalwaysuseagivenoptimalitycriterion.SelectFile >
Preferences > Platforms > DOE.CheckOptimalityCriterionandselectyourpreferred
criterion.
Number of Starts Enablesyoutospecifythenumberofrandomstartsusedinconstructing
thedesign.SeeNumberofStartsonpage 108.
Design Search Time Maximumnumberofsecondsspentsearchingforadesign.Thedefault
searchtimeisbasedonthecomplexityofthedesign.SeeDesignSearchTimeon
page 108andNumberofStartsonpage 108.
Iftheiterationsofthealgorithmrequiremorethanafewseconds,aComputingDesign
progresswindowappears.IfyouclickCancelintheprogresswindow,thecalculation
stopsandgivesthebestdesignfoundatthatpoint.Theprogresswindowalsodisplays
DefficiencyforDoptimaldesignsthatdonotincludefactorswithChangessettoHardor
VeryHardorwithEstimabilitysettoIfPossible.
Note: YoucansetapreferenceforDesignSearchTime.SelectFile > Preferences > Platforms
> DOE.CheckDesignSearchTimeandenterthemaximumnumberofseconds.Incertain
situationswheremoretimeisrequired,JMPextendsthesearchtime.
Sphere Radius Constrainsthecontinuousfactorsinadesigntoahypersphere.Specifythe
radiusandclickOK.Designpointsarechosensothattheirdistancefrom0equalsthe
SphereRadius.SelectthisoptionbeforeyouclickMakeDesign.
Chapter 4
Design of Experiments Guide
Custom Designs
Custom Design Options
105
Note: SphereRadiusconstraintscannotbecombinedwithconstraintsaddedusingthe
SpecifyLinearConstraintsoption.Also,theoptionisnotavailablewhenhardtochange
factorsareincluded(splitplotdesigns).
Advanced Options > Mixture Sum Setthesumofthemixturefactorstoanypositivevalue.Use
thisoptiontokeepacomponentofamixtureconstantthroughoutanexperiment.
Advanced Options > Split Plot Variance Ratio Specifytheratioofthevarianceoftherandom
wholeplotandthesubplotvariance(ifpresent)totheerrorvariance.Beforesettingthis
value,youmustdefineahardtochangefactorforyoursplitplotdesign,orhardand
veryhardtochangefactorsforyoursplitsplitplotdesign.Thenyoucanenteroneortwo
positivenumbersforthevarianceratios,dependingonwhetheryouhavespecifieda
splitplotorasplitsplitplotdesign.
(AvailableonlywhentheModeloutlineis
available)SpecifytheweightsthatareusedforfactorswhoseEstimabilityissettoIf
Possible.TheoptionupdatestoshowthedefaultweightswhenyouclickMakeDesign.
Enterapositivenumberforeachofthetermsforwhichyouwanttospecifyaweight.The
valuethatyouenteristhesquarerootofthereciprocalofthepriorvariance.Alargervalue
representsasmallervarianceandthereforemorepriorinformationthattheeffectisnot
active.
BayesianDorIoptimalityisusedinconstructingdesignswithIfPossiblefactors.The
defaultvaluesusedinthealgorithmare0forNecessaryterms,4forinteractionsinvolving
IfPossibleterms,and1forIfPossibleterms.Formoredetails,seeTheAliasMatrixon
page 601intheTechnicalDetailsappendixandOptimalityCriteriaonpage 120.
SpecifytherelativeimportanceofDefficiencyto
aliasoptimalityinconstructingthedesign.Selectthisoptiontobalancereducingthe
varianceofthecoefficientswithobtainingadesirablealiasstructure.Valuesshouldbe
between0and1.LargervaluesgivemoreweighttoDEfficiency.Thedefaultvalueis0.5.
ThisoptionhasaneffectonlywhenyouselectMakeAliasOptimalDesignasyour
OptimalityCriterion.
ForthedefinitionofDefficiency,seeOptimalityCriteriaonpage 120.Fordetailsabout
aliasoptimality,seeAliasOptimalityonpage 124.
Specifythedifferenceinthemeanresponsethatyou
wanttodetectformodeleffects.SeeSetDeltaforPoweronpage 109.
CustomDesignwindowandplacesitinanopenscriptwindow.
106
Custom Designs
Custom Design Options
Chapter 4
Design of Experiments Guide
Save X Matrix
ThisoptionsavesscriptscalledMomentsMatrixandModelMatrixthatcontainthemoments
matrixandthemodelmatrix.Themomentsmatrixandthemodelmatrixareusedtocalculate
theAverageVarianceofPrediction,whichappearsintheDesignDiagnosticssectionofthe
DesignEvaluationoutline.Fordetails,seeGoosandJones(2011).Ifthedesignisasplitplot
design,anVInversescriptisalsosaved.TheVInversescriptcontainstheinverseofthe
covariancematrixoftheresponses.
Note: Youcansetapreferencetoalwayssavethematrixscript.SelectFile > Preferences >
Platforms > DOE.CheckSaveXMatrix.
ModelMatrix
Themodelmatrixdescribesthedesignfortheexperiment.Themodelmatrixhasarowforeach
runandacolumnforeachtermofthemodelspecifiedintheModeloutline.Foreachrun,the
correspondingrowofthemodelmatrixcontainsthecodedvaluesofthemodelterms.
Continuoustermsarecodedtorangefrom1to1.Nominaltermsarecodedbyapplyingthe
GramSchmidtorthogonalizationproceduretoJMPscodingfornominaleffects.Find
additionalinformationaboutcodingfornominaleffectsintheFittingLinearModelsbook.See
alsoTheModelMatrixonpage 601intheTechnicalDetailsappendix.
MomentsMatrix
Themomentsmatrixisdependentuponthemodeleffectsbutisindependentofthedesign.Itis
definedasfollows:
M =
f x f x ' dx
R
where f x denotesthemodeleffectscorrespondingtofactorcombinationsofthevectorof
factors, x ,andRdenotesthedesignspace.Foradditionaldetailsconcerningmomentsand
designmatrices,seeGoosandJones(2011,pp8890)andMyersetal.(2009).Notethatthe
momentsmatrixiscalledamatrixofregionmomentsinMyersetal.(2009,p.376).
Scripts
FromtheCustomDesignredtrianglemenu,selectSave X Matrix.Afterthedesignandthe
tablearecreated,intheCustomDesigntable,theMomentsMatrixandModelMatrixscripts,
andifthedesignisasplitplot,theVInversescript,aresavedastableproperties.
SelectEditfromtheredtrianglenexttoeithertheMomentsMatrix,ModelMatrix,orV
Inversescript.Thescriptshowsthecorrespondingmatrix.Youcancopythismatrixinto
scriptsthatyouwrite.
Chapter 4
Design of Experiments Guide
Custom Designs
Custom Design Options
107
WhenyouruntheMomentsMatrixscript,thelogshowsthenumberofrowsinthe
momentsmatrix,calledMoments.
WhenyourunthescriptModelMatrix,thelogdisplaysthenumberofrowsinthemodel
matrix,calledX.
WhenyourunthescriptVInverse,thelogdisplaysthenumberofrowsintheinverse
covariancematrix,calledVInverse.
Example
Followthesestepstoillustratethesefeatures:
Tip: Toseethelog,selectView > Log(Window > LogontheMacintosh).
1. SelectDOE>Custom Design.
2. Add3continuousfactorsandclickContinue.
3. ClickInteractions > 2nd.
4. FromtheCustomDesignredtrianglemenu,selectSave X Matrix.
5. UsingtheDefaultNumberofRuns(12),clickMake DesignandthenMake Table.
6. IntheTablepanel,selectEditfromtheredtrianglenexttoMomentsMatrix.
Thescriptappearsinascriptwindow.Thescriptshowsthemomentsmatrix,whichis
calledMoments.
Figure 4.27MomentsMatrixScript
108
Custom Designs
Custom Design Options
Chapter 4
Design of Experiments Guide
Number of Starts
Thenumberofstartsisthenumberoftimesthatthecoordinateexchangealgorithminitiates
withanewdesign.SeeCoordinateExchangeAlgorithmonpage 125.Youcanspecifyyour
ownvalueusingtheNumber of Startsoption.Increasingthenumberofrandomstartstendsto
improvetheoptimalityoftheresultingdesign.
UnlessyouspecifyavalueforNumberofStartsandclickOK,thenumberofstartsis
controlledbyDesignSearchTime.Toseehowmanystartswereusedtoconstructadesign,
clickMakeDesign.ThenselectNumberofStarts.Thevalueinthetextboxisthenumberof
startsusedtoconstructthespecificdesign.
Incertainspecialcases,thegloballyoptimaldesignisknownfromtheory.Ifthe
coordinateexchangealgorithmdetectsthatithasfoundanoptimaldesign,itstopssearching
andreturnsthatdesign.
Tip: Toreproduceaspecificdesign,youneedtospecifytheNumberofStartsandtheRandom
Seedoriginallyusedtoproducethedesign.Obtainthesevaluesfromtheredtriangleoptions
afteryouclickMakeDesign.
Inexamplesofcustomdesignsinthedocumentation,therandomseedandnumberofstarts
areoftenprovidedsothatyoucanreconstructtheexactdesignbeingdiscussed.
Chapter 4
Design of Experiments Guide
Custom Designs
Custom Design Options
109
Note: ThenumberofstartingdesignsisgivenbythevalueintheNumberofStartstextbox.
However,thisvalueisnotupdateduntilafteryouconstructyourdesignbyclickingMake
Design.
Incertainspecialcases,thegloballyDoptimaldesignisknownfromtheory.Thesecases
include:
Twolevelfractionalfactorialdesignsornonregularorthogonalarrays.Theseareglobally
Doptimalforallmaineffectandtwofactorinteractionmodels.
Latinsquaredesigns.TheseareDoptimalformaineffectmodelsassumingtheright
samplesizeandnumbersoflevelsofthefactors.
PlackettBurmandesigns.TheseareDoptimalformaineffectmodels.
Ifthecoordinateexchangealgorithmdetectsthatithasfoundanoptimaldesign,itstops
searchingandreturnsthatdesign.
110
Custom Designs
Technical Details
Chapter 4
Design of Experiments Guide
Givenaspecifiedvalueofdelta,eachcoefficientintheAnticipatedCoefficientslistissetat
delta/2multipliedbythedefaultcoefficient.Foracontinuousfactor,thisassignmentensures
thatadifferenceofdeltaisdetectedwiththecalculatedpower.Foracategoricalfactor,this
assignmentofcoefficientsensuresthatamaximumdifferenceofdeltabetweenanytwolevels
isdetectedwiththecalculatedpower.
Technical Details
Thissectioncontainstechnicaldetailsforthefollowingtopics:
DesignswithRandomizationRestrictionsonpage 110
CovariateswithHardtoChangeLevelsonpage 119
NumbersofWholePlotsandSubplotsonpage 120
OptimalityCriteriaonpage 120
OptimalityCriteriaonpage 120
CoordinateExchangeAlgorithmonpage 125
Chapter 4
Design of Experiments Guide
Custom Designs
Technical Details
111
Theblockingfactor,Day,consistsofeachdaysruns.Thedaysonwhichthetrialswere
conductedarerepresentativeofalargepopulationofdayswithdifferentenvironmental
conditions.ItfollowsthatDayisarandomblockingfactor.
SetupforaRandomBlockDesign
Tocreatearandomblockdesign,usetheCustomDesignplatformtoenterresponsesand
factorsanddefineyourmodelasusual.IntheDesignGenerationoutline,selecttheGroup
runs into random blocks of sizeoptionandenterthenumberofrunsyouwantineachblock.
SeeDesignStructureOptionsonpage 98.
Note: Todefineafixedblockingfactor,enterablockingfactorintheFactorsoutline.Todefine
arandomblockingfactor,donotenterablockingfactorintheFactorsoutline.Instead,select
theGroup runs into random blocks of sizeoptionunderDesignGeneration.
Split-Plot Designs
Splitplotdesignsareusedinsituationswherethesettingsofcertainfactorsareheldconstant
forgroupsofruns.Inindustry,theseareusuallyfactorsthataredifficultorexpensiveto
changefromruntorun.Factorswhosesettingsneedtobeheldconstantforgroupsofrunsare
classifiedashardtochangeinJMP.
Becausecertainfactorsarehardtochange,itisnotpracticaltorandomlyallocatethemto
experimentalunits.Instead,theyareallocatedtogroupsofunits.Thisimposesarestrictionon
randomizationthatmustbeconsideredingeneratingadesignandinanalyzingtheresults.
ScenarioforaSplitPlotDesign
Boxetal.(2005)presentsanexperimenttostudythecorrosionresistanceofsteelbars.The
barsareplacedinafurnaceforcuring.Afterward,acoatingisappliedtoincreaseresistanceto
corrosion.Thetwofactorsofinterestare:
Temperatureindegreescentigrade,withlevels360,370,and380
Coating,withlevelsC1,C2,C3,andC4depictingfourdifferenttypesofcoating
Temperatureisahardtochangefactor,duetothetimeittakestoresetthetemperatureinthe
furnace.Forthisreason,fourbarsareprocessedforeachsettingoffurnacetemperature.Ata
laterstage,thefourcoatingsarerandomlyassignedtothefourbars.
Theexperimentalunitsarethebars.Temperatureisahardtochangefactorwhoselevels
definewholeplots.Withineachwholeplot,theCoatingfactorisrandomlyassignedtothe
experimentalunitstowhichthewholeplotfactorwasapplied.
112
Custom Designs
Technical Details
Chapter 4
Design of Experiments Guide
Figure 4.28FactorsandDesignOutlinesforSplitPlotDesign
TheFactorsoutlineforthecorrosionexperimenthasChangessettoHardforTemperatureand
EasyforCoating.The10rundesignconsistsoffivewholeplots,withinwhichthesettingsof
Temperatureareheldconstant.
SetupforaSplitPlotDesign
Ingeneral,severalfactorscanbeappliedtoaprocessingstepwheresettingsare
hardtochange.Inthefurnaceexample,youmightconsiderafurnacelocationfactor,aswell
astemperature.IntheFactorsoutline,undertheChangescolumn,youwouldspecifya
ChangesvalueofHardforsuchfactors.
Whenacustomdesigninvolvesonlyeasytochangeandhardtochangefactors,therunsof
thehardtochangefactorsaregroupedusinganewfactorcalledWhole Plots.Thevaluesof
Whole Plotsdesignateblocksofrunswithidenticalsettingsforthehardtochangefactors.The
ModelscriptthatissavedtothedesigntabletreatsWhole Plotsasarandomeffect.Fordetails,
seeChangesonpage 86andDesignStructureOptionsonpage 98.
Foranexampleofcreatingasplitplotdesignandanalyzingtheexperimentaldata,see
SplitPlotExperimentonpage 181intheExamplesofCustomDesignschapter.
Split-Split-Plot Designs
Asplitsplitplotdesignisusedwhentherearetwolevelsoffactorsthatarehardtochange.
Inindustry,suchdesignsoftenoccurwhenbatchesofmaterialorexperimentalunitsfromone
processingstagepasstoasecondprocessingstage.Factorsareappliedtobatchesofmaterial
Chapter 4
Design of Experiments Guide
Custom Designs
Technical Details
113
atthefirststage.Thenthosebatchesaredividedforsecondstageprocessing,where
additionalfactorsarestudied.Thefirststagefactorsareconsideredveryhardtochange,and
thesecondstagefactorsareconsideredhardtochange.Additionalfactorscanbeappliedto
experimentalunitsafterthesecondprocessingstage.Thesefactorsareconsidered
easytochange.
Inasplitsplitplotdesign,thebatchesareconsideredtoberandomblocks.Sincethebatches
aredividedforsecondstageprocessing,thesecondstagefactorsarenestedwithinthe
firststagefactors.
ScenarioforaSplitSplitPlotDesign
Schoen(1999)presentsanexampleofasplitsplitplotdesignthatrelatestocheesequality.
ThefactorsaregivenintheCheese Factors.jmpdatatablefoundintheDesignExperiment
folder.Theexperimentconsistsofthreestagesofprocessing:
Milkisreceivedfromfarmersandstoredinalargetank.
Milkfromthistankisdistributedtosmallertanksusedforcurdprocessing.
Thecurdsfromeachtankaretransportedtopressesforprocessingindividualcheeses.
Theexperimentconsistsoftesting:
Twofactorsthatareappliedwhenthemilkisinthelargestoragetank.
Fivefactorsthatareappliedtothesmallercurdprocessingtanks.
Threefactorsthatareappliedtotheindividualcheesesfromacurdsprocessingtank.
Noticethatthelevelsoffactorsappliedtothecurdprocessingtanks(subplots)arenested
withinthelevelsoffactorsappliedtothemilkstoragetank(wholeplots).
TheFactorsoutlineforthecheeseexperimenthaveChangessetasfollows:
VeryHardforthetwostoragetankfactors
Hardforthefivecurdprocessingtankfactors
Easyforthethreefactorsthatcanberandomlyassignedtocheeses
114
Custom Designs
Technical Details
Chapter 4
Design of Experiments Guide
Figure 4.29FactorsandDesignGenerationOutlineforSplitSplitPlotDesign
Thedefaultnumberofwholeplotsis5andthedefaultnumberofsubplotsis11.ClickMake
Designtoseea22rundesign.
Figure 4.30SplitSplitPlotDesignforCheeseScenario
Chapter 4
Design of Experiments Guide
Custom Designs
Technical Details
115
AfactorcalledWhole Plotsrepresentstheblocksofconstantlevelsofthefactorswith
ChangessettoVeryHard.
AfactorcalledSubplotsrepresentstheblocksofconstantlevelsofthefactorswith
ChangessettoHard.
ThefactorSubplotsreflectsthenestingofthelevelsofthefactorswithChangessettoHard
withinthelevelsofthefactorswithChangessettoVeryHard.
ThelevelsoffactorswithChangessettoEasyarerandomlyassignedtounitswithin
subplots.
ThefactorsWhole PlotsandSubplotsaretreatedasrandomeffectsintheModelscriptthat
issavedtothedesigntable.
Fordetails,seetheChangesdescriptionunderFactorsOutlineonpage 86andDesign
StructureOptionsonpage 98.
Two-Way Split-Plot Designs
Atwowaysplitplot(alsoknownasstripplotorsplitblock)designconsistsoftwosplitplot
components.Inindustry,thesedesignsarisewhenbatchesofmaterialorexperimentalunits
fromoneprocessingstagepasstoasecondprocessingstage.But,afterthefirstprocessing
stage,itispossibletodividethebatchesintosubbatches.Thesecondstageprocessingfactors
areappliedrandomlytothesesubbatches.Foraspecificsecondstageexperimentalsetting,
allofthesubbatchesassignedtothatsettingcanbeprocessedsimultaneously.Additional
factorscanbeappliedtoexperimentalunitsafterthesecondprocessingstage.
Incontrasttoasplitsplitplotdesign,thesecondstagefactorsarenotnestedwithinthe
firststagefactors.Afterthefirststage,thebatchesaresubdividedandformedintonew
batches.Therefore,boththefirstandsecondstagefactorsareappliedtowholebatches.
116
Custom Designs
Technical Details
Chapter 4
Design of Experiments Guide
Althoughfactorsatbothstagesmightbeequallyhardtochange,todistinguishthesefactors,
JMPdenotesthefirststagefactorsasveryhardtochange,andthesecondstagefactorsas
hardtochange.Additionalfactorsappliedtoexperimentalunitsafterthesecondprocessing
stageareconsideredeasytochange.
ScenarioforaTwoWaySplitPlotDesign
VivacquaandBisgaard(2004)describeanexperimenttoimprovetheopencircuitvoltagein
batterycells.Twostagesofprocessingareofinterest:
Firststage:Acontinuousassemblyprocess
Secondstage:Acuringprocesswitha5daycycletime
Theengineerswanttostudysixtwolevelfactors:
Fourfactors,X1,X2,X3,andX4,thatareappliedtotheassemblyprocess
Twofactors,X5andX6,thatareappliedtothecuringprocess
Afullfactorialdesignwithallfactorsattwolevelswouldrequire26=64runs,andwould
requireaprohibitive64*5=320days.Also,itisnotpracticaltovaryassemblyconditionsfor
individualbatteries.However,assemblyconditionscanbechangedforlargebatches,suchas
batchesof2000batteries.
Boththefirstandsecondstagefactorsarehardtochange.Inasense,therearetwosplitplot
designs.However,thebatchesof2,000batteriesfromthefirststageexperimentcanbe
dividedintofoursubbatchesof500batterieseach.Thesesubbatchescanberandomly
assignedtothefoursettingsofthetwosecondstagefactors.Allofthebatchesassignedtoa
givensetofcuringconditionscanbeprocessedsimultaneously.Inotherwords,thefirstand
secondstagefactorsarecrossed.
Todistinguishbetweenthefirstandsecondstagefactors,youdesignatetheChangesforthe
firststagefactorsasVeryHard,andtheChangesforthesecondstagefactorsasHard.See
Figure 4.31.Also,underDesignGeneration,notethefollowingoption:Hard to change factors
can vary independently of Very Hard to change factors.Ifthisisnotchecked,thedesignis
treatedasasplitsplitplotdesign,withnestingoffactorsatthetwolevels.Checkthisoption
tocreateatwowaysplitplotdesign.
Chapter 4
Design of Experiments Guide
Custom Designs
Technical Details
Figure 4.31FactorsandDesignGenerationOutlineforTwoWaySplitPlotDesign
Thedefaultnumberofwholeplotsis7;thedefaultnumberofsubplotsis14.ClickMake
Designtoseethe28rundesign.
117
118
Custom Designs
Technical Details
Chapter 4
Design of Experiments Guide
Figure 4.32TwoWaySplitPlotDesignforBatteryCells
Thesevenwholeplotscorrespondtothefirststagefactors,X1,X2,X3,andX4.Thesettingsof
thesefactorsareconstantwithinawholeplot.The14subplotscorrespondtothesecondstage
factors,X5andX6.Forexample,thesubbatchesforruns1and15(fromdifferentwholeplots)
aresubjecttothesamesubplottreatment,whereX5issetat1andX6at1.
SetupforaTwoWaySplitPlotDesign
AtwowaysplitplotdesignrequiresfactorswithChangessettoVeryHardandtoHard.As
describedinSetupforaSplitSplitPlotDesignonpage 115,factorscalledWhole Plotsand
Subplotsarecreated.However,inatwowaysplitplotdesign,Subplotsdoesnotnestthe
levelsoffactorswithChangessettoHardwithinthelevelsoffactorswithChangessettoVery
Hard.BothWhole PlotsandSubplotsaretreatedasrandomeffectsintheModelscriptthatis
savedtothedesigntable.
YouneedtoensurethatthefactorSubplotsisnotnestedwithinthefactorWhole Plots.Select
theoptionHard to change factors can vary independently of Very Hard to change factorinthe
DesignGenerationoutline(Figure 4.31).Formoredetails,seeChangesonpage 86and
DesignStructureOptionsonpage 98.
Foranexampleofcreatingasplitplotdesignandanalyzingtheexperimentaldata,see
TwoWaySplitPlotExperimentonpage 186intheExamplesofCustomDesignschapter.
Chapter 4
Design of Experiments Guide
Custom Designs
Technical Details
119
120
Custom Designs
Technical Details
Chapter 4
Design of Experiments Guide
Optimality Criteria
Thissectionprovidesinformationaboutthefollowingdesigns:
DOptimalityonpage 120
BayesianDOptimalityonpage 121
IOptimalityonpage 122
BayesianIOptimalityonpage 123
AliasOptimalityonpage 124
D-Optimality
Bydefault,theCustomDesignplatformoptimizestheDoptimalitycriterionexceptwhena
fullquadraticmodeliscreatedusingtheRSMbutton.Inthatcase,anIoptimaldesignis
constructed.
TheDoptimalitycriterionminimizesthedeterminantofthecovariancematrixofthemodel
coefficientestimates.ItfollowsthatDoptimalityfocusesonpreciseestimatesoftheeffects.
Thiscriterionisdesirableinthefollowingcases:
screeningdesigns
experimentsthatfocusonestimatingeffectsortestingforsignificance
designswhereidentifyingtheactivefactorsistheexperimentalgoal
TheDoptimalitycriterionisdependentontheassumedmodel.Thisisalimitationbecause
oftentheformofthetruemodelisnotknowninadvance.TherunsofaDoptimaldesign
optimizetheprecisionofthecoefficientsoftheassumedmodel.Intheextreme,aDoptimal
Chapter 4
Design of Experiments Guide
Custom Designs
Technical Details
121
designmightbesaturated,withthesamenumberofrunsasparametersandnodegreesof
freedomforlackoffit.
Specifically,aDoptimaldesignmaximizesD,whereDisdefinedasfollows:
D = det X X
andwhereXisthemodelmatrixasdefinedinSaveXMatrixonpage 106.
DoptimalsplitplotdesignsmaximizeD,whereDisdefinedasfollows:
1
D = det X V X
and V
istheblockdiagonalcovariancematrixoftheresponses(Goos2002).
SinceaDoptimaldesignfocusesonminimizingthestandarderrorsofcoefficients,itmight
notallowforcheckingthatthemodeliscorrect.Forexample,aDoptimaldesigndoesnot
includecenterpointsforafirstordermodel.Whentherearepotentiallyactivetermsthatare
notincludedintheassumedmodel,abetterapproachistospecifyIfPossibletermsandtouse
aBayesianDoptimaldesign.
Bayesian D-Optimality
BayesianDoptimalityisamodificationoftheDoptimalitycriterion.TheBayesian
Doptimalitycriterionisusefulwhentherearepotentiallyactiveinteractionsornonlinear
effects.SeeDuMouchelandJones(1994)andJonesetal(2008).
BayesianDoptimalityestimatesaspecifiedsetofmodelparametersprecisely.Thesearethe
effectswhoseEstimabilityyoudesignateasNecessaryintheModeloutline.Butatthesame
time,BayesianDoptimalityhastheabilitytoestimateother,typicallyhigherordereffects,as
allowedbytherunsize.ThesearetheeffectswhoseEstimabilityyoudesignateasIfPossible
intheModeloutline.Totheextentpossiblegiventherunsizerestriction,aBayesian
DoptimaldesignallowsfordetectinginadequacyinamodelthatcontainsonlytheNecessary
effects.
TheBayesianDoptimalitycriterionismosteffectivewhenthenumberofrunsislargerthan
thenumberofNecessaryterms,butsmallerthanthesumoftheNecessaryandIfPossible
terms.Whenthisisthecase,thenumberofrunsissmallerthanthenumberofparametersthat
youwouldliketoestimate.UsingpriorinformationintheBayesiansettingallowsforprecise
estimationofalloftheNecessarytermswhileprovidingtheabilitytodetectandestimate
someIfPossibleterms.
Toallowforameaningfulpriordistributiontoapplytotheparametersofthemodel,
responsesandfactorsarescaledtohavecertainproperties(DuMouchelandJones,1994,
Section2.2).
Considerthefollowingnotation:
XisthemodelmatrixasdefinedinSaveXMatrixonpage 106
122
Custom Designs
Technical Details
Chapter 4
Design of Experiments Guide
Kisadiagonalmatrixwithvaluesasfollows:
k=0forNecessaryterms
k=1forIfPossiblemaineffects,powers,andinteractionsinvolvingacategoricalfactor
withmorethantwolevels
k=4forallotherIfPossibleterms
ThepriordistributionimposedonthevectorofIfPossibleparametersismultivariatenormal,
2
withmeanvector0anddiagonalcovariancematrixwithdiagonalentries 1 k .Therefore,a
2
value k isthereciprocalofthepriorvarianceofthecorrespondingparameter.
Thevaluesforkareempiricallydetermined.IfPossiblemaineffects,powers,andinteractions
withmorethanonedegreeoffreedomhaveapriorvarianceof1.OtherIfPossibletermshave
apriorvarianceof1/16.InthenotationofDuMouchelandJones,1994, k = 1 .
TocontroltheweightsforIfPossibleterms,selectAdvanced Options > Prior Parameter
Variancefromtheredtrianglemenu.SeeAdvancedOptions>PriorParameterVarianceon
page 105.
2 1
Theposteriordistributionfortheparametershasthecovariancematrix XX + K .The
BayesianDoptimaldesignisobtainedbymaximizingthedeterminantoftheinverseofthe
posteriorcovariancematrix:
2
det XX + K
I-Optimality
Ioptimaldesignsminimizetheaveragevarianceofpredictionoverthedesignspace.The
IoptimalitycriterionismoreappropriatethanDoptimalityifyourprimaryexperimental
goalisnottoestimatecoefficients,butrathertodothefollowing:
predictaresponse
determineoptimumoperatingconditions
determineregionsinthedesignspacewheretheresponsefallswithinanacceptablerange
Inthesecases,precisepredictionoftheresponsetakesprecedenceoverpreciseestimationof
theparameters.
Thepredictionvariancerelativetotheunknownerrorvarianceatapoint x 0 inthedesign
spacecanbecalculatedasfollows:
1
var Y x 0 = f x 0 XX f x 0
whereXisthemodelmatrixasdefinedinSaveXMatrixonpage 106.
Chapter 4
Design of Experiments Guide
Custom Designs
Technical Details
123
IoptimaldesignsminimizetheintegralIofthepredictionvarianceovertheentiredesign
space,whereIisgivenasfollows:
I = f x XX
f x dx = Trace XX M
HereMisthemomentsmatrix:
M =
f x f x dx
R
SeeSaveXMatrixonpage 106.Forfurtherdetails,seeGoosandJones(2011).
Themomentsmatrixdoesnotdependonthedesignandcanbecomputedinadvance.The
rowvectorf(x)consistsofa1followedbytheeffectscorrespondingtotheassumedmodel.
Forexample,forafullquadraticmodelintwocontinuousfactors,f(x)isdefinedasfollows:
f x = 1 x 1 x 2 x 1 x 2 x 21 x 22
Bayesian I-Optimality
TheBayesianIoptimaldesignminimizestheaveragepredictionvarianceoverthedesign
regionforNecessaryandIfPossibleterms.
Considerthefollowingnotation:
Xisthemodelmatrix,definedinSaveXMatrixonpage 106
Kisadiagonalmatrixwithvaluesasfollows:
k=0forNecessaryterms
k=1forIfPossiblemaineffects,powers,andinteractionsinvolvingacategoricalfactor
withmorethantwolevels
k=4forallotherIfPossibleterms
ThepriordistributionimposedonthevectorofIfPossibleparametersismultivariatenormal,
2
withmeanvector0anddiagonalcovariancematrixwithdiagonalentries 1 k .(See
BayesianDOptimalityonpage 121formoredetailsaboutthevaluesk.)
Theposteriorvarianceofthepredictedvalueatapointx0isasfollows:
2 1
x = f x X X + K
var Y
0
0
f x0
TheBayesianIoptimaldesignminimizestheaveragepredictionvarianceoverthedesign
region,asfollows:
2 1
I B = Trace X X + K M
124
Custom Designs
Technical Details
Chapter 4
Design of Experiments Guide
whereMisthemomentsmatrix.SeeSaveXMatrixonpage 106.
Alias Optimality
Aliasoptimalityseekstominimizethealiasingbetweeneffectsthatareintheassumedmodel
andeffectsthatarenotinthemodelbutarepotentiallyactive.Effectsthatarenotinthemodel
butthatareofpotentialinterestarecalledaliaseffects.Fordetailsaboutaliasoptimaldesigns,
seeJonesandNachtsheim(2011).
Specifically,letX1bethemodelmatrixcorrespondingtothetermsintheassumedmodel,as
definedinSaveXMatrixonpage 106.Thedesigndefinesthemodelthatcorrespondstothe
aliaseffects.DenotethematrixofmodeltermsforthealiaseffectsbyX2.
ThealiasmatrixisthematrixA,definedasfollows:
A = X 1 X 1 1 X 1 X 2
Theentriesinthealiasmatrixrepresentthedegreeofbiasassociatedwiththeestimatesof
modelterms.SeeTheAliasMatrixonpage 601intheTechnicalDetailsappendixforthe
derivationofthealiasmatrix.
ThesumofsquaresoftheentriesinAprovidesasummarymeasureofbias.Thissumof
squarescanberepresentedintermsofatraceasfollows:
trace AA
DesignsthatreducethetracecriteriongenerallyhavelowerDefficiencythantheDoptimal
design.Consequently,aliasoptimalityseekstominimizethetraceof AA subjecttoalower
boundonDefficiency.ForthedefinitionofDefficiency,seeOptimalityCriteriaon
page 120.ThelowerboundonDefficiencyisgivenbytheDefficiencyweight,whichyoucan
specifyunderAdvancedOptions.SeeAdvancedOptions>DEfficiencyWeightonpage 105.
D-Efficiency
LetXdenotethedesign,ormodel,matrixforagivenassumedmodelwithpparameters.For
thedefinitionofthemodelmatrix,seeSaveXMatrixonpage 106.Let X D denotethemodel
matrixforaDoptimaldesignfortheassumedmodel.ThentheDefficiencyofthedesign
givenbyXisasfollows:
XX 1 p
DEfficiency = ------------------X D X D
Chapter 4
Design of Experiments Guide
Custom Designs
Technical Details
125
Coordinate-Exchange Algorithm
CustomDesignconstructsadesignthatseekstooptimizeoneofseveraloptimalitycriteria.
(SeeOptimalityCriteriaonpage 120.)Tooptimizethecriterion,CustomDesignusesthe
coordinateexchangealgorithm(MeyerandNachtsheim,1995).Thealgorithmbeginsby
randomlyselectingvalueswithinthespecifieddesignregionforeachfactorandeachrunto
constructastartingdesign.
Supposeyourstudyrequirescontinuousfactors,nofactorconstraints,andamaineffects
model.Aniterationconsistsoftestingeachvalueofthemodelmatrix,asfollows:
Thecurrentvalueofeachfactorisreplacedbyitstwomostextremevalues.
Theoptimalitycriterioniscomputedforbothofthesereplacements.
Ifoneofthevaluesincreasestheoptimalitycriterion,thisvaluereplacestheoldvalue.
Theprocesscontinuesuntilnoreplacementoccursforanentireiteration.
Appropriateadjustmentsaremadetothealgorithmtoaccountforpolynomialterms,nominal
factors,andfactorconstraints.
Thedesignobtainedusingthisprocessisoptimalinalargeclassofneighboringdesigns.Butit
isonlylocallyoptimal.Toimprovethelikelihoodoffindingagloballyoptimaldesign,the
coordinateexchangealgorithmisrepeatedalargenumberoftimes.GoosandJones(2011,
p. 36)recommendusingatleast1,000randomstartsforallbutthemosttrivialdesign
situations.ThenumberofstartingdesignsiscontrolledbytheNumberofStartsoption.See
NumberofStartsonpage 108.CustomDesignprovidesthedesignthatmaximizesthe
optimalitycriterionamongalltheconstructeddesigns.
126
Custom Designs
Technical Details
Chapter 4
Design of Experiments Guide
Chapter 5
Examples of Custom Designs
Perform Experiments That Meet Your Needs
UsetheCustomDesignplatformasyourprimarytoolforconstructingawiderangeof
experimentaldesigns.Youcanconstructavarietyofdesigntypesandfinetunethemtoyour
specificexperimentalneedsandresourcebudget.
CustomDesignprovidesmoreoptionsandcontrolthantheScreening,ResponseSurface,Full
Factorial,andMixtureDesignplatforms.Thedesignsthatyouconstructarecreated
specificallytomeetyourgoals.Thiseliminatesthestruggletofindaclassicaldesignthatonly
comesclosetomeetingyourgoals.
TheflexiblespecialpurposedesignsthatyoucanconstructusingCustomDesigninclude:
Screeningdesigns,includingsupersaturatedscreeningdesigns
Responsesurfacedesigns,includingthosewithcategoricalfactors
Mixturedesigns,includingthosewithprocessfactors,andmixtureofmixturedesigns
Designsthatincludecovariatesorthatarerobusttolineartimetrends
Fixedandrandomblockdesigns
Splitplot,splitsplitplot,andtwowaysplitplot(stripplot)designs
InthischapteryouconstructmostofthesedesigntypeswithintheCustomDesignplatform.
Inmanycases,youalsoanalyzetheexperimentalresults.ForhelpwithusingtheCustom
Designplatform,seetheCustomDesignschapteronpage 63.
Figure 5.1FractionofDesignSpacePlot
Contents
ScreeningExperiments ........................................................... 129
DesignThatEstimatesMainEffectsOnly ........................................ 129
DesignThatEstimatesAllTwoFactorInteractions................................ 132
DesignThatAvoidsAliasingofMainEffectsandTwoFactorInteractions ........... 134
SupersaturatedScreeningDesigns .............................................. 138
DesignforFixedBlocks....................................................... 145
ResponseSurfaceExperiments .................................................... 150
ResponseSurfaceDesign ...................................................... 150
ResponseSurfaceDesignwithFlexibleBlocking.................................. 156
ComparisonofaDOptimalandanIOptimalResponseSurfaceDesign ............. 159
MixtureExperiments ............................................................ 163
MixtureDesignwithNonmixtureFactors ....................................... 164
MixtureofMixturesDesign.................................................... 168
ExperimentswithCovariates ..................................................... 171
DesignwithFixedCovariates .................................................. 172
DesignwithHardtoChangeCovariates ........................................ 175
DesignwithaLinearTimeTrend ............................................... 178
ExperimentswithRandomizationRestrictions ...................................... 181
SplitPlotExperiment ......................................................... 181
TwoWaySplitPlotExperiment................................................ 186
Chapter 5
Design of Experiments Guide
129
Screening Experiments
Intheearlystagesofstudyingaprocess,youidentifyalistoffactorsthatpotentiallyaffect
yourresponseorresponses.Youareinterestedinidentifyingtheactivefactors,thatis,the
factorsthatactuallydoaffectyourresponseorresponses.Ascreeningdesignhelpsyou
determinewhichfactorsarelikelytobeactive.Oncetheactivefactorsareidentified,youcan
constructmoresophisticateddesigns,suchasresponsesurfacedesigns,tomodelinteractions
andcurvature.
ScreeningdesignsconstructedusingtheCustomDesignplatformareoftenequivalenttothe
classicaldesignsprovidedintheScreeningDesignplatform.However,CustomDesigncan
constructdesignsforcaseswhereclassicalscreeningdesignsarenotavailable.
TheCustomDesignplatformconstructsscreeningdesignsusingeithertheDoptimalityor
BayesianDoptimalitycriterion.TheDoptimalitycriterionminimizesthedeterminantofthe
covariancematrixofthemodelcoefficientestimates.ItfollowsthatDoptimalityfocuseson
preciseestimatesoftheeffects.Fordetails,seeOptimalityCriteriaonpage 120inthe
CustomDesignschapter.
Thissectioncontainsthefollowingexamples:
DesignThatEstimatesMainEffectsOnlyonpage 129
DesignThatEstimatesAllTwoFactorInteractionsonpage 132
DesignThatAvoidsAliasingofMainEffectsandTwoFactorInteractionsonpage 134
SupersaturatedScreeningDesignsonpage 138
DesignforFixedBlocksonpage 145
130
Chapter 5
Design of Experiments Guide
Figure 5.2CustomDesignWindowShowingModelOutline
Keepthedefaultof12runs.
Note: SettingtheRandomSeedinstep5andNumberofStartsinstep6reproducesthe
exactresultsshowninthisexample.Whenconstructingadesignonyourown,thesesteps
arenotnecessary.
5. (Optional)FromtheCustomDesignredtrianglemenu,selectSet Random Seed,type
1839634787,andclickOK.
6. (Optional)FromtheCustomDesignredtrianglemenu,selectNumber of Starts,type1,
andclickOK.
7. ClickMake Design.
Chapter 5
Design of Experiments Guide
131
Figure 5.3DesignforMainEffectsOnly
Noticethefollowing:
Themaineffectsarerepresentedbythesixtermsintheupperleftcornerofthemap.
Thedeepbluecolorcorrespondingtothecorrelationsofthesixmaineffectswithother
maineffectsindicatescorrelationsof0.Thismeansthatallmaineffectsareorthogonal
andcanbeestimatedindependentlyofeachother.
Thelightbluecolorinthesquarescorrespondingtosometwowayinteractions
indicatesthatthecorrespondingeffectsarecorrelated.Thismeansthattheseeffects
cannotbeestimatedindependentlyofothereffects.Placeyourcursoroverthese
squarestoseetheexactcorrelation.
132
Chapter 5
Design of Experiments Guide
Noticethatnoeffectsarecompletelyconfoundedwitheachother.Theonlyred
squares,indicatingabsolutecorrelationsof1,areonthemaindiagonal.
9. OpentheDesign Evaluation > Alias Matrixoutline.
Figure 5.5AliasMatrix
TheAliasMatrixshowshowthecoefficientsofthemaineffecttermsinthemodelarebiased
bypotentiallyactivetwofactorinteractioneffects.Thecolumnlabelsidentifyinteractions.For
example,intheX1row,thecolumnX2*X3hasavalueof0.333andthecolumnX2*X4 hasa
valueof0.33.ThismeansthattheexpectedvalueofthemaineffectofX1isthesumofthe
maineffectofX1plus0.333timestheeffectofX2*X3,plus0.33timestheeffectofX2*X4,and
soon,fortherestoftheX1 row.InorderfortheestimateofthemaineffectofX1tobe
meaningful,youmustassumethattheseinteractionsarenegligibleinsizecomparedtothe
effectofX1.
Tip: TheAliasMatrixisageneralizationoftheconfoundingpatterninfractionalfactorial
designs.
Chapter 5
Design of Experiments Guide
133
Figure 5.6ModelOutlineShowingInteractions
6. ClickMinimumtoaccept16forthenumberofruns.
Note: SettingtheRandomSeedinstep7andNumberofStartsinstep8reproducesthe
exactresultsshowninthisexample.Inconstructingadesignonyourown,thesestepsare
notnecessary.
7. (Optional)FromtheCustomDesignredtrianglemenu,selectSet Random Seed,type
819994207,andclickOK.
8. (Optional)FromtheCustomDesignredtrianglemenu,selectNumber of Starts,type1,
andclickOK.
9. ClickMake Design.
Figure 5.7showstherunsofthedesign.Allmaineffectsandtwofactorinteractionsare
estimablebecausetheirEstimabilitywasdesignatedasNecessary(bydefault)inthe
Modeloutline.
134
Chapter 5
Design of Experiments Guide
Figure 5.7DesigntoEstimateAllTwoFactorInteractions
TheColorMapindicatesthatthefivemaineffectsandthetentwowayinteractionsareall
mutuallyorthogonal.
Chapter 5
Design of Experiments Guide
135
Yourbudgetallowsforonly16runs.Withsixfactors,thereare15possibletwofactor
interactions.Theminimumnumberofrunsrequiredtofittheconstant,thesixmaineffects,
andthe15twofactorinteractionsis22.
Inthisexample,youfindacompromisebetweenan8runmaineffectsonlydesign(see
DesignThatEstimatesMainEffectsOnlyonpage 129)anda22rundesigncapableoffitting
allthetwofactorinteractions.YouuseAliasOptimalityastheoptimalitycriteriontoachieve
yourgoal.
1. SelectDOE > Custom Design.
2. Type6nexttoAdd N Factors.
3. ClickAdd Factor > Continuous.
4. ClickContinue.
Themodelincludesthemaineffecttermsbydefault.Thedefaultestimabilityofthese
termsisNecessary.IntheAliasTermsoutline,noticethatsecondorderinteractionsare
added.Bydefault,alltwowayinteractionsnotincludedintheassumedmodelareadded
totheAliasTermslist.
5. SelectOptimality Criterion > Make Alias Optimal Designfromtheredtrianglemenu.
TheMakeAliasOptimalDesignselectiontellsJMPtogenerateadesignthatbalances
reductioninaliasingwithDefficiency.SeeAliasOptimalityonpage 124intheCustom
Designschapter.
6. ClickUser Specifiedandchangethenumberofrunsto16.
136
Chapter 5
Design of Experiments Guide
Figure 5.9Factors,Model,AliasTerms,andNumberofRuns
Note: SettingtheRandomSeedinstep7andNumberofStartsinstep8reproducesthe
exactresultsshowninthisexample.Inconstructingadesignonyourown,thesestepsare
notnecessary.
7. (Optional)FromtheCustomDesignredtrianglemenu,selectSet Random Seed,type
1692819077,andclickOK.
8. (Optional)FromtheCustomDesignredtrianglemenu,selectNumber of Starts,type161,
andclickOK.
9. ClickMake Design.
Chapter 5
Design of Experiments Guide
137
Allrowscontainonlyzeros,whichmeansthattheInterceptandmaineffecttermsarenot
biasedbyanytwofactorinteractions.
11. OpentheDesign Evaluation > Color Map on Correlations outline.
Figure 5.11ColorMaponCorrelations
TheColorMaponCorrelationsshowsthatmaineffectscanbeestimatedindependentlyof
twowayinteractions.However,sometwowayinteractionsarefullyaliasedwithother
twowayinteractions.Placeyourcursorovertheoffdiagonalredsquarestoseewhich
twowayinteractionsareconfounded.
ItturnsoutthatthisparticulardesignisaresolutionIVorthogonalscreeningdesign.Main
effectsarenotaliasedwitheachotherorwithtwowayinteractions.Buttwowayinteractions
arefullyaliasedwithothertwowayinteractions.
138
Chapter 5
Design of Experiments Guide
Ifthenumberofactivefactorsismorethanhalfthenumberofrunsintheexperiment,then
itislikelythatthesefactorswillbeimpossibletoidentify.Ageneralruleisthatthenumber
ofrunsshouldbeatleastfourtimeslargerthanthenumberofactivefactors.Inother
words,ifyouexpectthattheremightbeasmanyasfiveactivefactors,youshouldplanon
atleast20runs.
Analysisofsupersaturateddesignscannotyetbereducedtoanautomaticprocedure.
However,usingforwardstepwiseregressionisreasonable.Inaddition,theScreening
platform(Analyze>Modeling>Screening)offersastreamlinedanalysis.
Chapter 5
Design of Experiments Guide
139
Figure 5.12Factors,Model,andNumberofRuns
7. IntheAliasTermsoutline,selectalleffectsandclickRemove Term.
ThisensuresthatonlythemaineffectsappearintheColorMaponCorrelations.Thisplot
isconstructedoncethedesigniscreated.
8. SelectSimulate Responsesfromtheredtrianglemenu.
Thisoptiongeneratesrandomresponsesthatappearinyourdesigntable.Youwilluse
theseresponsestoseehowtoanalyzeexperimentaldata.
KeeptheNumberofRunssettotheDefaultof8.
140
Chapter 5
Design of Experiments Guide
Note: SettingtheRandomSeedinstep9andNumberofStartsinstep10reproducesthe
exactresultsshowninthisexample.Inconstructingadesignonyourown,thesestepsare
notnecessary.
9. (Optional)FromtheCustomDesignredtrianglemenu,selectSet Random Seed,type
1008705125,andclickOK.
10. (Optional)FromtheCustomDesignredtrianglemenu,selectNumber of Starts,type100,
andclickOK.
11. ClickMake Design.
12. ClickMake Table.
DonotcloseyourCustomDesignwindow.Youreturntoitlaterinthisexample.
Thedesigntable(Figure 5.13)andtheSimulateResponseswindow(Figure 5.14)appear.
Figure 5.13DesignTablewithSimulatedResponses
Theresponsecolumn,Y,containssimulatedvalues.Thesearerandomlygeneratedusing
themodeldefinedbytheparametervaluesintheSimulateResponseswindow.
Chapter 5
Design of Experiments Guide
141
Figure 5.14SimulateResponsesWindow
TheSimulateResponseswindowshowscoefficientsof0forallterms,withanErrorStdof
1.ThevaluesintheYcolumncurrentlyreflectonlyrandomvariation.Noticethatthe
modelcoefficientsaresetto0becausenotallcoefficientsareestimable.
13. ChangethevaluesofthecoefficientsintheSimulateResponseswindowasshownin
Figure 5.15.
Figure 5.15ParameterValuesforSimulatedResponses
14. ClickApply.
TheresponsevaluesintheYcolumnchange.SeeFigure 5.16.
Note: Ifyoudidnotsettherandomseedandthenumberofstarts,orifyouclickApplymore
thanonce,yourresponsevalueswillnotmatchthoseinFigure 5.16.
142
Chapter 5
Design of Experiments Guide
Figure 5.16ResponseColumnwithX1andX11Active
Inyoursimulation,youspecifiedX1 andX11asactivefactorswithlargeeffectsrelativetothe
errorvariation.Forthisreason,youranalysisofthedatashouldidentifythesetwofactorsas
active.
Analyzing a Supersaturated Design Using the Screening Platform
TheScreeningplatformprovidesawaytoidentifyactivefactors.Thedesigntablein
Figure 5.16containsthreescripts.TheScreeningscriptanalyzesyourdatausingtheScreening
platform(locatedundertheAnalyze > Modeling > Screeningmenu).
1. IntheTablespanelofthedesigntable,selectRun Scriptfromtheredtrianglenextto
Screening.
Figure 5.17ScreeningReportforSupersaturatedDesign
Chapter 5
Design of Experiments Guide
143
ThefactorsX1andX11havelargecontrastandLenthtRatiovalues.Also,their
SimultaneouspValuesaresmall.IntheHalfNormalPlot,bothX1andX11fallfarfrom
theline.TheContrastsandtheHalfNormalPlotreportsindicatethatX1 andX11are
active.AlthoughX12hasanIndividualpValuelessthan0.05,itseffectismuchsmaller
thanthatofX1andX11.
Becausethedesignissupersaturated,pvaluesmightbesmallerthantheywouldbeina
modelwherealleffectsareestimable.Thisisbecauseeffectestimatesarebiasedbyother
potentiallyactivemaineffects.InFigure 5.17,anotedirectlyabovetheMakeModel
buttonwarnsyouofthispossibility.
Youmightalsowanttocheckwhethertheeffectsthatappearactivecouldbehighly
correlatedwithothereffects.Whenthisoccurs,oneeffectcanmaskthetruesignificanceof
anothereffect.Seestep4.
2. ClickMake Model.
TheconstructedmodelcontainsonlytheeffectsX1,X11, andX12.
3. ClickRunintheModelSpecificationwindow.
Figure 5.18ParameterEstimatesforModel
NotethattheparameterestimatesforX11 andX1areclosetothetheoreticalvaluesthat
youusedtosimulatethemodel.SeeFigure 5.15,whereyouspecifiedamodelwithX1 = 10
andX11 = 10.ThesignificanceofthefactorX12isanexampleofafalsepositive.
4. InyourCustomDesignwindow,opentheDesignEvaluation>ColorMaponCorrelations
outline.
144
Chapter 5
Design of Experiments Guide
Figure 5.19ColorMaponCorrelationsOutline
Withyourcursor,placeyourmousepointerovercellstoseetheabsolutecorrelations.
NoticethatX1hascorrelationsashighas0.5withothermaineffects(X4,X5,X7).
Analyzing a Supersaturated Design Using Stepwise Regression
Stepwiseregressionisanotherwaytoidentifyactivefactors.ThedesigntableinFigure 5.16
containsthreescripts.TheModelscriptanalyzesyourdatausingstepwiseregressioninthe
FitModelplatform.
1. IntheTablespanelofthedesigntable,selectRun Scriptfromtheredtrianglenextto
Model.
2. ChangethePersonalityfromStandard Least SquarestoStepwise.
3. ClickRun.
4. IntheStepwiseFitforYreport,changetheStopping RuletoMinimum AICc.
Fordesignedexperiments,BICistypicallyamorelenientstoppingrulethanAICcasit
tendstoallowinactiveeffectsintothemodel.
5. ClickGo.
Chapter 5
Design of Experiments Guide
145
Figure 5.20StepwiseRegressionforSupersaturatedDesign
Figure 5.20showsthattheselectedmodelconsistsofthetwoactivefactors,X1andX11.
Thestephistoryappearsinthebottompartofthereport.Keepinmindthatcorrelations
betweenX1andX11andotherfactorscouldmasktheeffectsofotheractivefactors.See
Figure 5.19.
Note: Thisexampledefinestwolargemaineffectsandsetstheresttozero.Realworld
situationscanbelesslikelytohavesuchclearlydifferentiatedeffects.
146
Chapter 5
Design of Experiments Guide
5. ClickContinue.
Thedefaultsamplesizeof9requiresthreeblocks.TheFactorsoutlinenowshowsthatX4
hasthreevalues,indicatingthethreeblocks.
Chapter 5
Design of Experiments Guide
147
Figure 5.22FactorsOutlineShowingThreeBlocksforX4
6. Selectthethreecontinuousfactors,X1,X2,andX3,intheFactorsoutline.
7. IntheModeloutline,clickInteractions > 2nd.
ThisaddsalltwowayinteractionsinvolvingthenonblockingfactorstotheModel
outline.Interactionswiththeblockingfactorshouldnotbeaddedtotheassumedmodel.
148
Chapter 5
Design of Experiments Guide
Figure 5.23FactorsOutlineShowingSixBlocksforX4
TheNumberofRunspanelnowshowsthat18istheDefaultrunsize.NotethattheFactors
outlinehasupdatedtoshowsixvaluesforX4,indicatingsixblocks.
Note: SettingtheRandomSeedinstep8andNumberofStartsinstep9reproducesthe
exactresultsshowninthisexample.Inconstructingadesignonyourown,thesestepsare
notnecessary.
8. (Optional)FromtheCustomDesignredtrianglemenu,selectSet Random Seed,type
458027747,andclickOK.
9. (Optional)FromtheCustomDesignredtrianglemenu,selectNumber of Starts,type10,
andclickOK.
10. ClickMake Design.
Chapter 5
Design of Experiments Guide
149
Figure 5.24FixedBlockDesign
TheDesignoutlineshowsthedesign.RecallthatX4istheblockingfactor.Observethatthe
sixblocksarerepresented.Whenyouconductyourexperiment,yourunthethreetrials
whereX4 = 1onthefirstday,thethreewhereX4 = 2onthesecondday,andsoon.Soyou
wouldlikethedesigntabletorandomizethetrialswithinblocks.IntheOutputOptions
panel,notethatRandomizewithinBlocksisthedefaultsettingforRunOrder.
11. ClickMake Table.
Figure 5.25DesignTableforFixedBlockDesign
Therowsinthedesigntablearegroupedbyeachdaysruns.Thisdesignenablesyouto
estimatetheblockeffect,allmaineffects,andtwofactorinteractions.
150
Chapter 5
Design of Experiments Guide
ResponseSurfaceDesignonpage 150
ResponseSurfaceDesignwithFlexibleBlockingonpage 156
ComparisonofaDOptimalandanIOptimalResponseSurfaceDesignonpage 159
ConstructingaResponseSurfaceDesignonpage 150
AnalyzingtheExperimentalResultsonpage 153
Chapter 5
Design of Experiments Guide
151
2. IntheResponsesoutline,clickMaximizeandselectMatch Target.
3. Type54astheLower Limitand56astheUpper Limit.
4. LeaveImportanceblank.
Becausethereisonlyoneresponse,theImportancevalueissetto1bydefault.
5. Type3nexttoAdd N Factors.
6. ClickAdd Factor > Continuous.
Thisaddsthreecontinuousfactors:X1,X2,andX3.
7. ClickContinue.
8. IntheModeloutline,clicktheRSMbutton.
Thisaddsquadraticandinteractiontermstothemodel.Italsosetsthevalueofthe
RecommendedoptimalitycriteriontoIoptimality.YoucanverifythisintheDesign
DiagnosticsoutlineonceyouclickMakeDesign.
LeavetheDefaultNumberofRunssetto16.
Note: SettingtheRandomSeedinstep9andNumberofStartsinstep10reproducesthe
exactresultsshowninthisexample.Inconstructingadesignonyourown,thesestepsare
notnecessary.
9. (Optional)FromtheCustomDesignredtrianglemenu,selectSet Random Seed,type
929281409,andclickOK.
10. (Optional)FromtheCustomDesignredtrianglemenu,selectNumber of Starts,type40,
andclickOK.
11. ClickMake Design.
TheDesignoutlineshowsthedesign.
Figure 5.26RSMDesign
152
Chapter 5
Design of Experiments Guide
Inordertoestimatequadraticeffects,aresponsesurfacedesignusesthreelevelsforeach
factor.NotethatthedesigninFigure 5.26isafacecenteredCentralCompositeDesign
withtwocenterpoints.
12. OpentheDesign Evaluation > Design Diagnosticsoutline.
Figure 5.27DesignDiagnosticsOutline
ThefirstlineintheDesignDiagnosticsoutlineidentifiestheoptimalitycriterionbeing
used.ThisdesignisIoptimal.
13. OpentheDesign Evaluation > Prediction Variance Profile outline.
Figure 5.28PredictionVarianceProfile
Theverticalaxisshowstherelativepredictionvarianceoftheexpectedvalueofthe
response.Therelativepredictionvarianceisthepredictionvariancedividedbytheerror
variance.Whentherelativepredictionvarianceisone,itsabsolutevarianceequalsthe
errorvarianceoftheregressionmodel.
Theprofilershowsvaluesoftherelativepredictionvarianceoverthedesignspace.You
canmovethesliderstoexplorethepredictionvariancesbehavior.Thepredictionvariance
issmallestinthecenterofthedesignspace.Itisfairlyconstant,withvaluesonlyslightly
largerthan0.2,forfactorsettingsbetween0.5and0.5.Thepredictionvarianceincreases
asthesettingsapproachthedesignspaceboundaries.
14. SelectMaximize DesirabilityfromtheredtrianglemenunexttoPredictionVarianceProfile
outline.
Chapter 5
Design of Experiments Guide
153
Figure 5.29PredictionVarianceProfilewithRelativeVarianceMaximized
Theprofilershowsthatthemaximumvalueoftherelativepredictionvarianceis0.79569.
15. OpentheDesign Evaluation > Fraction of Design Space Plot outline.
Figure 5.30FractionofDesignSpacePlot
Thebluecurveintheplotshowstherelativepredictionvarianceasafunctionofthefractionof
designspace.Thereddashedcrosshairsindicatethat,for50%ofthedesignspace,the
predictionvarianceisabout0.32orless.Usethecrosshairtooltodrawotherinferences.For
example,whentheFractionofSpaceis0.95,thePredictionVarianceisabout0.52.Thismeans
thatfor95%ofthedesignspace,therelativepredictionvarianceisbelow0.52.
Analyzing the Experimental Results
TheCustom RSM.jmpsampledatatablecontainstheresultsoftheexperiment.TheModel
scriptopensaFitModelwindowshowingalloftheeffectsspecifiedintheDOEwindows
Modeloutline.ThisscriptwassavedtothedatatablebytheCustomDesignplatform.
1. SelectHelp > Sample Data LibraryandopenDesign Experiment/Custom RSM.jmp.
2. IntheTablespanel,clicktheredtrianglenexttoModelandselectRun Script.
3. ClickRun.
154
Chapter 5
Design of Experiments Guide
TheEffectSummaryreportshowstheLogWorthandPValueforeacheffectinthemodel.
Theverticalbluelineintheplotissetatthevalue2.ALogWorththatexceeds2is
significantatthe0.01level.
Figure 5.31EffectSummaryReport
ThereportshowsthatX1,X2,X1*X1,andX2*X2aresignificantatthe0.01level.Noneofthe
othereffectsaresignificantateventhe0.10level.Reducethemodelbyremovingthese
insignificanteffects.
4. IntheEffectSummaryreport,selectX3,X1*X2,X3*X3,X1*X3,andX2*X3.
Figure 5.32EffectSummaryReportwithInsignificantEffectsSelected
5. ClickRemove.
TheFitLeastSquaresreportisupdatedtoshowamodelcontainingonlythesignificant
effects:X1,X2,X1*X1,andX2*X2.
UsethePredictionProfiler(atthebottomoftheFitLeastSquareswindow)toexplorehow
thepredictedresponse(Y)changesasyouvarythefactorsX1andX2.Notethequadratic
behaviorofYacrossthevaluesofX1andX2.
RememberthatyouenteredresponselimitsforYintheResponsesoutlineoftheCustom
Designwindow.Asaresult,theResponseLimitcolumnpropertyisattachedtotheY
columninthedesigntable.TheDesirabilityfunctionforY(inthetopplotatright)isbased
Chapter 5
Design of Experiments Guide
155
ontheinformationcontainedintheResponseLimitcolumnproperty.JMPusesthis
functiontocalculateDesirabilityasafunctionofthesettingsofX1andX2.Thetracesof
theDesirabilityfunctionappearinthebottomrowofplots.
6. InthePredictionProfilerreport,selectMaximize Desirabilityfromtheredtriangleoptions.
Figure 5.33PredictionProfilerwithDesirabilityMaximized
Thepredictedresponseachievesthetargetvalueof55attheprocesssettingsshowninred
aboveX1andX2.Figure 5.33showsthatavalueofX1near0.65alsoachievesapredicted
valueof55whenX2=0.75062.Infact,yourPredictionProfilermightshowdifferent
settingsasthosethatmaximizedesirability.Thisisbecausethepredictedresponseis55for
manysettingsofX1andX2.
7. SelectFactor Profiling > Contour ProfilerfromtheredtrianglenexttoResponseY.
8. IntheContourProfilerreport,type55asthevalueforContour.
156
Chapter 5
Design of Experiments Guide
Figure 5.34ContourProfiler
ThesettingsofX1andX2thatcorrespondtotheredcontourhavepredictedresponse
valuesof55.Youmightwanttoselectfromamongtheseprocesssettingsbasedoncost
efficiency.
Chapter 5
Design of Experiments Guide
157
5. ClickContinue.
TheDefaultnumberofrunsis12.TheFactorsoutlineupdatestoshowthreelevelsforthe
Blockingfactor,X3.BecauseyourequiredX3tohavefourrunsperblock,the12runsallow
threeblocks.
6. ClickRSM.
AninformationalJMPAlertwindowremindsyouthattheblockingfactorcannotappear
ininteractionorquadraticterms.JMPaddsonlytheappropriateRSMtermstothelist.
7. ClickOKtodismissthemessage.
QuadraticandinteractionstermsforX1andX2areaddedtothemodel.Becauseyou
addedRSMterms,theRecommendedoptimalitycriterionchangesfromDOptimalto
IOptimal.YoucanseethislaterintheDesignDiagnosticsoutline.
Figure 5.36ModelOutlinewithResponseSurfaceEffects
Note: SettingtheRandomSeedinstep8andNumberofStartsinstep9reproducesthe
exactresultsshowninthisexample.Inconstructingadesignonyourown,thesestepsare
notnecessary.
8. (Optional)FromtheCustomDesignredtrianglemenu,selectSet Random Seed,type
1415408414,andclickOK.
9. (Optional)FromtheCustomDesignredtrianglemenu,selectNumber of Starts,type21,
andclickOK.
158
Chapter 5
Design of Experiments Guide
ThefirstlineintheDesignDiagnosticsoutlineidentifiestheoptimalitycriterionbeing
used.ThisdesignisIoptimal.
12. ClickMake Table.
Figure 5.38DesignTablewithBlockingFactor
BecausethedefaultRunOrderwasRandomizewithinBlocks,thelevelsoftheblocking
factor(X3)aresorted.
13. IntheTablespanelofthedesigntable,clicktheredtrianglenexttoModelandselectRun
Script.
Chapter 5
Design of Experiments Guide
Figure 5.39FitModelWindow
Noticethefollowing:
Theblockingfactor(X3)isenteredasaneffect.
NointeractionsinvolvingX3areincluded.
TheotherfiveeffectsdefinearesponsesurfacemodelforX1andX2.
159
160
Chapter 5
Design of Experiments Guide
Note: SettingtheRandomSeedinstep6andNumberofStartsinstep7reproducesthe
exactresultsshowninthisexample.Inconstructingadesignonyourown,thesestepsare
notnecessary.
6. (Optional)FromtheCustomDesignredtrianglemenu,selectSet Random Seed,type
383570403,andclickOK.
7. (Optional)FromtheCustomDesignredtrianglemenu,selectNumber of Starts,type8,
andclickOK.
8. ClickMake Design.
Figure 5.40IOptimalDesign
Therelativepredictionvarianceoftheexpectedresponseissmallestinthecenterofthe
designspace.
10. OpentheFraction of Design Space Plotoutline.
Chapter 5
Design of Experiments Guide
161
TheFractionofDesignSpacePlotappearsontheleftinFigure 5.44.WhentheFractionof
Spaceis0.95,theverticalcoordinateofthebluecurveisabout0.5.Thismeansthatforabout
95%ofthedesignspace,therelativepredictionvarianceisbelow50%oftheerrorvariance.
ThisCustomDesignwindowcontainsyourIoptimaldesign.Keepthiswindowopen.Inthe
nextsection,yougenerateaDoptimaldesign,andcomparethetwo.
D-Optimal Design
TocomparePredictionVarianceProfileandFractionofDesignSpaceplotsfortheIand
Doptimaldesigns:
1. IntheCustomDesignwindowcontainingyourIoptimaldesign,fromtheCustomDesign
redtrianglemenu,selectSave Script to Script Window.
Awindowappears,showingascriptthatreproducesyourwork.
2. Inthisnewscriptwindow,selectEdit > Run Script.
AduplicateCustomDesignwindowappears,butwiththeDesignEvaluationoutlines
closed.
3. InthisnewCustomDesignwindow,clickBack.
4. FromtheredtrianglenexttoCustomDesign,selectOptimality Criterion > Make D-Optimal
Design.
5. ClickMake Design.
YoucurrentCustomDesignwindowcontainsyourDoptimaldesign.
Figure 5.42DOptimalDesign
InthisDoptimaldesign,run7istheonlyrunatthecenterpoint.Doptimaldesignstend
toplacemorerunsattheextremesofthedesignspacethandoIoptimaldesigns.Recall
thattheIoptimaldesignhadfourcenterruns(Figure 5.40).
6. OpentheDesign Evaluation>Prediction Variance Profileoutline.
162
Chapter 5
Design of Experiments Guide
Figure 5.43PredictionVarianceProfileforDOptimalModel
Atthecenterofthedesignregion,therelativepredictionvarianceis0.53562,ascompared
to0.208333fortheIoptimaldesign(Figure 5.41).Thismeansthattherelativestandard
erroris0.732fortheDoptimaldesignand0.456fortheIoptimaldesign.Allelsebeing
equal,atthecenterofthedesignregion,confidenceintervalsfortheexpectedresponse
basedontheDoptimaldesignareabout60%widerthanthosebasedontheIoptimal
design.
TheDesignoutlineshowsthattheDoptimaldesignhasninedesignpoints,oneforevery
combinationofX1andX2setto1,0,1.TheDoptimalitycriterionattemptstokeepthe
relativepredictionvariancelowateachofthesedesignpoints.Explorethevarianceatthe
extremesofthedesignregionbymovingtheslidersforX1andX2to1and1.Notethatthe
varianceattheseextremepointsisusuallysmallerthanthevariancefortheIoptimal
designatthesepoints.
7. OpentheDesign Evaluation>Fraction of Design Space Plotoutline.
TheFractionofDesignSpacePlotappearsontherightinFigure 5.44.
Figure 5.44FractionofDesignSpacePlots(IOptimalonleft,DOptimalonright)
Chapter 5
Design of Experiments Guide
163
Theredcrosshairsineachplotindicatethemaximumpredictionvariancefor50%ofthe
designspace.For50%ofthedesignspace,thepredictionvariancefortheIoptimaldesign
fallsbelowabout0.27.FortheDoptimaldesign,thepredictionvarianceisabout0.4.
8. RightclickintheFractionofDesignSpacePlotforyourIoptimaldesign.SelectEdit >
Copy Frame Contents.
9. RightclickintheFractionofDesignSpacePlotforyourDoptimaldesign.SelectEdit >
Paste Frame Contents.
Figure 5.45FractionofDesignSpacePlotsSuperimposed
ThevariancecurvefortheIoptimaldesignisbelowthecurvefortheDoptimaldesign
overatleast90%ofthedesignspace.ThisreflectsthefactthatIoptimalityattemptsto
minimizepredictionvarianceoverallofthedesignspace.Incontrast,Doptimality
focusesonreducingpredictionvarianceatthedesignpoints.
Mixture Experiments
BoththeCustomDesignandMixtureDesignplatformsconstructdesignsforsituationswhere
allofyourfactorsareingredientsinamixture.However,mixtureexperimentscaninvolve
nonmixtureprocessvariables,orprocessfactors.TheCustomDesignplatformcanconstructa
designtoaccommodatebothmixtureingredientsandprocessfactors.TheCustomDesign
platformalsoallowsthemixturecomponentstosumtoanypositivenumber.SeeAdvanced
Options>MixtureSumonpage 105.
Thissectioncontainsthefollowingexamples:
MixtureDesignwithNonmixtureFactorsonpage 164
MixtureofMixturesDesignonpage 168
164
Chapter 5
Design of Experiments Guide
TheresponseisDamping,whichmeasurestheelectromagneticdampingofanacrylonitrile
powder.
Thethreemixtureingredientsare:
CuSO4(coppersulphate),rangingfrom0.2to0.8
Na2S2O3(sodiumthiosulphate),rangingfrom0.2to0.8
Glyoxal(glyoxal),rangingfrom0to0.6
ThenonmixtureenvironmentalfactorofinterestisWavelength(thewavelengthoflight)at
threelevelsdenotedL1,L2,andL3.
Wavelengthisacontinuousvariable.However,theresearcherswereinterestedonlyin
predictionsatthreespecificwavelengths.Forthisreason,youtreatWavelengthasa
categoricalfactorwiththreelevels.
Thisexamplecontainsthefollowingsteps:
CreatetheDesignonpage 164
EvaluatetheDesignonpage 166
CreatetheDesign
1. SelectDOE > Custom Design.
2. DoubleclickYunderResponseNameandtypeDamping.
3. ClickMaximizeunderGoalandchangeittoNone.
ThegoalissettoNonebecausetheauthorsofthestudydonotmentionhowmuch
dampingisdesirable.
4. FromtheCustomDesignredtrianglemenu,selectLoad Factors.
5. SelectHelp > Sample Data Library andopenDesign Experiment/Donev Mixture Factors.jmp.
Thisloadsthethreemixtureingredientsandthecategoricalprocessfactor.Notethatthe
boundsonthevaluesofthethreemixturefactorsarealsoloaded.
Chapter 5
Design of Experiments Guide
165
Figure 5.46ResponsesOutlineandFactorsOutline
166
Chapter 5
Design of Experiments Guide
8. Leavethedefaultnumberofrunsat18.
Thechoiceof18runsallowssixrunsforeachofthethreelevelsofthewavelengthfactor.
Note: SettingtheRandomSeedinstep9andNumberofStartsinstep10reproducesthe
exactresultsshowninthisexample.Inconstructingadesignonyourown,thesestepsare
notnecessary.
9. (Optional)FromtheCustomDesignredtrianglemenu,selectSet Random Seed,type
858576648,andclickOK.
10. (Optional)FromtheCustomDesignredtrianglemenu,selectNumber of Starts,type10,
andclickOK.
11. ClickMake Design.
Figure 5.48DesignOutlineShowing18RunDesign
YoucancheckthattherearesixrunsforeachlevelofWavelength.
EvaluatetheDesign
1. OpentheDesign Evaluation>Prediction Variance Profile outline.
Figure 5.49PredictionVarianceProfilefor18RunDesign
Chapter 5
Design of Experiments Guide
167
MovethesliderforWavelengthtoverifythattherelativepredictionvarianceprofilesfor
themixturefactorsdonotchangeacrossthelevelsofWavelength.Movethesliderforany
oneofthemixturefactors.Thefactorsfortheothertwomixturefactorsadjusttomakethe
mixtureingredientssumtoone.Noticethatthesmallestrelativepredictionvariances
occurnearthecentersettingsforthemixturefactors.
2. FromthePredictionVarianceProfileredtrianglemenu,selectMaximize Desirability.
Noticethatthemaximumrelativepredictionvarianceoverthedesignspaceis0.8times
theerrorvariance.
3. OpentheFraction of Design Space Plotoutline.
Figure 5.50FractionofDesignSpacePlotfor18RunDesign
Overtheentiredesignspace,therelativepredictionvarianceisbelow0.8.Theminimum
relativepredictionvarianceisabout0.32.AsseeninFigure 5.49,theminimumoccursnear
thecentersettingsforthemixturefactors.
4. OpentheDesign Diagnostics outline.
Figure 5.51DesignDiagnosticsOutlinefor18RunDesign
ThedesignisoptimalrelativetotheDoptimalitycriterion,eventhoughitsDefficiencyis
verylow(3.6%).Becausemixturedesignsarefarfromorthogonalduetothemixture
constraint,theytypicallyhaveverylowDefficiencies.TheAverage(relative)Varianceof
Predictionis0.410395.ThisisconsistentwiththeFractionofDesignSpaceplotinFigure 5.50.
168
Chapter 5
Design of Experiments Guide
Ingredient
Lower Level
Upper Level
Dry
Cocoa
10%(0.1)
20%(0.2)
Sugar
0%(0)
15%(0.15)
Flour
20%(0.2)
30%(0.3)
Butter
10%(0.1)
20%(0.2)
Milk
25%(0.25)
35%(0.35)
Eggs
5%(0.05)
20%(0.20)
Wet
Thedrycomponents(themixtureofflour,sugar,andcocoa)comprise45%ofthecombined
mixture.Thewetcomponents(butter,milk,andeggs)comprise55%.
ThegoalofyourexperimentistooptimizeaTasterating.Tasteisratedonascaleof1to10,
with10representingthebesttaste.
Youconstructa10rundesigntofitamaineffectsmodel.Becauseoftheconstraintonthe
proportionsofdryandwetingredients,youneedtoincludeonlyfivefactorsintheModel
outlinetoavoidsingularity.Thechoiceofwhichfactornottoincludeisarbitrary.
Thisexamplecontainsthefollowingsteps:
CreatetheDesignonpage 168
AnalyzetheExperimentalResultsonpage 171
CreatetheDesign
1. SelectDOE > Custom Design.
2. DoubleclickYunderResponseNameandtypeTaste.
NotethatthedefaultgoalisMaximize.BecauseyouwanttomaximizetheTasterating,do
notchangethegoal.
3. ClickunderLowerLimitandtype0.
Theleastdesirableratingis0.
Chapter 5
Design of Experiments Guide
169
4. ClickunderUpperLimitandtype10.
Themostdesirableratingis10.
5. LeavetheareaunderImportanceblank.
Becausethereisonlyoneresponse,thatresponseisgivenImportance1bydefault.
6. FromtheCustomDesignredtrianglemenu,selectLoad Factors.
7. OpenCake Factors.jmpfromtheDesign Experimentsampledatafolder.
Figure 5.52CompletedResponsesandFactorsOutlines
Notethatthefactorsareallmixturefactors.TheValuesthatdefinetherangeofsettingsfor
theexperimentvaryfromfactortofactor.
8. IntheDefineFactorConstraintsoutline,selectSpecify Linear Constraints.
9. IntheLinearConstraintspanel,clickAdd twice.
10. EntertheconstraintsshowninFigure 5.53.
Forthesecondconstraintsetting,besuretoselectthegreaterthanorequaltodirection.
Figure 5.53DefineFactorConstraints
170
Chapter 5
Design of Experiments Guide
Thetwoinequalitiesensurethatthedryfactorssumtoexactly45%ofthetotal,ensuring
thatthewetfactorsconstitutetheremaining55%.
11. IntheModeloutline,selectanyeffectandclickRemove Term.
Becauseoftheequalityconstraint,amodelcontainingallsixeffectswouldbesingular.
12. Type10nexttoUser Specified.
Yourexperimentrequiresbaking10cakes.
Note: SettingtheRandomSeedinstep13andNumberofStartsinstep14reproducesthe
exactresultsshowninthisexample.Inconstructingadesignonyourown,thesestepsare
notnecessary.
13. (Optional)FromtheCustomDesignredtrianglemenu,selectSet Random Seed,type
1992991263,andclickOK.
14. (Optional)FromtheCustomDesignredtrianglemenu,selectNumber of Starts,type40,
andclickOK.
15. ClickMake Design.
AJMPAlertinformsyouthatyourfactorconstraintsincludeanequalityconstraint.This
waswhatyouintended,becausethesumofthedryingredientproportionsisconstrained
to45%.
16. ClickOKtodismisstheJMPAlert.
17. ClickMake Table.
Figure 5.54MixtureofMixturesDesign
Thesettingsforthedryingredientssumto45%ofthemixtureandthesettingsforthewet
ingredientssumto55%ofthemixture.Thesettingsalsoconformtotheupperandlower
limitsgivenintheFactorsoutline.
Chapter 5
Design of Experiments Guide
171
AnalyzetheExperimentalResults
TheCake Data.jmpsampledatatableshowstheresultsoftheexperiment.Thedesigntable
containsaModelscriptthatopensaFitModelwindowshowingthefivemaineffectsspecified
intheDOEwindowsModeloutline.NoticethatthemaineffectofEggisnotincludedinthe
Modeloutlineforthisdesign.Thisscriptwassavedtothedatatablewhenitwascreatedby
CustomDesign.
1. OpentheCake Data.jmpsampledatatable,locatedintheDesignExperimentfolder.
2. IntheTablespanelofthedesigntable,clicktheredtrianglenexttoModelandselectRun
Script.
ThemaineffectduetoEggisnotincludedbecauseitwasexcludedfromtheModeloutline
intheCustomDesignwindow.AllfiveeffectsaredesignatedasResponseSurfaceand
Mixtureeffects.
3. ClickRun.
AJMPAlertappears,notifyingyouthattheProfilercannotbeshownbecauseofthe
additionalconstraint.
4. ClickOKtodismisstheJMPAlert.
TheParameterEstimatesreportindicatesthatSugar,Flour,andButteraresignificantatthe0.05
level.
Figure 5.55ParameterEstimatesReport
172
Chapter 5
Design of Experiments Guide
Note: Thenumberofrowsinthecovariatedatatablewherecovariatefactorshavenonmissing
valuesmustbegreaterthanorequaltothespecifiedNumberofRuns.
Chapter 5
Design of Experiments Guide
173
Figure 5.56ResponsesandFactorsOutlines
10. ClickContinue.
TheNumberofRunsshowsthenumberofrowswithcovariatevaluesavailable.Youhave
25batcheswithmeasuredcovariates.
11. Type12nexttoNumber of Runs.
Note: SettingtheRandomSeedinstep12andNumberofStartsinstep13reproducesthe
exactresultsshowninthisexample.Inconstructingadesignonyourown,thesestepsare
notnecessary.
12. (Optional)FromtheCustomDesignredtrianglemenu,selectSet Random Seed,type
84951,andclickOK.
13. (Optional)FromtheCustomDesignredtrianglemenu,selectNumber of Starts,type40,
andclickOK.
14. ClickMake Design.
174
Chapter 5
Design of Experiments Guide
Figure 5.57TwelveRunOptimalDesign
ThisdesignisDoptimal,giventhepotentialcovariatevalues.Itselectsthebestsetsof
covariatevaluesandthebestsettingsforthethreecontrollablefactors.
15. OpentheDesign Evaluation > Color Map On Correlationsoutline.
Figure 5.58ColorMaponCorrelations
Chapter 5
Design of Experiments Guide
175
Theseventermscorrespondingtomaineffectsappearintheupperleftcornerofthecolor
map.Noticethattheseseventermsareclosetoorthogonal.Thelargestabsolutecorrelationis
betweenTensile StrengthandSupplier2.Thisabsolutecorrelationofabout0.43isa
consequenceoftheavailablecovariatevalues.
solethickness(Thickness)
amountofgelcushioning(Gel)
outsolematerial(Outsole)
midsolematerial(Midsole)
Toobtaingeneralizableconclusions,youneedtotestyourshoesonabroadbaseofserious
runners.Toaccommodateyourexperimentalbudget,eachrunnermusttestseveral
experimentalcombinations.
Yourcompanyhascollecteddataon100suitablerunnerswillingtoparticipateinyourstudy.
Theconcomitantvariables(covariates)measuredontheserunnersareaveragedailymilesrun
(Miles),weight(Weight),andthefootsstrikepoint(Strike Point).
Createyourdesignasfollows:
1. SelectHelp > Sample Data LibraryandopenDesign Experiment/Runners Covariates.jmp.
2. SelectDOE > Custom Design.
3. DoubleclickYunderResponseNameandtypeWear.
4. ClickMaximizeunderGoalandchangeittoMinimize.
5. ClickAdd FactorandselectCovariate.
6. SelectMiles,Weight,andStrike PointfromthelistandclickOK.
Thesearethehardtochangecovariatesassociatedwiththerunners.
7. ForoneofthefactorsMiles,Weight,andStrike Point,underChanges,clickEasyandchange
ittoHard.
NotethatChangesforallthreecovariatesturntoHard.
8. Toaddtheremainingfactorsmanually,followstep9throughstep17.Or,toloadfactors
fromasavedtable,selectLoad FactorsfromtheredtrianglemenunexttoCustomDesign.
OpentheRunners Factors.jmpsampledatatable,locatedintheDesignExperimentfolder.
IfyouselectLoad Factors,skipstep9throughstep17.
9. Type2nexttoAdd N Factors.
10. ClickAdd Factor > Continuous.
176
Chapter 5
Design of Experiments Guide
11. RenamethetwofactorsThicknessandGel.
12. ChangetheValuesforThicknessto5and20.
13. ChangetheValuesforGelto1and10.
14. Type2nexttoAdd N Factors.
15. ClickAdd Factor > Categorical > 3 Level.
16. RenamethetwofactorsOutsoleandMidsole.
KeepthedefaultValuesforthesefactors.
Figure 5.59ResponsesandFactorsOutlines
17. ClickContinue.
18. SelectInteractions > 2nd.
Thespecifiedmodelfitsalltwofactorinteractions,includingcovariatebyexperimental
factorinteractions.
19. SettheNumberofWholePlots,orrunners,to32(ifitisnotalreadysettothatnumber).
20. Type64nexttoUserSpecifiedunderNumberofRuns(ifitisnotalreadysettothat
number).
Note: SettingtheRandomSeedinstep21andNumberofStartsinstep22reproducesthe
exactresultsshowninthisexample.Inconstructingadesignonyourown,thesestepsare
notnecessary.
21. (Optional)FromtheCustomDesignredtrianglemenu,selectSet Random Seed,type
12345,andclickOK.
22. (Optional)FromtheCustomDesignredtrianglemenu,selectNumber of Startsandsetit
to1(ifitisnotalreadysettothatnumber).ClickOK.
Chapter 5
Design of Experiments Guide
177
Ofthe100runners,32areselectedbasedontheircovariatevalues.Therows
correspondingtotheselectedrunnersareselectedintheRunnersCovariates.jmpsample
datatable.SettingsoftheexperimentalfactorsThickness,Gel,Insole,andOutsoleare
determinedsothatthedesignisoptimalforthemodeldescribedintheModelOutline.
24. WiththeRunnersCovariates.jmpsampledatatableastheactivetable,selectAnalyze >
Distribution.
25. SelectallthreecolumnsasY, Columns.
26. CheckHistograms Only.
27. ClickOK.
178
Chapter 5
Design of Experiments Guide
Figure 5.61Histogramsfor100RunnerswithSelectedRunnerDataShaded
ThehistogramsindicatethatalloftherunnerswithMilesof14.0orhigherwereselected.
RunnersattheextremesoftheWeightdistributionwereselected.Almostalloftherunners
withaStrike PointofForefootwereselected.Noticethatthedesignissomewhatbalanced
intermsofStrike Point.
Chapter 5
Design of Experiments Guide
179
12. ClickContinue.
13. OpentheAlias Termsoutline.
14. SelectalloftheeffectsinthelistandclickRemove Term.
Thisomitstheinteractioneffectsfromthecorrelationcolormap,leavingonlythemain
effects.
Note: SettingtheRandomSeedinstep15andNumberofStartsinstep16reproducesthe
exactresultsshowninthisexample.Inconstructingadesignonyourown,thesestepsare
notnecessary.
15. (Optional)FromtheCustomDesignredtrianglemenu,selectSet Random Seed,type
1084680980,andclickOK.
16. (Optional)FromtheCustomDesignredtrianglemenu,selectNumber of Starts,type
30000,andclickOK.
17. ClickMake Design.
AprogressbardisplayselapsedtimeandDEfficiency.
180
Chapter 5
Design of Experiments Guide
Figure 5.63DesignOutline
TheColorMapshowsthefollowing:
Thesevencontinuousfactors,X2throughX8,areorthogonaltoeachother.
Run Order,thelineartimetrendvariable,hasextremelylowabsolutecorrelationwith
X2throughX8.
19. OpentheDesign Evaluation > Estimation Efficiency outline.
Chapter 5
Design of Experiments Guide
181
Figure 5.65EstimationEfficiencyOutline
ThesmallabsolutecorrelationsofRun OrderwithX2throughX8resultinverysmall
increasesinconfidenceintervallengths,relativetoanidealorthogonaldesign.The
increasesinthelengthsofconfidenceintervalsforX2throughX8arealllessthan0.1%.
Inthisexample,therunorderfactorisnearlyorthogonaltothefactoreffects.Insomecases,
yourdesignmighthavemoresubstantialcorrelationsbetweentherunorderfactorandother
factors.Eveninsuchasituation,includingtherunorderasafactoraccountsforanylinear
trendeffect.Includingtherunorderalsoallowsformorepreciseestimationoftheotherfactor
effects.
Split-Plot Experiment
Splitplotdesignsoriginatedinagriculture,butarecommonplaceinmanufacturingand
engineeringstudies.Inasplitplotexperiment,hardtochangefactorsareresetonlybetween
onewholeplotandthenextwholeplot.Thewholeplotisdividedintosubplots,andthelevels
oftheeasytochangefactorsarerandomlyassignedtoeachsubplot.
TheexampleinthissectionisadaptedfromKowalski,Cornell,andVining(2002).Youare
interestedintheeffectsoffivefactorsonthethicknessofvinylthatisusedtomake
automobileseatcovers.Theresponseandfactorsintheexperimentaredescribedbelow:
Theresponseisthethicknessofthevinylthatisproduced.Youwanttomaximize
thickness.Alowerlimitforthicknessvaluesis10.
Thewholeplotfactorsaretherateofextrusion(extrusion rate)andthetemperature
(temperature)ofdrying.Theseareprocessvariablesandarehardtochange.
182
Chapter 5
Design of Experiments Guide
Thesubplotfactorsarethreeplasticizerswhoseproportions(m1,m2,andm3)sumtoone.
Thesefactorsaremixturecomponents.
Yourexperimentalbudgetallowsforrunning7settingsofthesewholeplotfactors.Foreach
wholeplot,youcanconduct4runsofthesubplotfactors.Thisgivesyouatotalof28runs.
CreatingtheDesign
1. SelectDOE > Custom Design.
2. DoubleclickYunderResponseNameandtypethickness.
KeepthedefaultgoalsettoMaximize.
3. EnteraLowerLimitof10.
4. Toaddfactorsmanually,followstep5throughstep12.Or,toloadfactorsfromasaved
table,selectLoad FactorsfromtheredtrianglemenunexttoCustomDesign.Openthe
Vinyl Factors.jmpsampledatatable,locatedintheDesignExperimentfolder.Ifyouselect
Load Factors,skipstep5throughstep12.
5. Type2nexttoAdd N Factors.
6. ClickAdd Factor > Continuous.
7. Renamethesefactorsextrusion rateandtemperature.
KeepthedefaultValuesof1and1forthesetwofactors.
8. ClickEasyandselectHardforbothextrusion rateandtemperature.
Thisdefinesextrusion rateandtemperaturetobewholeplotfactors.
9. Type3nexttoAdd N Factors.
10. ClickAdd Factor > Mixture.
11. Renamethethreemixturefactorsm1,m2,andm3.
KeepthedefaultValuesof0and1forthosethreefactors.
Chapter 5
Design of Experiments Guide
183
Figure 5.66ResponsesandFactorsOutlines
12. ClickContinue.
13. ClickInteractions > 2nd.
14. ClickOKtodismisstheinformativemessage.
Notethat5isthedefaultvaluefortheNumberofWholePlots.
15. Type7nexttoNumber of Whole Plots.
16. Type28nexttoUser Specified.
Note: SettingtheRandomSeedinstep17andNumberofStartsinstep18reproducesthe
exactresultsshowninthisexample.Inconstructingadesignonyourown,thesestepsare
notnecessary.
17. (Optional)FromtheCustomDesignredtrianglemenu,selectSet Random Seed,type
123686,andclickOK.
18. (Optional)FromtheCustomDesignredtrianglemenu,selectNumber of Starts,type10,
andclickOK.
19. ClickMake Design.
184
Chapter 5
Design of Experiments Guide
Figure 5.67DesignOutline
Notethatthewholeplotfactors,extrusion rateandtemperature,areresetseventimesin
accordancewiththelevelsofthefactorWhole Plots.WithineachlevelofWhole Plots,the
settingsforthemixtureingredients,m1,m2,andm3,areassignedatrandom.
AnalyzingtheResults
TheVinyl Data.jmpsampledatatablecontainsexperimentalresultsusingadesigncreatedina
previousversionofJMP.
1. SelectHelp > Sample Data LibraryandopenDesign Experiment/Vinyl Data.jmp.
Thissampledatatablecontains28runsandresponsevalues.Thedesignsettingsinthe
tablethatyoucreatedusingtheCustomDesignplatformmightdifferfromthoseusedin
theVinyl Data.jmpdesign.
2. SelectRun ScriptfromtheredtrianglenexttoModel.
Chapter 5
Design of Experiments Guide
185
Figure 5.68FitModelWindow
NoticethefollowingintheFitModelwindow:
ThefactorWhole PlotshastheAttributecalledRandomEffects(&Random).This
specifiesthatthelevelsofWhole Plotsarerandomrealizations.Theyhaveanassociated
errorterm.
TheanalysismethodisREML (Recommended).Thismethodisspecifiedprecisely
becausethemodelcontainsarandomeffect.FormoreinformationaboutREML
models,seetheFittingLinearModelsbook.
Tip: IntheFitModelwindow,JMPProuserscanchangethePersonalitytoMixedModel.
3. ClickRun.
186
Chapter 5
Design of Experiments Guide
Figure 5.69SplitPlotAnalysisResults
TheParameterEstimatesreportshowsthatthethreemixtureingredients,aswellasthe
extrusion rate*m3interaction,aresignificantatthe0.05level.
TheREMLVarianceComponentEstimatesreportindicatesthatthevariancecomponent
associatedwithWhole Plotsis2.476748.Thisis38.838%ofthetotalvariation.Itfollowsthat
theerrortermassociatedwithwholeplotreplicationissmallerthantheresidual(or
withinplot)errorterm.
Chapter 5
Design of Experiments Guide
187
Althoughfactorsatbothstagesmightbeequallyhardtochange,inordertodistinguishthese
factors,JMPdenotesthefirststagefactorsasveryhardtochangeandthesecondstagefactors
ashardtochange.Additionalfactorsappliedtoexperimentalunitsafterthesecond
processingstageareconsideredeasytochange.
ScenarioforaTwoWaySplitPlotDesign
Thisexampleisbasedonanexperimenttoimprovetheopencircuitvoltage(OCV)inbattery
cells(VivacquaandBisgaard,2004).YouneedtominimizetheOCVinordertokeepthecells
fromdischargingontheirown.
Batterycellsmovethroughtwostagesofprocessing:
Firststage:Acontinuousassemblyprocesswherebatteriesareprocessedinbatchesof
2000.
Secondstage:Acuringprocesswitha5daycycletimeinachamberthatcan
accommodate4000batteries.
Youwanttostudysixtwolevelcontinuousfactors:
Fourfactors(A1,A2,A3,andA4)areappliedtotheassemblyprocess.Youcanrun16trials
forthefirststagefactors.
Twofactors(C5andC6)areappliedtothecuringprocess.Becausecuringrequiresa5day
cycletime,youcanrunonly6cycles(30days)forthesecondstagefactors.Usingsix
curingcyclesgivesyoupartialreplicationofthecuringsettings,enablingyoutotestfor
curingeffects.
Boththefirstandsecondstagefactorsarehardtochange,suggestingtwosplitplots.
However,thebatchesof2,000batteriesfromthefirststageexperimentcanbedividedinto
subbatchesof500batterieseach.Eightofthesesubbatchescanberandomlyselectedand
processedsimultaneouslyinthecuringchamber.
Theexperimenthas48experimentalunits.Notethatthefirstandsecondstagefactorsare
crossed.
CreatingtheDesign
Todesignatwowaysplitplotexperiment:
1. SelectDOE > Custom Design.
2. DoubleclickYunderResponseNameandtypeOCV.
3. UnderGoal,clickMaximizeandselectMinimize.
4. Toaddfactorsmanually,followstep5throughstep10.Or,toloadfactorsfromasaved
table,selectLoad FactorsfromtheredtrianglemenunexttoCustomDesign.Openthe
Battery Factors.jmpsampledatatable,locatedintheDesignExperimentfolder.Ifyou
selectLoad Factors,skipstep5throughstep10.
188
Chapter 5
Design of Experiments Guide
5. Type6nexttoAdd N Factors.
6. ClickAdd Factor > Continuous.
7. RenamethefactorsA1,A2,A3,A4,C1,andC2.
KeepthedefaultValuesof1and1forthesefactors.
8. ForeachofthefactorsA1,A2,A3,andA4,underChanges,clickEasyandchangeittoVery
Hard.
Todistinguishbetweenthefirstandsecondstagefactors,youdesignatetheChangesfor
thefirststagefactorsasVeryHard,andtheChangesforthesecondstagefactorsasHard.
9. ForeachofthefactorsC1andC2,underChanges,clickEasyandchangeittoHard.
Figure 5.70ResponsesandFactorsOutlines
10. ClickContinue.
11. SelectInteractions> 2ndintheModeloutline.
12. IntheDesignGenerationoutline,selecttheoptionHard to change factors can vary
independently of Very Hard to change factors.
SeeFigure 5.71.Checkingthisoptioncreatesatwowaysplitplotdesign.Ifthisoptionis
notchecked,thedesignistreatedasasplitsplitplotdesign,withnestingoffactorsatthe
twolevels.
13. Type16astheNumber of Whole Plots.
Thisisthenumberoftrialsthatyoucanrunforthefirststagefactors.
14. Type6astheNumber of Subplots.
Thisisthenumberoftrialsthatyoucanrunforthesecondstagefactors.
15. UnderNumberofRuns,type48nexttoUser Specified.
Thisisthetotalnumberofexperimentalunits.
Chapter 5
Design of Experiments Guide
189
Figure 5.71DesignGenerationOutline
Note: SettingtheRandomSeedinstep16andNumberofStartsinstep17reproducesthe
exactresultsshowninthisexample.Inconstructingadesignonyourown,thesestepsare
notnecessary.
16. (Optional)FromtheCustomDesignredtrianglemenu,selectSet Random Seed,type
1866762673,andclickOK.
17. (Optional)FromtheCustomDesignredtrianglemenu,selectNumber of Starts,type21,
andclickOK.
18. ClickMake Design.
19. ClickMake Table.
Figure 5.72PartialViewofDesignTable
190
Chapter 5
Design of Experiments Guide
Chapter 5
Design of Experiments Guide
191
Figure 5.73ReportforFullModel
TheParameterEstimatesreportindicatesthatfourtwowayinteractions,A1*C1,A1*C2,
A2*C1,andA4*C2,andtwomaineffects,A1andA4,aresignificantatthe0.05level.
5. IntheBattery Data.jmptable,fromtheredtrianglenexttoReduced Model 1,selectRun
Script.
ThescriptopensaFitModelwindowwhereinsignificantinteractionshavebeenremoved.
TheremainingeffectsareallmaineffectsandthefourtwowayinteractionsA1*C1,A1*C2,
A2*C1,andA4*C2.Youarereducingthemodelinaconservativefashion.
6. ClickRun.
192
Chapter 5
Design of Experiments Guide
Figure 5.74ReportforPreliminaryReducedModel
NoticethatthemaineffectC2isnowsignificantatthe0.05level(Prob>|t| = 0.0331)
7. IntheFitModelwindow,removeA3.
ThemaineffectA3istheonlymaineffectthatisnotsignificantandnotinvolvedina
twowayinteraction.
8. ClickRun.
Figure 5.75ReportforReducedModel
TheREMLVarianceComponentEstimatesreportshowsthatthevariancecomponent
associatedwithWhole Plotsisaboutsixtimesaslargeasthevariancecomponentfor
Subplots.Thissuggeststhattheassemblyprocessismorevariablethanthecuringprocess.
Also,thewithin(Residual)errorislargerthanthatforSubplots.Effortstoreducevariation
shouldfocusontheassemblyprocessandonbatterytobatterydifferences.
9. FromtheredtrianglenexttoResponseOCV,selectFactor Profiling > Profiler.
Chapter 5
Design of Experiments Guide
TheprofilershowsthefivefactorsidentifiedasactiveandsettingsthatminimizeOCV.
193
194
Chapter 5
Design of Experiments Guide
Chapter 6
Definitive Screening Designs
Definitivescreeningdesignsworkforfactorscreeningifyouhaveanycombinationof
continuousortwolevelcategoricalfactors.Thesedesignsareparticularlyusefulifyou
suspectactivetwofactorinteractions,oryoususpectthataplotofacontinuousfactorseffect
ontheresponsemightexhibitstrongcurvature.
Definitivescreeningdesignsaresmalldesigns.Forsixormorefactors,thereareonlyabout
twiceasmanyrunsasfactors.Yet,theyoftenconclusivelyidentifywhichofseveralfactors
affecttheresponse.Inparticular,theycandetectandidentifyanyfactorscausingstrong
nonlineareffectsontheresponse.
Hereareareaswheredefinitivescreeningdesignsaresuperiortostandardscreeningdesigns:
Theyhelpidentifythecausesofnonlineareffectsbyfieldingeachcontinuousfactorat
threelevels.Instandardscreeningdesigns,continuousfactorshaveonlytwolevels.You
canaddcenterpointstoscreeningdesigns,butthesepointsonlyestablishifcurvature
exists.Theydonotallowyoutoidentifythefactorsresponsibleforquadraticeffects.
Theyavoidconfoundingbetweenanyeffectsupthroughthesecondorder.Forcontinuous
factors,definitivescreeningdesignshavemaineffectsthatareorthogonaltoeachother
andorthogonaltotwofactorinteractionsandquadraticeffects.Twofactorinteractionsare
notcompletelyconfoundedwitheachother.Confoundingoccursinmanystandard
screeningdesignswithasimilarnumberofruns.
Theyavoidtheneedforcostlyadditionalexperimentationtoresolveambiguityfromthe
initialresultsofstandardscreeningdesigns.
Figure 6.1PlotofResponseagainstFactorValuesShowingCurvature
Contents
OverviewofDefinitiveScreeningDesign ........................................... 197
ExamplesofDefinitiveScreeningDesigns .......................................... 199
DefinitiveScreeningDesign ................................................... 199
ComparisonwithaFractionalFactorialDesign ................................... 207
DefinitiveScreeningDesignwithBlocking....................................... 208
ComparisonofaDefinitiveScreeningDesignwithaPlackettBurmanDesign........ 212
DefinitiveScreeningDesignWindow .............................................. 216
Responses ................................................................... 217
Factors ...................................................................... 219
OrthogonalBlockingOptions.................................................. 221
BlockinginDefinitiveScreeningDesigns........................................ 221
Design ...................................................................... 223
DesignEvaluation ............................................................ 223
OutputOptions .............................................................. 224
DefinitiveScreeningDesignOptions ............................................... 225
TechnicalDetails................................................................ 227
StructureofDefinitiveScreeningDesigns........................................ 227
AnalysisofExperimentalData................................................. 228
Chapter 6
Design of Experiments Guide
197
Definitive Screening
Designs
Standard Screening
Designs
Maineffectsareorthogonalto
twofactorinteractions
Always
OnlyforResolution
IVorhigher
Notwofactorinteractioniscompletely
confoundedwithanyothertwofactor
interaction
Always
OnlyforResolutionV
orhigher
Allquadraticeffectsareestimablein
modelscontainingonlymainand
quadraticeffects
Always
Never
StandardScreeningDesigns
Standardscreeningdesigns,suchasfractionalfactorialorPlackettBurmandesigns,attempt
tostudymanyfactorswitharelativelysmallallocationofresources.However,standard
screeningdesignshaveseveralundesirablefeatures:
Theycanaliassomemaineffectswithtwofactorinteractions.InPlackettBurmandesigns,
forexample,maineffectsarecorrelatedwithseveraltwofactorinteractions.Ifoneormore
twofactorinteractioneffectsaresubstantial,thentheexperimentermustperform
additionalrunstoresolvetheambiguities.
Theycanalsoconfoundsometwofactorinteractionswitheachother.Consequently,ifa
twofactorinteractioneffectissubstantial,thentheexperimentermustperformadditional
runstoresolvetheremainingambiguities.
198
Chapter 6
Design of Experiments Guide
Continuousfactorsareusuallysetatonlytwolevels(lowandhigh).However,engineers
andscientistsoftenpreferdesignswherecontinuousfactorsaresetatthreelevels(low,
middle,andhigh).Thisisbecausetwolevelsarenotsufficienttodetectnonlinearity,
whichiscommoninphysicalsystems.Youcanuseatraditionalscreeningdesignwith
addedcenterpointstodetectnonlinearity,butsuchadesigndoesnotidentifythe
responsiblefactors.
DefinitiveScreeningDesigns
Usingdefinitivescreeningdesigns,youcan:
Avoidmodelambiguity,allowingyoutoidentifyimportantfactorsmorequicklyand
efficiently.
Identifythecauseofnonlineareffectswhileavoidingconfoundinganytermsuptosecond
order.Sonotonlycanyoudetectnonlinearity,asyoumightwithcenterpointsina
traditionalscreeningdesign,butyoucanidentifytheresponsiblefactors.
Definitivescreeningdesignsofferthefollowingadvantages:
Definitivescreeningdesignsrequireonlyasmallnumberofruns.Forsixormorefactors,
thenumberofrequiredrunsisusuallyonlyafewmorethantwicethenumberoffactors.
Formoredetailonthenumberofruns,seeConferenceMatricesandtheNumberof
Runsonpage 228.
Maineffectsareorthogonaltotwofactorinteractions.Thismeansthatestimatesofmain
effectsarenotbiasedbythepresenceofactivetwofactorinteractions,whetherthese
interactionsareincludedinthemodelornot.NotethatresolutionIIIscreeningdesigns
confoundsomemainandinteractioneffects.Also,PlackettBurmandesignsproduce
biasedmaineffectestimatesifthereareactivetwofactorinteractions.
Notwofactorinteractioniscompletelyconfoundedwithanyothertwofactorinteraction.
However,atwofactorinteractionmightbecorrelatedwithothertwofactorinteractions.
NotethatresolutionIVscreeningdesignscompletelyconfoundsometwofactor
interactioneffects.
Allquadraticeffectsareestimableinmodelscomprisedonlyofmaineffectsandquadratic
terms.Thisenablesyoutoidentifythefactorsthataccountfornonlinearity.Notethat
traditionalscreeningdesignswithaddedcenterpointsdonotallowestimationofall
quadraticeffectsinmodelsconsistingofmainandquadraticeffects.
Quadraticeffectsareorthogonaltomaineffectsandnotcompletelyconfoundedwith
twofactorinteractions.Aquadraticeffectmightbecorrelatedwithinteractioneffects.
For6throughatleast30factors,itispossibletoestimatetheparametersofanyfull
quadraticmodelinvolvingthreeorfewerfactorswithhighprecision.
For18factorsormore,theycanfitfullquadraticmodelsinany4factors.For24factorsor
more,theycanfitfullquadraticmodelsinany5factors.
Chapter 6
Design of Experiments Guide
199
DefinitiveScreeningDesignPlatform
TheDefinitiveScreeningDesignplatformenablesyoutoconstructdefinitivescreening
designsforcontinuousfactorsandfortwolevelcategoricalfactors.Italsoenablesyouto
constructblockeddesigns.
Toviewtheabsolutevaluesofthecorrelationsamongeffects,usetheColorMapon
CorrelationsprovidedaspartoftheDesignEvaluationoutlineintheDefinitiveScreening
Designwindow.Youcancomparethealiasingstructureofdefinitivescreeningdesignstothat
ofotherdesignsbycomparingtheircolormapsoncorrelations.Fordetails,seeColorMapon
Correlationsonpage 490intheEvaluateDesignschapter.
Fordetails,seeStructureofDefinitiveScreeningDesignsonpage 227.Forinformationon
definitivescreeningdesignswithblocks,seeBlockinginDefinitiveScreeningDesignson
page 221.Forsuggestionsonhowtoanalyzedataobtainedusingdefinitivescreeningdesigns,
seeAnalysisofExperimentalDataonpage 228.
DefinitiveScreeningDesignonpage 199
ComparisonwithaFractionalFactorialDesignonpage 207
DefinitiveScreeningDesignwithBlockingonpage 208
ComparisonofaDefinitiveScreeningDesignwithaPlackettBurmanDesignon
page 212
200
Chapter 6
Design of Experiments Guide
Figure 6.2ResponsesandFactorsforExtractionDesign
5. ClickContinue.
TheOrthogonalBlockingOptionsoutlineopens.Hereyoucanspecifyablocking
structure.Thereisnoneedtoblockinthisexample,soyouacceptthedefaultselectionof
No Blocks Required.
Note: SettingtheRandomSeedinstep6reproducestheexactresultsshowninthis
example.Inconstructingadesignonyourown,thisstepisnotnecessary.
6. (Optional)FromtheCustomDesignredtrianglemenu,selectSet Random Seed,type123,
andclickOK.
7. ClickMake Design.
TheDefinitiveScreeningDesignwindowupdatestoshowaDesignoutlineandaDesign
Evaluationoutline.
Chapter 6
Design of Experiments Guide
Figure 6.3DesignOutline
Notethefollowing:
Thesoliddeepblueareashowsthatthereisnocorrelationbetweenmaineffectsor
betweenmaineffectsandtwofactorinteractions.
201
202
Chapter 6
Design of Experiments Guide
Thelighterblueandgrayareasindicatethattheabsolutecorrelationsbetween
twofactorinteractionsaresmall.
Thesolidredsquaresindicateabsolutecorrelationsof1.Theseallappearonthe
diagonal,reflectingtheexpectedcorrelationofaneffectwithitself.
9. IntheOutputOptionspanel,notethattheRunOrderissettoRandomize.ClickMake
TabletoobtainthedatatableshowninFigure 6.5.
Figure 6.5DefinitiveScreeningDesignforExtractionProcess
Chapter 6
Design of Experiments Guide
Figure 6.6ModelSpecificationWindow
NotethattheresultingModelSpecificationwindowshowsamaineffectsonlymodel.
3. ClickRun.
203
204
Chapter 6
Design of Experiments Guide
Figure 6.7PartialResultsforMainEffectsModel
Notethefollowing:
TheActualbyPredictedPlotandtheAnalysisofVariancereportindicatethatthe
modelisnotsignificant.
TheEffectSummaryreportshowsthatMethanolistheonlysignificanteffect,witha
pvalueof0.01840.
ModelSpecifyingMainandAllSecondOrderEffects
Supposethatyoususpectthatthereareactivesecondordereffects.Toexploreall
secondordereffects,oneoptionistouseAllPossibleModelsregression.Anotheroptionisto
useforwardstepwiseregression,asyouwilldointhisexample.UsingStepwiseRegression,
youcanentereffectsmanually,startingwithmaineffectsandaddinghigherordertermsthat
accountforsubstantialvariation.Or,youcanusetheStepwiseplatformsautomaticfitting
capabilities:
1. IntheTablespaneloftheExtractionData.jmpsampledatatable,clicktheredtrianglenext
toModelandselectRun Script.
Chapter 6
Design of Experiments Guide
205
TheresultingModelSpecificationwindowshowsamaineffectsonlymodel.Inthenext
twosteps,youaddalltwowayinteractionandquadraticeffects.
2. IntheSelectColumnslist,selectMethanolthroughTime.
3. SelectMacros > Response Surface.
4. ChangethePersonalitytoStepwiseandclickRun.
5. IntheStepwiseFitforYieldreport,changetheStopping RuletoMinimum AICc.
Forscreeningexperiments,BICistypicallyamorelenientstoppingrulethanAICc.As
such,ittendstoallowinactiveeffectstoenterthemodel.
EnsurethatDirectionissettoForward and Rules issetto Combine.
6. ClickGo.
TheCurrentEstimatesreportshowstheresultingmodel.
Figure 6.8CurrentEstimatesReportforStepwiseFit
Stepwiseidentifiesamodelconsistingofthreemaineffects,aquadraticeffect,andan
interactioneffect:Methanol,Ethanol,Time,Methanol*Methanol, and Ethanol*Time.
7. ClickMake ModelintheupperrightoftheStepwiseRegressionControlreport.
ThisactionopensaModelSpecificationwindowthatcontainsonlytheeffectsidentified
byStepwise.
206
Chapter 6
Design of Experiments Guide
8. IntheModelSpecificationwindow,clickRun.
Figure 6.9PartialResultsforModelwithSecondOrderTerms
Notethefollowing:
TheActualbyPredictedPlotshowsthatthemodelissignificant(P<.0001).Itdoesnot
indicateanyanomaliesorlackoffitissues.
TheEffectSummaryreportshowsthatalleffectsotherthanEthanolaresignificantat
the0.05level.Ethanolisnearlysignificantatthe0.05levelanditisacomponentofthe
Ethanol*Timeinteraction,whichissignificant.Consequently,youretainEthanolasa
modeleffect.
TheParameterEstimatesreportgivesestimatesofthecoefficientsforthepredictive
model.Becausealleffectsarecontinuous,thetestsfornoninterceptestimatesarethe
sameasthosegivenintheEffectSummary.
Chapter 6
Design of Experiments Guide
207
Ifyouhadusedanordinaryscreeningdesignwithcenterruns,thenonlinearitycouldhave
beendetected.However,furtherrunswouldhavebeennecessarytoidentifyMethanolasthe
sourceofthequadraticeffect.
208
Chapter 6
Design of Experiments Guide
8. Selectthesixteenrunfractionalfactorialdesignwithnoblocks,shownhighlightedin
Figure 6.10.
9. ClickContinue.
10. OpentheDesign Evaluation > Aliasing of Effectsoutline.
Figure 6.11AliasingofEffectsforFractionalFactorialDesign
TheAliasingofEffectsoutlineforthe16runfractionalfactorialdesignshowsthatevery
twofactorinteractionisconfoundedwithatleastoneothertwofactorinteraction.Inthis
fractionalfactorialdesign,theEthanol*TimeinteractionisconfoundedwithMethanol*pH.To
determinewhichinteractionisactive,youneedtorunadditionaltrials.Hadthefactorsbeen
enteredinadifferentorder,theEthanol*Timeinteractionmighthavebeenaliasedwithtwo
othertwofactorinteractions.
InthesectionDefinitiveScreeningDesignonpage 199,youconstructeda13rundefinitive
screeningdesign.Whenyouanalyzedtheexperimentalresultsforthis13rundesign,the
Ethanol*Timeinteractionwasfoundtobeactive.SeeModelSpecifyingMainandAllSecond
OrderEffectsonpage 204.
Usingthe13rundefinitivescreeningdesign,youalsodeterminedthatthequadraticeffect
Methanol*Methanolwaslikelytobeactive.Forthe16runfractionalfactorialdesign,this
quadraticeffectcannotevenbeestimated.Thisisbecausethesettingsforeachfactorareat
eithertheloworthehighvalue.Ifyouaddcenterpoints,youmightbeabletodetect
curvature.Butyouwillnotbeabletodeterminewhichfactorisresponsiblewithoutfurther
runs.
The13rundefinitivescreeningdesigngivesmoreinformationthanthe16runfractional
factorialdesign.Italsogreatlyreducestheneedforfollowupexperimentation.
Chapter 6
Design of Experiments Guide
209
210
Chapter 6
Design of Experiments Guide
Figure 6.12DefinitiveScreeningDesignwithBlockforExtractionProcess
Noticethatrun6isacenterpointruninLot1andrun8isacenterpointruninLot2.
Analyze the Experimental Data
Atthispoint,youconductyourexperimentandrecordyourdataintheYieldcolumnofthe
designtable(Figure 6.12).TheExtraction2 Data.jmpsampledatatablecontainsyour
experimentalresults.
Toexploreallsecondordereffects,oneoptionistouseAllPossibleModelsregression.
Anotheroptionistouseforwardstepwiseregression,asdoneinthisexample.UsingStepwise
Regression,youcanentereffectsmanually,startingwithmaineffectsandaddinghigherorder
termsthataccountforsubstantialvariation.Or,youcanusetheStepwiseplatformsautomatic
fittingcapabilities:
1. SelectHelp > Sample Data LibraryandopenDesign Experiment/Extraction2 Data.jmp.
2. IntheTablespanelofthedesigntable,clicktheredtrianglenexttoModelandselectRun
Script.
3. IntheSelectColumnslist,selectMethanolthroughTime.
4. SelectMacros > Response Surface.
5. ChangethePersonalitytoStepwise.
6. ClickRun.
7. IntheStepwiseFitforYieldreport,changetheStopping RuletoMinimum AICc.
Forscreeningexperiments,BICistypicallyamorelenientstoppingrulethanAICc.As
such,ittendstoallowinactiveeffectstoenterthemodel.
NotethatDirectionissettoForward and Rules issetto Combine.
8. IntheEnteredcolumnintheCurrentEstimatesoutline,checktheboxnexttoLot(21).
Chapter 6
Design of Experiments Guide
211
RecallthatLotisablockingvariable.Itspurposeistoaccountfornuisancevariationso
thatyoucanmoreclearlyseetheeffectsofotherfactors.Forthisreason,youwantLottobe
partofallmodelsconsideredbyStepwise.Inthenextstep,youlocktheLot(12)termso
thatitremainsinallmodelsfitbyStepwise.
9. IntheLockcolumnintheCurrentEstimatesoutline,checktheboxnexttoLot(21).
ThecheckintheboxunderEntereddimsasareminderthatLot(12)islockedintothe
model.
10. ClickGo.
TheCurrentEstimatesreport(Figure 6.13)showsthatStepwiseselectsamodelconsisting
oftheblockingvariable,threemaineffects,aquadraticeffect,andaninteraction:Lot,
Methanol,Ethanol,Time,Methanol*Methanol,andEthanol*Time.
Figure 6.13CurrentEstimatesReportforStepwiseFit
212
Chapter 6
Design of Experiments Guide
Figure 6.14ModelFitResultsforBlockedDesign
Notethefollowing:
TheActualbyPredictedPlotshowsthatthemodelissignificant.Itdoesnotindicate
anyanomaliesorlackoffitissues.
TheEffectTestsreportshowsthatalleffectsaresignificant.
TheEffectTestsreportalsoshowsthatLothasthelargestSumofSquaresamongthe
modeleffects.Haditnotbeenincludedinthemodel,othereffectswouldnotappear
significant.
Chapter 6
Design of Experiments Guide
213
Figure 6.15DefinitiveScreeningDialogwith4Continuousand2CategoricalFactors
4. ClickContinue.
Thisexampledoesnotrequireablock.UndertheOrthogonalBlockingOptionsOutline,
checkthattheNoBlocksRequiredoptionisselected.
5. ClickMake Design.
Thedesignthatisgeneratedhas14runs.
6. OpentheDesign Evaluation > Color Map On Correlationsoutline.
214
Chapter 6
Design of Experiments Guide
Figure 6.16ColorMapforDefinitiveScreeningDesign
Noticethatthecategoricalmaineffectshavesmallcorrelationswitheachotherandwith
thecontinuousfactorsmaineffects.Thesecorrelationsleadtoasmallreductioninthe
precisionoftheestimates.
7. DonotcloseyourDefinitiveDesignScreeningwindowuntilyoucomparethecolormap
withthatofthePlackettBurmandesign,below.
ThePlackettBurmanDesign
NowcreateaPlackettBurmandesignusingthesamefactorstructure.
1. SelectDOE > Screening Design.
2. Type4intheAdd N FactorsboxandclickContinuous.
3. Type2intheAdd N FactorsboxandclickCategorical > 2 Level.
4. ClickContinue.
5. SelectChoose from a list of fractional factorial designsandclickContinue.
PotentialdesignsappearintheDesignList,showninFigure 6.17.
Chapter 6
Design of Experiments Guide
215
Figure 6.17PlackettBurmanDesign
6. Selectthe12runPlackettBurmandesign.SeeFigure 6.17.
7. ClickContinue.
8. OpentheDesign Evaluation > Color Map On Correlationsoutline.
Comparethecolormapforthe12runPlackettBurmandesigntothecolormapforthe
14rundefinitivescreeningdesign.
216
Chapter 6
Design of Experiments Guide
Figure 6.18PlackettBurmanCorrelations(left)andDefinitiveScreeningCorrelations(right)
Figure 6.18showsbothcolormaps,butonlyshowstheportionofthePlackettBurmancolor
mapthatinvolvesmaineffectsandtwowayinteractions.SeeColorMaponCorrelationson
page 490intheEvaluateDesignschapterfordetailsabouthowtoconstructacolormapfor
onlymaineffectsandtwowayinteractions.
InthecolormapforthePlackettBurmandesignontheleft,youseethatmosttwofactor
interactionsarecorrelatedwithmaineffects.Thismeansthatanynonnegligibletwofactor
interactionwillbiasseveralmaineffects.Thiscanleadtoafailuretoidentifyanactivemain
effectorthefalseconclusionthataninactivemaineffectisactive.
Contrastthiswiththecolormapforthedefinitivescreeningdesignontheright.Withonly
twoadditionalruns,thedefinitivescreeningdesigntradesoffasmallincreaseinthevariance
ofthemaineffectsforcompleteindependenceofmaineffectsandtwofactorinteractions.
Chapter 6
Design of Experiments Guide
217
Figure 6.19DefinitiveScreeningDesignFlow
Responses
Factors
Continue
Orthogonal
Blocking
Options
Make
Design
Design
Design Evaluation
Output Options
Make
Table
Responses
UsetheResponsesoutlinetospecifyoneormoreresponses.
Figure 6.20ResponsesOutline
TheResponsesoutlinecontainsthefollowingbuttons:
EntersasingleresponsewithagoaltypeofMaximize,MatchTarget,
Minimize,orNone.IfyouselectMatchTarget,enterlimitsforyourtargetvalue.Ifyou
selectMaximizeorMinimize,enteringlimitsisnotrequiredbutcanbeuseful.
Add Response
Remove Removestheselectedresponses.
Entersadditionalresponsessothatthenumberthatyouenteristhe
totalnumberofresponses.IfyouhaveenteredaresponseotherthanthedefaultY,the
GoalforeachoftheadditionalresponsesistheGoalassociatedwiththelastresponse
entered.Otherwise,theGoaldefaultstoMatchTarget.ClicktheGoaltypeinthetableto
changeit.
Number of Responses
Response Name
response,minimizeyourresponse,matchatarget,orthatyouhavenoresponsegoal.JMP
assignsaResponseLimitscolumnproperty,basedonthesespecifications,toeachresponse
columninthedesigntable.Itusesthisinformationtodefineadesirabilityfunctionforeach
response.TheProfilerandContourProfilerusethesedesirabilityfunctionstofindoptimal
218
Chapter 6
Design of Experiments Guide
factorsettings.Forfurtherdetails,seetheProfilersbookandResponseLimitson
page 562intheColumnPropertiesappendix.
AGoalofMaximizeindicatesthatthebestvalueisthelargestpossible.Ifthereare
naturallowerorupperbounds,youcanspecifytheseastheLowerLimitorUpper
Limit.
AGoalofMinimizeindicatesthatthebestvalueisthesmallestpossible.Ifthereare
naturallowerorupperbounds,youcanspecifytheseastheLowerLimitorUpper
Limit.
AGoalofMatchTargetindicatesthatthebestvalueisaspecifictargetvalue.The
defaulttargetvalueisassumedtobemidwaybetweentheLowerLimitandUpper
Limit.
AGoalofNoneindicatesthatthereisnogoalintermsofoptimization.Nodesirability
functionisconstructed.
Note: IfyourtargetresponseisnotmidwaybetweentheLowerLimitandtheUpper
Limit,youcanchangethetargetafteryougenerateyourdesigntable.Inthedatatable,
opentheColumnInfowindowfortheresponsecolumn(Cols>Column Info)andenterthe
desiredtargetvalue.
Importance Whenyouhaveseveralresponses,theImportancevaluesthatyouspecifyare
usedtocomputeanoveralldesirabilityfunction.Thesevaluesaretreatedasweightsfor
theresponses.Ifthereisonlyoneresponse,thenspecifyingtheImportanceisunnecessary
becauseitissetto1bydefault.
EditingtheResponsesOutline
IntheResponsesoutline,notethefollowing:
Doubleclickaresponsetoedittheresponsename.
Clickthegoaltochangeit.
Clickonalimitorimportancevaluetochangeit.
Formultipleresponses,youmightwanttoentervaluesfortheimportanceweights.
Chapter 6
Design of Experiments Guide
219
IfyoudonotspecifyaLowerLimitandUpperLimit,JMPusestherangeoftheobserveddata
fortheresponsetodefinethelimitsforthedesirabilityfunction.SpecifyingtheLowerLimit
andUpperLimitgivesyoucontroloverthespecificationofthedesirabilityfunction.Formore
detailsabouttheconstructionofthedesirabilityfunction,seetheProfilersbook.
Factors
AddfactorsintheFactorsoutline.
Figure 6.21FactorsOutline
Thefactorsoutlinecontainsthefollowingbuttons.
Continuous EntersthenumberofcontinuousfactorsspecifiedinAdd N Factors.
Categorical
EntersthenumberofnominalfactorsspecifiedinAdd N Factors.
Remove Removestheselectedfactors.
Add N Factors Addsmultiplefactorsofagiventype.Enterthenumberoffactorstoaddand
clickContinuousorCategorical.RepeatAdd N Factorstoaddmultiplefactorsofdifferent
types.
Tip: WhenyouhavecompletedyourFactorspanel,selectSaveFactorsfromtheredtriangle
menu.Thissavesthefactornamesandvaluesinadatatablethatyoucanlaterreload.See
DefinitiveScreeningDesignOptionsonpage 225.
TheFactorsoutlinecontainsthefollowingcolumns:
Name Thenameofthefactor.Whenadded,afactorisgivenadefaultnameofX1,X2,andso
on.Tochangethisname,doubleclickitandenterthedesiredname.
Role SpecifiestheDesignRoleofthefactor.TheDesignRolecolumnpropertyforthefactor
issavedtothedatatable.Thispropertyensuresthatthefactortypeismodeled
appropriately.
Theexperimentalsettingsforthefactors.ToinsertValues,clickonthedefaultvalues
andtypethedesiredvalues.
Values
220
Chapter 6
Design of Experiments Guide
EditingtheFactorsOutline
IntheFactorsoutline,notethefollowing:
Toeditafactorname,doubleclickthefactorname.
Toeditavalue,clickthevalueintheValuescolumn.
Factor Types
Continuous Numericdatatypesonly.Acontinuousfactorisafactorthatyoucan
conceptuallysettoanyvaluebetweenthelowerandupperlimitsyousupply,giventhe
limitationsofyourmeasurementsystem.
Eithernumericorcharacterdatatypeswithtwolevels.Foracategoricalfactor,
thevalueorderingistheorderofthevalues,asenteredfromlefttoright.Thisorderingis
savedintheValueOrderingcolumnpropertyafterthedesigndatatableiscreated.
Categorical
specifyindefiningthefactordeterminesthevalueofitsDesignRolecolumnproperty.
WhenyouaddablockunderOrthogonalBlockingOptions,thatfactorisassignedthe
Blockingvalue.TheDesignRolepropertyreflectshowthefactorisintendedtobeusedin
modelingtheexperimentaldata.DesignRolevaluesareusedintheAugmentDesign
platform.
Factor Changes EachfactorisassignedtheFactorChangescolumnpropertywithasettingof
Easy.Indefinitivescreeningdesigns,itisassumedthatfactorlevelscanbechangedfor
eachexperimentalrun.FactorChangesvaluesareusedintheEvaluateDesignand
AugmentDesignplatforms.
IftheRoleisContinuous,theCodingcolumnpropertyforthefactorissaved.This
propertytransformsthefactorvaluessothatthelowandhighvaluescorrespondto1and
+1,respectively.TheestimatesandtestsintheFitLeastSquaresreportarebasedonthe
transformedvalues.
Coding
IftheRoleisCategoricalorBlocking,theValueOrderingcolumnpropertyfor
thefactorissaved.Thispropertydeterminestheorderinwhichlevelsofthefactorappear.
Value Ordering
RunsPerBlock Indicatesthenumberofrunsineachblock.WhenaBlockisselectedinthe
OrthogonalBlockingOptionsoutlineandyouthenclickMakeDesign,afactorwiththe
defaultnameBlockisaddedtotheFactorslist.TheRunsPerBlockcolumnpropertyis
savedforthatfactor.
Chapter 6
Design of Experiments Guide
221
defaultselection.
Add Blocks with Center Runs to Estimate Quadratic Effects Addsthenumberofblocks
specifiedintheNumberofBlockstextbox.Constructsadesignwhereblockeffectsare
orthogonaltomaineffectsandwherethemodelconsistingofallmainandquadratic
effectsisestimable.Fordetails,seeAddBlockswithCenterRunstoEstimateQuadratic
Effectsonpage 222
Add Blocks without Extra Center Runs AddsthenumberofblocksspecifiedintheNumberof
Blockstextbox.Addsonlyasmanycenterrunsasrequiredbythedesignstructure.
Constructsadesignwhereblockeffectsareorthogonaltomaineffects,butthemodel
consistingofallmaineffectsandquadraticeffectsmaynotbeestimable.Fordetails,see
AddBlockswithoutExtraCenterRunsonpage 222.
Note: UsetheAdd Blocks without Extra Center Runsoptiononlyifyoucanassumethat
notallquadraticeffectsareimportant.
Number of Blocks Indicatesthenumberofblockstoadd.Thenumberofblocksthatyoucan
addrangesfromtwotothenumberoffactors.
Make Design Generatesthedesign,presentsitintheDesignoutline,andprovidesevaluation
informationintheDesignEvaluationoutline.TheOutputOptionspanelalsoappears,
enablingyoutocreatethedesigntable.
AddBlockswithCenterRunstoEstimateQuadraticEffectsonpage 222
AddBlockswithoutExtraCenterRunsonpage 222
Ifadesigncontainsacategoricalfactor,acenterrunisarunwhereallcontinuousfactorsare
setattheirmiddlevalues.Ifallfactorsarecategorical,thetwoblockingoptionsareavailable.
Bothoptionsproducedesignswhoseblocksareorthogonaltomaineffects.
222
Chapter 6
Design of Experiments Guide
Blockeffectsareorthogonaltomaineffects.
Themodelconsistingofallmainandquadraticeffectsisestimable.
Ifadesigncontainsonlycontinuousfactors,ablockeddesignforkfactorshavingthese
propertiescanbeconstructedasfollows:
RemovethecenterrunfromtheDSDdesignforkfactors.
Assignconferencematrixfoldoverpairstothesameblock.
Addonecenterruntoeachblock.
Blockeffectsareorthogonaltomaineffects.
Eachblockeffectisconfoundedwithalinearcombinationofquadraticeffects.This
impliesthatthemodelconsistingofallmainandquadraticeffectsisnotestimable.
Forthisreason,usethisoptiononlyifyoucanassumethatsomequadraticeffectsare
negligible.
Ablockeddesignforkfactorswithoutextracenterrunsisconstructedasfollows:
Assignconferencematrixfoldoverpairstothesameblock.
Ifallfactorsarecontinuous,assignthesinglecenterruntoasingleblock.
Chapter 6
Design of Experiments Guide
223
Iftherearecategoricalfactors,theunblockeddefinitivescreeningdesignrequiresthe
additionoftwocenterrunstothefoldoverpairsdefinedbytheconferencematrix.See
ConferenceMatricesandtheNumberofRunsonpage 228.Toconstructtheblocked
designwithoutextracenterruns,thesetwocenterrunsareaddedtoasingleblock.
Becausetheonlyrequirementonblocksizeisthatablockcontainsafoldoverpair,thenumber
ofblockscanrangefrom2tok,ifkisevenandfrom2tok+1,ifkisodd.SeeConference
MatricesandtheNumberofRunsonpage 228.JMPattemptstoconstructblocksofequal
size.
Design
TheDesignoutlineshowstherunsforthedefinitivescreeningdesign.Therunsaregivenina
standardorder.Tochangetherunorderforyourdesigntable,youcanselectRunOrder
optionsintheOutputOptionspanelbeforegeneratingthetable.
Note: Definitivescreeningdesignsforfourorfewerfactorsarebasedonafivefactordesign.
SeeDefinitiveScreeningDesignsforFourorFewerFactorsonpage 228.
Design Evaluation
TheDesignEvaluationoutlineprovidesanumberofwaystoevaluatethepropertiesofthe
generateddesign.OpentheDesignEvaluationoutlinetoseethefollowingoptions:
Power Analysis Enablesyoutoexploreyourabilitytodetecteffectsofgivensizes.
Prediction Variance Profile Showsthepredictionvarianceovertherangeoffactorsettings.
Fraction of Design Space Plot
Showshowmuchofthemodelpredictionvarianceliesbelow
(orabove)agivenvalue.
Prediction Variance Surface Showsasurfaceplotofthepredictionvarianceforanytwo
continuousfactors.
Estimation Efficiency Foreachparameter,givesthefractionalincreaseinthelengthofa
confidenceintervalcomparedtothatofanideal(orthogonal)design,whichmightnot
exist.Alsogivestherelativestandarderroroftheparameters.
Givescoefficientsthatindicatethedegreebywhichthemodelparametersare
biasedbyeffectsthatarepotentiallyactive,butnotinthemodel.
Alias Matrix
intensityscale.
Design Diagnostics Indicatestheoptimalitycriterionusedtoconstructthedesign.Alsogives
efficiencymeasuresforyourdesign.
224
Chapter 6
Design of Experiments Guide
FormoredetailsabouttheDesignEvaluationpanel,seeDesignEvaluationonpage 476in
theEvaluateDesignschapter.
Output Options
UsetheOutputOptionspaneltoperformthefollowingtasks:
specifytheorderfortherunsinthedesigndatatable
constructthedesigntable
returntoapreviouspointintheDefinitiveScreeningDesignwindow
Figure 6.22OutputOptionsPanel
TheOutputOptionspanelcontainstheseoptions:
RunOrder
TheRun Orderoptionsdeterminetheorderoftherunsinthedesigntable.Choicesincludethe
following:
Keep the Same RowsinthedesigntableareinthesameorderasintheDesignoutline.
Sort Left to Right
Columnsinthedesigntablearesortedfromlefttoright.
Randomize Rowsinthedesigntableareinrandomorder.
Sort Right to Left Columnsinthedesigntablearesortedfromrighttoleft.
Randomize within Blocks
Rowsinthedesigntableareinrandomorderwithintheblocks.
MakeTable
ClickMake TabletoconstructtheDefinitiveScreeningDesigndatatable.
IntheDefinitiveScreeningDesigntable,theTablepanel(intheupperleft)containsthe
followingscripts.Torunascript,selectRun Scriptfromtheredtrianglemenu.
Screening RunstheAnalyze>Modeling>Screeningplatform.
Model RunstheAnalyze>Fit Model platform.Themodeldescribedbythescriptcontainsthe
maineffectsforthefactorsthatyouspecified.Ifyourequestedablock,themodelincludes
thefactorBlock.
Chapter 6
Design of Experiments Guide
225
designtable.
Figure 6.23DefinitiveScreeningDesignTableShowingScripts
Back
TheBackbuttontakesyoubacktowhereyouwerebeforeclickingMakeDesign.Youcan
makechangestothepreviousoutlinesandregeneratethedesign.
Save Responses
Load Responses
LoadsresponsesthatyouhavesavedusingtheSaveResponsesoption.
levels.Afactorscolumncontainscolumnpropertiesassociatedwiththefactor.Saving
factorsallowsyoutoquicklyloadthemintoaDOEwindow.
Note: Itispossibletocreateafactorstablebytypingdataintoanemptytable,but
remembertoassigneachcolumnanappropriateDesignRole.Dothisbyrightclickingon
thecolumnnameinthedatagridandselectingColumn Properties > Design Role.Inthe
DesignRolearea,selecttheappropriaterole.
Load Factors
LoadsfactorsthatyouhavesavedusingtheSaveFactorsoption.
226
Chapter 6
Design of Experiments Guide
definedintheDefineFactorConstraintsorLinearConstraintsoutline.TheSave
Constraintsoptioncreatesadatatablethatcontainsacolumnforeachconstraint.Saving
constraintsallowsyoutoquicklyloadthemintoaDOEwindow.
Theconstrainttablecontainsacolumnforeachlinearconstraint.Thefirstrowscontainthe
coefficientsforeachfactor.Thelastrowcontainstheinequalitybound.Eachconstraints
columncontainsacolumnpropertycalledConstraintStatethatidentifiestheconstraintasa
lessthanoragreaterthanconstraint.SeeColumnPropertiesonpage 559inthe
ColumnPropertiesappendix.
(Unavailableforsomeplatforms)Loadsfactorconstraintsthatyouhave
savedusingtheSaveConstraintsoption.
Load Constraints
randomcomponent.Theseactionsinclude:
simulatingresponsesusingtheSimulateResponsesoption
randomizingRunOrderfordesignconstruction
selectingastartingdesignfordesignsbasedonrandomstarts.
Toreproduceadesignorsimulatedresponses,entertherandomseedusedtogenerate
them.Fordesignsusingrandomstarts,settheseedbeforeclickingMakeDesign.To
controlsimulatedresponsesorrunorder,settheseedbeforeclickingMakeTable.
NotethattherandomseedassociatedwithadesignisincludedintheDOEDialogscript
thatissavedtothedesigndatatable.
Addsresponsevaluestothedesigntablethatisgenerated.Selectthis
optionbeforeyouclickMakeTable.InthedesigntablethatresultsfromclickingMake
Table,theresponsecolumnscontainsimulatedvalues.
Simulate Responses
Forcertaintypesofdesigns,aSimulateResponseswindowliststhecoefficientsanderror
standarddeviationusedtosimulatetheresponsevalues.Youcanreplacethesecoefficients
andclickApplytoseeyoursimulatedresponsevaluesinthedatatable.Thedefaultvalues
forthecoefficientsareeither1or1.Thedefaultvaluefortheerrorstandarddeviationis1.
SomeplatformsallowyoutosetAnticipatedCoefficientsaspartofPowerAnalysisunder
DesignEvaluation.Fortheseplatforms,thedefaultvaluesintheSimulateResponses
windowarethevaluesthatyouspecifyasAnticipatedCoefficientsandAnticipatedRMSE
(ErrorStd)inthePowerAnalysisoutline.Ifitisnotpossibletofitthemodelspecifiedin
thedatatablesModelscript,theinterceptandcoefficientshavedefaultvaluesof0.
Note: Youcansetapreferencetoalwayssimulateresponses.SelectFile > Preferences >
Platforms > DOE.CheckSimulateResponses.
Chapter 6
Design of Experiments Guide
227
Specifythedifferenceinthemeanresponsethatyou
wanttodetectformodeleffects.SeeEvaluateDesignOptionsonpage 493inthe
EvaluateDesignschapter.
CustomDesignplatformandsavesitinanopenscriptwindow.
Technical Details
Thissectioncontainstechnicaldetailsforthefollowingtopics:
StructureofDefinitiveScreeningDesignsonpage 227
AnalysisofExperimentalDataonpage 228
228
Chapter 6
Design of Experiments Guide
twowayinteractioneffectsandquadraticeffectsareoftencorrelated
twowayinteractionandquadraticeffectscannotallbeestimatedsimultaneously
Chapter 6
Design of Experiments Guide
229
Figure 6.25showsaColorMaponCorrelationsforthedesignwitheightcontinuousfactors
showninFigure 6.24.Thecolormapisforafullquadraticdesign.Theeightpurequadratic
effectsarelistedtothefarright.YoucanconstructthisplotbyusingDOE>EvaluateDesign
andenteringtheappropriatetermsintotheAliasTermslist.SeeAliasTermsonpage 476in
theEvaluateDesignschapterfordetails.
Figure 6.25ColorMaponCorrelationsforFullQuadraticModel
Useyourcursortoholdyourmousepointeroverthecellsofthecolormapinordertoseethe
absolutecorrelationsbetweeneffects.Youseethatmaineffectsareuncorrelatedwithall
twowayinteractionandpurequadraticeffects.Youalsoseethatnoneoftheeffectsare
completelyconfoundedwithothereffectsbecausetheonlyredcellsareonthemaindiagonal.
Butnotethatsomeoftheabsolutecorrelationsbetweentwofactorinteractionsaresubstantial,
withsomeat0.667.Notealsothatabsolutecorrelationsbetweentwofactorinteractionsand
purequadraticeffectsareeither0or0.3673.
Ifonlymainandpurequadraticeffectsareactive,youcanfitasaturatedmodelthatcontains
maineffectsandquadraticeffects.Thismodelwillresultineffectestimatesthatareunbiased,
assumingnoactivethreewayorhigherordereffects.
230
Chapter 6
Design of Experiments Guide
Becauseofthecorrelationsinvolvingsecondordereffects,youmustbecarefulinfittinga
modelwithtwowayinteractions.Reasonableanalysismethodologiesinclude:
ForwardstepwiseregressionusingtheStoppingRulesettoMinimumAICcandtheRules
settoCombinetoensuremodelheredity.Becauseofeffectconfounding,severalmodels
mightbeequivalent.Toidentifythese,youcanfollowupbyselectingtheAllPossible
Modelsredtriangleoption.Additionalrunswillbenecessarytoresolvetheconfounding.
AllPossibleModelsregression,whereyouselecttheoptionthatimposestheHeredity
RestrictionandusetheAICccriterionformodelselection.
Chapter 7
Screening Designs
Screeningdesignsareamongthemostpopulardesignsforindustrialexperimentation.They
aretypicallyusedintheinitialstagesofexperimentation.Theyexaminemanyfactorsto
identifythosethathavethegreatesteffectontheresponseorresponses.Thefactorsidentified
arethenstudiedusingmoresensitivedesigns.
Screeningdesignsgenerallyrequirefewerexperimentalrunsthanotherdesigns.Theyare
attractivebecausetheyarearelativelyinexpensiveandefficientwaytobeginimprovinga
process.
Inascreeningdesign,eachcontinuousfactorisusuallysetattwolevelstoeconomizeonthe
numberofrunsneeded.Thedesignconsistsofonlyafractionofthepossiblecombinationsof
factorlevels.Tablesofstandarddesignsthatinvolvecontinuousandcategoricalfactorshave
beencataloged.
Whenstandardscreeningdesignsexist,theScreeningDesignplatformsuppliesalistof
popularscreeningdesignsfortwoormorefactors.Thesefactorscanbetwolevelcontinuous
factorsorthreelevelcategoricalordiscretecontinuousfactors.
However,screeningsituationsoccurforwhichstandarddesignsarenotavailable.Forthese
situations,JMPgeneratesmaineffectsscreeningdesigns.Therearedesignsthatareeither
orthogonalornearorthogonal.Theyfocusonestimatingmaineffectsinthepresenceof
negligibleinteractions.
IntheScreeningDesignplatform,youenteryourfactorsandtheirlevels.Ifastandard
screeningdesignexists,youaregiventheoptiontochoosesuchadesignfromalistof
standardscreeningdesignsthatincludesblockingdesigns.Alternatively,youcangeneratea
maineffectsscreeningdesign,whichassuresyouofanorthogonalornearorthogonaldesign.
Ifastandardscreeningdesigndoesnotexist,amaineffectsscreeningdesignisautomatically
generatedforyou.
Contents
OverviewofScreeningDesigns ................................................... 233
ScreeningDesignExamples....................................................... 234
AStandardDesignwithTwoContinuousFactorsandOneCategoricalFactor ........ 234
AStandardDesignforFiveContinuousFactors.................................. 237
CreatingaScreeningDesign...................................................... 241
EnterResponses.............................................................. 242
EnterFactors ................................................................ 243
ChooseScreeningType ....................................................... 244
ChoosefromaListofFractionalFactorialDesigns................................ 244
DesignGeneration ........................................................... 252
NearOrthogonalDesigns ..................................................... 252
DesignEvaluation ............................................................ 254
SpecifyOutputOptions....................................................... 254
ViewtheDesignTable ........................................................ 255
CreatingaPlackettBurmanDesign ................................................ 256
CreatingaMainEffectsScreeningDesign........................................... 258
Chapter 7
Design of Experiments Guide
Screening Designs
Overview of Screening Designs
233
Classicaldesigns:Forsituationswherestandardscreeningdesignsexist,youcanchoose
fromalistofthesedesigns.
MainEffectsScreeningDesigns:Forsituationswherestandarddesignsarenotavailable,
JMPgeneratesdesignsthatareeitherorthogonalornearorthogonal.Likesomeofthe
standarddesigns,thesedesignsfocusonestimatingmaineffectsinthepresenceof
negligibleinteractions.SeeNearOrthogonalDesignsonpage 252.
Theemphasisonstudyingmaineffectsearlyonintheexperimentationprocessissupported
bytheHierarchicalOrderingPrinciple(WuandHamada,2000).Thisprinciplecontendsthat
lowereffectsaremorelikelytobeimportantthanhigherordereffects.Forthisreason,
screeningdesignsgenerallyassumethatinteractionsarenegligible.Incaseswherethis
assumptionisnotreasonable,screeningdesignsassumethattwofactorinteractionsaremore
importantthanthreefactorinteractions,andsoon.
Theefficiencyofscreeningdesignsalsodependsonthecriticalassumptionofeffectsparsity.
Effectsparsityreflectsthefactthatrealworldprocessesusuallyhaveonlyafewdriving
factors.Otherfactorsarerelativelyunimportant.Tounderstandtheimportanceofeffect
sparsity,youcancontrastscreeningdesignstofullfactorialdesigns:
Fullfactorialdesignsconsistofallcombinationsofthelevelsofthefactors.Thenumberof
runsistheproductofthefactorlevels.Forexample,afullfactorialexperimentwiththree
twolevelfactorsandafourlevelfactorhas2x2x2x4=32runs.
Bycontrast,screeningdesignsrequireonlyafractionoftherunsinthefullfactorial
design.Themaineffectsofthefourfactorsdescribedabovecanbestudiedinaneightrun
maineffectsscreeningdesign.
Thischaptershowsyouhowtogenerateandanalyzescreeningdesigns,pointingouttheir
limitationsintheprocess.
234
Screening Designs
Screening Design Examples
Chapter 7
Design of Experiments Guide
Operator,whoisthetechnicianoperatingtheweldingmachine
Rotation Speed,whichisthespeedatwhichthepartrotatesunderthebeam
Beam Current,whichisacurrentthataffectstheintensityofthebeam
Aftereachprocessingrun,theengineercutsthepartinhalf.Thisrevealsanareawherethe
twopartshavefused.TheLength ofthisfusedareaisthedepthofpenetrationoftheweld.
Thisdepthofpenetrationistheresponseforthestudy.
Thegoalsofthestudyarethefollowing:
Findwhichfactorsaffectthedepthoftheweld.
Quantifythoseeffects.
Findspecificfactorsettingsthatpredictawelddepthof0.17inches.
Chapter 7
Design of Experiments Guide
Screening Designs
Screening Design Examples
235
Figure 7.1ScreeningDesignResponsewithMatchTargetGoal
3. ClicktheLower Limittexteditareaandenter0.12asthelowerlimit(minimumacceptable
value).ThenclicktheUpper Limittexteditareaandenter0.22astheupperlimit
(maximumacceptablevalue).
Thisexamplehasonecategoricalfactor(Operator)andtwocontinuousfactors(Speedand
Current).IntheFactorspanel:
4. Addthecategoricalfactorbyselecting2 LevelfromtheCategorical list.
5. Addtwocontinuousfactorsbytyping2intheAdd N Factors boxandclickingthe
Continuous button.
6. DoubleclickthefactornamesandrenamethemOperator,Speed,andCurrent.
7. AssignJohnandMaryasvaluesforthecategoricalfactorOperator.Sethighandlow
valuesforSpeedto3and5(rpm).SethighandlowvaluesforCurrentto150and165
(amps).YourScreeningDesignwindowshouldappearasshowninFigure 7.2.
Figure 7.2ScreeningDesignwithTwoContinuousandOneCategoricalFactor
8. ClickContinue.
SincethereisastandarddesignintheDesignListforthecombinationoffactorsandlevels
thatyouhavespecified,theChooseScreeningTypepanelappears(Figure 7.3).Youcan
choosebetweenselectingastandarddesignfromalistorgeneratinganorthogonalor
236
Screening Designs
Screening Design Examples
Chapter 7
Design of Experiments Guide
Chapter 7
Design of Experiments Guide
Screening Designs
Screening Design Examples
237
Figure 7.5TheDesignDataTable
feedrate,theamountofrawmaterialaddedtothereactionchamberinlitersperminute
percentageofcatalyst
stirrate,theRPMsofapropellerinthechamber
reactiontemperatureindegreesCelsius
concentrationofreactant
ToStarttheExample:
1. SelectDOE > Screening Design.
2. YouseeonedefaultresponsecalledY.Changethedefaultresponsename(Y)to Percent
Reacted.
3. TheGoal istomaximizetheresponse,butchangetheminimumacceptablereaction
percentageto90(Lower Limit),andupperlimitto99(Upper Limit),asshowninFigure 7.6.
4. Addfivecontinuousfactorsbyentering5intheAdd N Factorsboxandclicking
Continuous.
5. Changethedefaultfactornames(X1X5)toFeed Rate,Catalyst,Stir Rate,Temperature,and
Concentration.
6. Enterthehighandlowvalues,asshowninFigure 7.6.
238
Screening Designs
Screening Design Examples
Chapter 7
Design of Experiments Guide
Figure 7.6ScreeningforManyFactors
7. ClickContinue.
8. FromtheChooseScreeningTypepanel,acceptthedefaultselectiontoChoose from a list of
fractional factorial designs.
DesignsforthenumberoffactorsthatyouspecifiedarelistedintheDesignList
(Figure 7.7).
9. Selectthefirstiteminthelist,whichisan8runfractionalfactorialdesignwithnoblocks
(Figure 7.7).
Chapter 7
Design of Experiments Guide
Screening Designs
Screening Design Examples
239
Figure 7.7ScreeningDesignforFiveFactors
240
Screening Designs
Screening Design Examples
Chapter 7
Design of Experiments Guide
Figure 7.9JMPTableofRunsforScreeningExample
Chapter 7
Design of Experiments Guide
Screening Designs
Creating a Screening Design
241
Figure 7.10ReportforScreeningExample
SuppressCotterDesigns,describedinCotterDesignsonpage 247
242
Screening Designs
Creating a Screening Design
Chapter 7
Design of Experiments Guide
NumberofStarts,describedinDesignGenerationonpage 252
NumberofColumnStarts,describedinDesignGenerationonpage 252
Enter Responses
Toenterresponses,followthestepsinFigure 7.11.
1. Toenteroneresponseatatime,clickandthenselectagoaltype.Possiblegoaltypesare
Maximize,Match Target,Minimize,orNone.
2. (Optional)Doubleclicktoedittheresponsename.
3. (Optional)Clicktochangetheresponsegoal.
4. (Optional)Clicktoenterlowerandupperlimitsandimportanceweights.
Figure 7.11EnteringResponses
4
Forresponsessuchasstrengthoryield,thebestvalueisusuallythelargestpossible.A
goalofMaximizesupportsthisobjective.
TheMinimizegoalsupportsanobjectiveofhavingthesmallestvaluebethemostdesirable,
suchaswhentheresponseisimpurityordefects.
TheMatch Targetgoalsupportstheobjectivewhenthebestvalueforaresponseisa
specifictargetvalue,suchasdimensionsofamanufacturedpart.Thedefaulttargetvalue
isassumedtobemidwaybetweenthelowerandupperlimits.
Chapter 7
Design of Experiments Guide
Screening Designs
Creating a Screening Design
243
Note: Ifyourtargetrangeisnotsymmetricaroundthetargetvalue,youcanalterthedefault
targetafteryoumakeatableforthedesign.Inthedatatable,opentheresponsesColumnInfo
dialogbydoubleclickingthecolumnname,andentertheappropriatetargetvalue.
Understanding Importance Weights
Whencomputingoveralldesirability,JMPusesthevaluethatyouenterastheimportance
weight(step4inFigure 7.11)toweighteachresponse.Ifthereisonlyoneresponse,then
specifyingimportanceisunnecessary.Withtworesponses,youcangivegreaterweighttoone
responsebyassigningitahigherimportancevalue.
Enter Factors
Next,youenterfactors.ThisprocessisdescribedinFigure 7.12.
1. Toenteracontinuousfactor,clicktheContinuousbutton.ToenteraDiscrete Numericora
Categoricalfactor,selecttheappropriatenumberoflevelsforthefactorfromthelist.
2. Toenterseveralofonetypeoffactor,enterthenumberoffactorsintheboxnexttoAdd N
Factors.Thenselectthetypeoffactorforwhichyouwanttoaddthespecifiednumberof
factors.
3. Toremoveafactorfromthelist,highlightthefactorandclicktheRemove button.
4. Doubleclicktoeditafactorname.
5. Clicktoenterfactorvalues.
Figure 7.12EnteringFactors
2
1
3
4
Types of Factors
Ingeneral,whendesigningexperiments,youcanenterdifferenttypesoffactorsinthemodel.
Belowisadescriptionoffactortypesfromwhichyoucanchoosewhencreatingscreening
designs:
Continuous Continuousfactorshavenumericdatatypesonly.Intheory,youcanseta
continuousfactortoanyvaluebetweenthelowerandupperlimitsthatyousupply.
244
Screening Designs
Creating a Screening Design
Chapter 7
Design of Experiments Guide
factorcanassumeonlyadiscretenumberofvalues.Thesevalueshaveanimpliedorder.
Thedefaultvaluesforadiscretenumericfactorwithklevels,where k 2 ,aretheintegers
1 2 k .Thedefaultvaluesforadiscretenumericfactorwith k = 2 levelsare1and1.
Replacethedefaultvalueswiththesettingsthatyouplantouseinyourexperiment.
Everylevelofadiscretenumericfactorappearsinthedesignselectedorconstructedusing
theScreeningDesignplatform.
FitModeltreatsadiscretenumericfactorasacontinuouspredictor.Foreachdiscrete
numericfactor,theModelscriptthatissavedtothedesigntablecontainsonlyitsmain
effect.Youcanaddpolynomialtermsforadiscretenumericfactortothemodeleffectslist
intheModelSpecificationwindow.
Categoricalfactors(eithernumericorcategoricaldatatypes)havenoimplied
order.Ifthevaluesarenumbers,theorderisthenumericmagnitude.Ifthevaluesare
character,theorderisthesortingsequence.Thesettingsofacategoricalfactorarediscrete
andhavenointrinsicorder.Examplesofcategoricalfactorsaremachine,operator,and
gender.
Categorical
Afteryouenterresponsesandfactors,clickContinue.
Thisoptionisthedefault.Fordetails,seeChoosefromaListofFractionalFactorial
Designsonpage 244.
Generate orthogonal or near orthogonal designs for main effects only OpenstheDesign
Generationoutlinewhereyoucanspecifythenumberofrunsinthenearorthogonal
design.Fordetailsaboutnearorthogonaldesigns,seeNearOrthogonalDesignson
page 252.
Note: Ifnolistedstandarddesignexistsforyourspecificationoffactors,thentheChoose
ScreeningTypepaneldoesnotappear.TheDesignGenerationoutlineforconstructinga
nearorthogonaldesignopens.
Chapter 7
Design of Experiments Guide
Screening Designs
Creating a Screening Design
245
Design List
Thelistofscreeningdesignsthatyoucanuseincludesdesignsthatgrouptheexperimental
runsintoblocksofequalsizeswherethesizeisapoweroftwo.Highlightthetypeof
screeningdesignthatyouwanttouseandclickContinue.
Figure 7.13ChoosingaTypeofScreeningDesign
Thescreeningdesignerprovidesthefollowingtypesofdesigns:
TwoLevelFullFactorial
Afullfactorialdesignhasrunsforallcombinationsofthelevelsofthefactors.Thesamples
sizeistheproductofthelevelsofthefactors.Fortwoleveldesigns,thisis2kwherekisthe
numberoffactors.Thiscanbeexpensiveifthenumberoffactorsisgreaterthan3or4.
Thesedesignsareorthogonal.Thismeansthattheestimatesoftheeffectsareuncorrelated.If
youremoveaneffectintheanalysis,thevaluesoftheotherestimatesremainthesame.Their
pvalueschangeslightly,becausetheestimateoftheerrorvarianceandthedegreesoffreedom
aredifferent.
Fullfactorialdesignsallowtheestimationofinteractionsofallordersuptothenumberof
factors.Mostempiricalmodelinginvolvesfirstorsecondorderapproximationstothetrue
functionalrelationshipbetweenthefactorsandtheresponses.Thefiguretotheleftin
Figure 7.14isageometricrepresentationofatwolevelfullfactorialdesignwiththreefactors.
TwoLevelRegularFractionalFactorial
Aregularfractionalfactorialdesignalsohasasamplesizethatisapoweroftwo.Ifkisthe
numberoffactors,thenumberofrunsinaregularfractionalfactorialdesignis2kpwherep<
k.Thefractionofthefullfactorialis2p.Likethefullfactorial,regularfractionalfactorial
designsareorthogonal.
Thetradeoffinscreeningdesignsisbetweenthenumberofrunsandtheresolutionofthe
design.Ifpriceisnoobject,youcanrunseveralreplicatesofallpossiblecombinationsofm
factorlevels.Thisprovidesagoodestimateofeverything,includinginteractioneffectstothe
mthdegree.Butbecauserunningexperimentscoststimeandmoney,youtypicallyonlyruna
fractionofallpossiblelevels.Thiscausessomeofthehigherordereffectsinamodelto
becomenonestimable.Aneffectisnonestimablewhenitisconfoundedwithanothereffect,
246
Screening Designs
Creating a Screening Design
Chapter 7
Design of Experiments Guide
meaningthattheeffectscannotbedistinguishedfromeachother.Infact,fractionalfactorials
aredesignedbydecidinginadvancewhichinteractioneffectsareconfoundedwiththeother
interactioneffects.
ResolutionNumber:TheDegreeofConfounding
Inpractice,fewexperimentersworryaboutinteractionshigherthantwowayinteractions.
Thesehigherorderinteractionsareassumedtobezero.
Experimentscanthereforebeclassifiedbyresolutionnumberintothreegroups:
Resolution=3meansthatmaineffectsareconfoundedwithoneormoretwoway
interactions.Forthemaineffectstobemeaningful,theseinteractionsmustbeassumedto
bezero.
Resolution=4meansthatmaineffectsarenotconfoundedwithothermaineffectsor
twofactorinteractions.However,twofactorinteractionsareconfoundedwithother
twofactorinteractions.
Resolution5meansthereisnoconfoundingbetweenmaineffects,betweentwofactor
interactions,orbetweenmaineffectsandtwofactorinteractions.
Aminimumaberrationdesignisoneinwhichthereareaminimumnumberofconfoundings
foragivenresolution.ForDOEexperts,theminimumaberrationdesignofagivenresolution
minimizesthenumberofwordsinthedefiningrelationthatareofminimumlength.
ThefigureontherightinFigure 7.14isageometricrepresentationofatwolevelfractional
factorialdesignwiththreefactors.
Figure 7.14RepresentationofFullFactorial(Left)andTwoLevelFractionalFactorial(Right)
Designs
-1, 1, -1
-1, -1, -1
1, -1, -1
1, 1, -1
1, 1, 1
-1, -1, 1
PlackettBurmanDesigns
PlackettBurmandesignsareanalternativetoregularfractionalfactorialsforscreening.One
usefulcharacteristicisthatthesamplesizeisamultipleoffourratherthanapoweroftwo.
Chapter 7
Design of Experiments Guide
Screening Designs
Creating a Screening Design
247
Therearenotwolevelfractionalfactorialdesignswithsamplesizesbetween16and32runs.
However,thereare20run,24run,and28runPlackettBurmandesigns.
Themaineffectsareorthogonalandtwofactorinteractionsareonlypartiallyconfounded
withmaineffects.Thisisdifferentfromresolutionthreefractionalfactorialwheretwofactor
interactionsareindistinguishablefrommaineffects.
Incasesofeffectsparsity,astepwiseregressionapproachcanallowforremovingsome
insignificantmaineffectswhileaddinghighlysignificantandonlysomewhatcorrelated
twofactorinteractions.TheScreeningplatforminJMP,Analyze>Modeling>Screening,isa
streamlinedapproachforlookingatsparsedata.Thisplatformcanacceptmultipleresponses
andmultiplefactors,thenautomaticallyfitsatwoleveldesignandshowssignificanteffects
withplotsandstatistics.SeeTheScreeningPlatformchapteronpage 261fordetails.
MixedLevelDesigns
Formostdesignsthatinvolvecategoricalordiscretenumericfactorsatthreeormorelevels,
standarddesignsdonotexist.Insuchcases,thescreeningplatformgeneratesmaineffects
screeningdesignsthatareorthogonalornearlyorthogonalformaineffects.
TheDesignListprovidesfractionalfactorialdesignsforpurethreelevelfactorialswithupto
13factors.Formixedtwolevelandthreeleveldesigns,theDesignlistincludesthecomplete
factorialsandspecializedorthogonalarraydesignslistedinTable 7.1.
Ifyournumberoffactorsdoesnotexceedthenumberforadesignlistedinthetable,youcan
usethatdesignbyselectinganappropriatesubsetofcolumnsfromtheoriginaldesign.Some
ofthesedesignsarenotbalanced,eventhoughtheyareallorthogonal.
Table 7.1TableofMixedLevelDesigns
Design
TwoLevel Factors
ThreeLevel Factors
L18John
L18Chakravarty
L18Hunter
L36
11
12
CotterDesigns
Cotterdesignsareusedwhenyouhaveveryfewresourcesandmanyfactors,andyoubelieve
theremightbeinteractions.Supposeyoubelieveineffectsparsitythatveryfeweffectsare
trulynonzero.Youarewillingtobetthatifyouaddupanumberofeffects,thesumwillshow
aneffectifitcontainsanactiveeffect.Thedangeristhatseveralactiveeffectswithmixedsigns
mightcancelandstillsumtonearzeroandgiveafalsenegative.
248
Screening Designs
Creating a Screening Design
Chapter 7
Design of Experiments Guide
Cotterdesignsareeasytosetup.Forkfactors,thereare2k+2runs.Thedesignissimilartothe
varyonefactoratatimeapproachmanybookscallinefficientandnaive.
ACotterdesignbeginswitharunhavingallfactorsattheirhighlevel.Thenfollowkruns
eachwithonefactorinturnatitslowlevel,andtheothershigh.Thenextrunsetsallfactorsat
theirlowlevelandsequencesthroughkmorerunswithonefactorhighandtherestlow.This
completestheCotterdesign,subjecttorandomizingtheruns.
WhenyouuseJMPtogenerateaCotterdesign,thedesignalsoincludesasetofextracolumns
touseasregressors.TheseareoftheformfactorOddandfactorEvenwherefactorisafactor
name.Theyareconstructedbyaddingupalltheoddandeveninteractiontermsforeach
factor.Forexample,ifyouhavethreefactors,A,B,andC:
Table 7.2CotterDesignTable
AOdd=A+ABC
AEven=AB+AC
BOdd=B+ABC
BEven=AB+BC
COdd=C+ABC
CEven=BC+AC
BecausethesecolumnsinaCotterdesignmakeanorthogonaltransformation,testingthe
parametersonthesecombinationsisequivalenttotestingthecombinationsontheoriginal
effects.Intheexampleoffactorslistedabove,AOddestimatesthesumofoddtermsinvolving
A.AEvenestimatesthesumoftheeventermsinvolvingA,andsoon.
BecauseCotterdesignshaveafalsenegativerisk,manystatisticiansdiscouragetheiruse.
HowtoRunaCotterDesign
Bydefault,JMPdoesnotincludeaCotterdesigninthelistofavailablescreeningdesigns
(Figure 7.13).However,ifyouwanttomakeaCotterdesign:
1. Immediatelyafterenteringresponsesandfactors(andbeforeclickingContinue),clickthe
redtriangleiconintheScreeningDesigntitlebar.
2. DeselectSuppress Cotter Designs.(Theoptionisinitiallyselected.)
Changingthesettingviatheredtrianglemenuappliesonlytothecurrentdesign.Toalterthe
settingforallscreeningdesigns:
1. SelectFile > Preferences.
2. ClickthePlatformsicon.
3. ClickDOEtohighlightit.
4. UnchecktheboxbesideSuppress Cotter Designs.
Chapter 7
Design of Experiments Guide
Screening Designs
Creating a Screening Design
249
givennumberoffactors.
Aliasing of Effects Showstheconfoundingpatternforfractionalfactorialdesigns.
Coded Design Showsthepatternofhighandlowvaluesforthefactorsineachrun.
Aliasing of Effects
Toseewhicheffectsareconfoundedwithwhichothereffects,opentheAliasingofEffects
outline.Itshowseffectsandconfoundinguptotwofactorinteractions.
Figure 7.16GeneratingRulesandAliasingofEffectsPanel
Forexample,afullfactorialwithfivefactorsrequires25=32runs.Eightrunscanonly
accommodateafullfactorialwiththreetwolevelfactors.Itisnecessarytoconstructthetwo
additionalfactorsintermsofthefirstthreefactors.
250
Screening Designs
Creating a Screening Design
Chapter 7
Design of Experiments Guide
Thepriceofreducingthenumberofrunsfrom32toeightiseffectaliasing(confounding).
Confoundingisthedirectresultoftheassignmentofnewfactorvaluestoproductsofthe
codeddesigncolumns.
Intheexampleabove,thevaluesforTemperaturearetheproductofthevaluesforFeed Rate
andConcentration.ThismeansthatyoucannottellthedifferenceoftheeffectofTemperature
andthesynergistic(interactive)effectofFeed RateandConcentration.
The+/optionenablesyoutospecifynegativegeneratingrelations.Thisenablesyoutoobtain
differentfractionsofthedesign.Whenyoudeselectthe+/option,thisswitchesthesignsof
thelevelsfordesigncolumnsgeneratedbythefactorsintherelation.
IntheexampleshowninFigure 7.16,allthemaineffectsareconfoundedwithtwofactor
interactions.Thisisanexampleofaresolutionthreedesign.
Look at the Confounding Pattern
JMPcancreateadatatablethatshowsthealiasingpatternforaspecifiedlevel.Tocreatethis
table:
1. ClicktheredtriangleatthebottomoftheAliasingofEffectsarea.
2. Select Show Confounding Pattern(Figure 7.17).
Figure 7.17ShowConfoundingPatterns
3. Entertheorderofconfoundingyouwanttosee(Figure 7.18).
Figure 7.18EnterOrderofConfoundinginTextEditBox
Chapter 7
Design of Experiments Guide
Screening Designs
Creating a Screening Design
251
4. ClickOK.
Figure 7.19showsthethirdorderaliasingforthefivefactorreactorexample.Theeffectnames
beginwithC(Constant)andareshownbytheirordernumberinthedesign.Thus,
Temperatureappearsas4,withsecondorderaliasingas15(Feed RateandConcentration),
andthirdorderconfoundingas123(Feed Rate,Catalyst,andStir Rate).
Figure 7.19TheThirdLevelAliasfortheFiveFactorReactorExample
Temperature
Concentration
Stir Rate
252
Screening Designs
Creating a Screening Design
Chapter 7
Design of Experiments Guide
numberoffactors.TheCodedDesigntableinFigure 7.20showshowthelasttwocolumnsare
constructedintermsofthefirstthreecolumns.ThecheckmarksintheChangeGenerating
RulestableshowninFigure 7.21forTemperaturenowshowitisafunctionofFeed Rate,and
Catalyst.ThecheckmarksforConcentrationshowitisafunctionofFeed Rate andStir Rate.
IfyouchecktheoptionsasshowninFigure 7.21andclickApply,theCodedDesignpanel
changes.Thefirstthreecolumnsofthecodeddesignremainafullfactorialforthefirstthree
factors(Feed Rate,Catalyst,andStir Rate).TemperatureisnowtheproductofFeed Rateand
Catalyst,sothefourthcolumnofthecodeddesignistheelementbyelementproductofthe
firsttwocolumns.ConcentrationisafunctionofFeed RateandStir Rate.
Figure 7.21ModifiedCodedDesignsandGeneratingRules
Design Generation
TheDesignGenerationreportappearswhenyouselecttheoptionGenerate orthogonal or
near orthogonal designs for main effects onlyorwhentherearenostandarddesignsforyour
experimentalsituation.Youcanspecifyanumberofrunsinthepanel,acceptthedefault
number,orselecttheminimumrequirednumber.Anorthogonalornearorthogonaldesignis
constructed.ClickMakeDesigntoseethegenerateddesign.
Near-Orthogonal Designs
Ifanexperimentinvolvescategoricalordiscretenumericfactorsorifthenumberofrunsis
constrained,itmightnotbepossibletoconstructanorthogonaldesignforscreeningmain
effects.However,anearorthogonaldesigncanbeconstructed.SeeLekivetzetal.(2014,in
press).
Chapter 7
Design of Experiments Guide
Screening Designs
Creating a Screening Design
253
Anearorthogonaldesignisadesignwithgoodbalancepropertiesasdescribedbya
Chisquarecriterion.SeeChi2Efficiencyonpage 253.Suchdesignshavedesirablestatistical
propertiesformaineffectmodels.
Thealgorithmusedtogeneratethedesignattemptstoconstructanorthogonalarrayof
strengthtwo.Strengthtwoorthogonalarrayspermitorthogonalestimationofmaineffects
wheninteractionsarenegligible.Thesearraysareidealforscreeningdesigns.Regular
fractionalfactorialdesignsofresolutionthreeandPlackettBurmandesignsareexamplesof
strengthtwoorthogonalarrays.
Considerallpossiblepairsoflevelsforfactorsinthedesign.Thealgorithmattemptsto
balancethenumberofpairsoflevelsasfaraspossible.Giventhatafixednumberofcolumns
hasbeengenerated,anewbalancedcolumnisrandomlyconstructed.Ameasureisdefined
thatreflectsthedegreeofbalanceachievedforpairsthatinvolvethenewcolumn.The
algorithmattemptstominimizethismeasurebyinterchanginglevelswithinthenewcolumn.
Related Options
Youcancontrolcertainaspectsofthealgorithmusingoptionsintheredtrianglemenu:
Number of Starts Specifythemaximumnumberoftimesthatthealgorithmregenerates
entiredesignsfromscratch,attemptingtooptimizetheoveralldesign.
Design Search Time Specifythemaximumnumberofsecondsspentsearchingforadesign.
Thedefaultsearchtimeis15seconds.YoucansetapreferenceforDesignSearchTime(File
> Preferences > Platforms > DOE).
TheprogressbardisplaysChi2Efficiency.SeeChi2Efficiencyonpage 253.
Number of Column Starts Specifythemaximumnumberoftimesthatthealgorithmattempts
tooptimizeagivencolumnbeforemovingontoconstructingthenextcolumn.Thedefault
numberofcolumnstartsis50.
Chi2 Efficiency
Supposethatadesignhasnrunsandpfactorscorrespondingtothecolumnsofthedesign
matrix.
Denotethenumberoftimesthatthecombinationoflevels(a,b)appearsincolumnskandl
by n kl a b .
Ameasureofthelackoforthogonalityevidencedbycolumnskandlisgivenbythefollowing:
2
kl =
sk 1 sl 1
a=0 b=0
n kl a b n s k s l
-------------------------------------------------------n sk sl
254
Screening Designs
Creating a Screening Design
Chapter 7
Design of Experiments Guide
Ameasureoftheaveragenonorthogonalityofthedesignisgivenbythisexpression:
2 =
1klp
kl p p 1 2
Design Evaluation
FordetailsabouttheDesignEvaluationreport,seeDesignEvaluationonpage 476inthe
EvaluateDesignschapter.
Chapter 7
Design of Experiments Guide
Screening Designs
Creating a Screening Design
255
iscreated.Choicesare:
Keep the Same
Therows(runs)intheoutputtableappearastheydointheCoded
Designpanel.
Sort Left to Right
Randomize
Therows(runs)intheoutputtableappearsortedfromlefttoright.
Therows(runs)intheoutputtableappearinarandomorder.
Therows(runs)intheoutputtableappearsortedfromrighttoleft.
design.Acenterpointisarunwhereeverycontinuousfactorissetatthecenterofthe
factorsrange.ThisoptionisnotavailableifyouselectGenerate orthogonal or near
orthogonal designs for main effects only.
Supposethatyourdesignincludesbothcontinuousandcategoricalfactors.Ifyourequest
centerpointsintheOutputOptionspanel,thecenterpointsaredistributedasfollows.The
settingsforthecategoricalfactorsareorderedusingthevalueorderingspecifiedinthe
Factorsoutline.Onecenterpointisassignedtoeachcombinationofthesettingsofthe
categoricalfactorsinorder,andthisisrepeated,untilallcenterpointsareassigned.
Number of Replicates FordesignsfromtheDesignList,specifiesthenumberoftimesto
replicatetheentiredesign,includingcenterpoints.Enterthenumberoftimesyouwantto
replicatethedesignintheassociatedtextbox.Onereplicatedoublesthenumberofruns.
ThisoptionisnotavailableifyouselectGenerate orthogonal or near orthogonal designs for
main effects only.
Note: IfyourequestCenterPointsorReplicatesandclickMakeTablerepeatedly,theseactions
areappliedtothemostrecentlyconstructeddesigntable.
256
Screening Designs
Creating a Plackett-Burman Design
Chapter 7
Design of Experiments Guide
Figure 7.23TheDesignDataTable
Thenameofthetableisthedesigntypethatgeneratedit.RuntheScreeningscripttoscreen
foractiveeffects.ThecolumncalledPatternshowsthepatternoflowvaluesdenotedand
highvaluesdenoted+.Patternisespeciallyusefulasalabelvariableinplots.
Chapter 7
Design of Experiments Guide
Screening Designs
Creating a Plackett-Burman Design
257
Figure 7.24DesignListfor5FactorPlackettBurmanScreeningDesign
5. ClickContinue.
AfteryouselectthedesignfromtheDesignlist,theDisplayandModifyDesignand
DesignEvaluationoutlinesappear.IntheCustomdesigner,youhavetheabilitytoform
anymodeleffectsthatyouwant.TheScreeningdesignercreatesthedesigneffectsbased
onthedesignthatyouchoose.Inparticular,thefullfactorialwithalltwofactor
interactionshasnoaliasingoftheincludedinteractions.
AcompletediscussionoftheDesignEvaluationoptionsisintheEvaluateDesigns
chapteronpage 461.
Tocontinuewiththisexample,dothefollowing:
6. ChooseSort Left to RightintheOutputOptionspanel.
7. ClickMake TabletoseethedesignrunsshowninFigure 7.25.
ExaminethedatatableandnotethePatternvariabletoseethearrangementofplusandminus
signsthatdefinetheruns.Thistableisusedintheanalysissectionsthatfollow.
258
Screening Designs
Creating a Main Effects Screening Design
Chapter 7
Design of Experiments Guide
Figure 7.25Listingofa5FactorPlacketBurmanDesignTable
Chapter 7
Design of Experiments Guide
Screening Designs
Creating a Main Effects Screening Design
259
Figure 7.26ScreeningDesignDialogfor13Factors,withDesignGenerationPanel
TheBackbuttongivesyoutheoptiontoreturntotheResponsesandFactorspanels.Accept
thedefaultnumberofruns(24)andclickMake Design.
TherandomizeddesignisshownaspartoftheScreeningDesignreport.Thealgorithmthat
generatesthedesignisstochastic,sotoreproducethisdesign,youneedtosavethescriptwith
therandomseed.(Todothis,selectSave Script to Script Windowfromtheredtrianglemenu
nexttothereporttitle.)
Toseethatthisspecificdesignisorthogonal,clickthedisclosureiconnexttoDesign
Evaluation.Next,clickthedisclosureiconnexttoColor Map On Correlations.Thecolormap
(Figure 7.27)showsredentriescorrespondingtocorrelationofoneonthemaindiagonal.
Offdiagonalcorrelationsarealldeepblue,indicatingthatcorrelationsbetweenthe
parametersareallzero.
Figure 7.27ColorMaponCorrelations
260
Screening Designs
Creating a Main Effects Screening Design
Chapter 7
Design of Experiments Guide
Chapter 8
The Screening Platform
Analyze Data from Screening Experiments
TheScreeningplatformisamodelingplatformthatyoucanusetoanalyzeexperimentaldata
thatresultsfromascreeningdesign.TheScreeningplatformhelpsyouselectamodelby
identifyingeffectsthathavealargeimpactontheresponse.
TheScreeningplatformisbasedontheprincipleofeffectsparsity(BoxandMeyer,1986).This
principleassertsthatrelativelyfewoftheeffectsthatyoustudyinascreeningdesignare
active.Mostareinactive,meaningthattheirtrueeffectsarezeroandthattheirestimatesare
randomerror.
Ascreeningdesignoftenprovidesnodegreesoffreedomforerror.Consequently,classical
testsforeffectsarenotavailable.Insuchcases,theScreeningplatformisparticularlyuseful.
Figure 8.1HalfNormalPlotfromScreeningReport
Contents
OverviewoftheScreeningPlatform ............................................... 263
AnExampleComparingScreeningandFitModel ................................... 263
LaunchtheScreeningPlatform .................................................... 266
TheScreeningReport............................................................ 267
Contrasts.................................................................... 267
HalfNormalPlot ............................................................. 268
UsingtheFitModelPlatform .................................................. 269
AdditionalScreeningAnalysisExamples ........................................... 270
AnalyzingaPlackettBurmanDesign ........................................... 271
AnalyzingaSupersaturatedDesign............................................. 272
TechnicalDetails................................................................ 274
OrderofEffectEntry.......................................................... 274
ScreeningasanOrthogonalRotation............................................ 274
LenthsPseudoStandardError ................................................. 275
Chapter 8
Design of Experiments Guide
263
Ifyourfactorsarealltwolevelandorthogonal,thenallofthestatisticsintheScreening
platformareappropriate.
Forhighlysupersaturatedmaineffectdesigns,theScreeningplatformiseffectivein
selectingfactors,butisnotaseffectiveatestimatingtheerrororthesignificance.The
MonteCarlosimulationtoproducepvaluesusesassumptionsthatarenotvalidforthis
case.
Ifyouhaveacategoricaloradiscretenumericfactorwithmorethantwolevels,thenthe
Screeningplatformisnotanappropriatewaytoanalyzethedata.JMPtreatsthe
associatedmodeltermsascontinuous.Thevariationforthefactorisscatteredacrossmain
andpolynomialeffectsforthatterm.
Ifyourdataarenotorthogonal,thentheconstructedestimatesaredifferentfromstandard
regressionestimates.JMPcanpickoutbigeffects,butitdoesnoteffectivelytesteach
effect.Thisisbecauselatereffectsareartificiallyorthogonalized,makingearliereffects
lookmoresignificant.
TheScreeningplatformisnotappropriateformixturedesigns.
264
Chapter 8
Design of Experiments Guide
Figure 8.2showstheresultofusingtheFitModelplatform,whereafactorialtodegree2
modelisspecified.Sincetherearenotenoughobservationstoestimateanerrorterm,itisnot
possibletoconductstandardtests.
Figure 8.2TraditionalSaturatedHalf Reactor.jmpDesignOutput
JMPcancalculateparameterestimates,butdegreesoffreedomforerror,standarderrors,
tratios,andpvaluesareallmissing.RatherthanuseFitModel,youcanusetheScreening
platform,whichspecializesingettingthemostinformationoutofthesesituations,leadingto
abettermodel.ThereportfromtheScreeningplatformforthesamedataisshownin
Figure 8.3.
Chapter 8
Design of Experiments Guide
265
NotethefollowingfeaturesoftheScreeningreport:
EstimateslabeledContrast.Effectswhoseindividualpvalueislessthan0.10are
highlighted.
AtratioiscalculatedusingLenthsPSE(pseudostandarderror).TheLenthPSEisshown
belowtheHalfNormalPlot.
Bothindividualandsimultaneouspvaluesareshown.Thosethatarelessthan0.05are
shownwithanasterisk.
TheHalfNormalPlotenablesyoutoquicklyexaminetheeffects.Effectsinitially
highlightedintheeffectslistarealsolabeledinthisplot.
YoucanhighlighteffectsbyclickingonthemintheContrastsoutline.
TheMake ModelbuttonopenstheFitModelwindowandpopulatesitwiththeselected
effects.TheRun Modelbuttonrunsthemodelbasedontheselectedeffects.
266
Chapter 8
Design of Experiments Guide
Forthisexample,Catalyst,Temperature,andConcentration,alongwithtwooftheirtwofactor
interactions,areselected.
3. ClickOK.
TheScreeningreport,showninFigure 8.5,appears.
Chapter 8
Design of Experiments Guide
267
Figure 8.5ScreeningReport
Ifalleffectsareinactive,theirestimatesarerandomnormalnoise.Theirestimates
(contrasts)shouldfallclosetothelineshownintheHalfNormalplotinFigure 8.5.Effects
thatfallfarfromthelinearelikelynotnoise,andsomayrepresentactiveeffects.Notethat
effectswithIndividualpValuesthatfallbelow0.10arehighlightedintheContrasts
outline.TheseeffectsarelabeledintheHalfNormalPlotandthentendtofallfarfromthe
line.
Contrasts
TheContrastsoutlinelistsmodeleffects,acontrastvalueforeacheffect,Lenthtratios
(calculatedasthecontrastvaluedividedbytheLenthPSE(pseudostandarderror),individual
andsimultaneouspvalues,andaliasesifthereareany.Effectsareenteredintotheanalysis
268
Chapter 8
Design of Experiments Guide
followingahierarchicalordering.SeeOrderofEffectEntryonpage 274fordetails.Effects
withIndividualpValuelessthan0.10arehighlighted.
Table 8.1DescriptionoftheContrastsReport
Term
Nameofthefactor.
Contrast
Estimateforthefactor.Fororthogonaldesigns,thisnumberisthe
sameastheregressionparameterestimate.Thisisnotthecasefor
nonorthogonaldesigns.Anasteriskmightappearnexttothe
contrast,indicatingalackoforthogonality.
BarChart
ShowstheLenthtratioswithblueverticallinesindicatingavalue
thatissignificantatthe0.10level.
LenthtRatio
IndividualpValue
Analogoustothestandardpvaluesforalinearmodel.Small
valuesofthisvalueindicateasignificanteffect.RefertoLenths
PseudoStandardErroronpage 275fordetails.
Donotexpectthepvaluestobeexactlythesameiftheanalysisis
rerun.TheMonteCarlomethodshouldgivesimilar,butnot
identical,valuesifthesameanalysisisrepeated.
Simultaneous
pValue
Similartotheindividualpvalue,butmultiplecomparison
adjusted.
Aliases
Appearsonlyifthereareexactaliasesoflatereffectstoearlier
effects.
Chapter 8
Design of Experiments Guide
269
270
Chapter 8
Design of Experiments Guide
embeddedinatableofparameterestimates.Thelastcolumnofthetablehasthepvaluesfor
eacheffect.
Figure 8.7ExampleofaScaledEstimatesReport
A Power Analysis
TheFitModelreporthasoutlinenodesfortheCatalystandTemperature effects.Toruna
poweranalysisforaneffect,clicktheredtriangleicononitstitlebarandselectPower
Analysis.
ThisexampleshowsapoweranalysisfortheCatalystvariable,usingdefaultvaluefor(0.05),
therootmeansquareerrorandparameterestimateforCatalyst,forasamplesizeof12.The
resultingpoweris0.8926,whichmeansthatinsimilarexperiments,youcanexpectan89%
chanceofdetectingasignificanteffectforCatalyst.
Figure 8.8ExampleofaPowerAnalysis
RefertotheFittingLinearModelsbookfordetails.
Chapter 8
Design of Experiments Guide
271
foundintextbookssuchasGiesbrechtandGumpertz(2004)andBox,Hunter,andHunter
(1978).Sevenfactorsarethoughttobeinfluentialonweldquality.Thesevenfactorsinclude
Initial Structure,Bead Size,Pressure Treatment,Heat Treatment,Cooling Rate,Polish,andFinal
Treatment.APlackettBurmandesignwith12runsisusedtoinvestigatetheimportanceofthe
sevenfactors.Theresponseis 100 log lifetime .(Therearealsofourtermsthatwereusedto
modelerrorthatarenotusedinthisanalysis.)
UsingtheScreeningplatform,selecttheseveneffectsasXandLog LifeasY.(Iftermsare
automaticallypopulatedintheScreeningPlatformlaunchwindow,removethefourerror
termslistedaseffects.)ClickOK.Figure 8.9appears,showingonlyasinglesignificanteffect.
Figure 8.9ScreeningReportforWeld-Repaired Castings.jmp
272
Chapter 8
Design of Experiments Guide
Noteasterisksmarkfourterms,indicatingthattheyarenotorthogonaltoeffectspreceding
them,andtheobtainedcontrastvaluewasafterorthogonalization.So,theywouldnotmatch
correspondingregressionestimates.
where~N(0,1).So,Yhasbeenconstructedwiththreeactivefactors.
Todetecttheactivefactors,runtheScreeningplatformwithX1X18asXandYasY.The
reportshowninFigure 8.10appears.
Chapter 8
Design of Experiments Guide
273
Figure 8.10ScreeningReportforSupersaturated.jmp
Notethatthethreeactivefactorshavebeenhighlighted.Oneotherfactor,X18,hasalsobeen
highlighted.ItshowsintheHalfNormalplotclosetotheblueline,indicatingthatitiscloseto
the0.1cutoffsignificancevalue.The0.1criticalvalueisgenerousinitsselectionoffactorsso
youdontmissthosethatarepossiblyactive.
Thecontrastsof5.1,3,and1.8areclosetotheirsimulatedvalues(5,3,2).However,the
similarityofthesevaluescanbeincreasedbyusingaregressionmodel,withouttheeffectof
orthogonalization.
Thepvalues,whileuseful,arenotentirelyvalidstatistically,sincetheyarebasedona
simulationthatassumesorthogonaldesigns,whichisnotthecaseforsupersaturateddesigns.
274
Chapter 8
Design of Experiments Guide
Technical Details
Order of Effect Entry
TheScreeningplatformhasacarefullydefinedorderofoperations.
First,themaineffecttermsenteraccordingtotheabsolutesizeoftheircontrast.Alleffects
areorthogonalizedtotheeffectsprecedingtheminthemodel.Themethodassuresthat
theirorderisthesameasitwouldbeinaforwardstepwiseregression.Orderingbymain
effectsalsohelpsinselectingpreferredaliasedtermslaterintheprocess.
Aftermaineffects,allsecondorderinteractionsarebroughtin,followedbythirdorder
interactions,andsoon.Thesecondorderinteractionscrosswithallearliertermsbefore
bringinginanewterm.Forexample,withsizeorderedmaineffectsA,B,C,andD,B*C
entersbeforeA*D.Ifafactorhasmorethantwolevels,squareandhigherorder
polynomialtermsarealsoconsidered.
Aneffectthatisanexactaliasforaneffectalreadyinthemodelshowsinthealiascolumn.
Effectsthatarealinearcombinationofseveralpreviouseffectsarenotdisplayed.Ifthere
ispartialaliasing(alackoforthogonality)theeffectsinvolvedaremarkedwithanasterisk.
Theprocesscontinuesuntilneffectsareobtained,wherenisthenumberofrowsinthe
datatable,thusfullysaturatingthemodel.Ifcompletesaturationisnotpossiblewiththe
factors,JMPgeneratesrandomorthogonalizedeffectstoabsorbtherestofthevariation.
TheyarelabeledNull nwherenisanumber.Forexample,thissituationoccursifthereare
exactreplicaterowsinthedesign.
Ifnoeffectinthemodelisactiveaftertheintercept,thecontrastsarejustanorthogonal
rotationofrandomindependentvariatesintodifferentrandomindependentvariates.
Thesenewlyorthogonallyrotatedvariateshavethesamevarianceastheoriginalrandom
independentvariates.Totheextentthatsomeeffectsareactive,theinactiveeffectsstill
Chapter 8
Design of Experiments Guide
275
representthesamevariationastheerrorinthemodel.Thehopeisthattheeffectsandthe
designarestrongenoughtoseparatetheactiveeffectsfromtherandomerroreffects.
276
Chapter 8
Design of Experiments Guide
Chapter 9
Response Surface Designs
Responsesurfacedesignsareusefulformodelingacurvedquadraticsurfacetocontinuous
factors.Aresponsesurfacemodelcanpinpointaminimumormaximumresponse,ifone
existsinsidethefactorregion.Threedistinctvaluesforeachfactorarenecessarytofita
quadraticfunction,sothestandardtwoleveldesignscannotfitcurvedsurfaces.
Themostpopularresponsesurfacedesignisthecentralcompositedesign,illustratedinthe
figuretotheleftbelow.Itcombinesatwolevelfractionalfactorialandtwootherkindsof
points:
Centerpoints,forwhichallthefactorvaluesareatthezero(ormidrange)value.
Axial(orstar)points,forwhichallbutonefactoraresetatzero(midrange)andthatone
factorissetatouter(axial)values.
TheBoxBehnkendesign,illustratedinthefigureontherightbelow,isanalternativeto
centralcompositedesigns.OnedistinguishingfeatureoftheBoxBehnkendesignisthatthere
areonlythreelevelsperfactor.
AnotherimportantdifferencebetweenthetwodesigntypesisthattheBoxBehnkendesign
hasnopointsattheverticesofthecubedefinedbytherangesofthefactors.Thisissometimes
usefulwhenitisdesirabletoavoidthesepointsduetoengineeringconsiderations.Theprice
ofthischaracteristicisthehigheruncertaintyofpredictionneartheverticescomparedtothe
centralcompositedesign.
Figure 9.1ResponseSurfaceDesigns
Central Composite Design
Box-Behnken Design
fractional factorial points
axial points
center points
Contents
ABoxBehnkenDesign:TheTennisBallExample .................................... 279
ThePredictionProfiler ........................................................ 282
AResponseSurfacePlot(ContourProfiler)...................................... 284
GeometryofaBoxBehnkenDesign............................................. 286
CreatingaResponseSurfaceDesign ............................................... 286
EnterResponsesandFactors ................................................... 287
ChooseaDesign ............................................................. 287
SpecifyOutputOptions....................................................... 289
ViewtheDesignTable ........................................................ 290
Chapter 9
Design of Experiments Guide
279
Aftertheresponsedataandfactorsdataareloaded,theResponseSurfaceDesignChoice
dialogliststhedesignsinFigure 9.3.(ClickContinuetoseethechoicesontheright.)
280
Chapter 9
Design of Experiments Guide
Figure 9.3ResponseSurfaceDesignSelection
TheBoxBehnkendesignselectedforthreeeffectsgeneratesthedesigntableof15runsshown
inFigure 9.4.
Inreallife,youwouldconducttheexperimentandthenentertheresponsesintothedata
table.SupposeyoucompletedtheexperimentandthefinaldatatableisBounce Data.jmp.
1. OpenBounce Data.jmpfromtheDesign Experiment folderfoundinthesampledata
installedwithJMP(Figure 9.4).
Figure 9.4JMPTableforaThreeFactorBoxBehnkenDesign
AfteropeningtheBounce Data.jmpdatatable,runafitmodelanalysisonthedata.Thedata
tablecontainsascriptlabeledModel,showingintheupperleftpanelofthetable.
2. ClicktheredtrianglenexttoModelandselectRun Scripttostartafitmodelanalysis.
3. WhentheFitModeldialogappears,clickRun.
ThestandardFitModelanalysisresultsappearintablesshowninFigure 9.5,withparameter
estimatesforallresponsesurfaceandcrossedeffectsinthemodel.
Thepredictionmodelishighlysignificantwithnoevidenceoflackoffit.Allmaineffectterms
aresignificantaswellasthetwointeractioneffectsinvolvingSulfur.
Chapter 9
Design of Experiments Guide
281
Figure 9.5JMPStatisticalReportsforaResponseSurfaceAnalysisofBounceData
SeetheFittingLinearModelsbookformoreinformationaboutinterpretationofthetablesin
Figure 9.5.
Note: DOEresponsesurfacedesignsareavailableforuptoeightfactorsonly.IntheDOE
ResponseSurfaceDesignplatform,anerrormessageisgeneratedifmorethaneightfactors
arespecifiedwitharesponsesurfacedesign.Responsesurfacedesignswithmorethaneight
factorscanbegeneratedusingDOE > Custom Design,whereeitheraDoptimaloran
Ioptimaldesigncanbespecified.ForexamplesofusingCustomDesigntocreateresponse
surfacedesigns,seeResponseSurfaceExperimentsonpage 150intheExamplesofCustom
Designschapter.Curvatureanalysisisnotshown(noerrororwarningmessageisgiven)for
responsesurfacedesignsofmorethan20factorswhenusingCustomDesignortheFitModel
platform.
TheResponseSurfacereportalsohasthetablesshowninFigure 9.6.
282
Chapter 9
Design of Experiments Guide
Figure 9.6StatisticalReportsforaResponseSurfaceAnalysis
TheResponseSurfacereportshowsasummaryoftheparameterestimates.
TheSolutionreportliststhecriticalvaluesofthesurfacefactorsandtellsthekindofsolution
(maximum,minimum,orsaddlepoint).Thesolutionforthisexampleisasaddlepoint.The
tablealsowarnsthatthecriticalvaluesgivenbythesolutionareoutsidetherangeofdata
values.
TheCanonicalCurvaturereportshowseigenvaluesandeigenvectorsoftheeffects.The
eigenvectorvaluesshowthatthedominantnegativecurvature(yieldingamaximum)is
mostlyintheSulfurdirection.Thedominantpositivecurvature(yieldingaminimum)is
mostlyintheSilicadirection.ThisisconfirmedbythepredictionprofilerinFigure 9.8.
SeetheFittingLinearModelsbookfordetailsabouttheresponsesurfaceanalysistablesin
Figure 9.6.
Chapter 9
Design of Experiments Guide
283
ThecurrentpredictedvalueofStretch,396,isbasedonthedefaultfactorsetting.Itis
representedbythehorizontaldottedlinethatshowsslightlybelowthedesirabilityfunction
targetvalue(Figure 9.7).TheprofilershowsdesirabilitysettingsforthefactorsSilica,Silane,
andSulfurthatgiveavalueforStretchof396,whichisquitedifferentfromthespecifiedtarget
of450.
Thebottomrowhasaplotforeachfactor,showingitsdesirabilitytrace.Theprofileralso
containsaDesirabilitycolumn,whichgraphsdesirabilityonascalefrom0to1andhasan
adjustabledesirabilityfunctionforeachyvariable.Theoveralldesirabilitymeasureisonthe
leftofthedesirabilitytraces.
Figure 9.7ThePredictionProfiler
2. ToadjustthepredictiontracesofthefactorsandfindaStretchvaluethatisclosertothe
target,clicktheredtriangleonthePredictionProfilertitlebarandselectMaximize
Desirability.Thiscommandadjuststheprofiletracestoproducetheresponsevalueclosest
tothespecifiedtarget(thetargetgivenbythedesirabilityfunction).Therangeof
acceptablevaluesisdeterminedbythepositionsoftheupperandlowerhandles.
Figure 9.8showstheresultofthemostdesirablesettings.Findingmaximumdesirabilityisan
iterativeprocesssoyourresultsmaydifferslightlyfromthoseshownbelow.
284
Chapter 9
Design of Experiments Guide
Figure 9.8PredictionProfilerwithMaximumDesirabilitySetforaResponseSurfaceAnalysis
SeetheProfilersbookforfurtherdiscussionofthePredictionProfiler.
Chapter 9
Design of Experiments Guide
285
Figure 9.9ContourProfilerforaResponseSurfaceAnalysis
EntertheLolimitandHilimitvaluestoshadetheunacceptableregionsinthecontourplot.
Figure 9.10ContourProfilerwithHighandLowLimits
ThePredictionProfilerandtheContourProfilerarediscussedinmoredetailintheProfilers
book.
286
Chapter 9
Design of Experiments Guide
Chapter 9
Design of Experiments Guide
287
EnterResponsesandFactorsonpage 287
ChooseaDesignonpage 287
SpecifyAxialValue(CentralCompositeDesignsOnly)onpage 288
SpecifyOutputOptionsonpage 289
ViewtheDesignTableonpage 290
ClickContinuetoproceedtothenextstep.
Choose a Design
HighlightthetypeofresponsesurfacedesignyouwantandclickContinue.Thenextsections
describethetypesofresponsesurfacedesignsshowninFigure 9.13.
288
Chapter 9
Design of Experiments Guide
Figure 9.13ChooseaDesignType
Box-Behnken Designs
TheBoxBehnkendesignhasonlythreelevelsperfactorandhasnopointsattheverticesof
thecubedefinedbytherangesofthefactors.Thisissometimesusefulwhenitisdesirableto
avoidextremepointsduetoengineeringconsiderations.Thepriceofthischaracteristicisthe
higheruncertaintyofpredictionneartheverticescomparedtothecentralcompositedesign.
Central Composite Designs
Theresponsesurfacedesignlistcontainstwotypesofcentralcompositedesigns:uniform
precisionandorthogonal.Thesepropertiesofcentralcompositedesignsrelatetothenumberof
centerpointsinthedesignandtotheaxialvalues:
Uniformprecisionmeansthatthenumberofcenterpointsischosensothattheprediction
variancenearthecenterofthedesignspaceisveryflat.
Fororthogonaldesigns,thenumberofcenterpointsischosensothatthesecondorder
parameterestimatesareminimallycorrelatedwiththeotherparameterestimates.
Chapter 9
Design of Experiments Guide
289
Figure 9.14DisplayandModifytheCentralCompositeDesign
makesthevarianceofpredictiondependonlyonthescaleddistancefromthe
centerofthedesign.Thiscausestheaxialpointstobemoreextremethantherangeofthe
factor.Ifthisfactorrangecannotbepracticallyachieved,itisrecommendedthatyou
chooseOn Faceorspecifyyourownvalue.
Rotatable
Orthogonal makestheeffectsorthogonalintheanalysis.Thiscausestheaxialpointstobe
moreextremethanthe1or1representingtherangeofthefactor.Ifthisfactorrange
cannotbepracticallyachieved,itisrecommendedthatyouchooseOn Faceorspecifyyour
ownvalue.
On Face leavestheaxialpointsattheendofthe1and1ranges.
User Specified
usesthevalueyouenterintheAxialValuetextbox.
Ifyouwanttoinscribethedesign,clicktheboxbesideInscribe.Whenchecked,JMPrescales
thewholedesignsothattheaxialpointsareatthelowandhighendsoftherange(theaxials
are1and1andthefactorialsareshrunkenbasedonthatscaling).
290
Chapter 9
Design of Experiments Guide
Run Orderprovidesamenuwithoptionsfordesignatingtheorderyouwanttherunsto
appearinthedatatablewhenitiscreated.Menuchoicesare:
Keep the Same therows(runs)intheoutputtablewillappearinthestandardorder.
Sort Left to Right
therows(runs)intheoutputtablewillappearsortedfromlefttoright.
Randomize therows(runs)intheoutputtablewillappearinarandomorder.
Sort Right to Left therows(runs)intheoutputtablewillappearsortedfromrighttoleft.
therows(runs)intheoutputtablewillappearinrandomorder
withintheblocksyousetup.
design.Acenterpointisarunthatislocatedinthecenteroftherangeofeachcontinuous
factor.
Number of Replicates Specifythenumberoftimestoreplicatetheentiredesign,including
centerpoints.Typethenumberoftimesyouwanttoreplicatethedesignintheassociated
textbox.Onereplicatedoublesthenumberofruns.
Thenameofthetableisthedesigntypethatgeneratedit.
RuntheModelscripttofitamodelusingthevaluesinthedesigntable.
Chapter 9
Design of Experiments Guide
291
ThecolumncalledPatternidentifiesthecodingofthefactors.Itshowsallthecodingswith+
forhigh,forlowfactor,aandAforlowandhighaxialvalues,and0formidrange.
Patternissuitabletouseasalabelvariableinplotsbecausewhenyouhoveroverapointina
plotofthefactors,thepatternvalueshowsthefactorcodingofthepoint.Thethreerows
whosevaluesinthePatterncolumnare000arethreecenterpoints.
TherunsinthePatterncolumnareintheorderyouselectedfromtheRun Ordermenu.
TheYcolumnisforrecordingexperimentalresults.
292
Chapter 9
Design of Experiments Guide
Chapter 10
Full Factorial Designs
Afullfactorialdesigncontainsallpossiblecombinationsofasetoffactors.Thisisthemost
foolproofdesignapproach,butitisalsothemostcostlyinexperimentalresources.Thefull
factorialdesignersupportsbothcontinuousfactorsandcategoricalfactorswithuptonine
levels.
Infullfactorialdesigns,youperformanexperimentalrunateverycombinationofthefactor
levels.Thesamplesizeistheproductofthenumbersoflevelsofthefactors.Forexample,a
factorialexperimentwithatwolevelfactor,athreelevelfactor,andafourlevelfactorhas2x
3x4=24runs.
Factorialdesignswithonlytwolevelfactorshaveasamplesizethatisapoweroftwo
(specifically2fwherefisthenumberoffactors).Whentherearethreefactors,thefactorial
designpointsareattheverticesofacubeasshowninthediagrambelow.Formorefactors,the
designpointsaretheverticesofahypercube.
Fullfactorialdesignsarethemostconservativeofalldesigntypes.Thereislittlescopefor
ambiguitywhenyouarewillingtotryallcombinationsofthefactorsettings.
Unfortunately,thesamplesizegrowsexponentiallyinthenumberoffactors,sofullfactorial
designsaretooexpensivetorunformostpracticalpurposes.
Figure 10.1FullFactorialDesign
Contents
TheFiveFactorReactorExample .................................................. 295
AnalyzetheReactorData...................................................... 296
CreatingaFactorialDesign....................................................... 301
EnterResponsesandFactors ................................................... 301
SelectOutputOptions ........................................................ 302
MaketheTable............................................................... 302
Chapter 10
Design of Experiments Guide
295
296
Chapter 10
Design of Experiments Guide
6. ClickContinuetoseetheOutputOptionspanel.IntheOutputOptionspanel,selectSort
Left to RightfromtheRunOrdermenu,asshowntotheright.Thiscommanddefinesthe
orderofrunsastheywillbeinthefinalJMPdesigntable.
7. ClickMake Table.
Thedesigndatatable(Figure 10.3)containsarunforeverycombinationofhighandlow
valuesforthefivevariables,whichcoversallcombinationsoffivefactorswithtwolevelseach.
Sincetherearefivevariables,thereare25=32runs.Initially,thetablehasanemptyYcolumn
namedPercent Reactedforenteringresponsevalueswhentheexperimentiscomplete.
Toseethecompletedexperimentandcontinuethisexample,openReactor 32 Runs.jmpfound
intheDesign Experiment sampledatafolder.
Figure 10.3PartialListingofReactor32Runs.jmpfromtheSampleDataFolder
Chapter 10
Design of Experiments Guide
297
Figure 10.4DistributionofResponseVariableforReactorData
Thisinitialanalysisshowssomeexperimentalrunswithaveryhighpercentreactedresponse.
Starttheformalanalysiswithastepwiseregression.Thedatatablehasascriptstoredwithit
thatautomaticallydefinesananalysisofthemodelwithmaineffectsandalltwofactor
interactions.
4. ClicktheredtriangleiconnexttotheFitModelscriptandselectRun Script.Thestepwise
analysisbeginswiththeStepwiseRegressionControlpanelshowninFigure 10.5.
5. SelectP-value ThresholdfromtheStoppingRulelist.
6. Theprobabilitytoenterafactor(ProbtoEnter)inthemodelshouldbe0.05.
7. Theprobabilitytoremoveafactor(ProbtoLeave)shouldbe0.1.
8. AusefulwaytousetheStepwiseplatformistocheckallthemaineffectsintheCurrent
Estimatestable.However,makesurethatthemenubesideDirectionintheStepwise
RegressionControlpanelspecifiesMixed (seeFigure 10.5).
Figure 10.5StepwiseControlPanel
9. ChecktheboxesforthemaineffectsofthefactorsasshowninFigure 10.6.
298
Chapter 10
Design of Experiments Guide
Figure 10.6StartingModelForStepwiseProcess
10. ClickGo.
Themixedstepwiseprocedureremovesinsignificantmaineffectsandaddsimportant
interactions.TheendresultisshowninFigure 10.7.NotethattheFeed RateandStir Rate
factorsarenolongerinthemodel.
Figure 10.7ModelAfterMixedStepwiseRegression
Chapter 10
Design of Experiments Guide
299
Figure 10.8FittingaPredictionModel
ThefactorPredictionProfileralsogivesyouawaytocomparethefactorsandfindoptimal
settings.
300
Chapter 10
Design of Experiments Guide
1. ToopenthePredictionProfiler,clicktheredtriangleontheResponsePercentReactedtitle
barandselectFactor Profiling > Profiler.
Figure 10.10showstheprofilersinitialdisplay.ThePredictionProfilerisdiscussedin
moredetailinthechapterResponseSurfaceDesignsonpage 277,andintheProfilers
book.
Figure 10.10ViewingtheProfiler
2. ClicktheredtriangleonthePredictionProfilertitlebarandselectMaximize Desirabilityto
seetheprofilerinFigure 10.11.
Figure 10.11ViewingthePredictionProfilesattheOptimumSettings
Chapter 10
Design of Experiments Guide
301
ThegoalistomaximizePercent Reacted.Thereactionisunfeasibleeconomicallyunlessthe
Percent Reactedisabove90%.Percent Reactedincreasesfrom65.5atthecenterofthefactor
rangestoapredictedmaximumof95.8752.96atthemostdesirablesettings.Thebest
settingsofallthreefactorsareattheendsoftheirranges.Futureexperimentscould
investigatewhathappensasyoucontinuemovingfurtherinthisdirection.
EnterResponsesandFactorsonpage 301
SelectOutputOptionsonpage 302
MaketheTableonpage 302
Whenyoufinishaddingfactors,clickContinue.
302
Chapter 10
Design of Experiments Guide
Run Ordergivesoptionstodesignatetheorderyouwanttherunstoappearinthedatatable
whenitiscreated.Choicesare:
Keep the Same therows(runs)intheoutputtablewillappearinthestandardorder.
Sort Left to Right
therows(runs)intheoutputtablewillappearsortedfromlefttoright.
Randomize therows(runs)intheoutputtablewillappearinarandomorder.
Sort Right to Left therows(runs)intheoutputtablewillappearsortedfromrighttoleft.
Addadditionalpointstothedatatablewiththeseoptions:
Number of Center Points Specifieshowmanyadditionalrunstoaddascenterpointstothe
design.Acenterpointisarunthatislocatedinthecenteroftherangeofeachcontinuous
factor.
Number of Replicates Specifythenumberoftimestoreplicatetheentiredesign,including
centerpoints.Typethenumberoftimesyouwanttoreplicatethedesignintheassociated
textbox.Onereplicatedoublesthenumberofruns.
Chapter 10
Design of Experiments Guide
Thenameofthetableisthedesigntypethatgeneratedit.
RuntheModelscripttofitamodelusingvaluesinthedesigntable.
ValuesinthePatterncolumndescribetheruneachrowrepresents.
Forcontinuousfactors,aplussignrepresentshighlevels.
Forcontinuousfactors,aminussignrepresentslowlevels.
Levelnumbersrepresentvaluesofcategoricalfactors.
303
304
Chapter 10
Design of Experiments Guide
Chapter 11
Mixture Designs
Themixturedesignersupportsexperimentswithfactorsthatareingredientsinamixture.You
canchooseamongseveralclassicalmixturedesignapproaches,suchassimplex,extreme
vertices,andlattice.Fortheextremeverticesapproachyoucansupplyasetoflinear
inequalityconstraintslimitingthegeometryofthemixturefactorspace.
Thepropertiesofamixturearealmostalwaysafunctionoftherelativeproportionsofthe
ingredientsratherthantheirabsoluteamounts.Inexperimentswithmixtures,afactorsvalue
isitsproportioninthemixture,whichfallsbetweenzeroandone.Thesumoftheproportions
inanymixturerecipeisone(100%).
Designsformixtureexperimentsarefundamentallydifferentfromthoseforscreening.
Screeningexperimentsareorthogonal.Thatis,overthecourseofanexperiment,thesettingof
onefactorvariesindependentlyofanyotherfactor.Thus,theinterpretationofscreening
experimentsisrelativelysimple,becausetheeffectsofthefactorsontheresponseare
separable.
Withmixtures,itisimpossibletovaryonefactorindependentlyofalltheothers.Whenyou
changetheproportionofoneingredient,theproportionofoneormoreotheringredientsmust
alsochangetocompensate.Thissimplefacthasaprofoundeffectoneveryaspectof
experimentationwithmixtures:thefactorspace,thedesignproperties,andtheinterpretation
oftheresults.
Becausetheproportionssumtoone,mixturedesignshaveaninterestinggeometry.The
feasibleregionfortheresponseinamixturedesigntakestheformofasimplex.Forexample,
considerthreefactorsina3Dgraph.Theplanewherethesumofthethreefactorssumtoone
isatriangleshapedslice.Youcanrotatetheplanetoseethetrianglefaceonandseethepoints
intheformofaternaryplot.
Figure 11.1MixtureDesign
x3
triangular feasible region
x2
x1
Contents
MixtureDesignTypes............................................................ 307
TheOptimalMixtureDesign...................................................... 308
TheSimplexCentroidDesign ..................................................... 309
CreatingtheDesign .......................................................... 309
SimplexCentroidDesignExamples ............................................. 310
TheSimplexLatticeDesign ....................................................... 312
TheExtremeVerticesDesign...................................................... 314
CreatingtheDesign .......................................................... 315
AnExtremeVerticesExamplewithRangeConstraints ............................ 316
AnExtremeVerticesExamplewithLinearConstraints ............................ 318
ExtremeVerticesMethod:HowItWorks ........................................ 319
TheABCDDesign ............................................................... 320
TheSpaceFillingDesign ......................................................... 320
FFFOptimalityCriterion...................................................... 321
SetAverageClusterSize....................................................... 321
LinearConstraints............................................................ 322
ASpaceFillingExample ...................................................... 322
ASpaceFillingExamplewithaLinearConstraint ................................ 322
CreatingTernaryPlots........................................................... 323
FittingMixtureDesigns.......................................................... 324
WholeModelTestsandAnalysisofVarianceReports ............................. 325
UnderstandingResponseSurfaceReports ....................................... 325
AChemicalMixtureExample ..................................................... 326
CreatetheDesign ............................................................ 326
AnalyzetheMixtureModel.................................................... 328
ThePredictionProfiler ........................................................ 329
TheMixtureProfiler .......................................................... 330
ATernaryPlotoftheMixtureResponseSurface .................................. 331
Chapter 11
Design of Experiments Guide
Mixture Designs
Mixture Design Types
307
bewithinthe0to1range.
ABCD Design
generatesascreeningdesignformixturesdevisedbySnee(1975).
constructsadesignthataccommodateslinearconstraints.Designpointsare
spreadthroughoutthedesignspace.
Space Filling
Figure 11.2MixtureDesignSelectionDialog
308
Mixture Designs
The Optimal Mixture Design
Chapter 11
Design of Experiments Guide
Afteryouselectthedesigntype,enterselectionsoracceptdefaultstoadjustthenumberof
runsintheDesignGenerationpanel.ThenclickMake DesignorMake Table,asappropriate.
Thefollowingsectionsdescribeeachmixturedesigntypeandshowexamples.
Chapter 11
Design of Experiments Guide
Mixture Designs
The Simplex Centroid Design
309
However,youcanaddfactorinteractions,specificcrossedfactorterms,powers,orScheff
Cubictermstothemodel.
Toaddinteractiontermstoamodel,clicktheInteractionsbuttonandselect2nd,3rd,4th,
or5th.Forexample,ifyouhavefactors X1and X2,clickInteractions > 2nd andX1*X2is
addedtothelistofmodeleffects.
Toaddcrossedeffectstoamodel,highlightthefactorsandeffectsthatyouwanttocross
andclicktheCrossbutton.
Toaddpowersofcontinuousfactorstothemodel,clickthePowersbuttonandselect2nd,
3rd,4th,or5th.
Whenyouwantamixturemodelwiththirddegreepolynomialterms,theScheff Cubic
buttonprovidesapolynomialspecificationofthesurfacebyaddingtermsoftheform
X1*X2*(X1X2).
allonefactor
allcombinationsoftwofactorsatequallevels
allcombinationsofthreefactorsatequallevels
andsoon,uptokfactorsatatimecombinedatkequallevels.
Acenterpointrunwithequalamountsofalltheingredientsisalwaysincluded.
310
Mixture Designs
The Simplex Centroid Design
Chapter 11
Design of Experiments Guide
Figure 11.4ExampleofFactorSettingsandOutputOptions
7. Specify RunOrder,whichistheorderinwhichtherunsthatappearinthedatatablethat
youwillcreate.Runorderchoicesare:
Keep the Same:Therows(runs)intheoutputtableappearastheydointheFactor
Settingspanel.
Sort Left to Right:Therows(runs)intheoutputtableappearsortedfromlefttoright.
Randomize:Therows(runs)intheoutputtableappearinarandomorder.
Sort Right to Left:Therows(runs)intheoutputtableappearsortedfromrighttoleft.
Randomize within Blocks:Therows(runs)intheoutputtableappearinrandomorder
withintheblocksthatyousetup.
8. SpecifyNumber of Replicates.Thenumberofreplicatesisthenumberoftimestoreplicate
theentiredesign,includingcenterpoints.Enterthenumberoftimesyouwanttoreplicate
thedesignintheassociatedtextbox.Onereplicatedoublesthenumberofruns.
9. ClickMake Table.
Chapter 11
Design of Experiments Guide
Mixture Designs
The Simplex Centroid Design
311
Figure 11.5ThreeFactorSimplexCentroidDesignsofDegrees1and2
TogeneratethetwosetsofrunsinFigure 11.5:
1. ChooseDOE > Mixture Design.
2. Enterthreemixturefactors.
3. ClickContinue.
4. Enter1intheKbox,andclickSimplex CentroidtoseethedesignontheleftinFigure 11.6.
5. ClicktheBackbutton,clickContinue,andthenenter2intheKbox.ThenclickSimplex
CentroidtoseethedesignontherightinFigure 11.6.
Figure 11.6CreateSimplexCentroidDesignsofDegrees1and2
Asanotherexample:
1. ChooseDOE > Mixture Design.
2. EnterfivefactorsandclickContinue.
3. Usethedefaultvalue,4,intheKbox.
4. ClickSimplex Centroid.
5. ClickMake Table.
Figure 11.7showspartofthe31rundesign.Notethatyourtablemightlookdifferent
becausethedesignwascreatedwithRunOrdersettoRandomize.
312
Mixture Designs
The Simplex Lattice Design
Chapter 11
Design of Experiments Guide
Figure 11.7PartialListingofFactorSettingsforFiveFactorSimplexCentroidDesign
Chapter 11
Design of Experiments Guide
Mixture Designs
The Simplex Lattice Design
Figure 11.8ThreeFactorSimplexLatticeDesignsforFactorLevels3,4,and5
Figure 11.9liststherunsforasimplexlatticeofdegree3forfiveeffects.Inthefivelevel
example,therunscreepacrossthehypertriangularregionandfillthespaceinagridlike
manner.
313
314
Mixture Designs
The Extreme Vertices Design
Chapter 11
Design of Experiments Guide
Figure 11.9JMPDesignTableforSimplexLatticewithFiveVariables,Order(Degree)3
Chapter 11
Design of Experiments Guide
Mixture Designs
The Extreme Vertices Design
315
Thegeometricshapeofaregionboundbylinearconstraintsiscalledasimplex.Becausethe
verticesrepresentextremeconditionsoftheoperatingenvironment,theyareoftenthebest
placestouseasdesignpointsinanexperiment.
Youusuallywanttoaddpointsbetweenthevertices.Theaverageofpointsthatsharea
constraintboundaryiscalledacentroidpoint,andcentroidpointsofvariousdegreescanbe
added.Thecentroidpointfortwoneighboringverticesjoinedbyalineisaseconddegree
centroidbecausealineistwodimensional.Thecentroidpointforverticessharingaplaneisa
thirddegreecentroidbecauseaplaneisthreedimensional,andsoon.
316
Mixture Designs
The Extreme Vertices Design
Chapter 11
Design of Experiments Guide
5. ClickExtreme Vertices.
6. SelectSort Left to RightfromtheRun Ordermenu.
7. ClickMake Table.
Figure 11.11showsapartiallistingofaresultingdesign.NotethattheRowspanelinthe
datatableshowsthatthetablehasthedefault116runs.
Chapter 11
Design of Experiments Guide
Mixture Designs
The Extreme Vertices Design
317
Figure 11.11JMPDesignTableforExtremeVerticeswithRangeConstraints
Supposeyouwantfewerruns.Youcangobackandenteradifferentsamplesize(number
ofruns).
8. ClickBackandthenclickContinue.
9. Enter4intheDegreetextboxandclickExtreme Vertices.
10. Inthesamplesizetextbox,enter10asthesamplesize.
11. ClickFind Subset togenerateanoptimalsubsethavingthenumberofrunsspecified.
Theresultingdesign(Figure 11.12)isanoptimal10runsubsetofthe116currentruns.
Thisisusefulwhentheextremeverticesdesigngeneratesalargenumberofvertices.Your
designmightlookdifferent,becausetherearedifferentsubsetsthatachievethesame
Defficiency.
318
Mixture Designs
The Extreme Vertices Design
Chapter 11
Design of Experiments Guide
Figure 11.12JMPDesignTablefor10RunSubsetofthe116CurrentRuns
0.1
0.5
0.1
0.7
0.7
Toentertheseconstraints:
1. Entertheupperandlowerlimitsinthefactorspanel.
2. ClickContinue.
3. ClicktheLinear Constraintbuttonthreetimes.Entertheconstraintsasshownin
Figure 11.13.
4. ClicktheExtreme Verticesbutton.
5. ChangetherunordertoSort Right to Left,andkeepthesamplesizeat13.SeeFigure 11.13
forthedefaultFactorSettingsandcompletedOutputOptions.
6. ClickMake Table.
Chapter 11
Design of Experiments Guide
Mixture Designs
The Extreme Vertices Design
319
Figure 11.13Constraints
Thisexampleisbestunderstoodbyviewingthedesignasaternaryplot,asshownattheend
ofthischapter,inFigure 11.16.Theternaryplotshowshowclosetooneagivencomponentis
byhowcloseitistothevertexofthatvariableinthetriangle.SeeCreatingTernaryPlotson
page 323,fordetails.
320
Mixture Designs
The ABCD Design
Chapter 11
Design of Experiments Guide
feasibleregionisdefinedbynf noftheboundariesandthecentroidofafacedefinedtobe
theaverageoftheverticeslyingonit.Thealgorithmgeneratesallpossiblecombinationsofthe
boundaryconditionsandthenaveragesovertheverticesgeneratedonthefirststep.
panel.
Sort Left to Right:Therows(runs)intheoutputtableappearsortedfromlefttoright.
Randomize:Therows(runs)intheoutputtableappearinarandomorder.
Sort Right to Left:Therows(runs)intheoutputtableappearsortedfromrighttoleft.
Randomize within Blocks:Therows(runs)intheoutputtableappearinrandomorder
withintheblocksthatyousetup.
7. SpecifyNumberofReplicates.Thenumberofreplicatesisthenumberoftimestoreplicate
theentiredesign,includingcenterpoints.Enterthenumberoftimesyouwanttoreplicate
thedesignintheassociatedtextbox.Onereplicatedoublesthenumberofruns.
8. ClickMake Table.
Chapter 11
Design of Experiments Guide
Mixture Designs
The Space Filling Design
321
TworedtriangleoptionsrelatetotheSpaceFillingDesign:
FFF Optimality Criterion FortheFastFlexibleFillingmixturedesigntype,enablesyouto
selectbetweentheMaxProcriterion(thedefault)andtheCentroidcriterion.SeeFFF
OptimalityCriteriononpage 321.
Advanced Options > Set Average Cluster Size FortheFastFlexibleFillingmixturedesign
type,enablesyoutospecifytheaveragenumberofrandomlygeneratedpointsusedto
defineeachclusteror,equivalently,eachdesignpoint.SeeSetAverageClusterSizeon
page 321.
strivestofindpointsintheclustersthatminimizethefollowingcriterion:
C MaxPro =
n1
j = i+1
x ik x jk
k=1
TheMaxProcriterionmaximizestheproductofthedistancesbetweenpotentialdesign
pointsinawaythatinvolvesallfactors.Thissupportsthegoalofprovidinggood
spacefillingpropertiesonprojectionsoffactors.SeeJosephetal.(2014,forthcoming).The
MaxProoptionisthedefault.
Centroid Thismethodplacesadesignpointatthecentroidofeachcluster.Ithastheproperty
thattheaveragedistancefromanarbitrarypointinthedesignspacetoitsclosest
neighboringdesignpointissmallerthanforotherdesigns.
Note: Youcansetapreferencetoalwaysuseagivenoptimalitycriterion.SelectFile >
Preferences > Platforms > DOE.SelectFFFOptimalityCriterionandselectyourpreferred
criterion.
322
Mixture Designs
The Space Filling Design
Chapter 11
Design of Experiments Guide
Bydefault,ifthenumberofRunsfortheSpaceFillingdesigntypeis200orsmaller,atotalof
10,000randomuniformlygeneratedpointsareusedasthebasisfortheclusteringalgorithm.
WhenthenumberofRunsexceeds200,thedefaultvalueis50.Increasingthisvaluecanbe
particularlyusefulindesignswithalargenumberoffactors.
Note: DependingonthenumberoffactorsandthespecifiedvalueforRuns,youmightwant
toincreasetheaveragenumberofinitialpointsperdesignpointbyselectingAdvanced
Options > Set Average Cluster Size.
Linear Constraints
ThedesignregioncanberestrictedbyselectingtheLinear Constraint optionintheLinear
Constraintsoutline.
Whenyouspecifylinearconstraints,therandompointsthatformthebasisfortheclustering
algorithmarerandomlydistributedwithintheconstraineddesignregion.Theclustering
algorithmusesthesepoints.
Chapter 11
Design of Experiments Guide
Mixture Designs
Creating Ternary Plots
323
Figure 11.14SpaceFillingDesignwithOneLinearConstraint
X1 (1, 0, 0)
(1/3, 1/3, 1/3)
(1/2, 1/2, 0)
(0.1, 0.1, 0.8)
X2 (0, 1, 0)
X3 (0, 0, 1)
X2
X3
ThePiepel(1979)examplereferencedinAnExtremeVerticesExamplewithLinear
Constraintsonpage 318isbestunderstoodbytheternaryplotshowninFigure 11.16.
324
Mixture Designs
Fitting Mixture Designs
Chapter 11
Design of Experiments Guide
Toviewamixturedesignasaternaryplot:
1. CreatethePiepelmixturedataasshownpreviously,oropenthetablecalledPiepel.jmp,
foundintheDesignExperimentsfolderoftheSampleDataLibrary.
2. ChooseGraph > Ternary Plot.
3. IntheTernaryPlotlaunchwindow,specifythethreemixturecomponentsandclickOK.
Theternaryplotplatformrecognizesthethreefactorsasmixturefactors,andalsoconsiders
theupperandlowerconstraintsenteredintotheFactorspanelwhenthedesignwascreated.
Theternaryplotusesshadingtoexcludetheunfeasibleareasexcludedbythoseconstraints.
ThePiepeldatahadadditionalconstraints,enteredaslinearconstraintsfortheextreme
verticesdesign.Therearesixactiveconstraints,sixvertices,andsixcentroidpointsshownon
theplot,aswellasthreeinactive(redundant)constraints.Thefeasibleareaistheinnerwhite
polygondelimitedbythedesignpointsandconstraintlines.
Figure 11.16DiagramofTernaryPlotShowingPiepelExampleConstraints
suppressestheintercept
includesallthelinearmaineffectterms
excludesallthesquareterms(suchasX1*X1)
Chapter 11
Design of Experiments Guide
Mixture Designs
Fitting Mixture Designs
325
includesallthecrossterms(suchasX1*X2)
Tofitamodel:
1. ChooseDOE > Mixture Designandmakethedesigndatatable.Tofitamodel,theY
columninthedatatablemustcontainvalues.EitherassignresponsesorselectSimulate
ResponsesfromtheredtrianglemenubeforeyouclickMake Table.
2. Thedesigndatatablestoresthemodelinthedatatableasatableproperty.Thistable
propertyisaJSLscriptcalledModel,locatedintheleftpanelofthetable.
3. RightclickthemodelandselectRun ScripttoopentheFitModellaunchwindow,whichis
automaticallyfilledwiththesavedmodel.
4. ClickRunontheFitModelwindow.
Inthismodel,theparametersareeasytointerpret(Cornell1990).Thecoefficientsonthelinear
termsarethefittedresponseattheextremepointswherethemixtureconsistsofasingle
factor.Thecoefficientsonthecrosstermsindicatethecurvatureacrosseachedgeofthefactor
space.
Themodelreportusuallyhasseveralsectionsofinterest,includingthewholemodeltests,
AnalysisofVariancereports,andresponsesurfacereports,whicharedescribedbelow.
326
Mixture Designs
A Chemical Mixture Example
Chapter 11
Design of Experiments Guide
3. Click Continue.
4. Enter3intheDegreetextbox.
5. ClickExtreme Vertices.
6. Click Make Table.JMPusesthe9factorsettingstogenerateaJMPtable(Figure 11.18).
Chapter 11
Design of Experiments Guide
Mixture Designs
A Chemical Mixture Example
327
Figure 11.18ExtremeVerticesMixtureDesign
7. Addanextrafivedesignrunsbyduplicatingthevertexpointsandcenterpoint,togivea
totalof14rowsinthetable.
Note: Toidentifythevertexpointsandthecenter(orinterior)point,usethesampledata
scriptcalledLabelMixturePoints.jsl intheSampleScriptsfolderinstalledwithJMP.
8. RuntheLabelMixturePoints.jsltoseetheresultsinFigure 11.19,andhighlightthevertex
pointsandtheinteriorpointasshown.
Figure 11.19IdentifyVerticesandCenterPointwithSampleScript
328
Mixture Designs
A Chemical Mixture Example
Chapter 11
Design of Experiments Guide
Figure 11.20Plasticizer.jmpDataTablefromtheSampleDataLibrary
Note: TheseresultscorrectthecoefficientsreportedinCornell(1990).
TheResponseSurfaceSolutionreport(Figure 11.21)showsthatamaximumpredictedvalue
of19.570299occursatpoint(0.63505,0.15568,0.20927).
Chapter 11
Design of Experiments Guide
Mixture Designs
A Chemical Mixture Example
329
Figure 11.21MixtureResponseSurfaceAnalysis
330
Mixture Designs
A Chemical Mixture Example
Chapter 11
Design of Experiments Guide
Figure 11.22InitialPredictionProfiler
Figure 11.23MaximumDesirabilityinProfilerforMixtureAnalysisExample
AternaryplotisusedinsteadofaCartesianplot,whichenablesyoutoviewthreemixture
factorsatatime.
Ifyouhavemorethanthreefactors,radiobuttonsletyouchoosewhichfactorstoplot.
Ifthefactorshaveconstraints,youcanentertheirlowandhighlimitsintheLoLimitand
HiLimitcolumns.Thissettingshadesnonfeasibleregionsintheprofiler.
Chapter 11
Design of Experiments Guide
Mixture Designs
A Chemical Mixture Example
331
332
Mixture Designs
A Chemical Mixture Example
Chapter 11
Design of Experiments Guide
Figure 11.25TernaryPlotLaunchWindow
4. ClickOKandviewtheresults,asshowninFigure 11.26.
Bydefault,theternaryplotshowscontourlinesonly.AddafillbyselectingContour Fill
fromtheTernaryPlotredtrianglemenuandthenselectingFill AboveorFill Below.
Figure 11.26TernaryPlotofaMixtureResponseSurface
Chapter 12
Covering Arrays
Detecting Component Interaction Failures
Coveringarraysareusedintestingdeterministicsystemswherefailuresoccurasaresultof
interactionsamongcomponentsorsubsystems.Thedesigngoalistorevealifanyinteraction
inducesafailureinthesystem.Applicationareasincludesoftware,circuit,andnetwork
design.
Sincethetestsaredeterministic,theemphasisdrivingthedesignistheneedtocoverall
requiredinteractions.TheCoveringArraysplatformconstructshighlyefficientcovering
arrays.Youcanalsoexcludefactorlevelcombinationsthatarenotfeasibleforyourtesting
protocol.
Figure 12.1Strength3CoveringArray
Contents
OverviewofCoveringArrays ..................................................... 335
CoveringArraysandStrength ................................................. 335
ExampleofaCoveringArraywithNoFactorLevelRestrictions....................... 337
CreatetheDesign ............................................................ 337
AnalyzetheExperimentalData ................................................ 339
ExampleofaCoveringArraywithFactorLevelRestrictions .......................... 341
CreatetheDesign ............................................................ 341
AnalyzetheExperimentalData ................................................ 346
CoveringArrayWindow ......................................................... 347
Factors ...................................................................... 347
RestrictFactorLevelCombinations............................................. 349
Design ...................................................................... 351
Metrics ..................................................................... 353
OutputOptions .............................................................. 354
TheCoveringArrayDataTable ................................................ 354
CoveringArrayOptions.......................................................... 356
TechnicalDetails................................................................ 357
AlgorithmforOptimize ....................................................... 357
FormulasforMetrics.......................................................... 357
Chapter 12
Design of Experiments Guide
Covering Arrays
Overview of Covering Arrays
335
Thecostoftestingisusuallyhigh.
Testingfocusesonrevealinginteractionsforwhichfailuresoccur.
Atestrunistypicallydeterministicandresultsineithersuccessorfailure.
Replicaterunsarewastefulbecausetheyyieldidenticalresults.
Theefficiencyofadesignisbasedonhowmanyofthepossibleconditionsarecovered
withoutincludingredundantruns.
Becausesystemstestingisexpensive,reducingtheamountoftestingiscritical.Testingall
possibleinteractionsisusuallyprohibitiveandoftenunnecessary.Experienceshowsthatmost
failuresresultfromtheinteractionofasmallnumberofcomponents.Thesizeofthelargest
combinationofcomponentslikelytodriveafailure,calledthestrength,drivesthesizeofthe
design.
IntheCoveringArrayplatform,youspecifytherequiredstrengthofyourdesign.If
appropriate,youdefinefactorlevelcombinationsthatarenotpermitted.TheCoveringArray
platformconstructsahighlyefficientdesignthatmeetsyourrequirements.Itprovidesmetrics
thatyoucanusetoassessthequalityofthedesignintermsofitscoverage.Italsoprovidesa
scriptinthedatatableforthedesignthatenablesyoutoanalyzeyourresults.
Coveringarraysareoftenusedinsituationswherecertaincombinationsoffactorlevelsettings
arenotfeasible.TheCoveringArrayplatformisabletofindveryefficientcoveringarrays
evenwhenrestrictionsareplacedonfactorlevelcombinations.
Forbackgroundonthestructureofcoveringarraysandalgorithmsforcomputingthem,see
Colbourn(2004),Colbournetal.(2011),HartmanandRaskin(2004),andMartirosyan(2003).
Fordetailsaboutcoveringarrayswithrestrictionsonfactorlevels,seeCohenetal.(2007)and
Morgan(2009).
336
Covering Arrays
Overview of Covering Arrays
Chapter 12
Design of Experiments Guide
Toillustratethenatureofcoveringarrays,considerasituationinvolvingsevencategorical
factorseachwithtwolevels.Youwanttotestallpairwisecombinationsoffactorlevels.
Adesignthatmightbeusedinthissituationisthe8runresolutionIIImaineffectsdesign
givenasfollows:
Figure 12.2AResolutionIIIDesignwithStrength2
Notethatthisdesignisastrength2coveringarraybecauseallpairwisecombinationsoflevels
ofanytwofactorsappear.Forexample,forX1andX2,thefollowingcombinationseach
appeartwice:
L2andL1
L2andL2
L1andL1
L1andL2
However,the6rundesigninFigure 12.3isalsoastrength2coveringarray:
Figure 12.3Strength2CoveringArray
Allpairwisecombinationsoflevelsofanytwofactorsappearandthisisaccomplishedinsix
runs,ratherthaneight.TheCoveringArraydesignismoreefficientthantheResolutionIII
designbecauseitachievesstrength2coverageinfewerruns.
Theefficiencyofacoveringarrayismeasuredbythenumberofrunsrequiredtoachievethe
requiredcoverage.Thesmallerthenumberofruns,themoreefficientthedesign.
Chapter 12
Design of Experiments Guide
Covering Arrays
Example of a Covering Array with No Factor Level Restrictions
337
Web Browser(Safari,IE,Firefox,Chrome,Other)
Operating System(WindowsorMacintosh)
RAM(4,8,or16MB)
Connection Speedatthreesettings(01,15,orgreaterthan5Mbps)
Youareinterestedinfindingoutwhichcombinationsofthesefactorsarelikelytocause
failures.
Theresponseiswhetherthesystemfunctionsproperlyforeachcombinationoffactorsettings.
Testingeachcombinationofsettingswouldrequire90(5x2x3x3)trials.Tokeeptherunsize
manageable,youdecidetorequireStrength3coverage,indicatingthatallcombinationsofany
threefactorsaretested.
5. ClickContinue.
338
Covering Arrays
Example of a Covering Array with No Factor Level Restrictions
Chapter 12
Design of Experiments Guide
TheRestrictFactorLevelCombinationsoutlineopens,whereyoucanenterrestrictionson
thedesignsettings.Becausetherearenorestrictionsforthisdesign,donotchangethe
defaultselectionofNone.
6. ClickMake Design.
TheDesignoutlineopenstoshowa45rundesign.
Figure 12.5DesignandMetricsOutlinesforSoftwareFactors
IntheMetricsoutline,considertherowthatcorrespondstot = 3.TheCoverageis100%,
indicatingthatthedesigncovers100%ofthethreefactorinteractions.Thisiswhatyou
want,becauseyourequestedaStrength3design.Fort = 3,theDiversitycolumnindicates
that68.33%ofthethreefactorinteractionsthatappeararedistinct.Thereissomeminor
repetitionofthreefactorcombinations.
Fort = 4,theCoverageis50%,indicatingthatthedesigncovershalfofthefourfactor
interactions.Thereare90possibledistinctcombinationsofthefourfactorsettings.The45
runsinthedesigncompriseonehalfofthesedistinctcombinations.TheDiversityvalueof
100%reinforcesthefactthatnoneofthefourwayinteractionsarerepeated.
7. ClickMake Table.
Chapter 12
Design of Experiments Guide
Covering Arrays
Example of a Covering Array with No Factor Level Restrictions
339
Figure 12.6DesignTableforSoftwareFactors
Thedesignispresentedinadatatable.NoticethefollowingintheTablepanelatthetopleft:
TheDesignnoteindicatesthatthisisastrength3coveringarray.
TheDOEDialogscriptreproducestheCoveringArraywindowsettings.
TheAnalysisscriptanalyzestheexperimentaldata.
340
Covering Arrays
Example of a Covering Array with No Factor Level Restrictions
Chapter 12
Design of Experiments Guide
TheSummaryoutlineindicatesthatthreetestsfailedandfourtestsdidnotresultinapass
orfailoutcome.
TheFailureAnalysisDetailsoutlinegivesabreakdownoffailuresintermsofthe
associatedthreewayinteractions.Theoutlinelistsonlycombinationsoffactorlevels
wherealltestsresultedinfailure.Ifanytestthatinvolvesagiventhreewaycombination
ofsettingsresultsinsuccess,thenthatthreewaycombinationofsettingscannotbe
responsibleforsystemfailure.
TwofailureswereassociatedwithWeb BrowsersettoFirefox,Operating Systemsetto
Macintosh,andRAMsetto8 MB.Noticethatthiscombinationledtofailureregardlessof
thesettingofConnection Speed.
3. Selectthefirstlineinthe3FactorInteractionsreport.
Figure 12.8SelectionofanInteractionintheAnalysisReport
Thisactionselectsthecorrespondingrowsandcolumnsinthedatatable.
Figure 12.9CorrespondingSelectionofRowsandColumnsintheDataTable
Chapter 12
Design of Experiments Guide
Covering Arrays
Example of a Covering Array with Factor Level Restrictions
341
ThreefailureswereassociatedwithcombinationsofWeb Browser,RAM,and
Connection Speed.Notethattwoofthesefailures,Firefox,8 MB,15 MbpsandFirefox,
8 MB,>5 Mbps,areamongthetwofailuresfortheWeb Browser,Operating System,and
RAMinteraction.Selectinganyoftheserowsinthereportselectsthecorrespondingrows
andcolumnsinthedatatable.
Market:USA,UK,Canada,France,Mexico
NearPhone:ISDN,Bus(Business),Coin,Res(Residential)
NearInterface:AorB
FarPhone:ISDN,Bus(Business),Coin,Res(Residential)
FarInterface:AorB
Youareinterestedinwhichcombinationsofpairsofthesefactorsarelikelytocausefailures.
However,certaincombinationsarenotpossible:
AnISDNlineoneitherphone(NearorFar)cannotuseinterfaceA.
BusinessandResidentiallinesontheoriginatingphone(Near)cannotuseinterfaceB.
342
Covering Arrays
Example of a Covering Array with Factor Level Restrictions
Chapter 12
Design of Experiments Guide
Figure 12.10FactorsOutlineforPhoneFactors
4. ClickContinue.
TheRestrictFactorLevelCombinationsoutlineopens.
Restrict Factor Level Combinations
Youcanspecifydisallowedcombinationsintwoways:
UseDisallowedCombinationsFilter
UseDisallowedCombinationsScript
Thefiltergivesanintuitivewaytospecifydisallowedcombinations.Thescriptprovidesa
quickandeasywaytospecifydisallowedcombinations,butrequiresthatyouhavewrittenor
savedascript.Inthisexample,ifyoudonotwanttospecifycombinationsusingthefilter,skip
toSpecifyDisallowedCombinationsUsingaScriptonpage 344.
Recallthattherestrictionsarethefollowing:
AnISDNlineoneitherphone(NearorFar)cannotuseinterfaceA.
BusinessandResidentialphonesontheoriginatingphone(Near)cannotuseinterfaceB.
Chapter 12
Design of Experiments Guide
Covering Arrays
Example of a Covering Array with Factor Level Restrictions
343
Figure 12.11DisallowedCombinationsPanelShowingFirstConstraints
Bothblocksshouldturndark.YouhaveaddedtheconstraintthatanISDNlineonthe
originatingphone(Near)cannotuseinterfaceA.
4. ClickOR.
5. FromtheAddFilterFactorslist,selectFar PhoneandFar InterfaceandclickAdd.
6. HolddowntheCtrlkeyandclickISDNunderFar PhoneandAunderFar Interface.
YouhaveaddedtheconstraintthatanISDNlineonthereceivingphone(Far)cannotuse
interfaceA.
7. ClickOR.
8. FromtheAddFilterFactorslist,selectNear PhoneandNear InterfaceandclickAdd.
9. HolddowntheCtrlkeyandclickBusandResunderNear PhoneandBunderNear
Interface.
YouhaveaddedtherestrictionthatBusinessandResidentiallinesontheoriginating
phone(Near)cannotuseinterfaceB.
344
Covering Arrays
Example of a Covering Array with Factor Level Restrictions
Chapter 12
Design of Experiments Guide
Figure 12.12CompletedDisallowedCombinationsFilter
Chapter 12
Design of Experiments Guide
Covering Arrays
Example of a Covering Array with Factor Level Restrictions
345
Figure 12.13CompletedDisallowedCombinationsScriptWindow
Note: InDOEplatformsotherthanCoveringArrays,ascriptfordisallowedcombinations
mustspecifythelevelnumberratherthanthelevelname.
Construct the Design Table
Note: SettingtheRandomSeedinthenexttwostepsreproducestheexactresultsshownin
thisexample.Whenconstructingadesignonyourown,thesestepsarenotnecessary.
1. Fromtheredtrianglemenu,selectSet Random Seed.
2. Enter632andclickOK.
3. ClickMake Design.
TheDesignoutlineopenstoshowa20rundesign.AMetricsoutlineisaddedtothe
window.
Figure 12.14MetricsOutlineforPhoneDesign
TheMetricsoutlineindicatesthatStrength2coverageis100%.Thismeansthatall
permissibletwofactorcombinationsarerepresentedinthedesign.Thedesignalsocovers
65%ofallthreefactorcombinations.
4. ClickMake Table.
Thedesignisplacedinadesigntable.Acolumnfortheresponseisprovided,aswellas
variousscripts.
346
Covering Arrays
Example of a Covering Array with Factor Level Restrictions
Chapter 12
Design of Experiments Guide
Figure 12.15CoveringArrayDesignTable
Chapter 12
Design of Experiments Guide
Covering Arrays
Covering Array Window
347
TheSummaryoutlineindicatesthatthreetestsfailed.
TheFailureAnalysisDetailsoutlinecontainsa2FactorInteractionsreport,becausea
twowayinteractionisthelowestlevelinteractionthatdetectsafailure.
The2FactorInteractionsreportshowsthecombinationsthatmighthavecausedthethree
failures.Itispossiblethatonecombination,Near InterfacesettoAandFar Phonesetto
Coin,isresponsibleforallthreefailures.Oritispossiblethattwoorthreeother
combinationscausedthethreefailures.
3. Selectthefirstlineinthe2FactorInteractionsreport.
Inthedatatable,rows1,3,and15areselected.Failuresoccurforthesecombinations,
regardlessofthesettingsforMarket,Near Phone,andFar Interface.Butnotethatother
combinationsoffactorsettingscouldaccountforthesefailuresaswell.
Continue
Factors
AddfactorsintheFactorsoutline.
Figure 12.18FactorsOutline
Make
Design
Design
Metrics
Output Options
Make
Table
348
Covering Arrays
Covering Array Window
Chapter 12
Design of Experiments Guide
EntersthenumberoffactorsspecifiedinAdd N Factors.Allfactorsare
categorical.Selectorspecifythenumberoflevels.
Add Factor
Remove Removestheselectedfactors.
Add N Factors Addsmultiplefactorswithaspecificnumberoflevels.Enterthenumberof
factorstoadd,clickAdd Factor,andselectorspecifythenumberoflevels.RepeatAdd N
Factorstoaddmultiplefactorswithdifferentnumbersoflevels.
Strength t = Selectavaluetospecifythestrengthofthearray.
Name
Role SpecifiestheDesignRoleofthefactor.TheDesignRoleforallcoveringarrayfactorsis
Categorical.TheDesignRolecolumnpropertyforthefactorissavedtothedatatable.This
propertyensuresthatthefactorismodeledappropriately.
Thesettingsforthefactors.ToinsertValues,clickonthedefaultvaluesandenterthe
desiredvalues.Thevalueorderinginthedesigntableistheorderofthevaluesasentered
fromlefttoright.
Values
Toeditafactorname,doubleclickthefactorname.
Categoricalfactorshaveadownarrowtotheleftofthefactorname.Clickthearrowto
addalevel.
Toremoveafactorlevel,clickthevalue,clickDelete,andclickoutsidethetextbox.
Toeditavalue,clickthevalueintheValuescolumn.
Chapter 12
Design of Experiments Guide
Covering Arrays
Covering Array Window
349
showninthedatatableandareusedinplotsandreports.Fordetails,seeValueLabelson
page 591intheColumnPropertiesappendix.
individualfactors.YoucandefinebothANDandORconstraints.SeeUseDisallowed
CombinationsFilteronpage 349.
Use Disallowed Combinations Script Definesdisallowedcombinationsandotherconstraints
asBooleanJSLexpressionsinascripteditorbox.SeeUseDisallowedCombinations
Scriptonpage 351.
Use Disallowed Combinations Filter
ThisoptionusesanadaptationoftheDataFiltertofacilitatespecifyingdisallowed
combinations.FordetailedinformationaboutusingtheDataFilter,seetheUsingJMPbook.
Toadddisallowedcombinations:
1. SelectfactorsfromtheAddFilterFactorslistandclickAdd.
2. Specifythedisallowedcombinationsbyselectinglevels.
Note: TheredtriangleoptionsintheAddFilterFactorsmenuarethesameasthosefoundin
theSelectColumnspanelofmanyplatformlaunchwindows.SeetheUsingJMPbookfor
additionaldetails.
WhenyouclickAdd,theinitialpanelisupdated.TheDisallowedCombinationscontrolpanel
showstheselectedfactorsandprovidesoptionsforfurthercontrol.
TheCoveringArrayplatformallowsonlycategoricalfactors.Forcategoricalfactors,the
possiblelevelsareshowneitheraslabeledblocksor,whenthenumberoflevelsislarge,aslist
entries.Selectaleveltodisallowit.Toselectmultiplelevels,holddowntheCtrlkey.Theblock
orlistentriesarehighlightedtoindicatethelevelsthathavebeendisallowed.Whenyouadda
factortotheDisallowedCombinationspanel,thenumberoflevelsofthecategoricalfactoris
giveninparenthesesfollowingthefactorname.
DisallowedCombinationsOptions
Clearsalldisallowedfactorlevelsettingsthatyouhavespecified.Thisdoesnotclear
theselectedfactors.
Clear
350
Covering Arrays
Covering Array Window
Chapter 12
Design of Experiments Guide
combinationoffactorlevelsspecifiedwithinanANDgroupisdisallowed.
ToaddafactortoanANDgrouplateron,clickthegroupsoutlinetoseeahighlighted
rectangle.SelectANDandaddthefactor.
Toremoveasinglefactor,selectDeletefromitsredtrianglemenu.
OR OpenstheAddFilterFactorslist.SelectedfactorsbecomeaseparateANDgroup.For
ANDgroupsseparatedbyOR,acombinationisdisallowedifitisspecifiedinatleastone
ANDgroup.
RedTriangleOptionsforFactors
AfactorcanappearinseveralORgroups.AnoccurrenceofthefactorinaspecificORgroupis
referredtoasaninstanceofthefactor.
Delete RemovestheselectedinstanceofthefactorfromtheDisallowedCombinationspanel.
Clear Selection
Clearsanyselectionforthatinstanceofthefactor.
Deselectstheselectedvaluesandselectsthevaluesnotpreviouslyselected
forthatinstanceofthefactor.
Invert Selection
Display Options
Changestheappearanceofthedisplay.Optionsincludethefollowing:
Blocks Displayshowseachlevelasablock.
List Displayshowseachlevelasamemberofalist.
Single Category Display showseachlevel.
Check Box Display addsacheckboxnexttoeachvalue.
Find Providesatextboxbeneaththefactornamewhereyoucanenterasearchstringfor
levelsofthefactor.PresstheEnterkeyorclickoutsidethetextboxtoperformthesearch.
OnceFindisselected,thefollowingFindoptionsappearintheredtrianglemenu:
Clear FindclearstheresultsoftheFindoperationandreturnsthepaneltoitsoriginal
state.
Match Caseusesthecaseofthesearchstringtoreturnthecorrectresults.
Containssearchesforvaluesthatincludethesearchstring.
Does not containsearchesforvaluesthatdonotincludethesearchstring.
Starts withsearchesforvaluesthatstartwiththesearchstring.
Ends withsearchesforvaluesthatendwiththesearchstring.
Chapter 12
Design of Experiments Guide
Covering Arrays
Covering Array Window
351
Design
WhenyouclickMakeDesign,theDesignandMetricsoutlinesappear.Fordesignsthat
requireextensivecomputation,aprogressbarappears.
TheDesignoutlineshowsthedesignthatyouhaveconstructed.ThefirstcolumnlistsaRun
order.Youmightneedtousethescrollbartoviewalltheruns.Theremainingcolumnsshow
factorsettingsforeachrun.
Optimize
SelectOptimizetoreducethesizeofadesignthatwasconstructedbytheCoveringArray
platformorthatyouhaveloadedusingtheLoadDesignredtriangleoption.Optimizeisnot
availablefordesignsconstructedbytheCoveringArrayplatformthatareknowntobe
optimal.Inparticular,allunconstrainedstrength2designsfortwolevelfactorsconstructed
bytheplatformareoptimal.Also,anyunconstrainedstrengthtdesignfort+1factorsis
optimalforanyt.
Fordetailsaboutthealgorithm,seeAlgorithmforOptimizeonpage 357.
352
Covering Arrays
Covering Array Window
Chapter 12
Design of Experiments Guide
Note: Optimizeistimeintensive,butcanberunrepeatedlytoyieldincrementallybetter
designs.
UsetheMaximum iterationsoptiontospecifyamaximumnumberofiterationstobeusedin
optimizingthedesign.
Unsatisfiable Constraints
Ifasetofconstraintsprohibitstheconstructionofacoveringarraywhereallrequiredfactor
levelsarerepresented,itissaidtobeunsatisfiable.
ExampleofUnsatisfiableConstraints
Considerastrength2designforthreefactors,eachatthreelevels.
1. SelectDOE > Covering Array.
2. NexttoAdd N Factors,type3.
3. FromtheAdd Factormenu,select3 Level.
4. ClickContinue.
5. SelectUse Disallowed Combinations Filter.
6. FromtheAdd Filter Factorslist,selectallthreefactorsandclickAdd.
7. HolddowntheCtrlkeyandselectthefollowinglevels:
ForX1,selectL1.
ForX2,selectL1,L2,andL3.
ForX3,selectL3.
Figure 12.20CompletedRestrictFactorLevelCombinationsPanel
Chapter 12
Design of Experiments Guide
Covering Arrays
Covering Array Window
353
Note: SettingtheRandomSeedinthenexttwostepsreproducestheexactresultsshownin
thisexample.Whenconstructingadesignonyourown,thesestepsarenotnecessary.
8. FromtheCoveringArrayredtrianglemenu,selectSet Random Seed.
9. Enter12345andclickOK.
10. ClickMake Design.
Figure 12.21DesignandMetricsOutlines
AnotebeneaththeDesignoutlineindicatesthatonerunhasamissingsettingduetothe
constraints.Thatrunisrun11.Toensurethatthecoveringarrayhasstrength2,the
combinationofX1settoL1andX3settoL3isrequired.Butforthesesettings,the
constraintsprohibitallsettingsforX2.
Metrics
TheMetricsoutlinegivesyouinformationabouthowwellthedesignmeetsthestrength
requirements.SeeDalalandMallows(1998)forbackgroundonthesemetricsfor
unconstraineddesigns.
t Thenumberoffactors.
Coverage Theratioofthenumberofdistincttfactorsettingsthatappearinthedesigntothe
totalpossiblenumberoftfactorsettings,expressedasapercent.Atcoverageof100%
354
Covering Arrays
Covering Array Window
Chapter 12
Design of Experiments Guide
indicatesthatallpossibletfactorsettingsarecoveredbythedesign.Notethateachtfactor
settingcanappearmultipletimes.
Forconstrainedandunsatisfiabledesigns,thedefinitionofCoverageisadjustedforthe
numberoftfactorsettingsthatarepossibleoncetheconstraintshavebeenappliedtoall
tfactorcombinations.SeeFormulasforMetricsonpage 357.
Diversity Theratioofthenumberofdistincttfactorsettingsinthedesigntothetotalnumber
ofoccurrencesoftfactorsettingsinthedesign,expressedasapercentage.Thetdiversity
measureshowwellthedesignavoidsreplication.Atdiversityof100%indicatesthatno
tfactorsettingsarerepeated.Atdiversityof50%indicatesthattheaveragenumberof
timesthatdistincttfactorsettingsappearistwo.
Forconstrainedandunsatisfiabledesigns,thedefinitionofDiversityisadjustedforthe
numberofrunswithmissingsettings.SeeFormulasforMetricsonpage 357.
Output Options
Make Table ConstructstheCoveringArraydatatable.
Back TakesyoubacktotheFactorsoutline.Youcanmakechangestothepreviousoutlines
andregeneratethedesign.
Note: IfyouhavedefinedDisallowedCombinationsintheRestrictFactorLevelCombinations
outline,theseareretainedasascript.ThescriptisshownintheUseDisallowedCombinations
ScriptpanelwhenyouclickContinue.
table.
Disallowed Combinations ShowsfactorlevelrestrictionsthatyouenteredintheRestrict
FactorLevelCombinationsoutline.
Analysis Providesananalysisofyourexperimentaldata.Fordetails,seeAnalysisScripton
page 355.Forbackground,seeZhangandZhang(2011).
Tip: Torunascript,selectRun Scriptfromtheredtrianglemenu.
Chapter 12
Design of Experiments Guide
Covering Arrays
Covering Array Window
355
Figure 12.22PartialViewofCoveringArrayTableforSoftwareData.jmpShowingScripts
Analysis Script
TheAnalysisscriptassumesthefollowingabouttheResponsecolumn:
Theresponsesarerecordedas0forfailureand1forsuccess.
Missingvaluesarepermitted.
TheResponsecolumniscontinuous.
YoucanrenameormovetheResponsecolumn.
TheAnalysisscriptproducesareportwithtwooutlines:
TheSummaryoutlinegivesthenumberofrunsresultinginSuccess,Failure,andthe
numberofrunsforwhichtheresponseisMissing.
TheFailureAnalysisDetailsreportcontainsa<k>FactorInteractionsreport.Thevalueofk
isthesmallestnumberofinteractionsthatdetectafailure.(Foradefinitionofdetect,see
CoveringArraysandStrengthonpage 335.)Thethreecolumnscontainthefollowing:
TheFactorscolumnlistsallkfactorcombinationsthatdetectfailures.
TheFailure Levels columnliststhevaluesofthekfactorsintheFactorscolumnthat
detectfailures.
TheFailure Countcolumngivesthenumberoffailurescorrespondingtothekfactor
combinationofFailure Levels.
Note: Afailureobservationcanappearinmorethanoneofthekfactorcombinations
listedintheFailure Levelscolumn.
Therowsinthe<k>FactorInteractionsreportaredynamicallylinkedtothedatatable.Ifyou
selectoneormorerowsinthereport,thecorrespondingrowsareselectedinthedatatable.
356
Covering Arrays
Covering Array Options
Chapter 12
Design of Experiments Guide
levels.Eachfactorscolumncontainsthesecolumnproperties:DesignRole,Value
Ordering,andFactorChanges.SavingfactorsenablesyoutoquicklyloadthemintoaDOE
window.
Note: YoucancreateafactorstableforaCoveringArraybyenteringdataintoanempty
table,butremembertoassigneachcolumnanappropriateDesignRoleofCategorical.
RightclickonthecolumnnameinthedatagridandselectColumn Properties > Design
Role.IntheDesignRolearea,selectCategorical.
LoadsfactorsthatyouhavesavedusingtheSaveFactorsoptionintothe
Factorsoutline.
Load Factors
Loadsadesignfromtheactivedatatable.Ifnodatatableisactive,youare
promptedtoopenone.WhenyouselectLoadDesign,amenuappearsthatenablesyouto
selectthecolumnsthatyouwanttospecifyasfactorsinthedesign.Allcolumnsare
importedascategorical.ColumnsandtheirvaluesarelistedintheFactorsoutline.The
DesignoutlineshowsaRunforeachrowinthedatatableandgivesthevaluesofthe
factorsforeachrun.
Load Design
TheLoadDesignoptionsenablesyoutoobtainmetrics,modify,orconstructanAnalysis
scriptforanexistingdesign:
TheMetricsoutlineshowstCoverageandtDiversityforthespecifieddesign.
YoucanclickBacktoimposefactorlevelrestrictionsandthenconstructanewdesign.
ClickingMake Tableconstructsadesigntablewhereyoucanenterresponses.Thetable
containsanAnalysisscriptforthedesign.
Set Random Seed SetstherandomseedthatJMPusestocontrolcertainactionsthathavea
randomcomponent.ForCoveringArrays,theseedselectsastartingdesignandan
iterationcount.Formostdesigns,therandomseedguaranteesreproducibilityofthe
design,butnotoftherunorder.
Note: Upperlimitsontimeaswellasiterationcountareusedtolimitdesignconstruction
time.Forsomelargeandhighstrengthdesigns,dependingonthemachine,thetimelimit
mightoverridetheiterationlimit.Forsuchdesigns,therandomseedwillnotguarantee
reproducibility.
Toreproduceadesign,entertherandomseedusedtogenerateitbeforeclickingMake
Design.
Chapter 12
Design of Experiments Guide
Covering Arrays
Technical Details
357
Note: TherandomseedassociatedwithadesignisincludedintheDOEDialogscriptthatis
savedtothedesigndatatable.
Advanced Options NotavailableforCoveringArrays.
Save Script to Script Window Createsthescriptforthedesignthatyouspecifiedinthe
CoveringArraywindowandplacesitinanopenscriptwindow.
Technical Details
Algorithm for Optimize
TheOptimizebuttoninvokesanalgorithmthatisconceptuallysimilartoaclassofcovering
arrayoptimizerssometimesreferredtoaspostconstructionrandomizedoptimizers(Nayerietal.,
2013).However,JMPsalgorithmdiffersfrommostinthatitalsoaddressesdesignswith
constraints.Inparticular,itoptimizesconstrainedcoveringarraysaswellasunsatisfiable,
constrainedcoveringarrays.
Thealgorithmassumesthatthedesigntobeoptimizedisacoveringarrayofthespecified
strength.ForaKfactordesignofstrengtht,thealgorithmiterativelyexaminesallKCtfactor
projectionstodeterminewhetherrunscanbeeliminatedormerged.Consequently,asKort
increases,theruntimeofthealgorithmquicklyescalates.Toimproveperformance,theJMP
implementationisthreadedtouseasmanyCPUcoresasareavailableonyourworkstation.
tisthestrengthofthedesign
Kisthenumberoffactors
M = KCt
i = 1,2,..., Misanindexthatordersallcombinations,orprojections,oftfactors
vikisthenumberoflevelsforthekthfactor
niisthenumberofdistinctttuplesinthedesignfortheithprojection
piistheproductofthevikforthefactorsintheithprojection
risthenumberofrunsinthedesign
358
Covering Arrays
Technical Details
Chapter 12
Design of Experiments Guide
Unconstrained Design
CoverageandDiversityaregivenbythefollowing:
1
Coverage = ----M
ni pi
i=1
M
1
Diversity = ----M
ni r
i=1
Constrained Design
Inaconstraineddesign,certainttuplesarenotallowed.Thiscanresultinmissingvaluesfor
somettuples.Forsomecombinationsoftfactors,theremightbenovalidttupleswhatsoever.
Coverageanddiversitymustbedefinedintermsofthepossiblevalidcombinations.Forthis
reason,theformulasforconstraineddesignsrequireadditionalnotation:
aiisthenumberofinvalidttuplesarisingfromfactorsintheithprojection
misthenumberofprojectionswheretherearenovalidttuples
qiisthenumberofrunsinthedesignwithmissingvaluesforanyfactorintheith
projection
r i = r qi
M = M m
CoverageandDiversityaregivenbythefollowing:
1
Coverage = ------M
ni pi ai
i=1
M
1
Diversity = ------M
ni ri
i=1
Chapter 13
Discrete Choice Designs
TheDiscreteChoicedesignercreatesexperimentswithfactorsthatareproductattributes.A
collectionofattributesiscalledaproductprofile.Respondentschooseoneineachsetof
productprofiles.
Industrialexperimentationdealswiththequestionofhowtoimproveprocessestodeliver
betterproducts.Choiceexperimentshelpacompanyprioritizeproductfeaturesfortheir
market.Thepurposeofachoiceexperimentistodefineaproductthatpeoplewanttobuy.
Choiceexperimentsalwaysinvolvepeoplecomparingprospectiveproductsandpickingthe
onethattheyprefer.Forexample,supposeacomputercompanywantstoupdateitshighend
laptop.Laptopshavemanyfeaturesthatareimportanttocustomerssuchasprocessorspeed,
harddisksize,screensize,batterylife,andprice.Tobuildalaptopthatcustomerswant,the
computercompanyneedstoknowtherelativeimportanceofeachfeature.Mostpeopleprefer
afastercomputerwithmorestorage,longerbatterylife,andalowprice.Whatthecompany
doesnotknowishowmuchbatterylifeorharddisksizeisasimportantasdoublingthe
processorspeedworthtoacustomer.Achoiceexperimentcananswerthesequestionsand
indicatetheoptimalsetoftradeoffsamongproductfeatures.
Contents
CreateaChoiceDesignwithNoPriorInformation................................... 361
CreateanExampleChoiceExperiment ............................................. 361
CreateaChoiceDesignandAnalyzetheData ....................................... 365
CreateaChoiceExperimentforaPilotStudy .................................... 367
AnalyzethePilotStudyData .................................................. 370
DesignaChoiceExperimentUsingPriorInformation............................. 372
AdministertheSurveyandAnalyzeResults ..................................... 374
ChoiceDesignOptions........................................................... 377
Chapter 13
Design of Experiments Guide
361
Grindsize(mediumorcoarse)
Temperature(195,200,205)
Brewingtime(3minutes,3.5minutes,or4minutes)
Charge(1.6grams/ounce,2grams/ounce,or2.4grams/ounce)
Everyparticipantcouldsampleeverypossiblecombinationofcupsofcoffee,butthiswould
notbeefficientoreconomical.Instead,eachparticipantcanindicatehisorherpreferencein
severalchoicesets.Inthesimplestdesign,eachchoicesetwouldhaveonlytwocupsofcoffee
tochoosebetween.Analysisofthepreferencesofmultiplerespondentscanbeusedtodraw
conclusionsabouthowtomakeacupofcoffeethatpleasesmostcustomers.
Inthiscoffeeexperiment,fourrespondentschoosetheirpreferencebetweenthreesetsoftwo
cupsofcoffeeeach.Thisisrepeatedseventimesforatotalof21responsesperrespondent.
Thegoalistogivethecoffeeshopthemostimportantinformationfortheleasttimeand
expense.Thus,eachrespondenttastescupsofcoffeethatarethebestrepresentationsofthe
factorsathand.
362
Figure 13.1ChoiceDesignWindowwithAttributesDefined
2. ClickContinue.
3. IntheModelpanel,opentheDOEModelControlsoutline.
Chapter 13
Design of Experiments Guide
Chapter 13
Design of Experiments Guide
363
Figure 13.2ChoiceDesignWindow
364
Chapter 13
Design of Experiments Guide
Figure 13.3SurveyResultsBasedonaSimpleModelandDefaultPriorInformation
Chapter 13
Design of Experiments Guide
365
Figure 13.4ChoiceProfilesforExperimentDesign
Figure 13.5ChoiceRunsforExperimentDesign
YoucannowanalyzetheseresultsusingtheChoiceplatformintheAnalyzemenu(Analyze>
Consumer Research>Choice).SeeConsumerResearchbookfordetails.
366
Chapter 13
Design of Experiments Guide
customerpreferencebeforebeginninganexpensivedevelopmentprocess.Theydecideto
examinepreferencesforfourpossiblelaptopattributes.
sizeofharddrivedisk(40GBor80GB)
speedofprocessor(1.5GHzor2.0GHz)
batterylife(4Hrsor6Hrs)
costofcomputer($1000,$1200or$1500)
Table 13.1showshypotheticalresultsfromasinglesurveydesignedtocollectinformation
aboutconsumerpreferencesforlaptopcomputers.
Eachcolumninthesurveyidentifiesalaptopattribute.
Eachlineinthesurveydefinesalaptopprofile,whichisacollectionofattributevalues.
Eachchoicesetconsistsoftwoattributeprofiles.
Alloftheattributevaluesareallowedtochangeacrossthetwoprofilesinachoiceset.
Table 13.1HypotheticalChoiceSurveyResultsfromaSingleRespondent,SubjectID2
For each pair, please check the combination of attributes that you find most
appealing.
Disk Size
Speed
Battery Life
Price
Preference
40 GB
1.5 GHz
6 hours
$1,000
_X_
80 GB
1.5 GHz
4 hours
$1,200
___
40 GB
1.5 GHz
4 hours
$1,500
___
80 GB
2.0 GHz
4 hours
$1,200
_X_
40 GB
2.0 GHz
4 hours
$1,200
_X_
80 GB
2.0 GHz
6 hours
$1,500
___
40 GB
2.0 GHz
4 hours
$1,000
_X_
80 GB
1.5 GHz
6 hours
$1,200
___
40 GB
1.5 GHz
6 hours
$1,000
_X_
40 GB
2.0 GHz
4 hours
$1,500
___
Chapter 13
Design of Experiments Guide
367
Table 13.1HypotheticalChoiceSurveyResultsfromaSingleRespondent,SubjectID
For each pair, please check the combination of attributes that you find most
appealing.
Disk Size
Speed
Battery Life
Price
Preference
40 GB
2.0 GHz
6 hours
$1,200
_X_
80 GB
1.5 GHz
4 hours
$1,500
___
40 GB
2.0 GHz
6 hours
$1,500
___
80 GB
1.5 GHz
4 hours
$1,000
_X_
40 GB
1.5 GHz
4 hours
$1,200
___
80 GB
2.0 GHz
4 hours
$1,000
_X_
TheDOEChoicedesignercancreateasurveylikethatshowninTable 13.1.However,tocreate
aneffectivedesign,theChoicedesignerneedsinformationabouttheattributes.Forexample,
mostlaptopattributeshavevaluesthatareintrinsicpreferences.Thatis,abiggerdisksizeis
better,longerbatterylifeisbetter,andsoon.Thepurposeofconductingachoicesurveyisto
findouthowpotentiallaptoppurchasersfeelabouttheadvantagesofacollectionof
attributes.
Onewaytogainpriorinformationaboutsurveyattributesistoconductasingleexample
surveyandusetheresultsaspriorinformationtocreatethefinalsurvey.
Thischaptershowshowtocreateasamplesurveyforapilotstudyanduseitsresultsasprior
informationforafinalsurveydesign.
368
Chapter 13
Design of Experiments Guide
Figure 13.6ChoiceDesignWindowwithAttributesDefined
2. ClickContinue.Forthisexample,usethedefaultvaluesintheDOEModelControlsand
DesignGenerationpanels,asshowninFigure 13.7.
Figure 13.7DesignGenerationPanelfortheLaptopExperiment
Note: Recallthatthisfirstexampleisusedtogeneratepriorinformation,thenusedto
createamorerealisticsurvey.Thisexampleisasinglesurveygiventoasinglerespondent.
3. ClickMake DesigntoseetheexamplesurveyresultsinFigure 13.8.
Youcanseethatthereareeightchoicesets,eachconsistingoftwolaptopprofiles.
Chapter 13
Design of Experiments Guide
369
Figure 13.8SurveyResultsBasedonaSimpleModelandDefaultPriorInformation
370
Chapter 13
Design of Experiments Guide
Figure 13.9JMPDataTableforPreliminaryLaptopChoiceSurvey
Chapter 13
Design of Experiments Guide
371
inasingletable.FordetailsaboutusingtheChoiceanalysisplatform,seetheChoice
platformchapterintheConsumerResearchbook.
Figure 13.11ChoiceModelFittingDialog
2. ClickRun ModelontheChoicemodelfittingwindow.
3. Anadditionalwindowthenappears,askingifthisisaonetableanalysiswithallthedata
intheProfileTable,whichisthecaseinthissamplesurvey.ClickYes inthiswindowto
continue.
TheanalysisshowsasinFigure 13.12.
Todesignthefinalchoicesurveyusingpriorinformation,youneedtoenterestimatesof
themeanandvarianceoftheattributeparameterestimates.Theanalysisonthetopin
Figure 13.12hasestimatesoftheattributemeans,calledEstimate,andestimatesofthe
standarddeviationoftheattributes,called Std Error.Aneasywaytoseethevarianceofthe
attributesistocapturetheanalysisinaJMPtableandcomputethevariance.
4. RightclicktheParameterEstimatesreportandselectMake into Data Tablefromthemenu,
asshown.
5. InthenewUntitleddatatable,createanewcolumnandcallitVar.
6. SelectFormula fromtheColsmenu(Cols>Formula),orrightclicktheVarcolumnand
selectFormula.
7. IntheFormulaEditor,clicktheStd Errorcolumninthecolumnlistandclicktheexponent
button( )ontheformulaeditorpaneltocomputethevarianceshownontherightin
Figure 13.12.
372
Chapter 13
Design of Experiments Guide
Figure 13.12AnalysisoftheSampleLaptopSurvey
Thispreliminarysurveywithitsanalysisgivesyoutheinformationneededtodesignafinal
surveyappropriateforgatheringinformationfrommultiplerespondents.Keepinmindthat
inarealsituation,youmighthavepriorinformationaboutfactorattributesandnotneedtodo
asampledesign.
Note: LeavetheUntitleddatatablewiththemeanandvarianceinformationopentobeusedin
thenextexample.
Chapter 13
Design of Experiments Guide
373
3. NowenterthevaluesfromtheJMPtablecreatedbythepreviousanalysisintothePrior
MeanandPriorVarianceMatrixpanelsoftheChoiceDesignwindow,asshownin
Figure 13.13.Youcancopyandpastetotransferthevaluesfromthedatatabletothe
Choicewindowpanels.
Figure 13.13EnterPriorMeanandVarianceInformationfromPreliminarySurvey
374
Chapter 13
Design of Experiments Guide
Figure 13.15DesignRunsforTwoChoiceSurveys
6. ClickMake Table.Thefinaldatatablehasrunsfortensurveyrespondents,givingatotalof
160observations(2profiles*8choicesets*2surveys*5respondents=160observations).
Chapter 13
Design of Experiments Guide
375
Figure 13.16ChoiceModelFittingWindowtoAnalyzetheLaptopSurvey
3. ClickRun ModelontheFitModelwindow.Thequeryagainappears,askingiftheanalysis
isaonetableanalysiswithallthedataintheprofiletable.ClickYestoseetheinitial
analysisresultshowninFigure 13.17.
Theresultsareclear.Alloftheeffectsaresignificant(ormarginallysignificantforBattery
Life),andthemostsignificantattributeisSpeed.
Figure 13.17InitialAnalysisoftheFinalLaptopSurvey
376
Chapter 13
Design of Experiments Guide
Find Unit Cost and Trade Off Costs with the Profiler
Youwouldliketoknowhowchangingtheprice,orothercharacteristics,ofalaptopaffectsthe
desirabilityasperceivedbypotentialbuyers.Thisdesirabilityiscalledtheutilityvalueofthe
laptopattributes.Theprofilershowstheutilityvalueandhowitchangesasthelaptop
attributeschange.
1. SelectProfilerfromthemenuontheChoiceModeltitlebartoseethePredictionProfilerin
Figure 13.18.
Figure 13.18DefaultPredictionProfilerforLaptopChoiceAnalysis
Wheneachattributevalueissettoitslowestvalue,theUtilityvalueis0.3406.Thefirst
thingthatyouwanttoknowistheunitutilitycost.
2. Tofindtheunitutilitycost,movethetraceforPriceto$1,500andnotehowtheUtility
valuechanges.
ComparetheUtilityvaluesinFigure 13.18andFigure 13.19.ThevalueofUtilitychanges
from0.3406to2.3303whencostisraisedfrom$1,000to$1,500.Thatis,raisingtheprice
ofalaptop$500.00lowerstheutility(ordesirability)approximately2units.Thus,youcan
saythattheunitutilitycostisapproximately$250.00.
Figure 13.19CompareChangeinUtilityOverPrice
Withthisunitutilitycostestimate,youcannowvarytheotherattributes,notethechange
inutility,andfindanapproximatedollarvalueassociatedwiththatattributechange.For
example,themostsignificantattributeisspeed(seeFigure 13.17).
Chapter 13
Design of Experiments Guide
377
3. InthePredictionProfiler,setPricetoitslowestvalueandchangeSpeedtoitshighervalue.
YoucanseeinFigure 13.20thattheUtilityvaluechangesfromtheoriginalvalueshownin
Figure 13.18of0.3406to0.9886,foratotalchangeof1.3292units.Iftheunitutilitycostis
estimatedtobe$250.00,asshownabove,thentheincreaseinpricefora2.0GHzlaptop
overa1.5GHzlaptopcanbecomputedtobe1.3292*$250.00=$332.30.Thisisthedollar
valuetheChoicesurveyprovidesthemanufacturerasabasisforpricingdifferentlaptop
products.Youcanmakesimilarcalculationsfortheotherattributes.
Figure 13.20ChangeSpeedinProfilerandNoteUtilityValue
ThissimpleChoicesurveyanditsanalysisshowshowthiskindifinformationcanbeusedto
helpmanufacturersandretailersidentifyimportantproductattributesandassignvaluesto
them.
TheChoicedesignerallowsmorecomplexdesigns,suchasdesignswithinteractionsand
otherterms.TheChoiceanalysisplatformcanbeusedtoanalyzecomplexdesigns,anditcan
beusedtoincorporatedatafrommultipledatasetsthatincludedemographicinformation
abouttherespondents.
TheDOEModelControlsenableyoutospecifypotentialmaineffectsandinteractions.In
somesituations,youmightexpectthereareinteractionsandwanttogenerateprofilesets
thathelpdetectthem.YoucanusetheDOEModelControlspaneltoaddinteractionsto
thechoicemodel.
Toaddaninteraction,clicktheInteractionsbutton.Allpossibleinteractionsload.After
addingtheinteraction,theDOEModelControlspanelcollapses.Ifyoudonotwantto
testalloftheinteractions,opentheDOEModelControlspanel,highlightthe
interactionsthatyoudonotwant,andclicktheRemove Termbutton.
ThePriorSpecificationpanelenablesyoutoenterpriormeansandvariancesaswedidin
thelaptopexample.
378
Chapter 13
Design of Experiments Guide
YoucanspecifyaspectsofyourdesignwiththeDesignGenerationpanel.
Numberofattributesthatcanchangewithinachoiceset: Thisisusuallythetotal
numberofattributes,orvariables,youareexamining.Youcanenterfewerthanthe
totalnumberofattributestoconstrainthetotalnumberthatcanbechangedwithina
choiceset.Thismightbeareasonablethingtodoifyouhadalargenumberof
attributesandyouwanttomakeiteasierfortherespondentstomakeachoice.For
example,asurveymightbeinterestedin20ormoreattributesofacellphone,butshow
andchangeonly5orfewerattributesinachoiceset.
Numberofprofilesperchoiceset:Thenumberofitemsthatarecomparedforeach
preferencetest.Youcandesignchoiceexperimentswithmorethantwoprofilesina
choiceset.
Numberofchoicesetspersurvey:Thenumberofpreferencesthatyouwanttogetfrom
eachrespondent.
Numberofsurveys:Youmightwanttogenerateseveralversionsofthesurveyto
administertomultiplerespondents.
Expectednumberofrespondentspersurvey:Thetotalnumberofrespondentsforeach
survey.Ifyouhave100respondentsand4differentsurveys,youwouldhave25
respondentspersurvey.
Chapter 14
Space-Filling Designs
Spacefillingdesignsareusefulinsituationswhereruntorunvariabilityisoffarlessconcern
thantheformofthemodel.Considerasensitivitystudyofacomputersimulationmodel.In
thissituation,andforanymechanisticordeterministicmodelingproblem,anyvariabilityis
smallenoughtobeignored.Forsystemswithnovariability,replication,randomization,and
blockingareirrelevant.
TheSpaceFillingplatformprovidesdesignsforsituationswithbothcontinuousand
categoricalfactors.Forcontinuousfactors,spacefillingdesignshavetwoobjectives:
maximizethedistancebetweenanytwodesignpoints
spacethepointsuniformly
Figure 14.1SpaceFillingDesign
Contents
OverviewofSpaceFillingDesigns................................................. 381
SpaceFillingDesignWindow ..................................................... 382
Responses ................................................................... 382
Factors ...................................................................... 384
DefineFactorConstraints ..................................................... 386
SpaceFillingDesignMethods .................................................. 390
Design ...................................................................... 390
DesignDiagnostics........................................................... 390
DesignTable................................................................. 390
SpaceFillingDesignOptions ..................................................... 391
SpherePackingDesigns .......................................................... 393
CreatingaSpherePackingDesign .............................................. 393
VisualizingtheSpherePackingDesign .......................................... 394
LatinHypercubeDesigns......................................................... 396
CreatingaLatinHypercubeDesign............................................. 396
VisualizingtheLatinHypercubeDesign......................................... 397
UniformDesigns ................................................................ 399
ComparingSpherePacking,LatinHypercube,andUniformMethods .................. 401
MinimumPotentialDesigns ...................................................... 402
MaximumEntropyDesigns....................................................... 404
GaussianProcessIMSEOptimalDesigns........................................... 406
FastFlexibleFillingDesigns ...................................................... 407
FFFOptimalityCriterion...................................................... 407
SetAverageClusterSize....................................................... 407
Constraints .................................................................. 408
CreatingandViewingaConstrainedFastFlexibleFillingDesign ................... 408
BoreholeModel:ASpherePackingExample ........................................ 410
CreatetheSpherePackingDesignfortheBoreholeData........................... 411
GuidelinesfortheAnalysisofDeterministicData................................. 412
Chapter 14
Design of Experiments Guide
Space-Filling Designs
Overview of Space-Filling Designs
381
spacingofthelevelsofeachfactor.Thismethodproducesdesignsthatmimictheuniform
distribution.TheLatinHypercubemethodisacompromisebetweentheSpherePacking
methodandtheUniformdesignmethod.
minimizesthediscrepancybetweenthedesignpoints(whichhaveanempirical
uniformdistribution)andatheoreticaluniformdistribution.
Uniform
Minimum Potential
spreadspointsoutinsideaspherearoundthecenter.
Maximum Entropy
measurestheamountofinformationcontainedinthedistributionofaset
ofdata.
Gaussian Process IMSE Optimal createsadesignthatminimizestheintegratedmeansquared
erroroftheGaussianprocessovertheexperimentalregion.
Fast Flexible Filling TheFastFlexibleFillingmethodformsclustersfromrandompointsin
thedesignspace.Theseclustersareusedtochoosedesignpointsaccordingtoan
optimizationcriterion.Thisistheonlymethodthatcanaccommodatecategoricalfactors
andconstraintsonthedesignspace.Youcanspecifylinearconstraintsanddisallowed
382
Space-Filling Designs
Space Filling Design Window
Chapter 14
Design of Experiments Guide
combinations.SeeCreatingandViewingaConstrainedFastFlexibleFillingDesignon
page 408andseeFFFOptimalityCriteriononpage 407.
Continue
Space Filling
Design Methods
Design
Design Diagnostics
Make
Table
ThissectiondescribestheoutlinesintheSpaceFillingDesignwindow.
Responses
UsetheResponsesoutlinetospecifyoneormoreresponses.
Figure 14.3ResponsesOutline
Chapter 14
Design of Experiments Guide
Space-Filling Designs
Space Filling Design Window
383
TheResponsesoutlinecontainsthefollowingbuttons:
EntersasingleresponsewithagoaltypeofMaximize,MatchTarget,
Minimize,orNone.IfyouselectMatchTarget,enterlimitsforyourtargetvalue.Ifyou
selectMaximizeorMinimize,enteringlimitsisnotrequiredbutcanbeuseful.
Add Response
Remove Removestheselectedresponses.
Entersadditionalresponsessothatthenumberthatyouenteristhe
totalnumberofresponses.IfyouhaveenteredaresponseotherthanthedefaultY,the
GoalforeachoftheadditionalresponsesistheGoalassociatedwiththelastresponse
entered.Otherwise,theGoaldefaultstoMatchTarget.ClicktheGoaltypeinthetableto
changeit.
Number of Responses
Response Name
response,minimizeyourresponse,matchatarget,orthatyouhavenoresponsegoal.JMP
assignsaResponseLimitscolumnproperty,basedonthesespecifications,toeachresponse
columninthedesigntable.Itusesthisinformationtodefineadesirabilityfunctionforeach
response.TheProfilerandContourProfilerusethesedesirabilityfunctionstofindoptimal
factorsettings.Forfurtherdetails,seetheProfilersbookandResponseLimitson
page 562intheColumnPropertiesappendix.
AGoalofMaximizeindicatesthatthebestvalueisthelargestpossible.Ifthereare
naturallowerorupperbounds,youcanspecifytheseastheLowerLimitorUpper
Limit.
AGoalofMinimizeindicatesthatthebestvalueisthesmallestpossible.Ifthereare
naturallowerorupperbounds,youcanspecifytheseastheLowerLimitorUpper
Limit.
AGoalofMatchTargetindicatesthatthebestvalueisaspecifictargetvalue.The
defaulttargetvalueisassumedtobemidwaybetweentheLowerLimitandUpper
Limit.
AGoalofNoneindicatesthatthereisnogoalintermsofoptimization.Nodesirability
functionisconstructed.
384
Space-Filling Designs
Space Filling Design Window
Chapter 14
Design of Experiments Guide
Note: IfyourtargetresponseisnotmidwaybetweentheLowerLimitandtheUpper
Limit,youcanchangethetargetafteryougenerateyourdesigntable.Inthedatatable,
opentheColumnInfowindowfortheresponsecolumn(Cols>Column Info)andenterthe
desiredtargetvalue.
Importance Whenyouhaveseveralresponses,theImportancevaluesthatyouspecifyare
usedtocomputeanoveralldesirabilityfunction.Thesevaluesaretreatedasweightsfor
theresponses.Ifthereisonlyoneresponse,thenspecifyingtheImportanceisunnecessary
becauseitissetto1bydefault.
EditingtheResponsesOutline
IntheResponsesoutline,notethefollowing:
Doubleclickaresponsetoedittheresponsename.
Clickthegoaltochangeit.
Clickonalimitorimportancevaluetochangeit.
Formultipleresponses,youmightwanttoentervaluesfortheimportanceweights.
Factors
AddfactorsintheFactorsoutline.
Chapter 14
Design of Experiments Guide
Space-Filling Designs
Space Filling Design Window
385
Figure 14.4FactorsOutline
TheFactorsoutlinecontainstheseoptions:
Continuous EntersthenumberofcontinuousfactorsspecifiedinAdd N Factors.
Categorical
EntersthenumberofnominalfactorsspecifiedinAdd N Factors.
Remove Removestheselectedfactors.
Add N Factors Addsmultiplefactorsofagiventype.Enterthenumberoffactorstoaddand
clickContinuousorCategorical.RepeatAdd N Factorstoaddmultiplefactorsofdifferent
types.
Tip: WhenyouhavecompletedyourFactorspanel,selectSave Factorsfromtheredtriangle
menu.Thissavesthefactornamesandvaluesinadatatablethatyoucanlaterreload.See
SpaceFillingDesignOptionsonpage 391.
Factors Outline
TheFactorsoutlinecontainsthefollowingcolumns:
Name Thenameofthefactor.Whenadded,afactorisgivenadefaultnameofX1,X2,andso
on.Tochangethisname,doubleclickitandenterthedesiredname.
Role SpecifiestheDesignRoleofthefactor.TheDesignRolecolumnpropertyforthefactor
issavedtothedatatable.Thispropertyensuresthatthefactortypeismodeled
appropriately.
Theexperimentalsettingsforthefactors.ToinsertValues,clickonthedefaultvalues
andenterthedesiredvalues.
Values
EditingtheFactorsOutline
IntheFactorsoutline,notethefollowing:
Toeditafactorname,doubleclickthefactorname.
386
Space-Filling Designs
Space Filling Design Window
Chapter 14
Design of Experiments Guide
Categoricalfactorshaveadownarrowtotheleftofthefactorname.Clickthearrowto
addalevel.
Toremoveafactorlevel,clickthevalue,clickDelete,andclickoutsidethetextbox.
Toeditavalue,clickthevalueintheValuescolumn.
Factor Types
Continuous Numericdatatypesonly.Acontinuousfactorisafactorthatyoucan
conceptuallysettoanyvaluebetweenthelowerandupperlimitsyousupply,giventhe
limitationsofyourprocessandmeasurementsystem.
Eithernumericorcharacterdatatypes.Foracategoricalfactor,thevalue
orderingistheorderofthevaluesasenteredfromlefttoright.Thisorderingissavedina
ValueOrderingcolumnpropertyafterthedesigndatatableiscreated.
Categorical
specifyindefiningthefactordeterminesthevalueofitsDesignRolecolumnproperty.The
DesignRolepropertyreflectshowthefactorisintendedtobeusedinmodelingthe
experimentaldata.DesignRolevaluesareusedintheAugmentDesignplatform.
Factor Changes EachfactorisassignedtheFactorChangescolumnpropertywithasettingof
Easy.Inscreeningdesigns,itisassumedthatfactorlevelscanbechangedforeach
experimentalrun.FactorChangesvaluesareusedintheEvaluateDesignandAugment
Designplatforms.
IftheRoleisContinuous,theCodingcolumnpropertyforthefactorissaved.This
propertytransformsthefactorvaluessothatthelowandhighvaluescorrespondto1and
+1,respectively.TheestimatesandtestsintheFitLeastSquaresreportarebasedonthe
transformedvalues.
Coding
IftheRoleisCategoricalorBlocking,theValueOrderingcolumnpropertyfor
thefactorissaved.Thispropertydeterminestheorderinwhichlevelsofthefactorappear.
Value Ordering
Chapter 14
Design of Experiments Guide
Space-Filling Designs
Space Filling Design Window
387
OnlyavailableforfactorswithaRoleofContinuousorMixture.SeeSpecifyLinear
Constraints.
Use Disallowed Combinations Filter Definessetsofconstraintsbasedonrestrictingvaluesof
individualfactors.YoucandefinebothANDandORconstraints.SeeUseDisallowed
CombinationsFilter.
Use Disallowed Combinations Script Definesdisallowedcombinationsandotherconstraints
asBooleanJSLexpressionsinascripteditorbox.SeeUseDisallowedCombinations
Script.
Specify Linear Constraints
Incaseswhereitisimpossibletovarycontinuousfactorsindependentlyoverthedesign
space,youcanspecifylinearinequalityconstraints.Linearinequalitiesdescribefactorlevel
settingsthatareallowed.
ClickAddtoenteroneormorelinearinequalityconstraints.
Add Addsatemplateforalinearexpressioninvolvingallthecontinuousfactorsinyour
design.Entercoefficientvaluesforthefactorsandselectthedirectionoftheinequalityto
reflectyourlinearconstraint.Specifytheconstrainingvalueintheboxtotherightofthe
inequality.Toaddmoreconstraints,clickAddagain.
Note: TheAddoptionisdisabledifyouhavealreadyconstrainedthedesignregionby
specifyingaSphereRadius.
Remove Last Constraint Removesthelastconstraint.
Checkstheconstraintsforconsistency.Thisoptionremovesredundant
constraintsandconductsfeasibilitychecks.AJMPalertappearsifthereisaproblem.If
constraintsareequivalenttoboundsonthefactors,aJMPalertindicatesthattheboundsin
theFactorsoutlinehavebeenupdated.
Check Constraints
388
Space-Filling Designs
Space Filling Design Window
Chapter 14
Design of Experiments Guide
WhenyouclickAdd,theDisallowedCombinationscontrolpanelshowstheselectedfactors
andprovidesoptionsforfurthercontrol.Factorsarerepresentedasfollows,basedontheir
modelingtypes:
Continuous Factors Foracontinuousfactor,adoublearrowsliderthatspanstherangeof
factorsettingsappears.Anexpressionthatdescribestherangeusinganinequalityappears
abovetheslider.Youcanspecifydisallowedsettingsbydraggingthesliderarrowsorby
clickingontheinequalityboundsintheexpressionandenteringyourdesiredconstraints.
Intheslider,asolidbluehighlightrepresentsthedisallowedvalues.
Categorical Factor Foracategoricalfactor,thepossiblelevelsaredisplayedeitheraslabeled
blocksor,whenthenumberoflevelsislarge,aslistentries.Selectaleveltodisallowit.To
selectmultiplelevels,holdtheControlkey.Theblockorlistentriesarehighlightedto
indicatethelevelsthathavebeendisallowed.Whenyouaddacategoricalfactortothe
DisallowedCombinationspanel,thenumberoflevelsofthecategoricalfactorisgivenin
parenthesesfollowingthefactorname.
DisallowedCombinationsOptions
Thecontrolpanelhasthefollowingcontrols:
Clearsalldisallowedfactorlevelsettingsthatyouhavespecified.Thisdoesnotclear
theselectedfactors.
Clear
combinationoffactorlevelsspecifiedwithinanANDgroupisdisallowed.
ToaddafactortoanANDgrouplateron,clickthegroupsoutlinetoseeahighlighted
rectangle.SelectANDandaddthefactor.
Toremoveasinglefactor,selectDeletefromitsredtrianglemenu.
OR OpenstheAddFilterFactorslist.SelectedfactorsbecomeaseparateANDgroup.For
ANDgroupsseparatedbyOR,acombinationisdisallowedifitisspecifiedinatleastone
ANDgroup.
RedTriangleOptionsforFactors
AfactorcanappearinseveralORgroups.AnoccurrenceofthefactorinaspecificORgroupis
referredtoasaninstanceofthefactor.
Delete RemovestheselectedinstanceofthefactorfromtheDisallowedCombinationspanel.
Clear Selection
Clearsanyselectionforthatinstanceofthefactor.
Deselectstheselectedvaluesandselectsthevaluesnotpreviouslyselected
forthatinstanceofthefactor.
Invert Selection
Chapter 14
Design of Experiments Guide
Space-Filling Designs
Space Filling Design Window
389
Availableonlyforcategoricalfactors.Changestheappearanceofthedisplay.
Optionsinclude:
Display Options
Blocks Displayshowseachlevelasablock.
List Displayshowseachlevelasamemberofalist.
Single Category Display showseachlevel.
Check Box Display addsacheckboxnexttoeachvalue.
Availableonlyforcategoricalfactors.Providesatextboxbeneaththefactornamewhere
youcanenterasearchstringforlevelsofthefactor.PresstheEnterkeyorclickoutsidethe
textboxtoperformthesearch.OnceFindisselected,thefollowingFindoptionsappearin
theredtrianglemenu:
Find
Clear FindclearstheresultsoftheFindoperationandreturnsthepaneltoitsoriginal
state.
Match Caseusesthecaseofthesearchstringtoreturnthecorrectresults.
Containssearchesforvaluesthatincludethesearchstring.
Does not containsearchesforvaluesthatdonotincludethesearchstring.
Starts withsearchesforvaluesthatstartwiththesearchstring.
Ends withsearchesforvaluesthatendwiththesearchstring.
Use Disallowed Combinations Script
UsethisoptiontodisallowparticularcombinationsoffactorlevelsusingaJSLscript.This
optioncanbeusedwithcontinuousfactorsormixedcontinuousandcategoricalfactors.
Thisoptionopensascriptwindowwhereyouinsertascriptthatidentifiesthecombinations
thatyouwanttodisallow.ThescriptmustevaluateasaBooleanexpression.Whenthe
expressionevaluatesastrue,thespecifiedcombinationisdisallowed.
Whenformingtheexpressionforacategoricalfactor,usetheordinalvalueofthelevelinstead
ofthenameofthelevel.Ifafactorslevelsarehigh,medium,andlow,specifiedinthatorder
intheFactorsoutline,theirassociatedordinalvaluesare1,2,and3.Forexample,supposethat
youhavetwocontinuousfactors,X1andX2,andacategoricalfactorX3withthreelevels:L1,
L2,andL3,inorder.Youwanttodisallowlevelswherethefollowingholds:
e
X1
+ 2X 2 0andX 3 = L2
390
Space-Filling Designs
Space Filling Design Window
Chapter 14
Design of Experiments Guide
Figure 14.5ExpressioninScriptEditor
(Inthefigure,unnecessaryparentheseswereremovedbyparsing.)Noticethatfunctionscan
beenteredaspartoftheBooleanexpression.
SpherePackingDesignsonpage 393
LatinHypercubeDesignsonpage 396
UniformDesignsonpage 399
MinimumPotentialDesignsonpage 402
MaximumEntropyDesignsonpage 404
GaussianProcessIMSEOptimalDesignsonpage 406
FastFlexibleFillingDesignsonpage 407
Design
TheDesignoutlineshowstherunsforthespacefillingscreeningdesign.
Design Diagnostics
TheDesignDiagnosticsoutlineshowsthevaluesforthefactorsscaledfromzerotoone.The
MinimumDistanceisbasedonthesescaledvaluesandistheminimumdistancefromeach
pointtoitsnearestneighbor.TherownumberforthenearestneighborisgivenintheNearest
Pointcolumn.Thediscrepancyvalueshownbelowthetableistheintegrateddifference
betweenthedesignpointsbasedandauniformdistribution.
Design Table
Make Table ConstructstheSpaceFillingDesigndatatable.
Back TakesyoubacktowhereyouwerebeforeclickingMake Design.Youcanmakechanges
tothepreviousoutlinesandregeneratethedesign.
Chapter 14
Design of Experiments Guide
Space-Filling Designs
Space Filling Design Options
391
Save Responses
Load Responses
LoadsresponsesthatyouhavesavedusingtheSaveResponsesoption.
levels.Afactorscolumncontainscolumnpropertiesassociatedwiththefactor.Saving
factorsallowsyoutoquicklyloadthemintoaDOEwindow.
Note: Itispossibletocreateafactorstablebytypingdataintoanemptytable,but
remembertoassigneachcolumnanappropriateDesignRole.Dothisbyrightclickingon
thecolumnnameinthedatagridandselectingColumn Properties > Design Role.Inthe
DesignRolearea,selecttheappropriaterole.
Load Factors
LoadsfactorsthatyouhavesavedusingtheSaveFactorsoption.
definedintheDefineFactorConstraintsorLinearConstraintsoutline.TheSave
Constraintsoptioncreatesadatatablethatcontainsacolumnforeachconstraint.Saving
constraintsallowsyoutoquicklyloadthemintoaDOEwindow.
Theconstrainttablecontainsacolumnforeachlinearconstraint.Thefirstrowscontainthe
coefficientsforeachfactor.Thelastrowcontainstheinequalitybound.Eachconstraints
columncontainsacolumnpropertycalledConstraintStatethatidentifiestheconstraintasa
lessthanoragreaterthanconstraint.SeeColumnPropertiesonpage 559inthe
ColumnPropertiesappendix.
(Unavailableforsomeplatforms)Loadsfactorconstraintsthatyouhave
savedusingtheSaveConstraintsoption.
Load Constraints
randomcomponent.Theseactionsinclude:
simulatingresponsesusingtheSimulateResponsesoption
randomizingRunOrderfordesignconstruction
392
Space-Filling Designs
Space Filling Design Options
Chapter 14
Design of Experiments Guide
selectingastartingdesignfordesignsbasedonrandomstarts.
Toreproduceadesignorsimulatedresponses,entertherandomseedusedtogenerate
them.Fordesignsusingrandomstarts,settheseedbeforeclickingMakeDesign.To
controlsimulatedresponsesorrunorder,settheseedbeforeclickingMakeTable.
NotethattherandomseedassociatedwithadesignisincludedintheDOEDialogscript
thatissavedtothedesigndatatable.
Addsresponsevaluestothedesigntablethatisgenerated.Selectthis
optionbeforeyouclickMakeTable.InthedesigntablethatresultsfromclickingMake
Table,theresponsecolumnscontainsimulatedvalues.
Simulate Responses
Forcertaintypesofdesigns,aSimulateResponseswindowliststhecoefficientsanderror
standarddeviationusedtosimulatetheresponsevalues.Youcanreplacethesecoefficients
andclickApplytoseeyoursimulatedresponsevaluesinthedatatable.Thedefaultvalues
forthecoefficientsareeither1or1.Thedefaultvaluefortheerrorstandarddeviationis1.
SomeplatformsallowyoutosetAnticipatedCoefficientsaspartofPowerAnalysisunder
DesignEvaluation.Fortheseplatforms,thedefaultvaluesintheSimulateResponses
windowarethevaluesthatyouspecifyasAnticipatedCoefficientsandAnticipatedRMSE
(ErrorStd)inthePowerAnalysisoutline.Ifitisnotpossibletofitthemodelspecifiedin
thedatatablesModelscript,theinterceptandcoefficientshavedefaultvaluesof0.
Note: Youcansetapreferencetoalwayssimulateresponses.SelectFile > Preferences >
Platforms > DOE.CheckSimulateResponses.
FFF Optimality Criterion FortheFastFlexibleFillingdesignmethod,enablesyoutoselect
betweentheMaxProcriterion(thedefault)andtheCentroidcriterion.SeeFFFOptimality
Criteriononpage 407.
Number of Starts Specifiesthenumberoftimesthatthealgorithmforthechosendesigntype
initiatestoconstructanewdesign.Thebestdesign,basedonthecriterionforthegiven
designtype,isreturned.Setto1bydefaultforalldesigntypes.NotusedforFastFlexible
FillingDesigns.
Advanced Options > Set Average Cluster Size FortheFastFlexibleFillingdesignmethod,
enablesyoutospecifytheaveragenumberofrandomlygeneratedpointsusedtodefine
eachclusteror,equivalently,eachdesignpoint.
Save Script to Script Window Createsthescriptforthedesignthatyouspecifiedinthe
CustomDesignplatformandsavesitinanopenscriptwindow.
Chapter 14
Design of Experiments Guide
Space-Filling Designs
Sphere-Packing Designs
393
Sphere-Packing Designs
TheSpherePackingdesignmethodmaximizestheminimumdistancebetweenpairsofdesign
points.Theeffectofthismaximizationistospreadthepointsoutasmuchaspossibleinside
thedesignregion.
4. ClickContinue.
5. Inthedesignspecificationdialog,specifyasamplesize(Number of Runs).Figure 14.7
showsasamplesizeofeight.
394
Space-Filling Designs
Sphere-Packing Designs
Chapter 14
Design of Experiments Guide
Figure 14.7SpaceFillingDesignDialog
6. ClickSphere Packing.
JMPcreatesthedesignanddisplaysthedesignrunsandthedesigndiagnostics.
Figure 14.8showstheDesignDiagnosticspanelopenwith0.518astheMinimum Distance.
Yourresultsmightdifferslightlyfromtheonesbelow,buttheminimumdistanceisthe
same.
Figure 14.8SpherePackingDesignDiagnostics
7. ClickMake Table.Usethistabletocompletethevisualizationexample,describednext.
Createanoverlayplot.
Adjusttheplotsframesize.
Chapter 14
Design of Experiments Guide
Space-Filling Designs
Sphere-Packing Designs
395
AddcirclesusingtheminimumdistancefromthediagnosticreportshowninFigure 14.8
astheradiusforthecircles.
Example
Usingthetableyoujustcreated,proceedasfollows:
1. SelectGraph > Overlay Plot.
2. SpecifyX1asXandX2asY,andthenclickOK.
3. Adjusttheframesizesothattheframeissquarebyrightclickingtheplotandselecting
Size/Scale > Size to Isometric.
4. RightclicktheplotandselectCustomize.WhentheCustomizepanelappears,clickthe
plussigntoseeatexteditareaandenterthefollowingscript:
For Each Row(Circle({:X1, :X2}, 0.518/2))
where0.518istheminimumdistancenumberthatyounotedintheDesignDiagnostics
panel.Thisscriptdrawsacirclecenteredateachdesignpointwithradius0.259(halfthe
diameter,0.518),asshownontheleftinFigure 14.9.ThisplotshowstheefficientwayJMP
packsthedesignpoints.
5. Nowrepeattheprocedureexactlyasdescribedintheprevioussection,butwithasample
sizeof10insteadofeight.
Remembertochange0.518 inthegraphicsscripttotheminimumdistanceproducedby
10runs.Whentheplotappears,againsettheframesizeandcreateagraphicsscriptusing
theminimumdistancefromthediagnosticreportasthediameterforthecircle.Youshould
seeagraphsimilartotheoneontherightinFigure 14.9.Notetheirregularnatureofthe
spherepacking.Infact,youcanrepeattheprocessathirdtimetogetaslightlydifferent
picturebecausethearrangementisdependentontherandomstartingpoint.
Figure 14.9SpherePackingExamplewithEightRuns(left)and10Runs(right)
396
Space-Filling Designs
Latin Hypercube Designs
Chapter 14
Design of Experiments Guide
4. ClickContinue.
5. Inthedesignspecificationdialog,specifyasamplesize(Number of Runs).Thisexample
usesasamplesizeofeight.
Chapter 14
Design of Experiments Guide
Space-Filling Designs
Latin Hypercube Designs
397
Createanoverlayplot
Adjusttheplotsframesize
Addcirclesusingtheminimumdistancefromthediagnosticreportastheradiusforthe
circle
Example
1. CreateanotherLatinHypercubedesignusingthedefaultX1and X2factors.
2. Besuretochangethefactorvaluessothattheyare0and1insteadofthedefault1and1.
3. ClickContinue.
4. Specifyasamplesizeofeight(Number of Runs).
5. ClickLatin Hypercube.FactorsettingsanddesigndiagnosticsareshowninFigure 14.12.
398
Space-Filling Designs
Latin Hypercube Designs
Chapter 14
Design of Experiments Guide
Figure 14.12LatinHypercubeDesignwithTwoFactorsandEightRuns
6. ClickMake Table.
7. SelectGraph > Overlay Plot.
8. SpecifyX1asXandX2asY,andthenclickOK.
9. RightclicktheplotandselectSize/Scale > Size to Isometrictoadjusttheframesizesothat
theframeissquare.
10. Rightclicktheplot,selectCustomizefromthemenu.IntheCustomizepanel,clickthe
largeplussigntoseeatexteditarea,andenterthefollowingscript:
For Each Row(Circle({:X1, :X2}, 0.404/2))
where0.404istheminimumdistancenumberthatyounotedintheDesignDiagnostics
panel(Figure 14.12).Thisscriptdrawsacirclecenteredateachdesignpointwithradius
0.202(halfthediameter,0.404),asshownontheleftinFigure 14.13.Thisplotshowsthe
efficientwayJMPpacksthedesignpoints.
11. Repeattheaboveprocedureexactly,butwith10runsinsteadofeight(step5).Remember
tochange0.404inthegraphicsscripttotheminimumdistanceproducedby10runs.
YoushouldseeagraphsimilartotheoneontherightinFigure 14.13.Notetheirregular
natureofthespherepacking.Infact,youcanrepeattheprocesstogetaslightlydifferent
picturebecausethearrangementisdependentontherandomstartingpoint.
Chapter 14
Design of Experiments Guide
Space-Filling Designs
Uniform Designs
399
Figure 14.13ComparisonofLatinHypercubeDesignswithEightRuns(left)and10Runs
(right)
NotethattheminimumdistancebetweeneachpairofpointsintheLatinHypercubedesignis
smallerthanthatfortheSpherePackingdesign.ThisisbecausetheLatinHypercubedesign
constrainsthelevelsofeachfactortobeevenlyspaced.TheSpherePackingdesignmaximizes
theminimumdistancewithoutanyconstraints.
Uniform Designs
TheUniformdesignminimizesthediscrepancybetweenthedesignpoints(empiricaluniform
distribution)andatheoreticaluniformdistribution.
Note: Thesedesignsaremostusefulforgettingasimpleandpreciseestimateoftheintegralof
anunknownfunction.Theestimateistheaverageoftheobservedresponsesfromthe
experiment.
1. SelectDOE > Space Filling Design.
2. Enterresponses,ifnecessary,andfactors.
SeeResponsesonpage 382.
3. Alterthefactorlevelvaluesto0and1.
4. ClickContinue.
5. Inthedesignspecificationdialog,specifyasamplesize.Thisexampleusesasamplesize
ofeight(Number of Runs).
6. ClicktheUniform button.JMPcreatesthisdesignanddisplaysthedesignrunsandthe
designdiagnosticsasshowninFigure 14.14.
400
Space-Filling Designs
Uniform Designs
Chapter 14
Design of Experiments Guide
Note: TheemphasisoftheUniformdesignmethodisnottospreadoutthepoints.The
minimumdistancesinFigure 14.14varysubstantially.
Figure 14.14FactorSettingsandDiagnosticsforUniformSpaceFillingDesignswithEight
Runs
7. ClickMake Table.
AUniformdesigndoesnotguaranteeevenspacingofthefactorlevels.However,increasing
thenumberofrunsandrunningadistributiononeachfactor(useAnalyze>Distribution)
showsflathistograms.
Figure 14.15HistogramsAreFlatforEachFactorWhenNumberofRunsIsIncreasedto20
Chapter 14
Design of Experiments Guide
Space-Filling Designs
Comparing Sphere-Packing, Latin Hypercube, and Uniform Methods
401
402
Space-Filling Designs
Minimum Potential Designs
Chapter 14
Design of Experiments Guide
Figure 14.16ComparisonofDiagnosticsforThreeEightRunSpaceFillingMethods
SpherePacking
Latin
Hypercube
Uniform
Anotherpointofcomparisonisthetimeittakestocomputeadesign.TheUniformdesign
methodrequiresthemosttimetocompute.Also,thetimetocomputethedesignincreases
rapidlywiththenumberofruns.Forcomparableproblems,allthespacefillingdesign
methodstakelongertocomputethantheDoptimaldesignsintheCustomDesigner.
Chapter 14
Design of Experiments Guide
Space-Filling Designs
Minimum Potential Designs
403
Figure 14.17MinimumPotentialDesign
MinimumPotentialdesigns:
havesphericalsymmetry
arenearlyorthogonal
haveuniformspacing
ToseeaMinimumPotentialexample:
1. SelectDOE > Space Filling Design.
2. Add1continuousfactor.
SeeFactorsonpage 384.
3. Alterthefactorlevelvaluesto0and1,ifnecessary.
4. ClickContinue.
5. Inthedesignspecificationdialog(shownontheleftinFigure 14.18),enterasamplesize
(Number of Runs).Thisexampleusesasamplesizeof12.
6. ClicktheMinimum Potential button.JMPcreatesthisdesignanddisplaysthedesignruns
andthedesigndiagnostics(shownontherightinFigure 14.18).
Figure 14.18SpaceFillingMethodsandDesignDiagnosticsforMinimumPotentialDesign
404
Space-Filling Designs
Maximum Entropy Designs
Chapter 14
Design of Experiments Guide
7. ClickMake Table.
YoucanseethesphericalsymmetryoftheMinimumPotentialdesignusingtheScatterplot3D
graphicsplatform.
1. AfteryoumaketheJMPdesigntable,choosetheGraph>Scatterplot 3Dcommand.
2. IntheScatterplot3Dlaunchdialog,selectX1,X2,and X3asY, ColumnsandclickOK tosee
theinitialthreedimensionalscatterplotofthedesignpoints.
3. ToseetheresultssimilartothoseinFigure 14.19:
SelecttheNormal Contour EllipsoidsoptionfromthemenuintheScatterplot3Dtitle
bar.
Makethepointslarger.RightclickontheplotandselectSettings,andthenincreasethe
Marker Sizeslider.
Nowitiseasytoseethepointsspreadevenlyonthesurfaceoftheellipsoid.
Figure 14.19MinimumPotentialDesignPointsonSphere
Chapter 14
Design of Experiments Guide
Space-Filling Designs
Maximum Entropy Designs
405
runsandwiththefactorlevelsettingssetbetween1and1.Notethatthisdesignseamsto
leaveaholeinthebottomrightoftheoverlayplot.
Figure 14.20TwofactorLatinHypercubeDesign
TheMaximumEntropydesignisacompetitortotheLatinHypercubedesignforcomputer
experimentsbecauseitoptimizesameasureoftheamountofinformationcontainedinan
experiment.Seethetechnicalnotebelow.Withthefactorlevelssetbetween1and1,the
twofactorMaximumEntropydesignshowninFigure 14.21coverstheregionbetterthanthe
LatinhypercubedesigninFigure 14.20.Thespacefillingpropertygenerallyimprovesasthe
numberofrunsincreaseswithoutbound.
Figure 14.21TwoFactorMaximumEntropyDesign
Technical MaximumEntropydesignsmaximizetheShannoninformation(ShewryandWynn
(1987))ofanexperiment,assumingthatthedatacomefromanormal(m,s2R)distribution,
where
406
Space-Filling Designs
Gaussian Process IMSE Optimal Designs
Chapter 14
Design of Experiments Guide
2
R ij = exp k x ik x jk
k
isthecorrelationofresponsevaluesattwodifferentdesignpoints,xiandxj.Computationally,
thesedesignsmaximize|R|,thedeterminantofthecorrelationmatrixofthesample.Ifxiand
xjarefarapart,thenRijapproacheszero.Ifxiandxjareclosetogether,thenRijisnearone.
Note: BoththeMaximumEntropydesignandtheGaussianProcessIMSEOptimaldesign
werecreatedusing100randomstarts.
Chapter 14
Design of Experiments Guide
Space-Filling Designs
Fast Flexible Filling Designs
407
strivestofindpointsintheclustersthatminimizethefollowingcriterion:
C MaxPro =
n1
j = i+1
x ik x jk
k=1
TheMaxProcriterionmaximizestheproductofthedistancesbetweenpotentialdesign
pointsinawaythatinvolvesallfactors.Thissupportsthegoalofprovidinggood
spacefillingpropertiesonprojectionsoffactors.SeeJosephetal.(2014,forthcoming).The
MaxProoptionisthedefault.
Centroid Thismethodplacesadesignpointatthecentroidofeachcluster.Ithastheproperty
thattheaveragedistancefromanarbitrarypointinthedesignspacetoitsclosest
neighboringdesignpointissmallerthanforotherdesigns.
Note: Youcansetapreferencetoalwaysuseagivenoptimalitycriterion.SelectFile >
Preferences > Platforms > DOE.CheckFFFOptimalityCriterionandselectyourpreferred
criterion.
408
Space-Filling Designs
Fast Flexible Filling Designs
Chapter 14
Design of Experiments Guide
withalargenumberoffactorsorwheredisallowedcombinationsrestrictthedistributionof
pointsusedintheclusteringalgorithm.
Note: DependingonthenumberoffactorsandthespecifiedvalueforNumberofRuns,you
mightwanttoincreasetheaveragenumberofinitialpointsperdesignpointbyselecting
Advanced Options > Set Average Cluster Size.
Constraints
OnceyoucompletetheFactorsoutline,clickContinue.TheDefineFactorConstraintsoutline
appears.Usethisoutlinetorestrictthedesignregion.Fordetailsabouttheoutline,see
DefineFactorConstraintsonpage 386.
YoucanusetheUseDisallowedCombinationsFilterandUseDisallowedCombinationsScript
optionstospecifydisallowedfactorlevelcombinations.Or,youcanusetheSpecifyLinear
Constraintsoptiontospecifyboundsintermsoflinearinequalities.However,thedesignis
generateddifferentlyforthesetwomethods.
UseDisallowedCombinationsFilterandUseDisallowedCombinationsScript
Whendisallowedcombinationsarespecified,therandompointsthatformthebasisforthe
clusteringalgorithmarerandomlydistributedwithintheunconstraineddesignregion.Then
disallowedpointsareremovedandclusteringproceedswiththeremainingpoints.
Note: DependingonthenatureoftheconstraintsandthespecifiedNumberofRuns,the
defaultcoverageoftheunconstraineddesignspacebytheinitialrandomlygeneratedpoints
mightnotbesufficienttoproducetherequiredNumberofRuns.Inthiscase,youmight
obtainaJMPAlertindicatingthatthealgorithmCouldnotfindsufficientnumberofpoints.
Toincreasetheinitialnumberofpointsthatformthebasisfortheclusteringalgorithm,
specifyalargeraveragenumberofinitialpointsperdesignpointbyselectingAdvanced
Options > Set Average Cluster Size. (SeeSetAverageClusterSizeonpage 407).
SpecifyLinearConstraints
WhenyouusetheSpecify Linear Constraintsoption,therandompointsthatformthebasisfor
theclusteringalgorithmarerandomlydistributedwithintheconstraineddesignregion.The
clusteringalgorithmusesthesepoints.
Chapter 14
Design of Experiments Guide
Space-Filling Designs
Fast Flexible Filling Designs
2. EnterValuesof0and1forbothX1andX2.
3. ClickContinue.
4. IntheDefineLinearConstraintsoutline,selectSpecify Linear Constraints.
NoticethatFastFlexibleFillingistheonlyavailableSpaceFillingDesignMethod.
5. SelectAdd.
6. Enterthefollowingcoefficientsandbound:
1forX1
1forX2
0.8forthebound
Figure 14.23LinearConstraint
7. Type200nexttoNumber of Runs.
8. SelectFast Flexible Filling.
JMPcreatesadesignthatsatisfiestheconstraints.OpentheDesignoutlinetoviewthe
design.
9. SelectMake Table toconstructthedatatable.
ConstructingthePlot
1. Withthedatatableactive,selectGraph > Graph Builder.
2. DragX1tothedropzonelabeledX.
3. DragX2tothedropzonelabeledY.
4. RemovetheSmootherbyclickingthesmoothericon.
5. IntheGraphBuilderredtrianglemenu,clickShow Control Paneltodeselectit.
YoushouldseeagraphsimilartotheoneinFigure 14.24.Notethatthepointssatisfythe
linearconstraint X1 + X2 0.8 .
409
410
Space-Filling Designs
Borehole Model: A Sphere-Packing Example
Chapter 14
Design of Experiments Guide
Figure 14.24FastFlexibleFillingDesignwithOneLinearConstraint
Thereareeightinputstothismodel:
rw=radiusofborehole,0.05to0.15m
r=radiusofinfluence,100to50,000m
Tu=transmissivityofupperaquifer,63,070to115,600m2/year
Hu=potentiometricheadofupperaquifer,990to1100m
Tl=transmissivityofloweraquifer,63.1to116m2/year
Hl=potentiometricheadofloweraquifer,700to820m
Chapter 14
Design of Experiments Guide
Space-Filling Designs
Borehole Model: A Sphere-Packing Example
411
L=lengthofborehole,1120to1680m
Kw=hydraulicconductivityofborehole,9855to12,045m/year
Thisexampleisatypicalofmostcomputerexperimentsbecausetheresponsecanbeexpressed
asasimple,explicitfunctionoftheinputvariables.However,thissimplicityisusefulfor
explainingthedesignmethods.
Note: Thelogarithmofrandrwareusedinthefollowingdiscussion.
4. ClickContinue.
5. Specifyasamplesize(NumberofRuns)of32asshowninFigure 14.26.
412
Space-Filling Designs
Borehole Model: A Sphere-Packing Example
Chapter 14
Design of Experiments Guide
Figure 14.26SpaceFillingDesignMethodPanelShowing32Runs
6. ClicktheSphere Packingbuttontoproducethedesign.
7. ClickMake Tabletomakeatableshowingthedesignsettingsfortheexperiment.
Toseeacompleteddatatableforthisexample,selectHelp > Sample Data Libraryandopen
Design Experiment/Borehole Sphere Packing.jmp.Becausethedesignsaregeneratedfroma
randomseed,thesettingsthatyouobtainwilldifferfromthoseshowninthecompletedtable.
TheBorehole Sphere Packing.jmpdatatablecontainsaFitModelscriptthatyoucanuseto
analyzethedata.Columnscontainingthetruemodel,thepredictionformula,andthe
predictionbiasareincludedinthedatatable.
Astepwiseregressionoftheresponse,log y,versusthefullquadraticmodelintheeight
factors,ledtotheprediction formulacolumn.
Chapter 14
Design of Experiments Guide
Space-Filling Designs
Borehole Model: A Sphere-Packing Example
413
Thepredictionbiasisrelativelysmallforeachoftheexperimentalpoints.Thisindicates
thatthemodelfitsthedatawell.
Inrealworldexamples,thetruemodelisgenerallynotavailableinasimpleanalyticalform.
Asaresult,itisimpossibletoknowthepredictionbiasatpointsotherthantheobserveddata
withoutdoingadditionalruns.
Inthiscase,the true modelcolumncontainsaformulathatallowsprofilingthepredictionbias
tofinditsvalueanywhereintheregionofthedata.Tounderstandthepredictionbiasinthis
example:
1. SelectGraph > Profiler.
2. Highlighttheprediction biascolumnandclicktheY, Prediction Formulabutton.
3. ChecktheExpand Intermediate Formulasbox,asshownatthebottomontheProfiler
dialoginFigure 14.27.The prediction biasformulaisafunctionofcolumnsthatarealso
createdbyformulas.
4. ClickOK.
TheprofileplotsatthebottominFigure 14.27showthepredictionbiasatthecenterofthe
designregion.Iftherewerenobias,theprofiletraceswouldbeconstantbetweenthevalue
rangesofeachfactor.Inthisexample,thevariablesHuandHlshownonlineareffects.
414
Space-Filling Designs
Borehole Model: A Sphere-Packing Example
Chapter 14
Design of Experiments Guide
Figure 14.27ProfilerDialogandProfileofthePredictionBiasintheBoreholeSpherePacking
Data
Therangeofthepredictionbiasonthedataissmallerthantherangeofthepredictionbias
overtheentiredomainofinterest.Toseethis,lookatthedistributionanalysis(Analyze >
Distribution)ofthepredictionbiasinFigure 14.28.Notethatthemaximumbiasis1.826and
theminimumis0.684(therangeis2.51).
Chapter 14
Design of Experiments Guide
Space-Filling Designs
Borehole Model: A Sphere-Packing Example
415
Figure 14.28DistributionofthePredictionBias
ThetopplotinFigure 14.29showsthemaximumbias(2.91)overtheentiredomainofthe
factors.Theplotatthebottomshowsthecomparableminimumbias(4.84).Thisgivesarange
of7.75.Thisismorethanthreetimesthesizeoftherangeovertheobserveddata.
Figure 14.29PredictionPlotsShowingMaximumandMinimumBiasoverFactorDomains
416
Space-Filling Designs
Borehole Model: A Sphere-Packing Example
Chapter 14
Design of Experiments Guide
Keepinmindthat,inthisexample,thetruemodelisknown.Inanymeaningfulapplication,
theresponseatanyfactorsettingisunknown.Thepredictionbiasovertheexperimentaldata
underestimatesthebiasthroughoutthedesigndomain.
Therearetwowaystoassesstheextentofthisunderestimation:
Crossvalidationrefitsthedatatothemodelwhileholdingbackasubsetofthepointsand
looksattheerrorinestimatingthosepoints.
Verificationruns(newrunsperformed)atdifferentsettingstoassessthelackoffitofthe
empiricalmodel.
Chapter 15
Accelerated Life Test Designs
Designing Experiments for Accelerated Life Tests
TheAcceleratedLifeTestDesignplatformcanbeusedtodesignexperimentalplansfor
acceleratedlifetesting.Youcandesigninitialexperiments,oraugmentexistingexperiments.
Figure 15.1AcceleratedLifeTestDesign
Contents
OverviewofAcceleratedLifeTestDesigns.......................................... 419
UsingtheALTDesignPlatform ................................................... 419
PlatformOptions ................................................................ 424
Example ....................................................................... 424
Chapter 15
Design of Experiments Guide
419
2. Selectoneortwoacceleratingfactors.
Fortwofactors,youcanchoosetoincludetheinteractionbetweenthefactors.
3. SelecteitherMonitoring at IntervalsorContinuous Monitoring.
ChooseMonitoring at Intervals ifyoucanestimatewhentheexperimentwillfail.Enterthe
numberofinspections,thetimeofthefirstinspection,andthetimebetweeninspections.
420
Chapter 15
Design of Experiments Guide
ChooseContinuous Monitoringifyouareunsureofwhentheexperimentwillfail.
4. ClickContinue.
Awindowappearsforspecifyingdetailsoftheacceleratingfactororfactors.
Figure 15.3AcceleratingFactorDetailsWindow
5. Fillintheseoptions:
Factor Name Enteranamefortheacceleratingfactor.
Number of Levels Enterthenumberoflevelsofthefactortoincludeintheexperiment.
Selectatransformationforthefactor.TheoptionsareArrhenius
Celsius,Reciprocal,Log,SquareRoot,andLinear.
Factor Transformation
Enteravalueforthehighusageconditions.
6. ClickContinue.
Awindowappearsforspecifyingadditionalinformationabouttheassumeddistribution
anddesiredexperimentalconditions.
Chapter 15
Design of Experiments Guide
421
Figure 15.4DistributionDetails
7. Fillintheseoptions:
Factors Enterthevaluesoftheacceleratingfactorlevels.
Distribution Choice
Selectthefailuredistribution,eitherWeibullorLogNormal.
Entertheaccelerationmodelparameters.Thesevaluescanbeeitherabestguess
ortheestimatesoftheparametersfromananalysisofpreviouslyobtaineddata.
Prior Mean
Thesevaluescanbeeitherabestguessortheestimatedvariancematrixfromananalysisof
previouslyobtaineddata.
Ignore prior variance Selectthisoptiontoignorevariancesandcovariancesformodel
parameters.Whenthevariancesandcovariancesareignored,thedesigniscreatedforthe
specificfixedparametersenteredunderPriorMean.Theresultingdesignissaidtobea
locallyoptimaldesign.Thisdesignwillbegoodifthepriormeanparametersarecloseto
thetruevalues.However,thedesignwillnotberobusttomisspecifiedparameters.When
thevariancesandcovariancesareused,amultivariatenormalpriordistributionis
assumedfortheaccelerationmodelparameters.Thisisusefulwhenthevaluesentered
422
Chapter 15
Design of Experiments Guide
underPriorMeanareestimatesorguesses,andyouwantthedesigntoreflectthe
associateduncertainty.
Diagnostic Choices Entervaluesforthefollowing:
Length of Testisthelengthoftimetoruntheexperiment.
Number of Units Under Testisthenumberofunitsintheexperiment.Ifaugmentinga
previousexperiment,enterthenumberofunitsfromthepreviousexperimentplusthe
numberofunitsthatyouwanttorunforthenextexperiment.Ifdesigninganinitial
experiment,enterthenumberofunitsthatyouwanttorun.
8. ClickContinue.
NewoutlinenodesappearasshowninFigure 15.5.
Figure 15.5AdditionalOutlineNodes
Chapter 15
Design of Experiments Guide
423
Entertheminimumandmaximumnumberofrunsallowedateachlevelof
theaccelerationfactor.Ifaugmentingapreviousexperiment,enterthenumberofunits
alreadyrunateachlevelfortheMinimumUnits.
Candidate Runs
accelerationmodelparametersafterrunningandanalyzingthebalanceddesign(same
numberofrunsateachleveloftheaccelerationfactor).Thesevaluesarevalidunderthe
assumptionthatthevaluesforthepriormeanandvariancearecorrect.
ThesevaluescanbecomparedtotheonesenteredunderPriorVarianceMatrix,tosee
whetherthebalanceddesigncanimprovethevariancesoftheparameterestimates.They
canalsobecomparedtothefinalparametervariancesfortheoptimaldesign,afterclicking
Make Design.
Usetheprofilertovisualizetheprobabilitythataunitwillfailat
differentvaluesoftheaccelerationfactorandtime.
Distribution Profiler
9. ClickUpdate Profilertoupdatetheprofilerifchangesaremadetothedistributionchoice,
means,variances,designchoices,orcandidateruns.
10. ClickMake Designtocreatetheoptimaldesignanddisplaytheresults.
Figure 15.6DesignResults
TheinformationbelowdescribestheresultsyougetafterclickingMake Design.
TheDesign reportgivestheexpectednumberoffailuresforeachleveloftheacceleration
factor.Alsogivenistheprobabilitythatnoneoftheunitsatthissettingwillfail.
TheParameter Variance for Optimal Designreportgivesthevariancesandcovariancesforthe
accelerationmodelparametersfortheoptimaldesign.Thesevaluesarevalidunderthe
assumptionthatthevaluesforthepriormeanandvariancearecorrect.Thesevaluescanbe
424
Chapter 15
Design of Experiments Guide
comparedtothoseunderParameterVarianceforBalancedDesigntodeterminewhetherthe
optimaldesignisabletoreducetheparametervariancesmorethanthebalanceddesign.
TheOptimality Criteriareportgivesthevaluesoftheoptimalitycriterionfortheoptimal
design.Formoreinformationabouttheoptimalitycriterion,seePlatformOptionson
page 424.
TheMake Designbuttonupdatestheoptimaldesignifanychangesaremadetothe
distributionchoice,priormeansorvariances,designchoices,orcandidateruns.
TheMake Test Planbuttoncreatesadatatablewiththeaccelerationfactorlevelsandthe
numberofunitstoincludeintheexperimentforeachlevel.
TheMake Tablebuttoncreatesatablethatcanbeusedfordatacollectionduringthe
experiment.
Platform Options
TheredtrianglemenuforAcceleratedLifeTestPlanhasthefollowingoptions:
Simulate Responses
AddssimulatedresponsestothetablewhenyouclickMake Table.
Givesthreechoicesfordesignoptimality:
coefficients.
Make Time I-Optimal Designcreatesadesignthatminimizesthepredictionvariancewhen
predictingthetimetofailurefortheprobabilitygiveninDiagnosticChoiceson
page 422.
Make Probability I-Optimal Designcreatesadesignthatminimizesthepredictionvariance
whenpredictingthefailureprobabilityforthetimesgiveninDiagnosticChoiceson
page 422.
Advanced Options GivestheNMonteCarloSpheresoption,whichaffectsthespeedand
accuracyofnumericalintegration.Formoreinformation,seeAdvancedOptionsforthe
NonlinearDesigneronpage 445intheNonlinearDesignschapter.
Example
ThisexampleshowshowtousetheAcceleratedLifeTestDesigntoaugmentanexisting
design.
Anacceleratedlifetestwasperformed,andtheresultsareintheCapacitor ALT.jmpsample
datatable(intheDesign Experimentfolder).Fiftyunitsweretestedateachofthree
Chapter 15
Design of Experiments Guide
temperatures(85o,105o,and125oCelsius)for1500hours.Theresultingmodelisusedto
predicttheprobabilityoffailureat100,000hoursatnormaluseconditionsof25o.
1. SelectHelp > Sample Data LibraryandopenDesign Experiment/Capacitor ALT.jmp.
2. RuntheFit Life by Xtablescript.
3. IntheDistributionProfiler,enter25forTempand100,000forHours.
TheprofilerisshowninFigure 15.7.
Figure 15.7DistributionProfilerforCapacitorModel
Thepredictedprobabilityoffailureat100,000hoursat25ois0.00358,withaconfidence
intervalof0.00056to0.0227.Theanalystwantstodecreasethewidthoftheconfidence
interval.Todoso,theexperimentneedstobeaugmentedwithadditionaldata.
Toaugmentthedesignintheoptimalway,usetheAcceleratedLifeTestDesignplatform.
Followthestepsbelowtousetheplatform:
1. SelectDOE>Accelerated Life Test Design.
2. SelectDesign for one accelerating factorandclickContinue.
3. EnterTemperatureforFactor Name.
4. Enter5forNumber of Levels.
5. Enter25forbothLow Usage ConditionandHigh Usage Condition.
6. ClickContinue.
7. Enter85,95,105,115,and125fortheTemperature Level Values.
8. SelectWeibullforDistribution Choice.
9. UnderPrior Mean,entertheaccelerationmodelparametersfromtheFitLifebyX
Estimatesreport.SeeFigure 15.8.
Enter35.200forIntercept.
Enter1.389forTemperature.
Enter1.305forscale.
425
426
Chapter 15
Design of Experiments Guide
Figure 15.8FitLifebyXEstimates
IntheFitLifebyXoutput,undertheEstimatesreport,istheCovarianceMatrixreport.Note
thevariancesfortheaccelerationmodelparametersare22,0.025,and0.013.Thesevalueswill
becomparedtoourfinalresultsattheend.
10. Enter100,000forbothboxesforTime range of interest.
11. Enter1500forLength of Test.
12. Enter300forNumber of Units Under Test.Thepreviousexperimentused150units,andthe
nextexperimentuses150units,foratotalof300.
ThecompletedwindowisshowninFigure 15.9.
Figure 15.9CompletedWindow
Chapter 15
Design of Experiments Guide
427
13. ClickContinue.
14. Toaccountfortheunitsinthepreviousexperiment,enterthefollowingunderCandidate
Runs.
Enter50forMinimumUnitsfor85o.
Enter50forMinimumUnitsfor105o.
Enter50forMinimumUnitsfor125o.
15. FromtheredtrianglemenuforAcceleratedLifeTestPlan,selectALT Optimality Criterion>
Make Probability I-Optimal Design.
16. ClickMake Design.
Theoptimalexperimentaldesignisreturned,alongwithotherresults.SeeFigure 15.10.
Figure 15.10OptimalDesign
TheoptimaldesigniscomputedbasedontheNumberofUnitsUnderTest,CandidateRuns,
andotherinformationthatyouspecifiedearlier.Theoptimaldesignconsistsofthefollowing
numberofunitsateachtemperaturelevel:
184unitsat85o.Sincethepreviousexperimentused50units,134additionalunitsare
needed.
0unitsat95o.Thenextexperimentwillnotutilizeanyunitsatthislevel.
50unitsat105o.Sincethepreviousexperimentalreadyused50units,noadditionalunits
areneeded.
0unitsat115o.Thenextexperimentwillnotutilizeanyunitsatthislevel.
66unitsat125o.Sincethepreviousexperimentused50units,16additionalunitsare
needed.
Asweenteredearlier,atotalof134+16=150unitsareusedforthenewexperiment.
428
Chapter 15
Design of Experiments Guide
Anestimateoftheaccelerationmodelparametersvariancesisgiven.Notethat,duetothe
additionaldata,allthreevariancesaresmallerthanbeforefromtheoriginalFitLifebyX
report.
IntheProfiler,enter25forTemperatureand100,000forTime.Theestimatedprobabilityof
failureis0.00357,withanestimatedconfidenceintervalof0.00106to0.01201.Thisintervalis
narrowerthantheonefromthepreviousexperiment,asaresultoftheadditionalunitstobe
tested.
Todecreasetheintervalfurther,tryenteringmorethan300unitstobetested.
Chapter 16
Nonlinear Designs
Designofexperimentswithmodelsthatarenonlinearintheirparametersisavailableusing
eithertheDOEmenuortheJMPStarterDOEcategory.
Nonlineardesignsofferbothadvantagesanddisadvantagescomparedtodesignsforlinear
models.
Onthepositiveside,predictionsusingawellchosenmodelarelikelytobegoodoverawider
rangeoffactorsettings.Itisalsopossibletomodelresponsesurfaceswithmorecurvatureand
withasymptoticbehavior.
Onthenegativeside,theresearcherneedsagreaterunderstandingofboththesystemandof
thenonlineardesigntool.
Contents
ExamplesofNonlinearDesigns................................................... 431
UsingNonlinearFittoFindPriorParameterEstimates............................ 431
CreatingaNonlinearDesignwithNoPriorData ................................. 438
CreatingaNonlinearDesign ...................................................... 442
IdentifytheResponseandFactorColumnwithFormula........................... 443
SetUpFactorsandParametersintheNonlinearDesignDialog ..................... 443
EntertheNumberofRunsandPreviewtheDesign............................... 444
MakeTableorAugmenttheTable.............................................. 445
AdvancedOptionsfortheNonlinearDesigner...................................... 445
Chapter 16
Design of Experiments Guide
Nonlinear Designs
Examples of Nonlinear Designs
431
onecolumnforeachfactor
onecolumnfortheresponse
acolumnthatcontainsaformulashowingthefunctionalrelationshipbetweenthefactor(s)
andtheresponse.
Thisisthesameformatforatableyouwouldsupplytothenonlinearplatformformodeling.
Thefirstexampleinthissectiondescribeshowtoapproachcreatinganonlineardesignwhen
thereispriordata.Thesecondexampledescribeshowtoapproachcreatingthedesign
withoutdata,butwithreasonablestartingvaluesfortheparameterestimates.
formulawithapoorguessoftheparametervalues.
432
Nonlinear Designs
Examples of Nonlinear Designs
Chapter 16
Design of Experiments Guide
Figure 16.1ChemicalKinetics.jmp
First,fitthedatatothemodelusingnonlinearleastsquarestogetbetterparametervalues.
1. SelectAnalyze > Modeling > Nonlinear.
2. SelectVelocity (y)andclickY, Responseonthenonlinearlaunchdialog.
3. SelectModel (x)andclickX, Predictor Formula(seeFigure 16.2).Notethattheformula
givenbyModel (x)showsinthelaunchdialog.
Figure 16.2InitialNonlinearAnalysisLaunchDialog
Chapter 16
Design of Experiments Guide
Nonlinear Designs
Examples of Nonlinear Designs
433
4. Click OK onthelaunchdialogtoseetheNonlinearFitControlPanel.
5. ClickGointheControlPaneltoobtaintheestimatesshowninFigure 16.3.
Figure 16.3NonlinearFitResults
6. ClicktheConfidence LimitsbuttontoaddconfidenceintervalstotheSolutionreport.
TherangesforLowerCLandUpperCLaretheintervalsforVMaxandk.Theyare
asymptoticallynormal.UsetheselimitstocreateanonlineardesigninJMP.
7. ClickSave EstimatestoaddthenewfittedparametervaluesintheModel (x) columninthe
Chemical Kinetics.jmp datatable.
Clickthe+signnexttoModel (x)intheColumnspaneltoviewtheformula.Select
Parametersfromthemenuintheupperleftoftheformulaeditortoviewthenew
parameterestimates.
434
Nonlinear Designs
Examples of Nonlinear Designs
Chapter 16
Design of Experiments Guide
Figure 16.4NewParameterEstimates
Note: LeavethenonlinearanalysisreportopenbecausetheseresultsareneededintheDOE
nonlineardesigndialogdescribednext.
Nowcreateadesignforfittingthemodelsnonlinearparameters.
1. WiththeChemical Kinetics.jmp datatableopen,selectDOE > Nonlinear Design.
2. CompletethelaunchdialogthesamewayastheNonlinearAnalysislaunchdialogshown
previously.Thatis,SelectVelocity (y)andclickY, Response.SelectModel (x)andclickX,
Predictor Formula.Figure 16.5showsthecompleteddialog.
Figure 16.5InitialNonlinearDesignLaunchDialog
3. ClickOKtoseethecompletedDesignpanelsforfactorsandparameters,asshownin
Figure 16.6.
Chapter 16
Design of Experiments Guide
Nonlinear Designs
Examples of Nonlinear Designs
435
Figure 16.6NonlinearDesignPanelsforFactorsandParameters
436
Nonlinear Designs
Examples of Nonlinear Designs
Chapter 16
Design of Experiments Guide
Figure 16.7ChangeValuesforFactorandParameters
UsecommandsfromthemenuontheNonlinearDesigntitlebartogetthebestpossible
design:
6. Enter100inthetextboxforNumber of RunsintheDesignGenerationpanel.
7. SelectAdvanced Options>Number of Monte Carlo Samplesandenter2inthetextbox.
8. ClickMake Designtopreviewthedesign(Figure 16.8).Yourresultsmightdifferfrom
thoseshownfortheadditionalruns.
Chapter 16
Design of Experiments Guide
Nonlinear Designs
Examples of Nonlinear Designs
437
Figure 16.8SelectingtheNumberofRuns
9. ClickMake Table.
ThiscreatesanewJMPdesigntable(Figure 16.9)whoserowsaretherunsdefinedbythe
nonlineardesign.
Note: ThisexamplecreatesanewtabletoavoidalteringthesampledatatableChemical
Kinetics.jmp.Inmostcases,however,youcanaugmenttheoriginaltableusingthe
Augment Table option intheNonlinearDesignerinsteadofmakinganewtable.This
optionaddsthenewrunsshownintheDesigntotheexistingdatatable.
438
Nonlinear Designs
Examples of Nonlinear Designs
Chapter 16
Design of Experiments Guide
Figure 16.9MakingaTablewiththeNonlinearDesigner
Thenewrunsusethewiderintervalofallowedconcentration,whichleadstomoreprecise
estimatesofkandVmax.
Chapter 16
Design of Experiments Guide
Nonlinear Designs
Examples of Nonlinear Designs
439
ThismodelisfromBoxandDraper(1987).Theformulaarisesfromthefractionalyieldofthe
intermediateproductinaconsecutivechemicalreaction.Itiswrittenasafunctionoftimeand
temperature.
1. WiththeReaction Kinetics Start.jmpdatatableopen,selectDOE > Nonlinear Designtosee
theinitiallaunchdialog.
2. Selectobserved yieldandclickY, Response.
3. Select yield model(thecolumnwiththeformula) andclickX, Predictor Formula.
ThecompleteddialogshouldlookliketheoneinFigure 16.11.
Figure 16.11NonlinearDesignlaunchDialog
4. ClickOKtoseethenonlineardesignFactorsandParameterspanelsinFigure 16.12.
5. Changethetwofactorsvaluestobeareasonablerangeofvalues.(Inyourexperiment,
thesevaluesmighthavetobeaneducatedguess.)Forthisexample,usethevalues510and
540forReaction Temperature.Usethevalues0.1and0.3forReaction Time.
6. Changethevaluesoftheparametert1to25and50,andt3to30and35.
7. ClickontheDistributionofeachparameterandselectUniformfromthemenutochange
thedistributionfromthedefaultNormal (seeFigure 16.12).
8. Changethenumberofrunsto12intheDesignGenerationpanel.
440
Nonlinear Designs
Examples of Nonlinear Designs
Chapter 16
Design of Experiments Guide
Figure 16.12ChangeFactorValues,ParameterDistributions,andNumberofRuns
Chapter 16
Design of Experiments Guide
Nonlinear Designs
Examples of Nonlinear Designs
441
Figure 16.14ReactionKinetics.jmp
First,examinethedesignregionwithanoverlayplot.
11. SelectGraph > Overlay Plot.
12. Removeallexistingcolumnassignments.
13. SelectReaction TemperatureandclickY
14. SelectReaction TimeandclickX asshownintheOverlayPlotlaunchdialogin
Figure 16.15.
15. ClickOKtoseetheoverlayplotinFigure 16.15.
Figure 16.15CreateanOverlayPlot
Noticethatthepointsarenotatthecornersofthedesignregion.Inparticular,thereareno
pointsatlowtemperatureandhightimethelowerrightcornerofthegraph.
16. SelectAnalyze > Modeling > Nonlinear.
17. Removeallexistingcolumnassignments.
442
Nonlinear Designs
Creating a Nonlinear Design
Chapter 16
Design of Experiments Guide
IdentifytheResponseandFactorColumnwithFormulaonpage 443
SetUpFactorsandParametersintheNonlinearDesignDialogonpage 443
EntertheNumberofRunsandPreviewtheDesignonpage 444
MakeTableorAugmenttheTableonpage 445
Chapter 16
Design of Experiments Guide
Nonlinear Designs
Creating a Nonlinear Design
443
UseFigure 16.19tounderstandhowtosetupfactorandparameternamesandvalues.
Theinitialvaluesforthefactorandtheparametersarereasonableanddonotneedtobe
changed.
Ifnecessary,changetheDistributionoftheparameterstoUniform,asshowninFigure 16.19.
444
Nonlinear Designs
Creating a Nonlinear Design
Chapter 16
Design of Experiments Guide
Figure 16.19ExampleofSettingUpFactorsandParameters
Double-click to edit the factor or
parameter name.
Chapter 16
Design of Experiments Guide
Nonlinear Designs
Advanced Options for the Nonlinear Designer
445
Figure 16.20ExamplePreviewDesign
446
Nonlinear Designs
Advanced Options for the Nonlinear Designer
Chapter 16
Design of Experiments Guide
withrespecttothepriordistributionoftheparameters.Theseintegralsarecomplicatedand
havetobecalculatednumerically.
ThewaytheintegrationisdoneforNormaldistributionpriorsusesanumericalintegration
techniquewheretheintegralisreparameterizedintoaradialdirection,andthenumberof
parametersminusoneangulardirections.Theradialpartoftheintegralishandledusing
RadauGaussLaguerrequadraturewithanevaluationatradius=0.Arandomized
Mysovskikhquadratureisusedtocalculatetheintegraloverthesphericalpart,whichis
equivalenttointegratingoverthesurfaceofahypersphere.
Note: IfsomeofthepriordistributionsarenotNormal,thentheintegralisreparameterizedso
thatthenewparametershavenormaldistribution,andthentheradialsphericalintegration
methodisapplied.However,ifthepriordistributionsetfortheparametersdoesnotlenditself
toasolution,sometimestheprocessfailsandgivesthemessagethattheFisherinformationis
singularinaregionoftheparameterspace,andadviseschangingthepriordistributionorthe
rangesoftheparameters.
Figure 16.22AdvancedOptionsfortheNonlinearDesigner
Thefollowingisatechnicaldescriptionforthesetwoadvancedoptions:
Number of Monte Carlo Samples setsthenumberofoctahedrapersphere.Becauseeach
octahedronisafixedunit,thisoptioncanbethoughtofassettingthenumberofoctahedra
persphere.
arethenumberofnonzeroradiusvaluesused.Thedefaultistwo
spheresandonecenterpoint.Eachradialvaluerequiresintegrationovertheangular
dimensions.Thisisdonebyconstructingacertainnumberofhyperoctahedra(the
generalizationofanoctagoninarbitrarydimensions),andrandomlyrotatingeachofthem.
Technical Thereasonfortheapproachgivenbytheseadvancedoptionsistogetgoodintegral
approximationsmuchfasterthanusingstandardmethods.Forinstance,withsixparameters,
usingtworadiiandonesamplepersphere,thesemethodsgiveageneralizedfivepointrule
thatneedsonly113observationstogetagoodapproximation.Usingthemostcommon
approach(Simpsonsrule)wouldneed56=15,625evaluations.ThestraightMonteCarlo
approachalsorequiresthousandsoffunctionevaluationstogetthesamelevelofqualityin
theanswer.Formoredetails,seeGotwalt,Jones,andSteinberg(2009).
Chapter 16
Design of Experiments Guide
Nonlinear Designs
Advanced Options for the Nonlinear Designer
447
Keepinmindthatifthenumberofradiiissettozero,thenjustthecenterpointisused,which
givesalocaldesignthatisoptimalforaparticularvalueoftheparameters.Forsomepeople
thisisgoodenoughfortheirpurposes.Thesedesignsarecreatedmuchfasterthanifthe
integrationisperformed.
448
Nonlinear Designs
Advanced Options for the Nonlinear Designer
Chapter 16
Design of Experiments Guide
Chapter 17
Taguchi Designs
Qualitywasthewatchwordofthe1980s,andGenichiTaguchiwasaleaderinthegrowthof
qualityconsciousness.OneofTaguchistechnicalcontributionstothefieldofqualitycontrol
wasanewapproachtoindustrialexperimentation.ThepurposeoftheTaguchimethodwasto
developproductsthatworkedwellinspiteofnaturalvariationinmaterials,operators,
suppliers,andenvironmentalchange.Thisisrobustengineering.
MuchoftheTaguchimethodistraditional.Hisorthogonalarraysaretwolevel,threelevel,and
mixedlevelfractionalfactorialdesigns.Theuniqueaspectsofhisapproacharetheuseof
signalandnoisefactors,innerandouterarrays,andsignaltonoiseratios.
ThegoaloftheTaguchimethodistofindcontrolfactorsettingsthatgenerateacceptable
responsesdespitenaturalenvironmentalandprocessvariability.Ineachexperiment,
Taguchisdesignapproachemploystwodesignscalledtheinnerandouterarray.TheTaguchi
experimentisthecrossproductofthesetwoarrays.Thecontrolfactors,usedtotweakthe
process,formtheinnerarray.Thenoisefactors,associatedwithprocessorenvironmental
variability,formtheouterarray.Taguchissignaltonoiseratiosarefunctionsoftheobserved
responsesoveranouterarray.TheTaguchidesignersupportsallthesefeaturesoftheTaguchi
method.Youchoosefrominnerandouterarraydesigns,whichusethetraditionalTaguchi
orthogonalarrays,suchasL4,L8,andL16.
Dividingsystemvariablesaccordingtotheirsignalandnoisefactorsisakeyingredientin
robustengineering.Signalfactorsaresystemcontrolinputs.Noisefactorsarevariablesthat
aretypicallydifficultorexpensivetocontrol.
Theinnerarrayisadesigninthesignalfactorsandtheouterarrayisadesigninthenoise
factors.Asignaltonoiseratioisastatisticcalculatedoveranentireouterarray.Itsformula
dependsonwhethertheexperimentalgoalistomaximize,minimizeormatchatargetvalue
ofthequalitycharacteristicofinterest.
ATaguchiexperimentrepeatstheouterarraydesignforeachrunoftheinnerarray.The
responsevariableinthedataanalysisisnottherawresponseorqualitycharacteristic;itisthe
signaltonoiseratio.
TheTaguchidesignerinJMPsupportssignalandnoisefactors,innerandouterarrays,and
signaltonoiseratiosasTaguchispecifies.
Contents
TheTaguchiDesignApproach.................................................... 451
TaguchiDesignExample......................................................... 451
AnalyzetheData ............................................................. 454
CreatingaTaguchiDesign........................................................ 456
DetailtheResponseandAddFactors ........................................... 456
ChooseInnerandOuterArrayDesigns ......................................... 457
DisplayCodedDesign........................................................ 458
MaketheDesignTable ........................................................ 458
Chapter 17
Design of Experiments Guide
Taguchi Designs
The Taguchi Design Approach
451
nominalisbest
2
S--------
= 10 log Y
N
s2
largerisbetter(maximize)
S1
--= 10 log --1- ------2
n
N
i Y
i
S- = 10 log --12
-- Yi
n
N
i
smallerisbetter
(minimize)
Type
Levels
Comment
Interfer
control
tubingandconnectorinterference
Wall
control
thewallthicknessoftheconnector
452
Taguchi Designs
Taguchi Design Example
Chapter 17
Design of Experiments Guide
Type
Levels
Comment
Depth
control
insertiondepthofthetubingintothe
connector
Adhesive
control
percentadhesive
Time
noise
theconditioningtime
Temperature
noise
temperature
Humidity
noise
therelativehumidity
Tostartthisexample:
1. SelectDOE > Taguchi Arrays.
2. ClicktheredtriangleiconontheTaguchiDesigntitlebarandselectLoad Factors.
3. WhentheOpenFiledialogappears,openthefactorstable,Byrne Taguchi Factors.jmp
foundintheDesign Experiment sampledatafolderinstalledwithJMP.
Thefactorspanelthenshowsthefourthreelevelcontrol(signal)factorsandthreenoise
factors,asshowninFigure 17.1.
Figure 17.1Response,andSignalandNoiseFactorsfortheByrneTaguchiExample
4. HighlightL9-TaguchitogivetheL9orthogonalarrayfortheinnerdesign.
5. HighlightL8togiveaneightrunouterarraydesign.
Chapter 17
Design of Experiments Guide
Taguchi Designs
Taguchi Design Example
453
6. ClickContinue.
Theouterdesignhasthreetwolevelfactors.Afullfactorialineightrunsisgenerated.
However,itisonlyusedasaguidetoidentifyanewsetofeightcolumnsinthefinalJMPdata
tableoneforeachcombinationoflevelsintheouterdesign.
7. ClickMake TabletocreatethedesigntableshowninFigure 17.2.
Figure 17.2TaguchiDesignBeforeDataEntry
Now,supposethepulloffadhesiveforcemeasuresarecollectedandenteredintothe
columnscontainingmissingdata,asshowninFigure 17.3.Themissingdatacolumn
namesareappendedwiththeletterYbeforethelevels(+or)ofthenoisefactorsforthat
run.Forexample, Y--- isthecolumnofmeasurementstakenwiththethreenoisefactorsset
attheirlowlevels.
8. Toseethecompletedexperiment,openthedatatable,Byrne Taguchi Data.jmpfoundinthe
Design Experiment sampledatafolderinstalledwithJMP.Figure 17.3showsthecompleted
design.
Figure 17.3CompleteTaguchiDesignTable(ByrneTaguchiData.jmp)
454
Taguchi Designs
Taguchi Design Example
10Log10
Chapter 17
Design of Experiments Guide
[Mean[(
,
1
1
1
1
1
,
,
,
,
2
2
2
2 (Y+ )2
Y ) (Y +) (Y + ) (Y ++)
1
1
,
, 1
(Y+ +)2 (Y+ + )2 (Y+++)2
]]
Thisexpressionislargewhenalloftheindividualyvaluesarelarge.
2. ClickRunontheFitModeldialog.
Thepredictionprofilerisaquickwaytofindsettingsthatgivethehighestsignaltonoise
ratioforthisexperiment.
3. ToopenthePredictionProfiler,clicktheredtriangleontheResponseMeanYtitlebarand
selectFactor Profiling > Profiler.
Chapter 17
Design of Experiments Guide
Taguchi Designs
Taguchi Design Example
455
Theprofiletraces(Figure 17.5)indicatethatdifferentsettingsofthefirstthreefactors
wouldincreaseSN Ratio Y.
Figure 17.5ThePredictionProfiler
4. Tofindoptimalsettings,clicktheredtriangleonthePredictionProfilertitlebarandselect
Desirability Functions.Thisaddstherowoftracesandacolumnoffunctionsettingstothe
profiler,asshowninFigure 17.6.Thedefaultdesirabilityfunctionsaresetto
largerisbetter,whichiswhatyouwantinthisexperiment.SeetheProfilersbookformore
detailsaboutthepredictionprofiler.
5. AgainclicktheredtriangleonthePredictionProfilertitlebarandselectMaximize
Desirabilitytoautomaticallysetthepredictiontracesthatgivethebestresultsaccordingto
thedesirabilityfunctions.
Inthisexample,thesettingsforInterferandWallchangedfrom1to2.(SeeFigure 17.5and
Figure 17.6).TheDepthsettingchangedfrom1to3.ThesettingsforAdhesivedidnotchange.
Thesenewsettingsincreasedthesignaltonoiseratiofrom24.0253to26.9075.
Figure 17.6BestFactorSettingsforByrneTaguchiData
456
Taguchi Designs
Creating a Taguchi Design
Chapter 17
Design of Experiments Guide
DetailtheResponseandAddFactorsonpage 456
ChooseInnerandOuterArrayDesignsonpage 457
DisplayCodedDesignonpage 458
MaketheDesignTableonpage 458
AddfactorsintheFactorsoutline.
Specifyoneormore2or3levelsignalfactors.Signalfactorsaresystemcontrol
inputs.Thesearefactorsthatyoucancontrolinproduction.
Signal
Noise Specifyoneormorenoisefactors.Noisefactorsarevariablesthataredifficultor
expensivetocontrolinproduction.However,youmustbeabletocontrolnoisefactors
duringtheexperiment.
Chapter 17
Design of Experiments Guide
Taguchi Designs
Creating a Taguchi Design
457
Remove Removestheselectedfactors.
ThestepsforspecifyingfactorsaregiveninFigure 17.8.
1. Clicktoaddasignal,thenselectasignaltype:2 Level,or3 Level.
Orclicktoaddanoise.
2. Doubleclicktoeditthefactorname.
3. Tochangethevalueofasignalornoise,clickandthentypethenewvalue.
Figure 17.8EnteringFactors
1
Whenyoufinishaddingfactors,clickContinue.
458
Taguchi Designs
Creating a Taguchi Design
Chapter 17
Design of Experiments Guide
Ifyoudidnotspecifyanoisefactor,afteryouclickContinue,adialogappearsthatasksyouto
specifyhowmanytimesyouwanttoperformeachinnerarrayrun.Specifytwo(2)forthis
example.
TheCodedDesignshowsthepatternofhighandlowvaluesforthefactorsineachrun.For
moredetailsonthecodeddesign,seeUnderstandingDesignCodesonpage 251inthe
ScreeningDesignschapter.
Chapter 17
Design of Experiments Guide
Figure 17.11TaguchiDesignTableforEightFactorL12Design
Taguchi Designs
Creating a Taguchi Design
459
460
Taguchi Designs
Creating a Taguchi Design
Chapter 17
Design of Experiments Guide
Chapter 18
Evaluate Designs
Explore Properties of Your Design
UsingtheEvaluateDesignplatform,youcan:
seethestrengthsandlimitationsofyourexistingexperimentaldesign
determineyourdesignsabilitytodetecteffectsassociatedwithmeaningfulchangesinthe
response
addresspredictionvarianceandtheprecisionofyourestimates
gaininsightonaliasing
obtainefficiencymeasures
TheEvaluateDesignplatformgeneratestheresultsthatappearintheDesignEvaluation
outlinesprovidedbyseveralDOEplatforms.DiagnosticsprovidedbybothEvaluateDesign
andtheDesignEvaluationoutlinesincludethefollowing:
poweranalysis
apredictionvarianceprofilerandsurfaceplot
afractionofdesignspaceplot,showinghowmuchofthedesignspacehasprediction
varianceaboveagivenvalue
estimationefficiencymeasuresforparameterestimates
thealiasmatrix,showingthebiasstructureformodeleffects
acolormapshowingabsolutecorrelationsamongeffects
designefficiencyvalues
Figure 18.1ComparisonofTwoFractionofDesignSpacePlots
Contents
OverviewofEvaluateDesign..................................................... 463
ExampleofEvaluateDesign...................................................... 464
AssessingtheImpactofLostRuns .............................................. 464
EvaluatingPowerRelativetoaSpecifiedModel.................................. 471
EvaluateDesignLaunchWindow ................................................. 473
EvaluateDesignWindow......................................................... 473
Factors ...................................................................... 475
Model ...................................................................... 475
AliasTerms.................................................................. 476
Design ...................................................................... 476
DesignEvaluation ............................................................ 476
PowerAnalysis .............................................................. 477
PredictionVarianceProfile .................................................... 483
FractionofDesignSpacePlot .................................................. 484
PredictionVarianceSurface .................................................... 485
EstimationEfficiency ......................................................... 487
AliasMatrix................................................................. 488
ColorMaponCorrelations .................................................... 490
DesignDiagnostics........................................................... 491
EvaluateDesignOptions......................................................... 493
TechnicalDetails................................................................ 494
PowerCalculations ........................................................... 494
RelativePredictionVariance................................................... 497
Chapter 18
Design of Experiments Guide
Evaluate Designs
Overview of Evaluate Design
463
Showshowmuchofthemodelpredictionvarianceliesbelow
oraboveagivenvalue.
Prediction Variance Surface Showsasurfaceplotofthepredictionvarianceforanytwo
continuousfactors.
Estimation Efficiency Foreachparameter,givesthefractionalincreaseinthelengthofa
confidenceintervalcomparedtothatofanideal(orthogonal)design,whichmightnot
exist.Alsogivestherelativestandarderroroftheparameters.
Givescoefficientsthatindicatethedegreetowhichthemodelparametersare
biasedbyeffectsthatarepotentiallyactive,butnotinthemodel.
Alias Matrix
intensityscale.
Design Diagnostics Givesefficiencymeasuresforyourdesign.
Note: InseveralDOEplatforms,whenyouconstructadesign,aDesignEvaluationoutline
appears.ThisoutlineshowsresultsprovidedbytheEvaluateDesignplatform.Theplatforms
thatprovideaDesignEvaluationoutlineare:CustomDesign,DefinitiveScreeningDesign,
ScreeningDesign,ResponseSurfaceDesign,andMixtureDesignwithOptimaldesigntype.
464
Evaluate Designs
Example of Evaluate Design
Chapter 18
Design of Experiments Guide
Chapter 18
Design of Experiments Guide
Evaluate Designs
Example of Evaluate Design
465
3. ClickRecall.
4. ClickOK.
LeaveyourEvaluateDesignwindowfortheactualdesignopen.
Tip: PlacetheEvaluateDesignwindowfortheactualdesigntotherightoftheEvaluate
Designwindowfortheintendeddesigntofacilitatecomparingthetwodesigns.
Comparison of Intended and Actual Designs
Youcannowcomparethetwodesignsusingthesemethods:
PowerAnalysisonpage 465
PredictionVarianceProfileonpage 466
FractionofDesignSpacePlotonpage 468
EstimationEfficiencyonpage 469
ColorMaponCorrelationsonpage 470
DesignDiagnosticsonpage 471
PowerAnalysis
Ineachwindow,dothefollowing:
1. OpenthePowerAnalysisoutline.
Theoutlineshowsdefaultvaluesof1forallAnticipatedCoefficients.Thesevalues
correspondtodetectingachangeintheanticipatedresponseof2unitsacrossthelevelsof
thecorrespondingterms.Thepowercalculationsassumeanerrorterm(Anticipated
RMSE)of1.
Frompreviousstudies,youbelievethattheRMSEisapproximately2.
2. Type2nexttoAnticipated RMSE.
Whenyouclickoutsidethetextbox,thepowervaluesareupdated.
Youareinterestedindetectingdifferencesintheanticipatedresponsethatareontheorder
of6unitsacrossthelevelsofthecorrespondingterms.Thisdifferencerequiresthe
AnticipatedCoefficientstobe3.Tosettheseuniformly,usearedtriangleoption.
3. FromtheredtrianglemenunexttoEvaluateDesign,selectAdvanced Options > Set Delta
for Power.
4. Type6asyourvaluefordelta.
5. ClickOK.
Figure 18.2showsbothoutlines,withtheDesignandAnticipatedResponsesoutlineclosed.
466
Evaluate Designs
Example of Evaluate Design
Chapter 18
Design of Experiments Guide
Figure 18.2PowerAnalysisOutlines,IntendedDesign(Left)andActualDesign(Right)
Thepowervaluesfortheactualdesignareuniformlysmallerthanfortheintendeddesign.For
SilicaandSulfur,thepowerofthetestsintheactualdesignisalmosthalfthepowerinthe
intendeddesign.FortheSilica*Sulfurinteraction,thepowerofthetestintheactualdesignis
0.231,comparedto0.672intheintendeddesign.Theactualdesignresultsinsubstantiallossof
powerincomparisonwiththeintendeddesign.
PredictionVarianceProfile
1. Ineachwindow,openthePredictionVarianceProfileoutline.
2. Inthewindowfortheactualdesign,placeyourcursoronthescalefortheverticalaxis.
Whenyourcursorbecomesahand,rightclick.Select Edit > Copy Axis Settings.
Thisactioncreatesascriptcontainingtheaxissettings.Next,applytheseaxissettingsto
thePredictionVarianceProfileplotfortheintendeddesign.
3. IntheEvaluateDesignwindowfortheintendeddesign,locatethePredictionVariance
Profileoutline.Whenyourcursorbecomesahand,rightclick.Select Edit > Paste Axis
Settings.
TheplotsareshowninFigure 18.5,withtheplotfortheintendeddesignatthetopandfor
theactualdesignatthebottom.
Chapter 18
Design of Experiments Guide
Evaluate Designs
Example of Evaluate Design
467
Figure 18.3PredictionVarianceProfile,IntendedDesign(Top)andActualDesign(Bottom)
ThePredictionVarianceProfileplotsareprofilerviewsoftherelativepredictionvariance.
Youcanexploretherelativepredictionvarianceinvariousregionsofdesignspace.
Bothplotsshowthesamerelativepredictionvarianceinthecenterofthedesignspace.
However,thevarianceforpointsneartheedgesofthedesignspaceappearsgreaterthan
forthesamepointsintheintendeddesign.Explorethisphenomenonbymovingallthree
verticallinestopointsneartheedgesofthefactorsettings.
4. Inbothwindows,selectMaximize DesirabilityfromthePredictionVarianceProfilered
trianglemenu.
Figure 18.4showsthemaximumrelativepredictionvariancefortheintendedandactual
designs.
468
Evaluate Designs
Example of Evaluate Design
Chapter 18
Design of Experiments Guide
Figure 18.4PredictionVarianceProfileMaximized,IntendedDesign(Top)andActualDesign
(Bottom)
Forbothdesigns,theprofilersidentifythesamepointasoneofthedesignpointswhere
themaximumpredictionvarianceoccurs:Silica=0.7,Sulfur=1.8,andSilane=40.The
maximumpredictionvarianceis1.396fortheintendeddesign,and3.021fortheactual
design.Notethatthereareotherpointswherethepredictionvarianceismaximized.The
largermaximumpredictionvariancefortheactualdesignmeansthatpredictionsinparts
ofthedesignspacearelessaccuratethantheywouldhavebeenhadtheintendeddesign
beenconducted.
FractionofDesignSpacePlot
1. Ineachwindow,opentheFractionofDesignSpacePlotoutline.
2. Inthewindowfortheintendeddesign,rightclickintheplotandselectEdit > Copy Frame
Contents.
3. Inthewindowfortheactualdesign,locatetheFractionofDesignSpacePlotoutline.
4. RightclickintheplotandselectEdit > Paste Frame Contents
Figure 18.5showstheplotwithannotations.EachFractionofDesignSpacePlotshowsthe
proportionofthedesignspaceforwhichtherelativepredictionvariancefallsbelowa
specificvalue.
Chapter 18
Design of Experiments Guide
Evaluate Designs
Example of Evaluate Design
469
Figure 18.5FractionofDesignSpacePlots
Therelativepredictionvariancefortheactualdesignisgreaterthanthatoftheintended
designovertheentiredesignspace.Thediscrepancyincreaseswithlargerdesignspace
coverage.
EstimationEfficiency
Ineachwindow,opentheEstimationEfficiencyoutline.
Figure 18.6EstimationEfficiencyOutlines,IntendedDesign(Left)andActualDesign(Right)
Intheactualdesign(right),therelativestandarderrorsforallparameterseitherexceedor
equalthestandarderrorsfortheintendeddesign(left).Forallexceptthreeofthe
noninterceptparameters,therelativestandarderrorsintheactualdesignexceedthoseinthe
intendeddesign.
TheFractionalIncreaseinCILengthcomparesthelengthofaparametersconfidenceinterval
asgivenbythecurrentdesigntothelengthofsuchanintervalgivenbyanidealdesignofthe
samerunsize.Thelengthoftheconfidenceinterval,andconsequentlytheFractionalIncrease
inCILength,isaffectedbythenumberofruns.SeeFractionalIncreaseinCILengthon
page 487.Despitethereductioninrunsize,fortheactualdesign,thetermsSilane,
Silica*Silane,andSulfur*Silanehaveasmallerincreasethanfortheintendeddesign.Thisis
470
Evaluate Designs
Example of Evaluate Design
Chapter 18
Design of Experiments Guide
becausethetworunsthatwereremovedtodefinetheactualdesignhadSilanesettoitscenter
point.Byremovingtheseruns,thewidthsoftheconfidenceintervalsfortheseparameters
morecloselyresemblethoseofanidealorthogonaldesign,whichhasnocenterpoints.
ColorMaponCorrelations
Ineachreport,dothefollowing:
1. OpentheColor Map On Correlationsoutline.
Theplotsshowduplicationofthetwowayinteractionscausedbythefactthattheseare
includedintheAliasTermsoutline.Next,youremovetheinteractionsintheAliasTerms
outlinetoshowplotsthatincludeonlytheeffectsintheModeloutline.
2. OpentheAliasTermsoutlineandselectallthreetwowayinteractions.
3. ClickRemove Term.
4. GobacktotheColorMaponCorrelationsoutline.
Thetwocolormaps,showninFigure 18.7,areupdatedtoshowonlytheeffectsinthe
Modeloutline.Eachplotshowstheabsolutecorrelationsbetweeneffectscoloredusinga
bluetoredintensityscale.Ideally,youwouldlikezeroorverysmallcorrelationsbetween
effects.
Figure 18.7ColorMaponCorrelations,IntendedDesign(Left)andActualDesign(Right)
Chapter 18
Design of Experiments Guide
Evaluate Designs
Example of Evaluate Design
471
Theabsolutevaluesofthecorrelationsrangefrom0(blue)to1(red).Hoveroveracelltosee
thevalueoftheabsolutecorrelation.Thecolormapfortheactualdesignshowsmoreabsolute
correlationsthatarelargethandoesthecolormapfortheintendeddesign.Forexample,the
correlationbetweenSulfurandSilica*Sulfuris< .0001fortheintendeddesign,and0.5774for
theactualdesign.
DesignDiagnostics
Ineachreport,opentheDesignDiagnosticsoutline.
Figure 18.8DesignDiagnostics,IntendedDesign(Left)andActualDesign(Right)
Theintendeddesign(left)hashigherefficiencyvaluesandaloweraverageprediction
variancethantheactualdesign(right).TheresultsoftheDesignEvaluationanalysisindicate
thatthetwolostrunshavehadanegativeimpactonthedesign.
Notethatboththenumberofrunsandthemodelmatrixfactorintothecalculationof
efficiencymeasures.Inparticular,theD,G,andAefficienciesarecalculatedrelativetothe
idealdesignfortherunsizeofthegivendesign.Itisnotnecessarilytruethatlargerdesigns
aremoreefficientthansmallerdesigns.However,foragivennumberoffactors,largerdesigns
tendtohavesmallerAverageVarianceofPredictionvaluesthandosmallerdesigns.For
detailsonhowefficiencymeasuresaredefined,seeDesignDiagnosticsonpage 491.
472
Evaluate Designs
Example of Evaluate Design
Chapter 18
Design of Experiments Guide
believethatthelikelymodelcontainsmain,interaction,andquadraticeffectsonlyfor
Methanol,Ethanol,andTime.Youdecidetoinvestigatepowerinthecontextofathreefactor
responsesurfacemodel.
UsetheEvaluateDesignplatformtodeterminethepowerofyourdesigntodetectstrong
quadraticeffectsforMethanol,Ethanol,orTime.
1. SelectHelp > Sample Data Library andopenDesign Experiment/Extraction Data.jmp.
2. SelectDOE > Evaluate Design.
3. SelectMethanol,Ethanol,andTimeandclickX, Factor.
YoucanaddYield asY, Responseifyouwish.Butspecifyingtheresponsehasnoeffecton
thepropertiesofthedesign.
4. ClickOK.
5. IntheModeloutline,clickRSM.
Thisaddstheinteractionandquadratictermsforthethreefactors.
6. OpenthePowerAnalysisoutline.
NotethattheAnticipatedRMSEissetto1bydefault.Althoughyouhaveanestimateof
theRMSEfrompaststudies,youneednotenterit.Thisisbecausethemagnitudeofthe
effectofinterestisthreetimestheerrorvariation.
7. UnderAnticipated Coefficient,type3nexttoMethanol*Methanol,Ethanol*Ethanol,and
Time*Time.
8. ClickApply Changes to Anticipated Coefficients.
Figure 18.9PowerAnalysisOutlineafterApplyingChangestoCoefficients
Thepowerofdetectingaquadraticeffectwhosemagnitudeisthreetimestheerror
variationis0.737.Thisassumesafinalmodelthatisaresponsesurfaceinthreefactors.It
alsoassumesa0.05significancelevelforthetest.
Chapter 18
Design of Experiments Guide
Evaluate Designs
Evaluate Design Launch Window
473
Thelaunchwindowcontainsthefollowingbuttons:
Y, Response Entertheresponsecolumnorcolumns.Enteringaresponseisoptional.
Responsevaluesarenotusedinevaluatingthedesign.Responsesmustbenumeric.
X, Factor Enterthefactorcolumns.FactorscanbeofanyDataTypeorModelingType.
TheFactors,Model,AliasTerms,andDesignoutlinesdefinethemodelanddesign.
TheDesignEvaluationoutlineprovidesresultsthatdescribethepropertiesofyourdesign.
474
Evaluate Designs
Evaluate Design Window
Chapter 18
Design of Experiments Guide
Figure 18.11EvaluateDesignWindowShowingAllPossibleOutlines
TheFactors,Model,AliasTerms,andDesignoutlinescontaininformationthatyouenter
aboutthefactors,assumedmodel,potentiallyaliasedeffectsofinterest,andtheactualdesign.
JMPpopulatestheseoutlinesusingyourselectionsinthelaunchwindowandthedesign
table.However,youcanmodifytheeffectsintheModelandAliasTermsoutlines.These
outlinesaredescribedinthefollowingsections:
Factorsonpage 475
Modelonpage 475
AliasTermsonpage 476
Designonpage 476
Onceyouhavemadeyourspecifications,theDesignEvaluationoutlinesareupdated.Youcan
opentheseoutlinestoseereportsorcontrolwindowsthatprovideinformationaboutyour
design.Theseoutlinesaredescribedinthefollowingsections:
PowerAnalysisonpage 477
PredictionVarianceProfileonpage 483
FractionofDesignSpacePlotonpage 484
PredictionVarianceSurfaceonpage 485
EstimationEfficiencyonpage 487
AliasMatrixonpage 488
ColorMaponCorrelationsonpage 490
DesignDiagnosticsonpage 491
Chapter 18
Design of Experiments Guide
Evaluate Designs
Evaluate Design Window
475
Factors
Thefactorsoutlineliststhefactorsenteredinthelaunchwindow.Youcanselectfactorsto
constructeffectsintheModeloutline.
Model
IfthedatatablecontainsascriptcalledModelorFitModel,theModeloutlinecontainsthe
effectsspecifiedinthatscript.Otherwise,theModeloutlinecontainsonlymaineffects.
Figure 18.12showstheModeloutlinefortheBounce Data.jmp datatable,foundintheDesign
Experimentfolder.TheModelscriptinthedatatablecontainsresponsesurfaceeffectsforthe
threefactorsSilica,Silane,andSulfur.Consequently,theModeloutlinecontainsthemain
effects,twowayinteractions,andquadraticeffectsforthesethreefactors.
Figure 18.12ModelOutlineforBounceData.jmp
YoucanaddeffectstotheModeloutlineusingthefollowingbuttons:
Main Effects Addsmaineffectsforallfactorsinthemodel.
Interactions Addsinteractioneffects.IfnofactorsareselectedintheFactorsoutline,select
2nd,3rd,4th,or5thtoaddallappropriateinteractionsuptothatorder.Addinteractions
uptoagivenorderforspecificfactorsbyselectingthefactornamesintheFactorsoutline,
selectingInteractions,andthenspecifyingtheappropriateorder.Interactionsbetween
nonmixtureandmixturefactors,andinteractionswithblockingandconstantfactors,are
notadded.
RSM Addsinteractionandquadratictermsuptothesecondorder(responsesurfacemodel
terms)forcontinuousfactors.CategoricalfactorsarenotincludedinRSMterms.Main
effectsfornonmixturefactorsthatinteractwithallthemixturefactorsareremoved.
Addsspecificinteractionterms.SelectfactornamesintheFactorsoutlineandeffect
namesintheModeloutline.ClickCrosstoaddthecrossedtermstotheModeloutline.
Cross
476
Evaluate Designs
Evaluate Design Window
Chapter 18
Design of Experiments Guide
Addspolynomialterms.IfnofactornamesareselectedintheFactorsoutline,adds
polynomialtermsforallcontinuousfactors.IffactornamesareselectedintheFactors
outline,addspolynomialtermsforonlythosefactors.Select2nd,3rd,4th,or5thtoadd
polynomialtermsofthatorder.
Powers
specifyamixturemodelwiththirddegreepolynomialterms.
Remove Term Removesselectedeffects.
Alias Terms
Itispossiblethateffectsnotincludedinyourassumedmodelareactive.IntheAliasTerms
outline,listpotentiallyactiveeffectsthatarenotinyourassumedmodelbutmightbiasthe
estimatesofmodelterms.TheAliasMatrixentriesrepresentthedegreeofbiasimpartedto
modelparametersbytheeffectsthatyouspecifiedintheAliasTermsoutline.Fordetails,see
TheAliasMatrixonpage 601intheTechnicalDetailsappendix.
Bydefault,theAliasTermsoutlineincludesalltwowayinteractioneffectsthatarenotinyour
Modeloutline(withtheexceptionoftermsinvolvingblockingfactors).Addorremoveterms
usingthebuttons.ForadescriptionofhowtousethesebuttonstoaddeffectstotheAlias
Termstable,seeModelonpage 475.
IntheEvaluateDesignplatform,theAliasMatrixoutlineisimmediatelyupdatedtoreflect
changestoAliasMatrixeffects.IntheCustomDesignplatform,youmustclickMakeDesign
aftermodifyingtheeffectsintheAliasTermsoutline.WithinotherDOEplatformsthat
constructdesigns,thereisnoAliasTermsoutline.However,theAliasMatrixoutline,
containingappropriateeffects,appearsunderDesignEvaluationafteryouconstructthe
design.
Design
TheDesignoutlineshowsthedesignrunsforthefactorsthatyouhavespecifiedinthelaunch
window.YoucaneasilyviewthedesignasyouexploreitspropertiesintheDesignEvaluation
outline.
Design Evaluation
DesignEvaluationwithintheEvaluateDesignplatformisbasedonyourdesignandthe
specificationsthatyoumakeintheModelandAliasTermsoutlines.SeveralDOEDesign
platformsprovideaDesignEvaluationoutline:Custom,DefinitiveScreening,Screening,
ResponseSurface,andMixturewithOptimaldesigntype.DesignEvaluationwithinthese
platformsisbasedonthedesignthatyouconstruct.
Chapter 18
Design of Experiments Guide
Evaluate Designs
Evaluate Design Window
477
TheDesignEvaluationoutlinecontainseightheadings:
PowerAnalysisonpage 477
PredictionVarianceProfileonpage 483
FractionofDesignSpacePlotonpage 484
PredictionVarianceSurfaceonpage 485
EstimationEfficiencyonpage 487
AliasMatrixonpage 488
ColorMaponCorrelationsonpage 490
DesignDiagnosticsonpage 491
Power Analysis
ThePowerAnalysisoutlinecalculatesthepoweroftestsfortheparametersinyourmodel.
Poweristheprobabilityofdetectinganactiveeffectofagivensize.ThePowerAnalysis
outlinehelpsyouevaluatetheabilityofyourdesigntodetecteffectsofpracticalimportance.
Powerdependsonthenumberofruns,thesignificancelevel,andtheestimatederror
variation.Inparticular,youcandetermineifadditionalrunsarenecessary.
Thissectioncoversthefollowingtopics:
PowerAnalysisOverviewonpage 477
PowerAnalysisDetailsonpage 478
TestsforIndividualParametersonpage 479
TestsforCategoricalEffectswithMoreThanTwoLevelsonpage 480
DesignandAnticipatedResponsesOutlineonpage 480
PowerAnalysisforCoffeeExperimentonpage 481
478
Evaluate Designs
Evaluate Design Window
Chapter 18
Design of Experiments Guide
InthePowerAnalysisoutline,youcan:
Specifycoefficientvaluesthatreflectdifferencesthatyouwanttodetect.Youentertheseas
AnticipatedCoefficientsinthetoppartoftheoutline.
Specifyanticipatedresponsevaluesandapplythesetodeterminethecorresponding
AnticipatedCoefficients.YouspecifyAnticipatedResponsesintheDesignand
AnticipatedResponsespanel.
Significance Level
calculationsupdateimmediatelywhenyouenteravalue.
Chapter 18
Design of Experiments Guide
Evaluate Designs
Evaluate Design Window
479
ThetopportionofthePowerAnalysisreportopenswithdefaultvaluesfortheAnticipated
Coefficients.SeeFigure 18.13.ThedefaultvaluesarebasedonDelta.Fordetails,see
AdvancedOptions>SetDeltaforPoweronpage 493.
Figure 18.14showsthetopportionofthePowerAnalysisreportwherevalueshavebeen
specifiedfortheAnticipatedCoefficients.Thesevaluesreflectthedifferencesyouwantto
detect.
Figure 18.14PossibleSpecificationofAnticipatedCoefficientsforCoffeeData.jmp
TestsforIndividualParameters
TheTermcolumncontainsalistofmodelterms.Foreachterm,theAnticipatedCoefficient
columncontainsavalueforthatterm.ThevalueinthePowercolumnisthepowerofatest
thatthecoefficientforthetermis0ifthetruevalueofthecoefficientisgivenbythe
AnticipatedCoefficient.
Term
Themodeltermassociatedwiththecoefficientbeingtested.
Note: TheorderinwhichmodeltermsappearinthePowerAnalysisreportmaynotbe
identicaltotheirorderintheParameterEstimatesreportobtainedusingStandardLeast
Squares.Thisdifferencecanonlyoccurwhenthemodelcontainsaninteractionwithmore
thanonedegreeoffreedom.
Anticipated Coefficient Avalueforthecoefficientassociatedwiththemodelterm.Thisvalue
isusedinthecalculationsforPower.Thesevaluesarealsousedtocalculatethe
AnticipatedResponsecolumnintheDesignandAnticipatedResponsesoutline.Whenyou
setanewvalueintheAnticipatedCoefficientcolumn,clickApply Changes to Anticipated
CoefficientstoupdatethePowerandAnticipatedResponsecolumns.
480
Evaluate Designs
Evaluate Design Window
Chapter 18
Design of Experiments Guide
Note: Theanticipatedcoefficientshavedefaultvaluesof1forcontinuouseffects.They
havealternatingvaluesof1and1forcategoricaleffects.YoucanspecifyavalueforDelta
beselectingAdvanced Options > Set Delta for Powerfromtheredtrianglemenu.Ifyou
changethevalueofDelta,thevaluesoftheanticipatedcoefficientsareupdatedsothat
theirabsolutevaluesareonehalfofDelta.Fordetails,seeAdvancedOptions>SetDelta
forPoweronpage 493.
Power Probabilityofrejectingthenullhypothesisofnoeffectwhenthetruecoefficientvalue
isgivenbythespecifiedAnticipatedCoefficient.Foracoefficientassociatedwitha
numericfactor,thechangeinthemeanresponse(basedonthemodel)istwicethe
coefficientvalue.Foracoefficientassociatedwithacategoricalfactor,thechangeinthe
meanresponse(basedonthemodel)acrossthelevelsofthefactorequalstwicethe
absolutevalueoftheanticipatedcoefficient.
CalculationsusethespecifiedSignificanceLevelandAnticipatedRMSE.Fordetailsofthe
powercalculation,seePowerforaSingleParameteronpage 494.
Apply Changes to Anticipated Coefficients WhenyousetanewvalueintheAnticipated
modelparameterscorrespondingtotheeffectarezero.Thedifferencetobedetectedis
definedbythevaluesintheAnticipatedCoefficientcolumnthatcorrespondtothemodel
termsfortheeffect.Thepowercalculationreflectsthedifferencesinresponsemeans
determinedbytheanticipatedcoefficients.
CalculationsusethespecifiedSignificanceLevelandAnticipatedRMSE.Fordetailsofthe
powercalculation,seePowerforaCategoricalEffectonpage 495.
DesignandAnticipatedResponsesOutline
TheDesignandAnticipatedResponsesoutlineshowsthedesignprecededbyanAnticipated
Responsecolumn.EachentryinthefirstcolumnistheAnticipatedResponsecorresponding
tothedesignsettings.TheAnticipatedResponseiscalculatedusingtheAnticipated
Coefficients.
Figure 18.15showstheDesignandAnticipatedResponsesoutlinecorrespondingtothe
specificationofAnticipatedCoefficientsgiveninFigure 18.14.
Chapter 18
Design of Experiments Guide
Evaluate Designs
Evaluate Design Window
481
Figure 18.15AnticipatedResponsesforCoffeeData.jmp
IntheAnticipatedResponsecolumn,youcanspecifyavalueforeachsettingofthefactors.
Thesevaluesreflectthedifferencesyouwanttodetect.
ClickApply Changes to Anticipate ResponsestoupdateboththeAnticipatedCoefficientand
Powercolumns.
Anticipated Response TheresponsevalueobtainedusingtheAnticipatedCoefficientvalues
ascoefficientsinthemodel.Whentheoutlinefirstappears,thecalculationofAnticipated
ResponsevaluesisbasedonthedefaultvaluesintheAnticipatedCoefficientcolumn.
WhenyousetnewvaluesintheAnticipatedResponsecolumn,clickApply Changes to
Anticipated ResponsestoupdatetheAnticipatedCoefficientandPowercolumns.
ThecolumnstotherightoftheAnticipatedResponsecolumnshowthefactor
settingsforallrunsinyourdesign.
Design
WhenyousetnewvaluesintheAnticipated
Responsecolumn,clickApply Changes to Anticipated Responsestoupdatethe
AnticipatedCoefficientandPowercolumns.
Achangeof0.10unitsasyouvaryGrindfromCoarsetoMedium.
482
Evaluate Designs
Evaluate Design Window
Chapter 18
Design of Experiments Guide
Achangeof0.10unitsormoreasyouvaryTemperature,Time,andChargefromtheirlow
tohighlevels.
AnincreaseduetoeachofStations1and2of0.10unitsbeyondtheoverallanticipated
mean.ThiscorrespondstoadecreaseduetoStation3of0.20unitsfromtheoverall
anticipatedmean.
Youset0.05asyourSignificanceLevel.YourestimateofthestandarddeviationofStrengthfor
fixeddesignsettingsis0.1andyouenterthisastheAnticipatedRMSE.
Figure 18.16showsthePowerAnalysisnodewiththesevaluesentered.Specifically,you
specifytheSignificanceLevel,AnticipatedRMSE,andthevalueofeachAnticipated
Coefficient.
WhenyouclickApplyChangestoAnticipatedCoefficients,theAnticipatedResponsevalues
areupdatedtoreflectthemodelyouhavespecified.
Figure 18.16PowerAnalysisOutlinewithUserSpecificationsinAnticipatedCoefficients
Panel
RecallthatTemperatureisacontinuousfactorwithcodedlevelsof1and1.Considerthetest
whosenullhypothesisisthatTemperaturehasnoeffectonStrength.Figure 18.16showsthat
thepowerofthistesttodetectadifferenceof0.10(=2*0.05)unitsacrossthelevelsof
Temperatureisonly0.291.
Chapter 18
Design of Experiments Guide
Evaluate Designs
Evaluate Design Window
483
NowconsiderthetestforthewholeStation effect,whereStationisathreelevelcategorical
factor.ConsiderthetestwhosenullhypothesisisthatStationhasnoeffectonStrength.Thisis
theusualFtestforacategoricalfactorprovidedintheEffectTestsreportwhenyourun
Analyze > Fit Model.(SeetheFittingLinearModelsbook.)
ThePowerofthistestisshowndirectlybeneaththeApplyChangestoAnticipated
Coefficientsbutton.TheentriesunderAnticipatedCoefficientsforthemodeltermsStation1
andStation2areboth0.10.Thesesettingsimplythattheeffectofbothstationsistoincrease
Strengthby0.10unitsabovetheoverallanticipatedmean.ForthesesettingsoftheStation1
andStation2coefficients,theeffectofStation3onStrength istodecreaseitby0.20unitsfrom
theoverallanticipatedmean.Figure 18.16showsthatthepowerofthetesttodetecta
differenceofatleastthismagnitudeis0.888.
RelativePredictionVariance
Forgivensettingsofthefactors,thepredictionvarianceistheproductoftheerrorvariance
andaquantitythatdependsonthedesignandthefactorsettings.Beforeyourunyour
experiment,theerrorvarianceisunknown,sothepredictionvarianceisalsounknown.
However,theratioofthepredictionvariancetotheerrorvarianceisnotafunctionoftheerror
variance.Thisratio,calledtherelativepredictionvariance,dependsonlyonthedesignandthe
factorsettings.Consequently,therelativevarianceofpredictioncanbecalculatedbefore
acquiringthedata.Fordetails,seeRelativePredictionVarianceonpage 497.
484
Evaluate Designs
Evaluate Design Window
Chapter 18
Design of Experiments Guide
Afteryourunyourexperimentandfitaleastsquaresmodel,youcanestimatetheerror
varianceusingthemeansquarederror(MSE)ofthemodelfit.Youcanestimatetheactual
varianceofpredictionatanysettingbymultiplyingtherelativevarianceofpredictionatthat
setting.
Itisidealforthepredictionvariancetobesmallthroughoutthedesignspace.Generally,the
errorvariancedropsasthesamplesizeincreases.Incomparingdesigns,youmaywantto
placethepredictionvarianceprofilersfortwodesignssidebyside.Adesignwithlower
predictionvarianceonaverageispreferred.
MaximizeDesirability
Youcanalsoevaluateadesignorcomparedesignsintermsofthemaximumrelative
predictionvariance.SelecttheMaximize Desirabilityoptionfromtheredtrianglenextto
PredictionVarianceProfile.JMPusesadesirabilityfunctionthatmaximizestherelative
predictionvariance.ThevalueoftheVariancedisplayedinthePredictionvarianceProfileis
theworst(leastdesirablefromadesignpointofview)valueoftherelativeprediction
variance.
Figure 18.18showsthePredictionVarianceProfileafterMaximizeDesirabilitywasselected.
TheplotisfortheBounce Data.jmpsampledatatable,locatedintheDesignExperimentfolder.
Thelargestvalueoftherelativepredictionvarianceis1.395833.Theplotalsoshowsvaluesof
thefactorsthatgivethisworstcaserelativevariance.However,keepinmindthatmany
settingscanleadtothissamerelativevariance.SeePredictionVarianceSurfaceonpage 485.
Figure 18.18PredictionVarianceProfileShowingMaximumVariance
Chapter 18
Design of Experiments Guide
Evaluate Designs
Evaluate Design Window
485
Figure 18.19FractionofDesignSpacePlot
TheXaxisintheplotrepresentstheproportionofthedesignspace,rangingfrom0to100%.
TheYaxisrepresentsrelativepredictionvariancevalues.Forapoint x y thatfallsonthe
bluecurve,thevaluexistheproportionofdesignspacewithvariancelessthanorequaltoy.
Reddottedcrosshairsmarkthevaluethatboundstherelativepredictionvariancefor50%of
designspace.
Figure 18.19showsthattheminimumrelativepredictionvarianceisslightlylessthan0.3,
whilethemaximumisbelow1.4.(Theactualmaximumis1.395833,asshowninFigure 18.18.)
Thereddottedcrosshairsindicatethattherelativepredictionvarianceisabout0.34.Youcan
usethecrosshairstooltofindthemaximumrelativepredictionvariancethatcorrespondsto
anyFractionofSpacevalue.UsethecrosshairstoolinFigure 18.19toseethat90%ofthe
predictionvariancevaluesarebelowapproximately0.55.
Note: MonteCarlosamplingofthedesignspaceisusedinconstructingtheFractionofDesign
SpacePlot.Therefore,plotsforthesamedesignmayvaryslightly.
486
Evaluate Designs
Evaluate Design Window
Chapter 18
Design of Experiments Guide
Figure 18.20PredictionVarianceSurface
Whentherearetwoormorefactors,thePredictionVarianceSurfaceoutlineshowsaplotof
therelativepredictionvarianceforanytwovariables.ThePredictionVarianceSurfaceoutline
plotstherelativepredictionvarianceformula.Dragontheplottorotateandchangethe
perspective.
ControlPanel
TheControlPanelconsistsofthefollowing:
Response Grid Slider TheGridcheckboxsuperimposesagridthatshowsconstantvaluesof
Variance.ThevalueoftheVarianceisshowninthetextbox.Thesliderenablesyouto
adjusttheplacementofthegrid.Alternatively,youcanenteraVariancevalueinthetext
box.Clickoutsidetheboxtoupdatetheplot.
Independent Variables Thispanelenablesyoutoselectwhichtwofactorsareusedasaxesfor
theplotandtospecifythesettingsforfactorsnotusedasaxes.Selectafactorforeachofthe
XandYaxesbyclickingintheappropriatecolumn.Usetheslidersandtextboxesto
specifyvaluesforeachfactornotselectedforanaxis.Theplotshowsthethreedimensional
sliceofthesurfaceatthespecifiedvaluesofthefactorsthatarenotusedasaxesintheplot.
Movethesliderstoseedifferentslices.
Eachgridcheckboxactivatesagridforthecorrespondingfactor.Usethesliderstoadjust
theplacementofeachgrid.
LockZScalelocksthezaxistoitscurrentvalues.Thisisusefulwhenmovingthesliders
thatarenotonanaxis.
Appearance TheResolutionslideraffectshowmanypointsareevaluatedforaformula.Too
coarsearesolutionmeansthatafunctionwithasharpchangemightnotberepresented
Chapter 18
Design of Experiments Guide
Evaluate Designs
Evaluate Design Window
487
verywell.Butsettingtheresolutionhighcanmakeevaluatinganddisplayingthesurface
slower.
TheOrthographic projectioncheckboxshowsaprojectionoftheplotintwodimensions.
TheContourmenucontrolstheplacementofcontourcurves.Acontourcurveisasetof
pointswhoseResponsevaluesareconstant.YoucanselecttoturnthecontoursOff(the
default)orplacethemcontoursBelow,Above,orOnSurface.
Estimation Efficiency
ThisreportgivestheFractionalIncreaseinCI(ConfidenceInterval)LengthandRelativeStd
(Standard)ErrorofEstimateforeachparameterestimateinthemodel.Figure 18.21showsthe
EstimationEfficiencyoutlinefortheBounce Data.jmpsampledatatable,locatedintheDesign
Experimentfolder.
Figure 18.21EstimationEfficiencyOutline
n X'X ii 1
488
Evaluate Designs
Evaluate Design Window
Chapter 18
Design of Experiments Guide
where
XisthemodelmatrixdefinedinTheModelMatrixonpage 601intheTechnical
Detailsappendix,
1 istheithdiagonalentryof X'X 1 ,and
X'X ii
nisthenumberofruns.
Notethatthestandarderrorforaparameterestimateinanorthogonaldesign,ifoneexists,is:
SE Orth = ------- I n
n
where I n isthenbynidentitymatrixandistheerror.
Relative Std Error of Estimate
TheRelativeStdErrorofEstimategivestheratioofthestandarddeviationofaparameters
estimatetotheerrorstandarddeviation.Thesevaluesindicatehowlargethestandarderrors
ofthemodelsparameterestimatesare,relativetotheerrorstandarddeviation.Fortheith
parameterestimate,theRelativeStdErrorofEstimateisdefinedasfollows:
SE =
1
X'X ii
where
XisthemodelmatrixdefinedinTheModelMatrixonpage 601intheTechnical
Detailsappendix,and
1 istheithdiagonalentryof X'X 1 .
X'X ii
Alias Matrix
TheAliasMatrixaddressestheissueofhowtermsthatarenotincludedinthemodelaffectthe
estimationofthemodelterms,iftheyareindeedactive.IntheAliasTermsoutline,youlist
potentiallyactiveeffectsthatarenotinyourassumedmodelbutthatmightbiastheestimates
ofmodelterms.TheAliasMatrixentriesrepresentthedegreeofbiasimpartedtomodel
parametersbytheAliasTermseffects.SeeAliasTermsonpage 476.
TherowsoftheAliasMatrixarethetermscorrespondingtothemodeleffectslistedinthe
Modeloutline.ThecolumnsaretermscorrespondingtoeffectslistedintheAliasTerms
outline.Theentryinagivenrowandcolumnindicatesthedegreetowhichthealiasterm
affectstheparameterestimatecorrespondingtothemodelterm.
Inevaluatingyourdesign,youideallywantoneoftwosituationstooccurrelativetoanyentry
intheAliasMatrix.Eithertheentryissmallor,ifitisnotsmall,theeffectofthealiastermis
smallsothatthebiaswillbesmall.Ifyoususpectthatthealiastermmayhaveasubstantial
Chapter 18
Design of Experiments Guide
Evaluate Designs
Evaluate Design Window
489
effect,thenthattermshouldbeincludedinthemodeloryoushouldconsideranaliasoptimal
design.
FordetailsonhowtheAliasMatrixiscomputed,seeTheAliasMatrixonpage 601inthe
TechnicalDetailsappendix.
Note: Dependingonthecomplexityofthedesign,itispossibletohavealiasmatrixentries
greaterthan1orlessthan1.
Alias Matrix Examples
ConsidertheCoffee Data.jmpsampledatatable,locatedintheDesignExperimentfolder.The
designassumesamaineffectsmodel.YoucanseethisbyrunningtheModelscriptinthedata
table.Consequently,intheEvaluateDesignwindowsModeloutline,onlytheInterceptand
fivemaineffectsappear.TheAliasTermsoutlinecontainsthetwowayinteractions.TheAlias
MatrixisshowninFigure 18.22.
Figure 18.22AliasMatrixforCoffeeData.jmp
TheAliasMatrixshowstheModeltermsinthefirstcolumndefiningtherows.Thetwoway
interactionsintheAliasTermsarelistedacrossthetop,definingthecolumns.Considerthe
modeleffectTemperatureforexample.IftheGrind*Timeinteractionistheonlyactivetwoway
interaction,theestimateforthecoefficientofTemperatureisbiasedby0.333timesthetrue
valueoftheGrind*Time effect.Ifotherinteractionsareactive,thenthevalueintheAliasMatrix
indicatestheadditionalamountofbiasincurredbytheTemperaturecoefficientestimate.
ConsidertheBounce Data.jmpsampledatatable,locatedintheDesignExperimentfolder.The
Modelscriptcontainsalltwowayinteractions.Consequently,theEvaluateDesignwindow
showsallmaineffectsandtwowayinteractionsintheModeloutline.Thethreetwoway
interactionsareautomaticallyaddedtothelistofAliasTerms.Therefore,theAliasMatrix
showsacolumnforeachofthesethreeinteractions(Figure 18.23).Noticethattheonly
nonzeroentriesinthealiasmatrixcorrespondtothebiasimpactofthetwowayinteractions
onthemselves.Theseentriesare1s,whichisexpectedbecausethetwowayinteractionsare
alreadyinthemodel.
490
Evaluate Designs
Evaluate Design Window
Chapter 18
Design of Experiments Guide
Figure 18.23AliasMatrixforBounceData.jmp
Chapter 18
Design of Experiments Guide
Evaluate Designs
Evaluate Design Window
491
Fromtheperspectiveofcorrelation,thisisagooddesign.Wheneffectsarehighlycorrelated,
itismoredifficulttodeterminewhichisresponsibleforaneffectontheresponse.
Figure 18.24ColorMaponCorrelations
Design Diagnostics
TheDesignDiagnosticsreportshowsD,G,andAefficienciesandtheaveragevarianceof
prediction.ThesediagnosticsarenotshownfordesignsthatincludefactorswithChangesset
toHardorVeryHardoreffectswithEstimabilitydesignatedasIfPossible.
WhenEvaluateDesignisaccessedfromaDOEplatformotherthanEvaluateDesign,the
DesignCreationTimegivestheamountoftimerequiredtocreatethedesign.WhenDesign
DiagnosticsisaccessedfromtheEvaluateDesignplatform,DesignCreationTimegivesthe
amountoftimerequiredfortheEvaluateDesignplatformtocalculateresults.
Figure 18.25showstheDesignDiagnosticsoutlinefortheBounce Data.jmpsampledatatable,
foundintheDesignExperimentfolder.
Figure 18.25DesignDiagnosticsOutline
492
Evaluate Designs
Evaluate Design Window
Chapter 18
Design of Experiments Guide
Caution: Theefficiencymeasuresshouldnotbeinterpretedontheirown.Buttheycanbe
usedtocomparedesigns.Giventwodesigns,theonewiththehigherefficiencymeasureis
better.Whilethemaximumefficiencyis100foranycriterion,anefficiencyof100%is
impossibleformanydesignproblems.
Notation
Thedescriptionsoftheefficiencymeasuresgivenbelowusethefollowingnotation:
Xisthemodelmatrix
nisthenumberofrunsinthedesign
pisthenumberofterms,includingtheintercept,inthemodel
Varianceonpage 497.
D Efficiency
TheefficiencyofthedesigntothatofanidealorthogonaldesignintermsoftheDoptimality
criterion.AdesignisDoptimalifitminimizesthevolumeofthejointconfidenceregionfor
thevectorofregressioncoefficients:
Defficiency= 100 --1- XX 1 / p
n
G Efficiency
TheefficiencyofthedesigntothatofanidealorthogonaldesignintermsoftheGoptimality
criterion.AdesignisGoptimalifitminimizesthemaximumpredictionvarianceoverthe
designregion:
Gefficiency= 100 p nVar y x max
LettingDdenotethedesignregion,
Var y x max = maximum x XX
x inD
Note: GEfficiencyiscalculatedusingMonteCarlosamplingofthedesignspace.Therefore,
calculationsforthesamedesignmayvaryslightly.
Chapter 18
Design of Experiments Guide
Evaluate Designs
Evaluate Design Options
493
A Efficiency
TheefficiencyofthedesigntothatofanidealorthogonaldesignintermsoftheAoptimality
criterion.AdesignisAoptimalifitminimizesthesumofthevariancesoftheregression
coefficients:
Aefficiency=100p nTrace XX 1
Average Variance of Prediction
Atapoint x inthedesignspace,therelativepredictionvarianceisdefinedas:
Var y x = x XX x
Notethatthisisthepredictionvariancedividedbytheerrorvariance.Fordetailsofthe
calculation,seeSection4.3.5inGoosandJones,2011.
Design Creation Time
DesignCreationTimegivestheamountoftimerequiredfortheEvaluateDesignplatformto
calculateresults.
wholeplotandthesubplotvariance(ifpresent)totheerrorvariance.Beforesettingthis
value,youmustdefineahardtochangefactorforyoursplitplotdesign,orhardand
veryhardtochangefactorsforyoursplitsplitplotdesign.Thenyoucanenteroneortwo
positivenumbersforthevarianceratios,dependingonwhetheryouhavespecifieda
splitplotorasplitsplitplotdesign.
Specifyavalueforthedifferenceyouwanttodetect
thatisappliedtoAnticipatedCoefficientsinthePowerAnalysisreport.TheAnticipated
CoefficientsvaluesaresettoDelta/2forcontinuouseffects.Forcategoricaleffects,theyare
alternatingvaluesofDelta/2andDelta/2.Foradditionaldetailsonpoweranalysis,see
PowerAnalysisonpage 477
Bydefault,Deltaissettotwo.Consequently,theAnticipatedCoefficientdefaultvaluesare
1forcontinuouseffectsandalternatingvaluesof1and1forcategoricaleffects.The
defaultvaluesthatareenteredasAnticipatedCoefficientswhenDeltais2ensurethese
properties:
494
Evaluate Designs
Technical Details
Chapter 18
Design of Experiments Guide
ThepowercalculationforanumericeffectassumesachangeofDeltaintheresponse
meanduetolinearmaineffectsasthefactorchangesfromthelowestsettingtothe
highestsettinginthedesignregion.
Thepowercalculationfortheparameterassociatedwithatwolevelcategoricalfactor
assumesachangeofDeltaintheresponsemeanacrossthelevelsofthefactor.
Thepowercalculationforacategoricaleffectwithmorethantwolevelsisbasedonthe
multipledegreeoffreedomFtestforthenullhypothesisthatalllevelshavethesame
responsemean.Poweriscalculatedatthevaluesoftheresponsemeansthatare
determinedbytheAnticipatedCoefficients.VariousconfigurationsoftheAnticipated
CoefficientscandefineadifferenceinlevelsaslargeasDelta.However,thepower
valuesforsuchconfigurationswilldifferbasedontheAnticipatedCoefficientsforthe
otherlevels.
Save Script to Script Window CreatesascriptthatreproducestheEvaluateDesignwindow
andplacesitinanopenscriptwindow.
Technical Details
Thissectioncontainstechnicaldetailsforthefollowingareas:
PowerCalculationsonpage 494
RelativePredictionVarianceonpage 497
Power Calculations
ThePowerAnalysisreportgivespowercalculationsforsingleparametervaluesand,when
thedesignincludesacategoricalfactorwiththreeormorelevels,forwholeeffects.This
sectiondescribesthecalculationsinthetwocases:
PowerforaSingleParameteronpage 494
PowerforaCategoricalEffectonpage 495
Chapter 18
Design of Experiments Guide
Evaluate Designs
Technical Details
495
?i Theparametercorrespondingtothetermofinterest.
i
A
i
Theleastsquaresestimatorofi
A
TheAnticipatedCoefficientvalue.Thedifferenceyouwanttodetectis 2 i .
1
Theerrorvariance,2,isestimatedbytheMSE,andhas n p 1 degreesoffreedom,wheren
isthenumberofobservationsandpisthenumberoftermsotherthantheinterceptinthe
model.
Thetestof H 0 : i = 0 isgivenby:
i
----------------------------------------MSE XX ii
orequivalentlyby:
2
i
F 0 = -------------------------------------1
MSE XX ii
Underthenullhypothesis,theteststatisticF0hasanFdistributionon1and n p 1 degrees
offreedom.
A
Ifthetruevalueof i is i ,thenF0hasanoncentralFdistributionwithnoncentrality
parametergivenby:
A 2
i
= -------------------------2
1
XX ii
Tocomputethepowerofthetest,firstsolveforthelevelcriticalvalueFc:
= 1 FDist F c 1 n p 1
Thencalculatethepowerasfollows:
Power = 1 FDist F c 1 n p 1
Power for a Categorical Effect
Thissectiondescribeshowpowerforthetestforawholecategoricaleffectiscomputed.Use
thefollowingnotation:
496
Evaluate Designs
Technical Details
Chapter 18
Design of Experiments Guide
Modelmatrix.SeeTheModelMatrixonpage 601intheTechnicalDetails
appendix.
Vectorofparameters
Leastsquaresestimateof
VectorofAnticipatedCoefficientvalues
Matrixthatdefinesthetestforthecategoricaleffect.ThematrixLidentifiesthe
valuesoftheparametersincorrespondingtothecategoricaleffectandsets
themequalto0.Thenullhypothesisforthetestofthecategoricaleffectisgiven
by:
H 0 :L = 0
RankofL.Alternatively,risthenumberoflevelsofthecategoricaleffectminus
one.
Thecovariancematrixof isgivenby XX
,where2istheerrorvariance.
Theerrorvariance,2,isestimatedbytheMSE,andhas n p 1 degreesoffreedom,wheren
isthenumberofobservationsandpisthenumberoftermsotherthantheinterceptinthe
model.
Thetestof H 0 :L = 0 isgivenby:
1
1
F 0 = L L XX L L rMSE
Underthenullhypothesis,theteststatisticF0hasanFdistributiononrand n p 1 degrees
offreedom.
A
Ifthetruevalueofis ,thenF0hasanoncentralFdistributionwithnoncentrality
parametergivenby:
A
1
= L L XX L
A
2
L
Tocomputethepowerofthetest,firstsolveforthelevelcriticalvalueFc:
= 1 FDist F c r n p 1
Chapter 18
Design of Experiments Guide
Evaluate Designs
Technical Details
Thencalculatethepowerasfollows:
Power = 1 FDist F c r n p 1
Modelmatrix.SeeTheModelMatrixonpage 601intheTechnicalDetails
appendix.
Errorvariance
Vectorofleastsquaresestimatesoftheparameters
xi
TheithrowofX
Usingthisnotation,thepredictedresponsefortheithrowofXisgivenby:
= x
Y
i
Therelativepredictionvarianceatthesettingsdefinedby x i isgivenby:
x i var Y x i
x i var X x i
1
----------------------------- = --------------------------------- = x i XX x i
2
2
497
498
Evaluate Designs
Technical Details
Chapter 18
Design of Experiments Guide
Chapter 19
Augmented Designs
Experimentaldesignisbesttreatedasasequentialprocess.Ambiguitiesthatresultfroma
singledesigncanberesolvedbyconductingfurtherexperimentalruns.
Foranexistingdesigntable,theAugmentDesignplatformconstructsadditionalrunsinaway
thatoptimizestheoveralldesignprocess.Youcanaddrunstoaccomplishthefollowing
objectives:
replicatethedesignaspecifiednumberoftimes
addcenterpoints
createafoldoverdesign
addaxialpointstogetherwithcenterpointstotransformascreeningdesigntoaresponse
surfacedesign
addspacefillingpointstoadesign
addrunstothedesignusingamodelthatcanhavemoretermsthantheoriginalmodel
ThischapterprovidesanoverviewoftheAugmentDesignplatform.Italsopresentsacase
studyofdesignaugmentation.
Contents
ADOptimalAugmentationoftheReactorExample................................. 501
AnalyzetheAugmentedDesign................................................ 504
Factors ......................................................................... 510
AugmentationChoices ........................................................... 510
ReplicateaDesign ............................................................ 511
AddCenterPoints............................................................ 514
CreatingaFoldoverDesign .................................................... 515
AddingAxialPoints .......................................................... 516
SpaceFilling ................................................................. 517
AddingNewRunsandTerms.................................................. 518
DefineFactorConstraints ........................................................ 521
SpecialAugmentDesignOptions.................................................. 525
SavetheDesign(X)Matrix .................................................... 525
ModifytheDesignCriterion(DorIOptimality)................................. 525
SelecttheNumberofRandomStarts ............................................ 525
DesignSearchTime .......................................................... 526
SpecifytheSphereRadiusValue................................................ 526
Chapter 19
Design of Experiments Guide
Augmented Designs
A D-Optimal Augmentation of the Reactor Example
501
4. NowclickAugmentontheAugmentDesigndialogtoseethedisplayinFigure 19.2.
ThismodelshowninFigure 19.2istheresultofthemodelstoredwiththedatatablewhenit
wascreatedbytheCustomdesigner.However,theaugmenteddesignistohave16runsin
ordertoestimatealltwofactorinteractions.
502
Augmented Designs
A D-Optimal Augmentation of the Reactor Example
Chapter 19
Design of Experiments Guide
Figure 19.2InitialAugmentedModel
Tocontinuewiththeaugmentedreactordesign:
5. Choose 2ndfromtheInteractionsmenuasshowninFigure 19.3.Thisaddsallthe
twofactorinteractionstothemodel.TheMinimumnumberofrunsgivenforthespecified
modelis16,asshownintheDesignGenerationtexteditbox.
Chapter 19
Design of Experiments Guide
Augmented Designs
A D-Optimal Augmentation of the Reactor Example
503
Figure 19.3AugmentedModelwithAllTwoFactorInteractions
6. ClickMake Design.
JMPnowcomputesDoptimallyaugmentedfactorsettings,similartothedesignshownin
Figure 19.4.
Figure 19.4DOptimallyAugmentedFactorSettings
Note: Theresultingdesignisafunctionofaninitialrandomnumberseed.Toreproducethe
exactfactorsettingstableinFigure 19.4,(orthemostrecentdesignthatyougenerated),
chooseSet Random SeedfromthepopupmenuontheAugmentDesigntitlebar.Adialog
showsthemostrecentlyusedrandomnumber.ClickOKtousethatnumberagain,orCancel
togenerateadesignbasedonanewrandomnumber.ThedialoginFigure 19.5showsthe
randomnumber(12834729)usedtogeneratetherunsinFigure 19.4.
504
Augmented Designs
A D-Optimal Augmentation of the Reactor Example
Chapter 19
Design of Experiments Guide
Figure 19.5SpecifyingaRandomNumber
7. ClickMake TabletogeneratetheJMPtablewithDOptimallyaugmentedruns.
Youarenowreadytoruntheanalysis.
4. Tostarttheanalysis,selectRun ScriptfromtheModelredtrianglemenuintheupperleft
cornerofthedatatable(Figure 19.7).
Chapter 19
Design of Experiments Guide
Augmented Designs
A D-Optimal Augmentation of the Reactor Example
505
Figure 19.7CompletedAugmentedExperiment(ReactorAugmentData.jmp)
TheModelscript,storedasatablepropertywiththedata,containstheJSLcommandsthat
displaytheFitModeldialogwithallmaineffectsandtwofactorinteractionsaseffects.
5. ChangethefittingpersonalityontheFitModeldialogfromStandard Least Squaresto
Stepwise,asshowninFigure 19.8.
Figure 19.8FitModelDialogforStepwiseRegressiononGeneratedModel
506
Augmented Designs
A D-Optimal Augmentation of the Reactor Example
Chapter 19
Design of Experiments Guide
6. WhenyouclickRun,thestepwiseregressioncontrolpanelappears.Clickthecheckboxes
forallthemaineffectterms.
Note: SelectP-value ThresholdfromtheStopping Rulemenu,Mixed fromtheDirection
menu,andmakesureProb to Enteris0.050andProb to Leaveis0.100.Thesearenotthe
defaultvalues.FollowthedialogshowninFigure 19.9.
Figure 19.9InitialStepwiseModel
7. ClickGotostartthestepwiseregression.Theprocesscontinuesuntilalltermsareentered
intothemodelthatmeettheProb to EnterandProb to LeavecriteriaintheStepwise
RegressionControlpanel.
Figure 19.10showstheresultofthisexampleanalysis.NotethatFeed Rateisoutofthe
modelwhiletheCatalyst*Temperature,Stir Rate*Temperature,andthe
Temperature*Concentrationinteractionshaveenteredthemodel.
Chapter 19
Design of Experiments Guide
Augmented Designs
A D-Optimal Augmentation of the Reactor Example
507
Figure 19.10CompletedStepwiseModel
8. AfterStepwiseisfinished,clickMake ModelontheStepwisecontrolpaneltogeneratethis
reducedmodel,asshowninFigure 19.11.
9. ClickRun andfitthereducedmodeltodoadditionaldiagnosticwork,makepredictions,
andfindtheoptimalfactorsettings.
508
Augmented Designs
A D-Optimal Augmentation of the Reactor Example
Chapter 19
Design of Experiments Guide
Figure 19.11NewPredictionModelDialog
TheAnalysisofVarianceandLackofFitTestsinFigure 19.12,indicateahighlysignificant
regressionmodelwithnoevidenceofLackofFit.
Figure 19.12PredictionModelAnalysisofVarianceandLackofFitTests
TheSortedParameterEstimatestableinFigure 19.13showsthatCatalysthasthelargest
maineffect.However,thesignificanceofthetwofactorinteractionsisofthesameorderof
magnitudeasthemaineffects.Forthisreason,theinitialscreeningexperimentinA
Chapter 19
Design of Experiments Guide
Augmented Designs
A D-Optimal Augmentation of the Reactor Example
509
StandardDesignforFiveContinuousFactorsonpage 237intheScreeningDesigns
chapterhadambiguousresults.
Figure 19.13PredictionModelEstimatesPlot
Tosummarize,comparetheanalysisof16runswiththeanalysesofreactordatafrom
previouschapters:
InAStandardDesignwithTwoContinuousFactorsandOneCategoricalFactoron
page 234intheScreeningDesignschapter,ascreeningdesignwithonly8runswas
analyzed.Theanalysisproducedamodelwiththefivemaineffectsandtwointeraction
effectswithconfounding.Noneofthefactorseffectsweresignificant,althoughthe
Catalystfactorwaslargeenoughtoencouragecollectingdataforfurtherruns.
InTheFiveFactorReactorExampleonpage 295,afullfactorialofthefivetwolevel
reactorfactors,32runs,wasfirstsubjectedtoastepwiseregression.Thisapproach
identifiedthreemaineffects(Catalyst,Temperature,andConcentration)andtwo
interactions(Temperature*Catalyst,Concentration*Temperature)assignificanteffects.
510
Augmented Designs
Factors
Chapter 19
Design of Experiments Guide
ByusingaDoptimalaugmentationof8runstoproduce8additionalruns,astepwise
analysisreturnedthesameresultsastheanalysisof32runs.Thebottomlineisthatonly
halfasmanyrunsyieldedthesameinformation.Thus,usinganiterativeapproachtoDOE
cansavetimeandmoney.
Factors
WhentheCustomDesignwindowopens,theFactorsoutlineshowsthefollowing:
AllfactorslistedasX,Factor,intheAugmentDesignlaunchwindowexceptfor
factorswiththeRandomBlockdesignrolecolumnproperty.
Name
Role IfthefactorhasaDesignRolecolumnpropertyspecifiedinthedatatable,thatroleis
shownintheRolecolumn.IfthefactordoesnothaveaDesignRolecolumnpropertyand
isconstant,thenConstantappearsintheRolecolumn.Otherwise,thefactorsmodeling
typeappearsintheRolecolumn.
Changes IfthefactorhasaFactorChangescolumnpropertyspecifiedinthedatatable,that
valueisshownintheChangescolumn.IfthefactordoesnothaveaFactorChanges
columnproperty,thenChangesisspecifiedasEasy.
Note: IfafactorhasaFactorChangescolumnpropertythatissettoHardorVeryHard,
thenthecorrespondingwholeplotfactormustbeincludedintheX,Factorlistinthe
AugmentDesignlaunchwindow.
Forcontinuousfactors,showstheminimumandmaximumvalues.Forcategorical
factors,showsthelevels.
Values
Tip: FactorsthathavearoleofCategoricalorConstantappearintheNamecolumnwitha
downarrowicon.Clickonthedownarrowtoaddlevels.IfthefactorisConstantandhasa
categoricalmodelingtype,multiplelevelscanbeadded.IfthefactorisConstantandhasa
continuousmodelingtype,onlyonelevelcanbeadded.
Augmentation Choices
TheAugmentDesignplatformrequiresanexistingdesigndatatable.Itgivesthefollowing
fivechoices:
Replicate replicatesthedesignaspecifiednumberoftimes.SeeReplicateaDesignon
page 511.
Add Centerpoints Addscenterpoints.Specifyhowmanyadditionalrunsyouwanttoaddas
centerpointstothedesign.Acenterpointisarunwhosesettingforeachcontinuousfactor
Chapter 19
Design of Experiments Guide
Augmented Designs
Augmentation Choices
511
ismidwaybetweenthehighandlowsettings.SeeCenterPoints,ReplicateRuns,and
Testingonpage 60intheStartingOutwithDOEchapter.
Ifadesigncontainsbothcontinuousandothertypesoffactors,centerpointsmightnotbe
balancedrelativetothelevelsoftheotherfactors.AugmentDesignchoosesthecenter
pointstomaximizetheD,I,oraliasefficiencyofthedesign.
SeeAddCenterPointsonpage 514.
Fold Over
createsafoldoverdesign.SeeCreatingaFoldoverDesignonpage 515.
responsesurfacedesign.SeeAddingAxialPointsonpage 516.
Addsadditionalrunstoanydesignconsistingofcontinuousfactors.Additional
runsareconstructedusingthefastflexiblefillingmethodology.SeeSpaceFillingon
page 517.
Space Filling
addsrunstothedesign(augment)usingamodel,whichcanhavemoretermsthan
theoriginalmodel.SeeAddingNewRunsandTermsonpage 518.
Augment
Replicate a Design
Replicationprovidesadirectcheckontheassumptionthattheerrorvarianceisconstant.It
alsoreducesthevariabilityoftheregressioncoefficientsinthepresenceoflargeprocessor
measurementvariability.
Toreplicatethedesignaspecifiednumberoftimes:
1. Openadatatablethatcontainsadesignthatyouwanttoaugment.Thisexampleuses
Reactor 8 Runs.jmp fromtheDesignExperimentsampledatafolderinstalledwithJMP.
2. SelectDOE > Augment Designtoseetheinitialdialogforspecifyingfactorsandresponses.
3. SelectPercent ReactedandclickY, Response.
4. Selectallothervariables(exceptPattern)andclickX, Factortoidentifythefactorsthatyou
wanttousefortheaugmenteddesign(Figure 19.15).
Figure 19.15IdentifyResponseandFactors
512
Augmented Designs
Augmentation Choices
Chapter 19
Design of Experiments Guide
7. ClicktheReplicatebuttontoseethedialogshownontheleftinFigure 19.17.Enterthe
numberoftimesyouwantJMPtoperformeachrunandthenclickOK.
Note: Entering2specifiesthatyouwanteachruntoappeartwiceintheresultingdesign.
Thisisthesameasonereplicate(Figure 19.17).
8. Viewthedesign,shownontherightinFigure 19.17.
Figure 19.17ReactorDataDesignAugmentedwithTwoReplicates
Chapter 19
Design of Experiments Guide
Augmented Designs
Augmentation Choices
9. IntheDesignEvaluationsection,clickthedisclosureiconsnexttoPredictionVariance
ProfileandPredictionVarianceSurfacetoseetheprofileandsurfaceplotsshownin
Figure 19.18.
Figure 19.18PredictionProfilerandSurfacePlot
513
514
Augmented Designs
Augmentation Choices
Chapter 19
Design of Experiments Guide
Figure 19.19TheReplicatedDesign
Chapter 19
Design of Experiments Guide
Augmented Designs
Augmentation Choices
515
Figure 19.20DesignwithTwoCenterPointsAdded
516
Augmented Designs
Augmentation Choices
Chapter 19
Design of Experiments Guide
Figure 19.21ListingofaFoldoverDesignonAllFactors
Chapter 19
Design of Experiments Guide
Augmented Designs
Augmentation Choices
517
center points
axial points
Space Filling
TheSpaceFillingaugmentationchoiceaddspointstoadesignconsistingofcontinuous
factorsusingthefastflexiblefillingmethodwiththeMaxProcriterion.TheSpaceFilling
choiceaccommodatesconstraintsonthedesignspace.Youcanspecifylinearconstraintsor
disallowedcombinations.
Thealgorithmthatisusedtoaugmentdesignsbeginsbygeneratingalargenumberof
randompointswithinthespecifieddesignregion.ThesepointsarethenclusteredusingaFast
WardalgorithmintoanumberofclustersthatequalstheNumberofAdditionalRunsthatyou
specify.
ThefinaldesignpointsareobtainedbyoptimizingtheMaxPro(maximumprojection)criterion
overtheexistingandadditionalruns.Forpfactorsandnequaltothenumberofexistingand
additionalruns,theMaxProcriterionstrivestofindpointsintheclustersthatminimizethe
followingcriterion:
C MaxPro =
n1
j = i+1
x ik x jk
k=1
TheMaxProcriterionmaximizestheproductofthedistancesbetweendesignpointsinaway
thatinvolvesallfactors.Thissupportsthegoalofprovidinggoodspacefillingpropertieson
projectionsoffactors.SeeJosephetal.(2014,forthcoming).
518
Augmented Designs
Augmentation Choices
Chapter 19
Design of Experiments Guide
Chapter 19
Design of Experiments Guide
Augmented Designs
Augmentation Choices
519
Figure 19.24ViewingtheExistingDesign
6. IntheDesignGenerationpanel,enterthenumberoftotalrunsthatyouwantthisdesignto
contain.Thenumberthatyouenteristheoriginalnumberofrunsplusthenumberof
additionalrunsthatyouwant.
7. ClicktheMake Designbutton.Theeightnewnumberofruns(Figure 19.25)appearinthe
Designpanel.
520
Augmented Designs
Augmentation Choices
Chapter 19
Design of Experiments Guide
Figure 19.2524TotalRuns
8. Ifdesired,viewthepredictionvarianceprofileandthepredictionvariancesurface.
9. ClickMake TabletocreatetheaugmenteddesignJMPtable(Figure 19.26)withthe
additionalruns.
Chapter 19
Design of Experiments Guide
Augmented Designs
Define Factor Constraints
521
Figure 19.26TheAugmentedDesignTablewithNewRuns
additional
runs
OnlyavailableforfactorswithaRoleofContinuousorMixture.SeeSpecifyLinear
Constraints.
Use Disallowed Combinations Filter Definessetsofconstraintsbasedonrestrictingvaluesof
individualfactors.YoucandefinebothANDandORconstraints.SeeUseDisallowed
CombinationsFilter.
Use Disallowed Combinations Script Definesdisallowedcombinationsandotherconstraints
asBooleanJSLexpressionsinascripteditorbox.SeeUseDisallowedCombinations
Script.
522
Augmented Designs
Define Factor Constraints
Chapter 19
Design of Experiments Guide
design.Entercoefficientvaluesforthefactorsandselectthedirectionoftheinequalityto
reflectyourlinearconstraint.Specifytheconstrainingvalueintheboxtotherightofthe
inequality.Toaddmoreconstraints,clickAddagain.
Note: TheAddoptionisdisabledifyouhavealreadyconstrainedthedesignregionby
specifyingaSphereRadius.
Remove Last Constraint Removesthelastconstraint.
Checkstheconstraintsforconsistency.Thisoptionremovesredundant
constraintsandconductsfeasibilitychecks.AJMPalertappearsifthereisaproblem.If
constraintsareequivalenttoboundsonthefactors,aJMPalertindicatesthattheboundsin
theFactorsoutlinehavebeenupdated.
Check Constraints
factorsettingsappears.Anexpressionthatdescribestherangeusinganinequalityappears
abovetheslider.Youcanspecifydisallowedsettingsbydraggingthesliderarrowsorby
clickingontheinequalityboundsintheexpressionandenteringyourdesiredconstraints.
Intheslider,asolidbluehighlightrepresentsthedisallowedvalues.
Categorical Factor Foracategoricalfactor,thepossiblelevelsaredisplayedeitheraslabeled
blocksor,whenthenumberoflevelsislarge,aslistentries.Selectaleveltodisallowit.To
Chapter 19
Design of Experiments Guide
Augmented Designs
Define Factor Constraints
523
selectmultiplelevels,holdtheControlkey.Theblockorlistentriesarehighlightedto
indicatethelevelsthathavebeendisallowed.Whenyouaddacategoricalfactortothe
DisallowedCombinationspanel,thenumberoflevelsofthecategoricalfactorisgivenin
parenthesesfollowingthefactorname.
DisallowedCombinationsOptions
Thecontrolpanelhasthefollowingcontrols:
Clearsalldisallowedfactorlevelsettingsthatyouhavespecified.Thisdoesnotclear
theselectedfactors.
Clear
combinationoffactorlevelsspecifiedwithinanANDgroupisdisallowed.
ToaddafactortoanANDgrouplateron,clickthegroupsoutlinetoseeahighlighted
rectangle.SelectANDandaddthefactor.
Toremoveasinglefactor,selectDeletefromitsredtrianglemenu.
OR OpenstheAddFilterFactorslist.SelectedfactorsbecomeaseparateANDgroup.For
ANDgroupsseparatedbyOR,acombinationisdisallowedifitisspecifiedinatleastone
ANDgroup.
RedTriangleOptionsforFactors
AfactorcanappearinseveralORgroups.AnoccurrenceofthefactorinaspecificORgroupis
referredtoasaninstanceofthefactor.
Delete RemovestheselectedinstanceofthefactorfromtheDisallowedCombinationspanel.
Clear Selection
Clearsanyselectionforthatinstanceofthefactor.
Deselectstheselectedvaluesandselectsthevaluesnotpreviouslyselected
forthatinstanceofthefactor.
Invert Selection
Availableonlyforcategoricalfactors.Changestheappearanceofthedisplay.
Optionsinclude:
Display Options
Blocks Displayshowseachlevelasablock.
List Displayshowseachlevelasamemberofalist.
Single Category Display showseachlevel.
Check Box Display addsacheckboxnexttoeachvalue.
Availableonlyforcategoricalfactors.Providesatextboxbeneaththefactornamewhere
youcanenterasearchstringforlevelsofthefactor.PresstheEnterkeyorclickoutsidethe
textboxtoperformthesearch.OnceFindisselected,thefollowingFindoptionsappearin
theredtrianglemenu:
Find
524
Augmented Designs
Define Factor Constraints
Chapter 19
Design of Experiments Guide
Clear FindclearstheresultsoftheFindoperationandreturnsthepaneltoitsoriginal
state.
Match Caseusesthecaseofthesearchstringtoreturnthecorrectresults.
Containssearchesforvaluesthatincludethesearchstring.
Does not containsearchesforvaluesthatdonotincludethesearchstring.
Starts withsearchesforvaluesthatstartwiththesearchstring.
Ends withsearchesforvaluesthatendwiththesearchstring.
Use Disallowed Combinations Script
UsethisoptiontodisallowparticularcombinationsoffactorlevelsusingaJSLscript.This
optioncanbeusedwithcontinuousfactorsormixedcontinuousandcategoricalfactors.
Thisoptionopensascriptwindowwhereyouinsertascriptthatidentifiesthecombinations
thatyouwanttodisallow.ThescriptmustevaluateasaBooleanexpression.Whenthe
expressionevaluatesastrue,thespecifiedcombinationisdisallowed.
Whenformingtheexpressionforacategoricalfactor,usetheordinalvalueofthelevelinstead
ofthenameofthelevel.Ifafactorslevelsarehigh,medium,andlow,specifiedinthatorder
intheFactorsoutline,theirassociatedordinalvaluesare1,2,and3.Forexample,supposethat
youhavetwocontinuousfactors,X1andX2,andacategoricalfactorX3withthreelevels:L1,
L2,andL3,inorder.Youwanttodisallowlevelswherethefollowingholds:
e
X1
+ 2X 2 0andX 3 = L2
(Inthefigure,unnecessaryparentheseswereremovedbyparsing.)Noticethatfunctionscan
beenteredaspartoftheBooleanexpression.
Chapter 19
Design of Experiments Guide
Augmented Designs
Special Augment Design Options
525
WhenyouruntheMoments Matrixscript,JMPcreatesamatrixcalledMomentsand
displaysitsnumberofrowsinthelog.
WhenyouruntheDesign Matrixscript,JMPcreatesamatrixcalledXanddisplaysits
numberofrowsinthelog.
WhenyouruntheV Inversescript,JMPcreatestheinverseofthevariancematrixofthe
responses,anddisplaysitsnumberofrowsinthelog.
526
Augmented Designs
Special Augment Design Options
Chapter 19
Design of Experiments Guide
clickMakeDesign.ThenselectNumberofStarts.Thevalueinthetextboxisthenumberof
startsusedtoconstructthespecificdesign.
Tip: Toreproduceaspecificdesign,youneedtospecifytheNumberofStartsandtheRandom
Seedoriginallyusedtoproducethedesign.Obtainthesevaluesfromtheredtriangleoptions
afteryouclickMakeDesign.
Chapter 19
Design of Experiments Guide
Augmented Designs
Special Augment Design Options
Or,useJSLandsubmitthefollowingcommandbeforeyoubuildacustomdesign:
DOE Sphere Radius = 1.0;
Inthisstatementyoucanreplace1.0withanypositivenumber.
527
528
Augmented Designs
Special Augment Design Options
Chapter 19
Design of Experiments Guide
Chapter 20
Prospective Sample Size and Power
UsetheDOE > Sample Size and PowercommandtoanswerthequestionHowmanyrunsdo
Ineed?Theimportantquantitiesaresamplesize,power,andthemagnitudeoftheeffect.
Thesedependonthesignificancelevel,alpha,ofthehypothesistestfortheeffectandthe
standarddeviationofthenoiseintheresponse.Youcansupplyeitheroneortwoofthethree
values.Ifyousupplyonlyoneofthesevalues,theresultisaplotoftheothertwo.Ifyou
supplytwovalues,thethirdvalueiscomputed.
TheSample Size and Powerplatformcananswerthequestion,WillIdetectthegroup
differencesIamlookingfor,givenmyproposedsamplesize,estimateofwithingroup
variance,andalphalevel?Inthistypeofanalysis,youmustapproximatethegroupmeans
andsamplesizesinadatatableaswellasapproximatethewithingroupstandarddeviation
().
Thesamplesizeandpowercomputationsdeterminethesamplesizenecessaryforyieldinga
significantresult,giventhatthetrueeffectsizeisatleastacertainsize.Itrequiresthatyou
entertwooutofthreepossiblequantities;differencetodetect,samplesize,andpower.The
thirdquantityiscomputedforthefollowingcases:
differencebetweenaonesamplemeanandahypothesizedvalue
differencebetweentwosamplemeans
differencesinthemeansamongksamples
differencebetweenastandarddeviationandahypothesizedvalue
differencebetweenaonesampleproportionandahypothesizedvalue
differencebetweentwosampleproportions
differencebetweencountsperunitinaPoissondistributedsampleandahypothesized
value.
Thecalculationsassumethatthereareequalnumbersofunitsineachgroup.Youcanapply
thisplatformtomoregeneralexperimentaldesigns,iftheyarebalancedandanadjustment
forthenumberofparametersisspecified.
Youcanalsocomputetherequiredsamplesizesneededforreliabilitystudiesand
demonstrations.
Contents
LaunchingtheSampleSizeandPowerPlatform ..................................... 531
OneSampleandTwoSampleMeans .............................................. 531
SingleSampleMean .......................................................... 533
SampleSizeandPowerAnimationforOneMean................................. 536
TwoSampleMeans........................................................... 537
kSampleMeans ................................................................ 539
OneSampleStandardDeviation................................................... 540
OneSampleStandardDeviationExample ....................................... 541
OneSampleandTwoSampleProportions .......................................... 542
ActualTestSize.............................................................. 543
OneSampleProportion....................................................... 543
TwoSampleProportions...................................................... 545
CountsperUnit ................................................................. 548
CountsperUnitExample...................................................... 549
SigmaQualityLevel............................................................. 550
SigmaQualityLevelExample .................................................. 550
NumberofDefectsComputationExample ....................................... 551
ReliabilityTestPlanandDemonstration ............................................ 552
ReliabilityTestPlan........................................................... 552
ReliabilityDemonstration ..................................................... 555
Chapter 20
Design of Experiments Guide
531
requiredsamplesize
expectedpower
expectedeffectsize
532
Chapter 20
Design of Experiments Guide
Figure 20.2InitialSampleSizeandPowerWindowsforSingleMean(left)andTwoMeans
(right)
ThewindowsarethesameexceptthattheOneMeanwindowhasabuttonatthebottomthat
accessesananimationscript.
TheinitialSampleSizeandPowerwindowrequiresvaluesforAlpha,Std Dev (theerror
standarddeviation),andoneortwooftheotherthreevalues:Difference to detect,Sample
Size,andPower.TheSampleSizeandPowerplatformcalculatesthemissingitem.Ifthereare
twounspecifiedfields,aplotisconstructed,showingtherelationshipbetweenthesetwo
values:
powerasafunctionofsamplesize,givenspecificeffectsize
powerasafunctionofeffectsize,givenasamplesize
effectsizeasafunctionofsamplesize,foragivenpower.
TheSampleSizeandPowerwindowasksforthesevalues:
Alpha istheprobabilityofatypeIerror,whichistheprobabilityofrejectingthenull
hypothesiswhenitistrue.Itiscommonlyreferredtoasthesignificancelevelofthetest.
Thedefaultalphalevelis0.05.Thisimpliesawillingnesstoaccept(ifthetruedifference
betweengroupsiszero)that,5%(alpha)ofthetime,asignificantdifferenceisincorrectly
declared.
istheerrorstandarddeviation.Itisameasureoftheunexplainedrandomvariation
aroundthemean.Eventhoughthetrueerrorisnotknown,thepowercalculationsarean
exerciseinprobabilitythatcalculateswhatmighthappenifthetruevalueistheoneyou
specify.Anestimateoftheerrorstandarddeviationcouldbetherootmeansquareerror
(RMSE)fromapreviousmodelfit.
Std Dev
multifactorbalanceddesign,inadditiontofittingthemeansdescribedinthesituation,
Chapter 20
Design of Experiments Guide
533
thereareotherfactorswithextraparametersthatcanbespecifiedhere.Forexample,ina
threefactortwoleveldesignwithallthreetwofactorinteractions,thenumberofextra
parametersisfive.(Thisincludestwoparametersfortheextramaineffects,andthree
parametersfortheinteractions.)Inpractice,theparticularvaluesenteredarenotthat
important,unlesstheexperimentalrangehasveryfewdegreesoffreedomforerror.
isthesmallestdetectabledifference(howsmalladifferenceyouwantto
beabletodeclarestatisticallysignificant)totestagainst.Forsinglesampleproblemsthisis
thedifferencebetweenthehypothesizedvalueandthetruevalue.
Difference to Detect
yourexperiment.Samplesizeisnotthenumberpergroup,butthetotaloverallgroups.
Power istheprobabilityofrejectingthenullhypothesiswhenitisfalse.Alargepowervalue
isbetter,butthecostisahighersamplesize.
Continue evaluatesattheenteredvalues.
Back returnstothepreviousSampleSizeandPowerwindowsothatyoucaneitherredoan
analysisorstartanewanalysis.
Animation Script runsaJSLscriptthatdisplaysaninteractiveplotshowingpowerorsample
size.Seethesection,SampleSizeandPowerAnimationforOneMeanonpage 536,for
anillustrationoftheanimationscript.
Single-Sample Mean
UsingtheSampleSizeandPowerwindow,youcantestifonemeanisdifferentfromthe
hypothesizedvalue.
Fortheonesamplemean,thehypothesissupportedis
H 0 : = 0
andthetwosidedalternativeis
H a : 0
whereisthepopulationmeanandisthenullmeantotestagainstoristhedifferenceto
detect.Itisassumedthatthepopulationofinterestisnormallydistributedandthetruemean
iszero.Notethatthepowerforthissettingisthesameasforthepowerwhenthenull
hypothesisisH0:=0andthetruemeanis0.
Supposeyouareinterestedintestingtheflammabilityofanewfabricbeingdevelopedby
yourcompany.Previoustestingindicatesthatthestandarddeviationforburntimesofthis
fabricis2seconds.Thegoalistodetectadifferenceof1.5secondswhenalphaisequalto0.05,
534
Chapter 20
Design of Experiments Guide
thesamplesizeis20,andthestandarddeviationis2seconds.Forthisexample,isequalto
1.5.Tocalculatethepower:
1. SelectDOE > Sample Size and Power.
2. ClicktheOne Sample MeanbuttonintheSampleSizeandPowerWindow.
3. LeaveAlphaas0.05.
4. LeaveExtra Parametersas0.
5. Enter2forStd Dev.
6. Enter1.5asDifference to detect.
7. Enter20forSample Size.
8. LeavePowerblank.(SeetheleftwindowinFigure 20.3.)
9. ClickContinue.
Thepoweriscalculatedas0.8888478174andisroundedto0.89.(Seerightwindowin
Figure 20.3.)Theconclusionisthatyourexperimenthasan89%chanceofdetectinga
significantdifferenceintheburntime,giventhatyoursignificancelevelis0.05,the
differencetodetectis1.5seconds,andthesamplesizeis20.
Figure 20.3AOneSampleExample
Chapter 20
Design of Experiments Guide
Figure 20.4AOneSampleExamplePlot
535
536
Chapter 20
Design of Experiments Guide
Chapter 20
Design of Experiments Guide
537
Figure 20.6ExampleofAnimationScripttoIllustratePower
Two-Sample Means
TheSampleSizeandPowerwindowsworksimilarlyforoneandtwosamplemeans;the
Difference to Detectisthedifferencebetweentwomeans.Thecomparisonisbetweentwo
randomsamplesinsteadofonesampleandahypothesizedmean.
Fortestingthedifferencebetweentwomeans,thehypothesissupportedis
H 0 : 2 = D 0
1
andthetwosidedalternativeis
H a : 2 D 0
1
whereandarethetwopopulationmeansandD0isthedifferenceinthetwomeansor
thedifferencetodetect.Itisassumedthatthepopulationsofinterestarenormallydistributed
andthetruedifferenceiszero.Notethatthepowerforthissettingisthesameasforthepower
whenthenullhypothesisisH0: = 0andthetruedifferenceisD0.
Supposethestandarddeviationis2(asbefore)forbothgroups,thedesireddetectable
differencebetweenthetwomeansis1.5,andthesamplesizeis30(15pergroup).Toestimate
thepowerforthisexample:
1. SelectDOE > Sample Size and Power.
538
Chapter 20
Design of Experiments Guide
Chapter 20
Design of Experiments Guide
539
k-Sample Means
Usingthe k-Sample Meansoption,youcancompareupto10means.Considerasituation
where4levelsofmeansareexpectedtobeintherangeof10to13,thestandarddeviationis
0.9,andyoursamplesizeis16.
Thehypothesistobetestedis:
H0:===versusHa:atleastonemeanisdifferent
Todeterminethepower:
1. SelectDOE > Sample Size and Power.
2. Clickthek Sample Means buttonintheSampleSizeandPowerWindow.
3. LeaveAlphaas0.05.
4. Enter0.9forStd Dev.
5. LeaveExtra Parametersas0.
6. Enter10,11,12,and13asthefourlevelsofmeans.
7. Enter16forSample Size.
8. LeavePowerblank.
9. ClickContinue.
ThePoweriscalculatedas0.95.(SeetheleftofFigure 20.8.)Thismeansthatthereisa95%
chanceofdetectingthatatleastoneofthemeansisdifferentwhenthesignificancelevelis
0.05,thepopulationmeansare10,11,12,and13,andthetotalsamplesizeis16.
IfbothSample SizeandPowerareleftblankforthisexample,thesamplesizeandpower
calculationsproducethePowerversusSample Size curve.(SeetherightofFigure 20.8.)
Thisconfirmsthatasamplesizeof16looksacceptable.
Noticethatthedifferenceinmeansis2.236,calculatedassquarerootofthesumof
squareddeviationsfromthegrandmean.Inthiscaseitisthesquarerootof(1.5)2+
(0.5)2+(0.5)2+(1.5)2,whichisthesquarerootof5.
540
Chapter 20
Design of Experiments Guide
Figure 20.8ProspectivePowerforkMeansandPlotofPowerbySampleSize
differencebetweenstandarddeviationandthehypothesizedstandarddeviationiszero)
thatasignificantdifferenceisincorrectlydeclared5%ofthetime.
Hypothesized Standard Deviation isthehypothesizedorbaselinestandarddeviationtowhich
thesamplestandarddeviationiscompared.
canselect LargerorSmallerfromthemenutoindicatethe
directionofthechangeyouwanttodetect.
isthesmallestdetectabledifference(howsmalladifferenceyouwantto
beabletodeclarestatisticallysignificant).Forsinglesampleproblemsthisisthedifference
betweenthehypothesizedvalueandthetruevalue.
Difference to Detect
experiment.
Chapter 20
Design of Experiments Guide
541
Power istheprobabilityofdeclaringasignificantresult.Itistheprobabilityofrejectingthe
nullhypothesiswhenitisfalse.
InthelowerpartofthewindowyouentertwooftheitemsandtheSampleSizeandPower
calculationdeterminesthethird.
SomeexamplesinthischapteruseengineeringexamplesfromtheonlinemanualofThe
NationalInstituteofStandardsandTechnology(NIST).YoucanaccesstheNISTmanual
examplesathttp://www.itl.nist.gov/div898/handbook.
542
Chapter 20
Design of Experiments Guide
Note: Sometimesyouwanttodetectachangetoasmallerstandarddeviation.Ifyouselect
SmallerfromtheAlternative Standard Deviation menu,enteranegativeamountinthe
Difference to Detectfield.
Figure 20.9WindowToCompareSingleDirectionOneSampleStandardDeviation
TheAddtwosuccessesandtwofailuresadjustedWaldteststatisticdescribedinAgresti
andCoull(1998).SeealsoSection3.3inthewhitepaperbyBarkerontheJMPwebsite:
http://www.jmp.com/blind/whitepapers/wp_jmp_powersample_104887.pdf.
TheClopperPearsonexactconfidenceintervalmethod(ClopperandPearson,1934;
AgrestiandCoull,1998,Section1)
Chapter 20
Design of Experiments Guide
543
Fortwoproportions,resultsarebasedonexactpowercalculationsfortheadjustedWald
statisticproposedbyAgrestiandCaffo(2000).
544
Chapter 20
Design of Experiments Guide
isthetrueproportion,whichcouldbeknownorhypothesized.Thedefaultvalue
is0.1.
Method isthemethodtodeterminetheexactconfidenceinterval.ChoicesareExact
AgrestiCoullorExactClopperPearson.Formoredetails,seeOneSampleand
TwoSampleProportionsonpage 542.
One-Sided or Two-Sided Specifyeitheraonesidedoratwosidedtest.Thedefaultsettingis
thetwosidedtest.
Inthebottomportionofthewindow,entertwoofthefollowingquantitiestoseethethird,
orasinglequantitytoseeaplotoftheothertwo.
Null Proportion istheproportiontotestagainst(p0)orisleftblankforcomputation.The
defaultvalueis0.2.
Sample Size isthesamplesize,orisleftblankforcomputation.IfSample Sizeisleftblank,
thenvaluesforProportionandNull Proportionmustbedifferent.
Power isthedesiredpower,orisleftblankforcomputation.
OneSampleProportionExample
Asanexample,supposethatanassemblylinehasahistoricalproportionofdefectsequalto
0.1,andyouwanttoknowthepowertodetectthattheproportionisdifferentfrom0.2,given
analphalevelof0.05andasamplesizeof100.
1. SelectDOE>Sample Size and Power.
2. ClickOne Sample Proportion.
3. LeaveAlphaas0.05.
4. Leave0.1asthevalueforProportion.
5. LeavetheMethodasExactAgrestiCoull.
6. AcceptthedefaultoptionofTwo-Sided.(Aonesidedtestisselectedifyouareinterested
intestingiftheproportioniseithergreaterthanorlessthantheNull Proportion.)
7. Leave0.2asthevalueforNull Proportion.
8. Enter100astheSample Size.
9. ClickContinue.
ThePoweriscalculatedandisshownasapproximately0.7(seeFigure 20.10).NotetheActual
TestSizeis0.0467,whichisslightlylessthanthedesired0.05.
Chapter 20
Design of Experiments Guide
545
Figure 20.10PowerandSampleWindowforOneSampleProportions
546
Chapter 20
Design of Experiments Guide
Proportion 1 istheproportionforpopulation1,whichcouldbeknownorhypothesized.The
defaultvalueis0.5.
Proportion 2 istheproportionforpopulation2,whichcouldbeknownorhypothesized.The
defaultvalueis0.1.
One-Sided or Two-Sided Specifyeitheraonesidedoratwosidedtest.Thedefaultsettingis
thetwosidedtest.
Null Difference in Proportion istheproportiondifference(D0)totestagainst,orisleftblank
forcomputation.Thedefaultvalueis0.2.
Sample Size 1 isthesamplesizeforpopulation1,orisleftblankforcomputation.
Sample Size 2 isthesamplesizeforpopulation2,orisleftblankforcomputation.
Power isthedesiredpower,orisleftblankforcomputation.
Ifyouenteranytwoofthefollowingthreequantities,thethirdquantityiscomputed:
Power
ExampleofDeterminingSampleSizeswithaTwoSidedTest
Asanexample,supposeyouareresponsiblefortwosiliconwaferassemblylines.Basedonthe
knowledgefrommanyruns,oneoftheassemblylineshasadefectrateof8%;theotherline
hasadefectrateof6%.Youwanttoknowthesamplesizenecessarytohave80%powerto
rejectthenullhypothesisofequalproportionsofdefectsforeachline.
Toestimatethenecessarysamplesizesforthisexample:
1. SelectDOE>Sample Size and Power.
2. ClickTwo Sample Proportions.
3. AcceptthedefaultvalueofAlphaas0.05.
4. Enter0.08forProportion 1.
5. Enter0.06forProportion 2.
6. AcceptthedefaultoptionofTwo-Sided.
7. Enter0.0forNull Difference in Proportion.
8. Enter0.8forPower.
9. LeaveSample Size 1andSample Size 2blank.
10. ClickContinue.
TheSampleSizewindowshowssamplesizesof2554.(seeFigure 20.11.)Testingfora
onesidedtestisconductedsimilarly.SimplyselecttheOne-Sidedoption.
Chapter 20
Design of Experiments Guide
547
Figure 20.11DifferenceBetweenTwoProportionsforaTwoSidedTest
ExampleofDeterminingPowerwithTwoSampleProportionsUsingaOneSidedTest
Supposeyouwanttocomparetheeffectivenessofatwochemicaladditives.Thestandard
additiveisknowntobe50%effectiveinpreventingcrackinginthefinalproduct.Thenew
additiveisassumedtobe60%effective.Youplanonconductingastudy,randomlyassigning
partstothetwogroups.Youhave800partsavailabletoparticipateinthestudy(400partsfor
eachadditive).Yourobjectiveistodeterminethepowerofyourtest,givenanulldifferencein
proportionsof0.01andanalphalevelof0.05.Becauseyouareinterestedintestingthatthe
differenceinproportionsisgreaterthan0.01,youuseaonesidedtest.
1. SelectDOE>Sample Size and Power.
2. ClickTwo Sample Proportions.
3. AcceptthedefaultvalueofAlphaas0.05.
4. Enter0.6forProportion 1.
5. Enter0.5forProportion 2.
6. SelectOne-Sided.
7. Enter0.01astheNull Difference in Proportion.
8. Enter400forSample Size 1.
9. Enter400forSample Size 2.
10. LeavePowerblank.
548
Chapter 20
Design of Experiments Guide
11. ClickContinue.
Figure 20.12showstheTwoProportionswindowswiththeestimatedPowercalculationof
0.82.
Figure 20.12DifferenceBetweenTwoProportionsforaOneSidedTest
Youconcludethatthereisaboutan82%chanceofrejectingthenullhypothesisatthe0.05
levelofsignificance,giventhatthesamplesizesforthetwogroupsareeach400.Notethe
ActualTestSizeis0.0513,whichisslightlylargerthanthestated0.05.
Isthedefectdensitywithinprescribedlimits?
Isthedefectdensitygreaterthanorlessthanaprescribedlimit?
Chapter 20
Design of Experiments Guide
549
IntheCountsperUnitwindow,optionsinclude:
Alpha isthesignificancelevelofyourtest.Thedefaultvalueis0.05.
Baseline Count per Unit isthenumberoftargeteddefectsperunit.Thedefaultvalueis0.1.
Difference to detect isthesmallestdetectabledifferencetotestagainstandisspecifiedin
defectsperunit,orisleftblankforcomputation.
Sample Size isthesamplesize,orisleftblankforcomputation.
Power isthedesiredpower,orisleftblankforcomputation.
550
Chapter 20
Design of Experiments Guide
Figure 20.13WindowForCountsPerUnitExample
TwoofthreequantitiescanbeenteredtodeterminetheSigmaQualityLevelstatisticinthe
SampleSizeandPowerwindow:
Number of Defects
Number of Opportunities
WhenyouclickContinue,thesigmaqualitycalculatorcomputesthemissingquantity.
Chapter 20
Design of Experiments Guide
551
Figure 20.14SigmaQualityLevelExample1
552
Chapter 20
Design of Experiments Guide
TheReliabilityTestPlanwindowhasthefollowingoptions:
Alpha isthesignificancelevel.Itisalso1minustheconfidencelevel.
Chapter 20
Design of Experiments Guide
553
Distribution istheassumedfailuredistribution,withtheassociatedparameters.
Precision Measure istheprecisionmeasure.Inthefollowingdefinitions,UandLcorrespond
totheupperandlowerconfidencelimitsofthequantitybeingestimated(eitheratimeor
failureprobability),andTcorrespondstothetruetimeorprobabilityforthespecified
distribution.
Interval Ratioissqrt(U/L),thesquarerootoftheratiooftheupperandlowerlimits.
Two-sided Interval Absolute WidthisUL,thedifferenceoftheupperandlowerlimits.
Lower One-sided Interval Absolute WidthisTL,thetruevalueminusthelowerlimit.
Two-sided Interval Relative Widthis(UL)/T,thedifferencebetweentheupperandlower
limits,dividedbythetruevalue.
Lower One-sided Interval Relative Widthis(TL)/T,thedifferencebetweenthetruevalue
andthelowerlimit,dividedbythetruevalue.
Objective istheobjectiveofthestudy.Theobjectivecanbeoneofthefollowingtwo:
estimatethetimeassociatedwithaspecificprobabilityoffailure.
estimatetheprobabilityoffailureataspecifictime.
isaplotoftheCDFofthespecifieddistribution.Whenestimatingatime,thetrue
timeassociatedwiththespecifiedprobabilityiswrittenontheplot.Whenestimatinga
failureprobability,thetrueprobabilityassociatedwiththespecifiedtimeiswrittenonthe
plot.
CDF Plot
istheamountoftimetorunthereliabilitytest.
Precision isthelevelofprecision.ThisvaluecorrespondstothePrecisionMeasurechosen
above.
givestheapproximatevariancesandcovariance
forthelocationandscaleparametersofthedistribution.
Continue clickheretomakethecalculations.
Back clickheretogobacktothePowerandSampleSizewindow.
AftertheContinuebuttonisclicked,twoadditionalstatisticsareshown:
Expected number of failures istheexpectednumberoffailuresforthespecified
reliability test.
Probability of fewer than 3 failures istheprobabilitythatthespecifiedreliabilitytestwill
resultinfewerthanthreefailures.Thisisimportantbecauseaminimumofthreefailuresis
requiredtoreliablyestimatetheparametersofthefailuredistribution.Withonlyoneor
twofailures,theestimatesareunstable.Ifthisprobabilityislarge,yourisknotbeingable
toachieveenoughfailurestoreliablyestimatethedistributionparameters,andyoushould
554
Chapter 20
Design of Experiments Guide
considerchangingthetestplan.Increasingthesamplesizeorcensortimearetwowaysof
loweringtheprobabilityoffewerthanthreefailures.
Example
Acompanyhasdevelopedanewproductandwantstoknowtherequiredsamplesizeto
estimatethetimetill20%ofunitsfail,withatwosidedabsoluteprecisionof200hours.In
otherwords,whenaconfidenceintervaliscreatedfortheestimatedtime,thedifference
betweentheupperandlowerlimitsneedstobeapproximately200hours.Thecompanycan
runtheexperimentfor2500hours.Additionally,fromstudiesdoneonsimilarproducts,they
believethefailuredistributiontobeapproximatelyWeibull(2000,3).
Tocomputetherequiredsamplesize,dothefollowingsteps:
1. SelectDOE>Sample Size and Power.
2. SelectReliability Test Plan.
3. SelectWeibullfromtheDistributionlist.
4. Enter2000fortheWeibullparameter.
5. Enter3fortheWeibullparameter.
6. SelectTwo-sided Interval Absolute WidthfromthePrecisionMeasurelist.
7. SelectEstimate time associated with specified failure probability.
8. Enter0.2forp.
9. Enter2500forCensor Time.
10. Enter200forPrecision.
11. ClickContinue.Figure 20.17showstheresults.
Figure 20.17ReliabilityTestPlanResults
Therequiredsamplesizeis217unitsifthecompanywantstoestimatethetimetill20%
failureswithaprecisionof200hours.Theprobabilityoffewerthan3failuresissmall,sothe
experimentwilllikelyresultinenoughfailurestoreliablyestimatethedistribution
parameters.
Chapter 20
Design of Experiments Guide
555
Reliability Demonstration
Areliabilitydemonstrationconsistsoftestingaspecifiednumberofunitsforaspecified
periodoftime.Iffewerthankunitsfail,youpassthedemonstration,andconcludethatthe
productreliabilitymeetsorexceedsareliabilitystandard.
TheReliability Demonstrationfeaturecomputesrequiredsamplesizesandexperimental
runtimesfordemonstratingthataproductmeetsorexceedsaspecifiedreliabilitystandard.
TolaunchtheReliabilityDemonstrationcalculator,selectDOE>Sample Size and Power,and
thenselectReliability Demonstration.Figure 20.18showstheReliabilityDemonstration
window.
Figure 20.18ReliabilityDemonstrationWindow
TheReliabilityDemonstrationwindowhasthefollowingoptions:
Alpha isthealphalevel.
Distribution istheassumedfailuredistribution.Afterselectingadistribution,specifythe
associatedscaleparameterinthetextfieldundertheDistributionmenu.
isthemaximumnumberoffailuresyouwanttoallowduringthe
demonstration.Ifweobservethismanyfailuresorfewer,thenwesaywepassedthe
demonstration.
Time isthetimecomponentofthereliabilitystandardyouwanttomeet.
Probability of Surviving istheprobabilitycomponentofthereliabilitystandardyouwantto
meet.
556
Chapter 20
Design of Experiments Guide
AftertheContinuebuttonisclicked,aplotappears(seeFigure 20.19).
Figure 20.19ReliabilityDemonstrationPlot
Thetrueprobabilityofaunitsurvivingtothespecifiedtimeisunknown.TheYaxisofthe
plotgivestheprobabilityofpassingthedemonstration(concludingthetruereliabilitymeets
orexceedsthestandard)asafunctionofthetrueprobabilityofaunitsurvivingtothe
standardtime.Noticethelineisincreasing,meaningthatthefurtherthetruthisabovethe
standard,themorelikelyyouaretodetectthedifference.
Example
Acompanywantstogettherequiredsamplesizeforassessingthereliabilityofanewproduct
againstanhistoricalreliabilitystandardof90%survivalafter1000hours.Frompriorstudies
onsimilarproducts,itisbelievedthatthefailuredistributionisWeibull,withaparameterof
3.Thecompanycanaffordtorunthedemonstrationfor800hours,andwantstheexperiment
toresultinnomorethan2failures.
Tocomputetherequiredsamplesize,dothefollowingsteps:
1. SelectDOE>Sample Size and Power.
2. SelectReliability Demonstration.
3. SelectWeibullfromtheDistributionlist.
Chapter 20
Design of Experiments Guide
557
4. Enter3fortheWeibull.
5. Enter2forMax Failures Tolerated.
6. Enter1000forTime.
7. Enter0.9forProbability of Surviving.
8. Enter800forTime of Demonstration.
9. ClickContinue.Figure 20.20showstheresults.
Figure 20.20ReliabilityDemonstrationResults
Thecompanyneedstorun118unitsinthedemonstration.Furthermore,iftheyobserve2or
fewerfailuresby800hours,wecanconcludethatthenewproductreliabilityisatleastas
reliableasthestandard.
558
Chapter 20
Design of Experiments Guide
Appendix A
Column Properties
Understanding Column Properties Assigned by DOE
WhenyouconstructadesignusingtheDOEplatforms,columnpropertiesaresavedtothe
datatablethatcontainstheresultingdesign.Thisappendixprovidesdetailaboutonlythose
columnpropertiesthataresavedtodesignsthattheDOEplatformconstructs.Examples
illustratehoweachcolumnpropertyisassignedandusedbytheDOEplatforms.Descriptions
ofcolumnpropertiesnotassignedbytheDOEplatformsareprovidedinUsingJMP.
Someofthecolumnpropertiesdescribedinthisappendixareusefulingeneralmodeling
situations.Tousethepropertiesmoregenerally,youcanspecifythemyourself.Thisabilityis
particularlyusefulwhenyourdesignhasnotbeencreatedbyaDOEplatform.Someofthe
examplesinthisappendixillustratesituationswhereyouaddacolumnpropertyonyour
own.
Figure A.1ColumnPropertyAsterisksandColumnInfoWindow
Contents
AddingandViewingColumnProperties........................................... 561
ResponseLimits................................................................. 562
ResponseLimitsExample ..................................................... 564
EditingResponseLimits ...................................................... 567
DesignRole .................................................................... 570
DesignRoleExample......................................................... 570
Coding......................................................................... 573
LowandHighValues ......................................................... 573
CodingColumnPropertyandCenterPolynomials................................ 574
CodingExample ............................................................. 574
AssigningCoding............................................................ 577
Mixture ........................................................................ 579
MixtureExample ............................................................. 582
FactorChanges ................................................................. 585
FactorChangesExample...................................................... 586
ValueOrdering ................................................................. 588
ValueOrderingExample...................................................... 589
AssigningValueOrdering ..................................................... 591
ValueLabels .................................................................... 591
ValueLabelsExample......................................................... 592
RunsPerBlock ................................................................... 594
RunsPerBlockExample ....................................................... 594
ConstraintState ................................................................. 595
ConstraintStateExample...................................................... 595
Appendix A
Design of Experiments Guide
Column Properties
Adding and Viewing Column Properties
561
562
Column Properties
Response Limits
Appendix A
Design of Experiments Guide
Figure A.2AsteriskIconforStretchRevealingTwoColumnProperties
YoucanalsoviewcolumnpropertiesbyaccessingtheColumnPropertieslistintheColumn
Infomenu.Selectthecolumnorcolumnswhosecolumnpropertiesyouwanttoviewanddo
oneofthefollowing:
Rightclicktheheaderarea,selectColumn Info,andselectthepropertyfromtheColumn
Propertieslist.
Response Limits
UsingtheResponseLimitscolumnproperty,youcanspecifythefollowing:
boundsontherangeofvariationforaresponse
adesirabilitygoal
ameasureoftheimportanceoftheresponse
desirabilityvalues
TheResponseLimitscolumnpropertydefinesadesirabilityfunctionfortheresponse.The
ProfilerandContourProfilerusedesirabilityfunctionstofindoptimalfactorsettings.Seethe
ProfilerchapterintheProfilersbook.
Figure A.3showstheResponseLimitspanelintheColumnInfowindowfortheresponse
StretchintheBounce Data.jmpsampledatatable,foundintheDesignExperimentfolder.
Appendix A
Design of Experiments Guide
Column Properties
Response Limits
563
Figure A.3ExampleoftheResponseLimitsPanel
TheResponseLimitspanelconsistsofthefollowingareas:
Selectyourresponsegoalfromthemenu.AvailablegoalsareMaximize,MatchTarget,
Minimize,andNone.JMPdefinesadesirabilityfunctionfortheresponsetomatchthe
selectedgoal.Ifyouspecifylimits,thedesirabilityfunctionisdefinedusingtheselimits.If
youdonotspecifylimits,JMPbasesthedesirabilityfunctiononconservativelimitvalues
derivedfromthedistributionoftheresponse.IfNoneisselectedasthegoal,thenall
responsevaluesareconsideredequallydesirable.Forfurtherdetails,seeResponseson
page 83intheCustomDesignschapter.
Goal
Importance Enterarelativeweightingforeachofseveralresponsesincomputingtheoverall
desirabilityfunction.TheImportancevaluecanbeanypositivenumber.Whenno
Importancevalueisspecified,JMPtreatsallresponsesinagivenanalysisashavingequal
Importancevalues.Ifthereisonlyoneresponse,itreceivesImportance1.
Value SpecifyLowerandUpperlimitsandaMiddlevalueforyourresponse.JMPusesthese
valuestoconstructadesirabilityfunctionfortheresponse.Ifyoudonotspecifylimits,JMP
basesthedesirabilityfunctiononconservativelimitvalues.IfyourgoalisMatchTarget
andnoMiddlevalueisspecified,thenthetargetisdefinedtobethemidpointoftheLower
andUpperlimits.
Desirability SpecifyvaluesthatreflectthedesirabilityofyourLower,Middle,andUpper
values.Desirabilityvaluesshouldbebetween0and1.IfyoudonotspecifyDesirability
values,JMPassignsvaluesinaccordancewiththeselectedGoal.
Show as graph reference lines ShowshorizontalreferencelinesfortheLower,Middle,and
UppervaluesintheActualbyPredictedPlotandthePredictionProfiler.Thisoption
appliesonlyiflimitsarespecified.
564
Column Properties
Response Limits
Appendix A
Design of Experiments Guide
Whenyoudesignedthisexperiment,youspecifiedaresponseGoalofMatchTargetwitha
LowerLimitof1.2andanUpperLimitof1.4.Sincethereisonlyoneresponse,youdidnot
specifyavalueforImportance,becauseitis1bydefault.Whenyouconstructedthedesign
table,JMPassignedtheResponseLimitscolumnpropertytoStrength.
4. ClosetheCustomDesignwindow.
5. IntheCoffee Data.jmpsampledatatable,selecttheStrengthcolumnandselectCols >
Column Info.
6. SelectResponseLimitsintheColumnPropertieslist.
Appendix A
Design of Experiments Guide
Column Properties
Response Limits
565
Figure A.5ResponseLimitsColumnPropertyforStrength
Noticethefollowing:
TheGoalissettoMatch Target.
Importanceismissing.WhenImportanceismissing,JMPtreatsallresponsesinagiven
analysisashavingequalImportancevalues.SoJMPassignsStrengthanImportance
valueofone.
TheLowerlimitis1.2.
TheUpperlimitis1.4.
NoMiddlevalueisspecified.
BecausenoMiddlevalueisspecified,thetargetisdefinedtobethemidpointofthe
LowerandUpperlimits,whichis1.3.
NoDesirabilityvaluesarespecified.
7. SelecttheShow as graph reference linesoption.
ThisoptionshowshorizontalreferencelinesfortheLower,Middle,andUppervaluesin
theActualbyPredictedPlotandthePredictionProfiler.
8. ClickOK.
9. IntheCoffee Data.jmpdatatable,selectRun ScriptfromtheredtrianglenexttoReduced
Model.
10. ClickRun.
ThePredictionProfilerappearsatthebottomofthereport.
566
Column Properties
Response Limits
Appendix A
Design of Experiments Guide
Figure A.6ProfilerShowingDesirabilityFunctionforStrength
ThedesirabilityfunctionforStrengthappearsintheplotattherightaboveDesirability.
ThisplotappearsbecausethedatatablecontainsaResponseLimitscolumnpropertyfor
Strength.ThePredictionProfileralsoshowsreferencelinesfortheLowerandUpperlimits
forStrength.
11. HolddowntheCtrlkeyandclicktheStrengthplotforDesirability.
Figure A.7ResponseGoalWindowforStrength
Noticethefollowing:
JMPdeterminestheMiddlevaluetobethemidpointoftheHighandLowlimitsthat
youspecifiedintheResponseLimitscolumnproperty.
BecausetheGoalissettoMatchTarget,JMPsetstheDesirabilityfortheMiddlevalue
to1.
JMPsetstheDesirabilityfortheHighandLowvaluestoverysmallnumbers,0.0183.
TheDesirabilityplotinFigure A.6showshowJMPusestheDesirabilityvaluesshown
inFigure A.7.TheDesirabilityfunctionforStrengthisessentially0beyondtheLow
andHighvaluesanditincreasesto1graduallyasStrengthapproachesthetargetof1.3.
TheImportancevalueissetto1sincethereisonlyoneresponseinthemodel.
Appendix A
Design of Experiments Guide
Column Properties
Response Limits
567
12. ClickCanceltoexitthewindow.
13. SelectMaximize DesirabilityfromthePredictionProfilerredtrianglemenu.
ThesettingsforTimeandChargeareupdatedtoshowsettingsforthefactorsthat
maximizethedesirabilityfunctionforStrength.However,manyothersettingsalso
maximizethedesirabilityfunction.SeetheContourProfilerchapterintheProfilersbook
forinformationabouthowtoidentifyothersettingsthatmaximizethedesirability
function.
568
Column Properties
Response Limits
Appendix A
Design of Experiments Guide
Figure A.8CompletedResponseLimitsPanel
7. ClickOK.
8. IntheVinyl Data.jmpdatatable,selectRun ScriptfromtheredtrianglenexttoModel.
Notethatm1,m2,andm3aremixturefactors.Also,thedesigninvolvesarandom
Whole Plotsfactor.Becauseofthis,thedefaultMethodisREML(Recommended).
9. ClickRun.
10. FromtheredtrianglenexttoResponsethickness,selectRow Diagnostics > Plot Actual by
Predicted.
ThereferencelinesfortheLower,Middle,andUpperlimitsappearontheActualby
PredictedPlot.
11. FromtheredtrianglenexttoResponsethickness,selectFactor Profiling > Profiler.
Appendix A
Design of Experiments Guide
Column Properties
Response Limits
569
Figure A.9PredictionProfilerShowingAsymmetricDesirabilityFunction
TheplotattherightaboveDesirabilityshowsthedesirabilityfunctionthatJMPhas
constructedforthickness.Thedesirabilityis1attheMiddlelimitof8.5.Thedesirabilityis
essentially0forthicknessvaluesbelow6andabove10.
12. HolddowntheCtrlkeyandclickthethicknessplotforDesirability.
Figure A.10ResponseGoalWindowforThickness
ThiswindowshowsyoursettingsfortheHigh,Middle,andLowValues.Italsoshowsthe
DesirabilityvaluesthatJMPassigns,basedonyourgoalofMatchTarget.TheDesirability
functionshowninFigure A.9isacontinuouscurvethatmatchestheDesirabilitysettings
inFigure A.10attheHigh,Middle,andLowValues.Atothervalues,theDesirability
functionassignsdesirabilitiesthatareconsistentwiththeselectedgoal.
13. ClickCancel.
14. SelectMaximize DesirabilityfromthePredictionProfilerredtrianglemenu.
Thesettingsforthefactorsareupdatedtoshowvaluesthatmaximizethedesirability
functionforthickness.Keepinmindthatmanyothersettingsalsomaximizethe
desirabilityfunction.Thepredictedresponseattheseoptimalsettingsis8.28.Recallthat
youset8.5asthetargetsetting,withlimitsof6and10.
15. ClosetheVinyl Data.jmpsampledatatablewithoutsavingthechanges.
570
Column Properties
Design Role
Appendix A
Design of Experiments Guide
Design Role
Factorsindesignedexperiments,aswellasinmoregeneralmodels,canbehaveinvarious
ways.JMPusesthedesignrolecolumnpropertytodescribethesebehaviors.Thesearethe
possibledesignroles:
Continuous
DiscreteNumeric
Categorical
Blocking
Covariate
Mixture
Constant
Uncontrolled
RandomBlock
Signal
Noise
InmanyoftheJMPDOEplatforms,youcanspecifyfactorswithdifferentdesignroles.In
someplatforms,yourdesignrequirementscauseJMPtodefinefactors.Forexample,
Whole PlotsandSubplotsarefactorsthatJMPcreateswhenyouspecifyveryhardtochange
andhardtochangefactors.Inplatformswherevariousdesignrolescanoccur,whenJMP
createsthedesigntableforyourdesign,eachfactorisassignedtheDesignRolecolumn
property.
FordescriptionsofthedesignrolesotherthanRandomBlock,Signal,andNoise,see
FactorTypesonpage 87intheCustomDesignschapter.
ForadescriptionoftheRandomBlockdesignrole,seeChangesandRandomBlockson
page 88intheCustomDesignschapter.
FordescriptionsoftheSignalandNoisedesignroles,seeDetailtheResponseandAdd
Factorsonpage 456intheTaguchiDesignschapter.
Appendix A
Design of Experiments Guide
Column Properties
Design Role
571
Sincevariationsintemperatureandhumiditymighthaveaneffectontheresponse,youwant
toincludeDayasarandomblockingfactor.ItiseasytoaddacolumnforDaytothedesign
table.ButyouwanttousetheEvaluateDesignplatformtocomparethedesignwiththe
unexpectedblocktoyouroriginaldesign.YoualsowanttheabilitytousetheAugment
Designplatformincaseyouneedtoaugmentthedesign.TousetheEvaluateDesignand
AugmentDesignplatforms,youneedtoaddtheDesignRolecolumnpropertytoyournew
Daycolumn.
1. SelectHelp > Sample Data LibraryandopenOdor Control Original.jmp.
2. SelectCols > Add Multiple Columns.
3. NexttoColumnprefix,typeDay.
4. UnderAddWhere,selectAfter selected column.
5. SelectRunfromthelistofcolumnnames.
6. FromtheInitialDataValueslist,selectSequence Data.
7. Enterthefollowing:
1forFrom
3forTo
1forStep
5forRepeateachvalueNtimes
572
Column Properties
Design Role
Appendix A
Design of Experiments Guide
Figure A.11CompletedAddMultipleColumnsWindow
8. ClickOK.
TheDaycolumnisaddedasthesecondcolumninthedatatable.
9. SelecttheDaycolumn.
10. SelectCols > Column Info.
11. FromtheColumnPropertieslist,selectDesign Role.
12. IntheDesignRolepanel,clickContinuousandselectRandom Block.
13. ClickOK.
Inthecolumnspanel,anasteriskappearsnexttoDay.
14. ClicktheasterisknexttoDaytoverifythattheDesignRolecolumnpropertyhasbeen
assigned.
15. ClosetheOdor Control Original.jmpsampledatatablewithoutsavingthechanges.
Appendix A
Design of Experiments Guide
Column Properties
Coding
573
Coding
TheCodingcolumnpropertyappliesonlytocolumnswithanumericdatatype.Itappliesa
lineartransformationtothedatainthecolumn.IntheCodingcolumnpropertywindow,you
specifyaLowValueandaHighValue.TheLowValueandHighValueinyouroriginaldata
aretransformedto1and+1.JMPusesthetransformeddatavalueswheneverthecolumnis
enteredasamodeleffectintheFitModelplatform.
Thecodingpropertyisusefulforthefollowingreasons:
Codedpredictorsleadtoparameterestimatesthataremoreeasilyinterpretedand
compared.
Codedpredictorshelpreducemulticollinearityinmodelswithinteractionand
higherorderterms.
WhenanyDOEplatformotherthanAcceleratedLifeTestDesigncreatesadesign,JMP
definesaCodingcolumnpropertyforeachnonmixturefactorwithanumericdatatype.
Figure A.12showstheCodingcolumnpropertypanelforthecolumnFeed Rate inthe
Reactor 20 Custom.jmpsampledatatable,foundintheDesignExperimentfolder.
Figure A.12CodingPropertyPanelforFeedRate
574
Column Properties
Coding
Appendix A
Design of Experiments Guide
WhenyouapplytheCodingpropertytoacolumnthatdoesnotcontainthatproperty,JMP
insertstheminimumvalueastheLowValueandthemaximumvalueastheHighValue.You
canchangethesevaluesasneeded.
Caution: AftertheCodingcolumnpropertyisassignedtoacolumn,JMPdoesnot
automaticallyupdateitwhenyoumakechangestothevaluesinthecolumn.Ifyouchangethe
valuesinacolumnthathasaCodingcolumnproperty,reviewtheHighValueandLowValue
toensurethattheyarestillappropriate.
TheCodingcolumnpropertycenterseachvalueinacolumnbysubtractingthemidpointof
theHighValueandLowValue.Itthendividesbyhalftherange.SupposethatHistheHigh
ValueandListheLowValue.TheneveryXinthecolumnistransformedtothefollowing:
X H + L 2
-----------------------------------H L 2
Foreachfactor,thetransformedvalueshaveamidpointequalto0andrangefrom1to+1.
Coding Example
TheReactor 20 Custom.jmpsampledatatablecontainsdatafroma20rundesignthatwas
constructedusingtheCustomDesignplatform.Theexperimentinvestigatestheeffectsoffive
factorsonayieldresponse(Percent Reacted)forachemicalprocess.
1. SelectHelp > Sample Data LibraryandopenDesign Experiment/Reactor 20 Custom.jmp.
2. SelectRun ScriptfromtheDOE Dialogredtrianglemenu.
3. OpentheFactorsoutline.
Appendix A
Design of Experiments Guide
Column Properties
Coding
575
NoticethatthesettingsforTemperaturerangefrom140to180.Whenthedesignwas
generated,theCodingcolumnpropertywasassignedtoTemperature.TheLowValueisset
to140andtheHighValueissetto180.
4. ClosetheCustomDesignwindow.
5. IntheReactor 20 Custom.jmpsampledatatable,clicktheasterisknexttoTemperaturein
thecolumnspanelandselectCoding.
TheColumnInfowindowappearsandshowstheCodingcolumnpropertypanel.Youcan
seethatJMPaddedthecolumnproperty,specifyingtheLowValueandHighValue,when
itconstructedthedesigntable.Infact,byrepeatingthisstep,youcanverifythatJMP
addedtheCodingpropertyforallfivefactors.
Figure A.14CodingPanelforTemperature
6. ClickCanceltoclosetheColumnInfowindow.
7. IntheReactor 20 Custom.jmpsampledatatable,selectRun ScriptfromtheReduced Model
redtrianglemenu.
Thisscriptfitsamodelthatcontainsonlythefiveeffectsdeterminedtobesignificant
basedonananalysisofthefullmodel.
576
Column Properties
Coding
Appendix A
Design of Experiments Guide
8. ClickRun.
Figure A.15EffectSummaryReportforReducedModel
IntheSourcelist,theHighandLowvaluesusedintheCodingcolumnpropertyappearin
parenthesestotherightofthemaineffects,Catalyst, Temperature,andConcentration.The
rangesimposedbytheCodingpropertyarenotshownfortheinteractioneffects.
Tip: Noticethe^symbolstotherightofthePValuesforTemperatureandConcentration.
Thesesymbolsindicatethatthesemaineffectsarecomponentsofinteractioneffectswith
smallerpvalues.Ifaninteractioneffectisincludedinthemodel,thentheprincipleof
effectheredityrequiresthatallcomponenteffectsarealsointhemodel.SeeEffect
Heredityonpage 59intheStartingOutwithDOEchapter.
9. SelectEstimates > Show Prediction ExpressionfromtheredtrianglenexttoResponse
PercentReacted.
LookatthePredictionExpressionoutlinetoseehowcodingaffectsthepredictionformula.
Figure A.16PredictionExpressionforReducedModel
Appendix A
Design of Experiments Guide
Column Properties
Coding
577
EachfactoristransformedasspecifiedbytheCodingcolumnproperty.Forexample,for
Temperature,noticethefollowing:
TheLowValueintheCodingpropertywassetto140.TheTemperaturevalueof140is
transformedto1.
TheHighValueintheCodingpropertywassetto180.TheTemperature valueof180is
transformedto+1.
ThemidpointoftheLowandHighvaluesis160.TheTemperature valueof160is
transformedto0.
Thetransformedvalueshelpyoucomparetheeffects.TheestimatedcoefficientforCatalystis
9.942andtheestimatedcoefficientforConcentrationis3.077.Itfollowsthatthepredicted
effectofCatalystonPercent Reactedismorethanthreetimesaslargeastheeffectof
ConcentrationonPercent Reacted.Also,thecoefficientsindicatethatpredicted
Percent ReactedincreasesasCatalystincreasesanddecreasesasConcentrationincreases.
Thetransformedvalueshelpyouinterpretthecoefficients:
Whenallfactorsareattheirmidpoints,theirtransformedvaluesare0.Thepredicted
Percent Reactedistheintercept,whichis65.465.
WhenCatalystandConcentrationareattheirmidpoints,a20unitincreaseinTemperature
increasesthePercent Reactedby5.558units.
SupposethatConcentrationisatitsmidpoint,sothatitstransformedvalueis0:
WhenCatalystisatitsmidpoint,a20unitincreaseinTemperatureincreasesthePercent
Reactedby5.558units.
WhenCatalystisatitshighsetting,a20unitincreaseinTemperatureincreasesthe
Percent Reactedby5.558+6.035=11.593units.
Itfollowsthatthecoefficientoftheinteractionterm,6.035,istheincreaseintheslopeofthe
modelforpredictedPercent Reactedfora0.5unitchangeinCatalyst.
Assigning Coding
TheexperimentaldataintheTiretread.jmpsampledatatableresultsfromanexperimentto
studytheeffectsofSILICA,SILANE,andSULFURonfourmeasuresoftiretreadperformance.
Inthisexample,youwillconsideronlyoneoftheresponses,ABRASION.
Youwillfirstfitamodelusingtheuncodedfactors.Thenyouwillassignthecodingproperty
tothefactorsandrerunthemodeltoobtainmeaningfulparameterestimates.
1. SelectHelp > Sample Data LibraryandopenTiretread.jmp.
2. SelectAnalyze > Fit Model.
3. SelectABRASIONandclickY.
4. SelectSILICA,SILANE,andSULFURandclickMacros > Response Surface.
578
Column Properties
Coding
Appendix A
Design of Experiments Guide
Thecoefficientsdonothelpyoucompareeffectsizes.Thesizesofthecoefficientsdonot
reflecttheimpactoftheeffectsonABRASIONovertherangeoftheirsettings.Also,the
coefficientsarenoteasilyinterpreted.Forexample,thecoefficientsdonotfacilitateyour
understandingofthepredictedresponsewhenSILICAisatthemidpointofitsrange.
ApplytheCodingcolumnpropertytothethreefactorstoseehowcodingmakesthe
coefficientsmoremeaningful.
8. IntheTiretread.jmpdatatable,selectSILICA,SILANE,andSULFURintheColumnspanel.
RightclickthehighlightedareaandselectStandardize Attributes.
9. SelectColumn Properties > CodingintheStandardizePropertiespanel.
10. ClickOK.
AnasteriskappearsintheColumnspanelnexttoSILICA,SILANE,andSULFURindicating
thatthesehavebeenassignedacolumnproperty.
11. IntheFitModelwindow,clickRun.
12. SelectEstimates > Show Prediction ExpressionfromtheResponseABRASIONredtriangle
menu.
Appendix A
Design of Experiments Guide
Column Properties
Mixture
579
Figure A.18PredictionExpressionforModelwithCodedFactors
Thecoefficientsforthecodedfactorsenableyoutocompareeffectsizes.SILANEhasthe
largesteffectonABRASIONovertherangeofdesignsettings.TheeffectsofSILICAandthe
SILANE*SULFURinteractionarelargeaswell.
Thecoefficientsforthecodedfactorsarealsomoreeasilyinterpreted.Forexample,when
allfactorsareatthecenteroftheirranges,thepredictedvalueofABRASIONisthe
intercept,139.12.
13. ClosetheTiretread.jmpsampledatatablewithoutsavingthechanges.
Mixture
TheMixturecolumnpropertyisusefulwhenacolumninadatatablerepresentsacomponent
ofamixture.Thecomponentsofamixtureareconstrainedtosumtoaconstant.Becauseof
this,theydifferfromnonmixturefactors.TheMixturecolumnpropertyservestwopurposes:
Itidentifiesacolumnasamixturecomponent.
580
Column Properties
Mixture
Appendix A
Design of Experiments Guide
IfyouaddacolumnwiththeMixturecolumnpropertyasamodeleffectinthe
Analyze > FitModelwindow,JMPautomaticallygeneratesanointerceptmodel.
Itdefinesthecodingforamixturecomponent.
Codingformixturecomponentsdiffersfromthatfornonmixturefactors.However,as
withnonmixturefactors,abenefitofcodingformixturefactorsisthatithelpsyou
interpretparameterestimates.SeePseudoComponentCodingonpage 581.
IntheMixturecolumnpropertypanel,youcanspecifythefollowing:
Lower Limit SpecifiesthelowvalueusedinPseudoComponentCoding.WhentheMixture
propertyisappliedaspartofdesignconstructioninaDOEplatform,theLowerLimitisset
totheminimumsettingofthefactor.WhenyouapplytheMixturepropertytoacolumn
thatdoesnotcontainthatproperty,JMPinsertstheminimumvalueastheLowerLimit.
Youcanchangethisvalueasneeded.
Upper Limit SpecifiesthehighvalueusedinPseudoComponentCoding.WhentheMixture
propertyisappliedaspartofdesignconstructioninaDOEplatform,theUpperLimitisset
tothemaximumsettingofthefactor.WhenyouapplytheMixturepropertytoacolumn
thatdoesnotcontainthatproperty,JMPinsertsthemaximumvalueastheUpperLimit.
Youcanchangethisvalueasneeded.
Appendix A
Design of Experiments Guide
Column Properties
Mixture
581
propertytoacolumnthatdoesnotcontainthatproperty,JMPinsertsadefaultvalueof1
fortheSumofTerms.
L PseudoComponent Coding
TransformsdatavaluessothattheLowerLimitcorrespondsto
0.
U PseudoComponent Coding TransformsdatavaluessothattheUpperLimitcorrespondsto
0.
PseudoComponentCoding
Apseudocomponentisalineartransformation.LetSdenotethesumofthemixture
components.Supposethaticolumns X 1 X 2 X q havebeenassignedtheMixturecolumn
property.Supposethatthecolumnsandeffectsconstructedfromthesecolumnsareenteredas
effectsintheFitModelwindow.
Definethefollowing:
q
L =
L i ,whereLiistheLowerLimitforXi
i=1
q
U =
U i ,whereUiistheUpperLimitforXi
i=1
LetxidenoteavalueofthecolumnXi.TheL PseudoComponentatxiisdefinedasfollows:
L
xi = Xi Li S L
TheU PseudoComponentatxiisdefinedasfollows:
U
xi = Ui Xi U S
IfyouselectbothL PseudoComponent CodingandU PseudoComponent Coding,theFit
ModelplatformusestheLcodingif(SL)<(US).Otherwise,theUcodingisused.
InFitModel,mixturefactorsaretransformedusingpseudocomponentsbeforecomputing
parameterestimates.Thishelpsmakeparameterestimatesmoremeaningful.Inreports
dealingwithparameterestimates,themixturemaineffectsaregivenbythecoding
transformation.Otherreports,suchastheprofilers,arebasedontheuncodedvalues.
582
Column Properties
Mixture
Appendix A
Design of Experiments Guide
Mixture Example
ThedataintheDonev Mixture Data.jmpsampledatatable,foundintheDesignExperiment
folder,arebasedonanexamplefromAtkinsonandDonev(1992).Thedesignincludesthree
mixturefactorsandonenonmixturefactor.Theresponseandfactorsareasfollows:
TheresponseistheelectromagneticDampingofanacrylonitrilepowder.
Thethreemixtureingredientsarecoppersulphate(CuSO4),sodiumthiosulphate
(Na2S2O3),andGlyoxal.
ThenonmixtureenvironmentalfactorofinterestistheWavelengthoflight.
ThoughWavelengthistheoreticallycontinuous,theresearcherswereinterestedonlyin
predictionsatthreediscretewavelengths.Asaresult,Wavelengthistreatedasacategorical
factorwiththreelevels.
FordetailsaboutusingCustomDesigntoconstructadesignforthissituation,seeMixture
Experimentsonpage 163intheExamplesofCustomDesignschapter.
1. SelectHelp > Sample Data LibraryandopenDesign Experiment/Donev Mixture Data.jmp.
2. ClicktheasterisknexttoCuSO4 inthecolumnspanelandselectMixture.
Figure A.20MixtureColumnPropertyPanelforCuSO4
Noticethefollowing:
TheLowerLimitis0.2,theminimumdesignsettingforCuSO4.
TheUpperLimitis0.8,themaximumdesignsettingforCuSO4.
TheSumofTermsissetto1.Thisisthesumofthethreemixturefactors.
Appendix A
Design of Experiments Guide
Column Properties
Mixture
583
584
Column Properties
Mixture
Appendix A
Design of Experiments Guide
Figure A.22PredictionExpressionforDampingModel
SupposethatyouareinterestedinpredictionsatWavelengthL2.Supposealsothat
Na2S2O3andGlyoxalaresettotheirlowvalues,0.2and0respectively,andthatCuSO4is
settoitshighvalue,0.8.Inthiscase,thepredictedDampingequalstheparameterestimate
forCuSO4 (6.191) plustheparameterestimateforCuSO4*Wavelength[L2](1.878).Youcan
verifythisinthePredictionProfiler.
9. SelectSave Columns > Save Coding TablefromtheResponseDampingredtrianglemenu.
Appendix A
Design of Experiments Guide
Column Properties
Factor Changes
585
Figure A.23FirstThreeColumnsofCodingTableShowingCodedMixtureFactors
Forthisparticulardesign,theL PseudoComponentcodingtransformsthemixturefactors
torangebetween0and1.Notethatthisdoesnothappeningeneral.
Factor Changes
TheFactorChangescolumnpropertyindicateshowdifficultitistochangefactorsettingsina
designedexperiment.ThepossiblespecificationsforFactorChangesareEasy,Hard,andVery
Hard.Forexample,Figure A.24showstheFactorChangescolumnpropertypanelforthe
factorA1intheBattery Data.jmpsampledatatable,locatedintheDesignExperimentfolder.
Figure A.24FactorChangesColumnPropertyPanel
586
Column Properties
Factor Changes
Appendix A
Design of Experiments Guide
Whenadesigncontainsfactorsthatarehardtochangeandveryhardtochange,itmust
alsoincludeasubplotandawholeplotfactor:
Thelevelsofthewholeplotfactordefinethegroupsofrunsforwhichthelevelsofthe
veryhardtochangefactorsareheldconstant.
Thelevelsofthesubplotfactordefinethegroupsofrunsforwhichthelevelsofthe
hardtochangefactorsareheldconstant.
Whenadesigncontainsonlyfactorsthatarehardtochange,butnofactorsthatare
veryhardtochange,itshouldincludeawholeplotfactor.Thelevelsofthewholeplot
factordefinethegroupsofrunsforwhichthelevelsofthehardtochangefactorsareheld
constant.Formoredetails,seeChangesandRandomBlocksonpage 88intheCustom
Designschapter.
AugmentandEvaluateDesign
FortheEvaluateDesignandAugmentDesignplatforms,theFactorChangescolumnproperty
identifiesfactorswithChangesspecifiedasHardorVeryHard.However,theseplatformsalso
requirethatthewholeplotandsubplotfactorsbeenteredasmodeleffectsinthelaunch
windows.Thisisbecausethewholeplotandsubplotfactorsarepartofthedesignstructure.
CustomDesign
TheCustomDesignplatformenablesyoutocreatedesignswhereallfactorchangesareEasy.
Youcanalsoconstructsplitplot,splitsplitplot,ortwowaysplitplot(stripplot)designs.
Whenconstructingthesedesigns,youneedtoidentifythefactorswhosevaluesare
hardtochangeorveryhardtochange.IntheFactorsoutline,youcanidentifyfactorsas
havingChangesthatareEasy,Hard,orVeryHard.WhentheCustomDesignplatform
constructsthedesigntable,theFactorChangespropertyisassignedtoeveryfactorthat
appearsintheFactorsoutline.
TheCustomDesignplatformistheonlyplatformthatconstructsdesignsforfactorswith
ChangesthatareHardorVeryHard.OtherDOEplatformsalsoassigntheFactorChanges
columnpropertytofactorsthattheyconstruct,butthevalueofthecolumnpropertyissetto
Easyfortheirfactors.
IfyouLoadFactorsintheCustomDesignwindowusingatableoffactors,youcanassignthe
FactorChangescolumnpropertytocolumnsinthattable.WhenyouLoadFactorsusingthat
table,yourFactorChangesspecificationsappearintheFactorsoutline.
Appendix A
Design of Experiments Guide
Column Properties
Factor Changes
587
twowaysplitplotdesign.Forfurtherbackground,seeExamplesofCustomDesigns
chapteronpage 186.
1. SelectHelp > Sample Data LibraryandopenDesign Experiment/Battery Data.jmp.
2. ClicktheasterisktotherightofthefactorC1 inthecolumnspanel.
3. SelectFactor Changes.
Figure A.25FactorChangesPanelforC1
ThevalueofFactorChangesforC1isHard.Figure A.24showsthatthevalueofFactor
ChangesforA1isVeryHard.
4. ClickOK.
5. Inthedatatable,clicktheredtrianglenexttoDOE DialogandselectRun Script.
6. OpentheFactorsoutline.
Figure A.26FactorsOutlineforBatteryExperiment
ThefactorsA1,A2,A3,andA4haveChangessettoVeryHard,andthefactorsC1andC2
haveChangessettoHard.WhentheCustomDesignplatformconstructsthedesigntable,
itsavesthesespecificationstotheappropriatecolumnsasFactorChangescolumn
properties.
588
Column Properties
Value Ordering
Appendix A
Design of Experiments Guide
IntheDesignoutline,noticetheWhole PlotsandSubplotsfactors.
Figure A.27DesignOutlinePartialView
ToaccountforthefactorchangesthatareHardandVeryHard,twofactorsarecreatedby
theCustomDesignplatform.TheWhole Plots factorgroupstherunswheretheVeryHard
factorlevelsareconstantandtheSubplotsfactorgroupstherunswheretheHardfactors
levelsareconstant.Thesefactorsneedtobeincludedasmodeleffectswhenyouenter
columnswiththeFactorChangescolumnpropertyintheEvaluateDesignandAugment
Designplatforms.
Value Ordering
TheValueOrderingcolumnpropertyassignsanordertothevaluesinacolumn.Thatorderis
thenusedinplotsandanalyses.Youcanspecifytheorderinwhichyouwantvaluestoappear
inreports.
Note: Forcertainvaluesthathaveanaturalordering,suchasdaysoftheweek,JMP
automaticallyorderstheseintheappropriatewayinreports.SeetheUsingJMPbook.
Figure A.28showstheValueOrderingpanelfortheTypecolumnintheCar Physical Data.jmp
sampledatatable.ReportsthatinvolvethevaluesofTypeplacetheselevelsintheorder
Sporty,Small,Compact,Medium,andLarge.UsethebuttonstotherightoftheValue
Orderinglisttospecifyyourdesiredorderingforthevalues.
Appendix A
Design of Experiments Guide
Column Properties
Value Ordering
589
Figure A.28ValueOrderingColumnPropertyforType
IndesignscreatedusingmostDOEplatforms,categoricalfactors,includingtheconstructed
factorsWhole PlotsandSubplots,andblockingfactorsareassignedtheValueOrdering
property.Thispropertyordersthelevelsaccordingtotheorderinwhichtheyappearinthe
Factorsoutline.ThelevelsofconstructedfactorsareconsecutiveintegersandtheValue
Orderingpropertyspecifiesthisnaturalordering.YoucanmodifytheValueOrdering
specificationforanyfactortomeetyourneeds.
TheValueOrderingpropertyisnotassignedbytheCoveringArrayorTaguchiArrays
platforms.TheCoveringArrayplatformassignstheValueLabelscolumnproperty.SeeValue
Labelsonpage 591.
590
Column Properties
Value Ordering
Appendix A
Design of Experiments Guide
Figure A.29ProfilerwithOriginalValueOrdering
NoticethatthevaluesforDe-StemandFilteringappearintheorderNofollowedbyYes.
Youwanttoreversethese,sothattheYeslevelappearsfirst.
4. ClosetheResponseRatingreport.
5. Inthedatatable,clicktheasterisknexttoDe-SteminthecolumnspanelandselectValue
Ordering.
6. ClickReverse.
7. ClickOK.
8. ClicktheasterisknexttoFilteringinthecolumnspanelandselectValue Ordering.
9. ClickReverse.
10. ClickOK.
11. Again,clicktheredtrianglenexttoReduced ModelandselectRun Script.
12. ClickRun.
Figure A.30ProfilerwithNewValueOrdering
ThelevelsforDe-StemandFilteringnowappearintheorderYesfollowedbyNo.
Appendix A
Design of Experiments Guide
Column Properties
Value Labels
591
Value Labels
TheValueLabelscolumnpropertyrepresentsvaluesinacolumnwithspecifiedlabels.These
labelsaredisplayedinthedatatableandareusedinplotsandreports.Inthedatatable,you
canviewtheoriginalvaluesbydoubleclickingwithinacell.Fordetailsabouthowtoassign
andworkwiththeValueLabelscolumnproperty,seetheUsingJMPbook.
592
Column Properties
Value Labels
Appendix A
Design of Experiments Guide
TheCoveringArraysplatformistheonlyDOEplatformthatassignstheValueLabelscolumn
property.TheCoveringArraysplatformsavesfactorstothedatatablewithaNominal
modelingtype.Theunderlyingvaluesareconsecutiveintegersrangingfrom1tothenumber
oflevelsthatyouspecifyintheCoveringArrayFactorsoutline.TheValuesthatyouspecifyin
theFactorsoutlinearetheValueLabelsthatareassignedtotheunderlyingintegers.
NoticethattheRoleofthefourfactorsisdescribedasCategorical.
4. ClickContinue.
TheRestrictFactorLevelCombinationsoutlineopens.Sinceallcombinationsofsettings
arepossible,leavethissettoNone.
5. ClickMake Design.
6. ClickMake Table.
7. Inthecolumnspanel,clicktheasterisknexttoWeb Browser andselectValue Labels.
Appendix A
Design of Experiments Guide
Column Properties
Value Labels
593
Figure A.32ColumnInfoWindowforFactorA
594
Column Properties
RunsPerBlock
Appendix A
Design of Experiments Guide
10. ClickChange.
Thechangeappearsinthedatatable.
Note: Tousethenumericvaluesandnotthelabels,deselectUse Value Labels.
RunsPerBlock
WhenyouusetheDOEplatformstoconstructadesigncontainingablockingfactor,thefactor
isassignedtheDesignRolecolumnpropertywiththevalueBlocking.JMPalsoassignsthe
RunsPerBlockcolumnpropertytoeachBlockingfactor.TheRunsPerBlockpropertyindicates
themaximumallowablenumberofrunsineachblock.ThispropertyisusedbytheEvaluate
DesignandAugmentDesignplatformstoindicatetheblockingstructureforthefactor.For
moredetails,seeBlockingonpage 87intheCustomDesignschapter.
Note: TheRunsPerBlockcolumnpropertyisassignedbyJMPaspartofdesignconstruction.
Youcannotdirectlyassignthiscolumnproperty.
RunsPerBlock Example
ConsiderthewinetastingexperimentdescribedinExampleofaCustomDesignonpage 66
intheCustomDesignschapter.Winesamplesaretastedbyfiveraters(Rater)andeachrater
tasteseightsamples.
1. SelectHelp > Sample Data LibraryandopenDesign Experiment/Wine Data.jmp.
2. ClicktheasterisknexttoRater inthecolumnspanelandselectDesign Role.
NoticethattheDesignRoleissettoBlocking.
3. ClickCancel.
4. ClicktheasterisknexttoRater inthecolumnspanelandselectRunsPerBlock.
Appendix A
Design of Experiments Guide
Column Properties
ConstraintState
595
Figure A.34RunsPerBlockColumnPropertyPanelforRater
NoticethatthevalueofRunsPerBlockis8.ThedesignconstructedbytheDOEDialog
scripthas40runs.Sincetherearefiveraters,JMPconstructsadesignwith40/5=8runsfor
eachrater.
ConstraintState
IntheCustomandMixtureDesignplatforms,youcanSaveConstraintsthatyouspecifyfora
design.WhenyouselectSaveConstraints,thecoefficientsofeachlinearconstraintappearina
columninadatatable.Thevaluethatboundstheinequalityisgiveninthelastrowofthe
table.
EachconstraintcolumnisassignedtheConstraintStatecolumnproperty.Thisproperty
specifiesthedirectionoftheinequalitythatdefinestheconstraint.WhenyouselectLoad
Constraintsfromadesignplatform,theConstraintStatecolumnpropertytellsJMPthe
directionoftheinequality.
Note: TheConstraintStatecolumnpropertyisassignedbyJMPaspartofdesignconstruction.
Youcannotdirectlyassignthiscolumnproperty.
ConstraintState Example
ThesampledatatablePiepel.jmp,locatedintheDesignExperimentfolder,containsamixture
designwiththreecontinuousfactors.ThedesignisbasedonanexperimentpresentedinSnee
(1979)andPiepel(1988),wherethereareboundaryconstraintsoneachfactorandthree
additionallinearconstraints.Inthefollowingexample,youdothefollowing:
1. Changeoneofthethreeadditionalconstraints
596
Column Properties
ConstraintState
Appendix A
Design of Experiments Guide
2. Savetheconstraintstoatable
3. ObservehowtheConstraintStatecolumnpropertydescribesthedirectionoftheinequality
intheconstraint
Forfurtherdevelopmentofthisexample,seeAnExtremeVerticesExamplewithLinear
Constraintsonpage 318intheMixtureDesignschapter.
1. SelectHelp > Sample Data LibraryandopenDesign Experiment/Piepel.jmp.
2. SelectRun ScriptfromtheDOE Dialogredtrianglemenu.
NoticethethreelinearconstraintsbelowtheFactorsoutline.Tomaketheconstraintsmore
interpretable,youwanttoreformulatethefirstconstraintintermsofagreaterthanor
equaltoinequality.
Figure A.35LinearConstraintsbeneathFactorsOutline
3. Inthefirstconstraint,dothefollowing:
Type85nexttoX1.
Type90nexttoX2.
Type100nexttoX3.
Selectfromtheinequalitymenu.
Type90totherightoftheinequalitysign.
4. SelectSave ConstraintsfromtheMixtureDesignredtrianglemenu.
Atablecontaininginformationabouttheconstraintsappears.
Figure A.36ConstraintTable
EachcolumncontainsthecoefficientsofthefactorsX1,X2,andX3inrows1through3.
Row4containsthevaluethatappearedtotherightoftheinequalitysign.
Appendix A
Design of Experiments Guide
Column Properties
ConstraintState
597
5. ClicktheasterisknexttoConstraint 1.
6. ClickConstraintState.
Figure A.37ConstraintStateColumnPropertyPanel
TheConstraintStatepanelforX1indicatesthatthedirectionoftheinequalityisgreater
thanindicatinggreaterthanorequalto.
7. ClickCancel.
598
Column Properties
ConstraintState
Appendix A
Design of Experiments Guide
Appendix B
Technical Details
The Model and Alias Matrices
TheModelMatrixrepresentsthecodedsettingsfortheeffectsthatyouincludeinyourmodel.
TheModelMatrixisusedindefiningthefollowing:
Optimalityandefficiencymeasures.SeeOptimalityCriteriaonpage 120intheCustom
DesignschapterandDEfficiencyonpage 124intheCustomDesignschapter.
Powercalculations.SeePowerCalculationsonpage 494intheEvaluateDesigns
chapter.
Relativepredictionvariance.SeeRelativePredictionVarianceonpage 497inthe
EvaluateDesignschapter.
ThisappendixshowshowtheModelMatrixisdefinedandpresentstwowaystoviewthis
matrix.
TheAliasMatrixgivescoefficientsthatindicatethedegreetowhichthemodelparametersare
biasedbyeffectsthatarepotentiallyactive,butnotinthemodel.Forthisreason,itisrelatedto
theModelMatrix.TheAliasMatrixisalsousedindefiningaliasoptimality.SeeAlias
Optimalityonpage 124intheCustomDesignschapter.
ThisappendixshowshowtheAliasMatrixisdefined.Inparticular,itpresentsthedefinition
forsituationswherethereareHardorVeryHardfactorchangesandwherethereareIf
Possibleeffects.
Contents
TheModelMatrix............................................................... 601
TheAliasMatrix ................................................................ 601
DesignswithHardorVeryHardFactorChanges ................................. 602
DesignswithIfPossibleEffects................................................. 602
Appendix B
Design of Experiments Guide
Technical Details
The Model Matrix
601
Themodelmatrixhasarowforeachrunandacolumnforeachtermofthemodel
specifiedintheModeloutline.
Foreachrun,thecorrespondingrowofthemodelmatrixcontainsthecodedvaluesofthe
modelterms.
Continuoustermsarecodedtorangefrom1to1.Nominaltermsarecodedbyapplying
theGramSchmidtorthogonalizationproceduretoJMPscodingfornominaleffects.Find
additionalinformationaboutcodingfornominaleffectsintheFittingLinearModelsbook.
Youcanviewadesignsmodelmatrixintwoways:
1. IfyoucreatethedesignusingCustomDesign,selectSave X Matrixfromtheredtriangle
menuintheCustomDesignwindow.InthedesigntablethatCustomDesigncreates,click
theredtrianglenexttotheModelMatrixscriptandselectEdit.Themodelmatrixisgiven
asX.
2. Foranarbitrarydesigntable,selectAnalyze > Fit Model.Entereffectstodescribeyour
model.ClickRun.Fromthereportsredtrianglemenu,selectSave Columns > Save Coding
Table.Themodelmatrixisdefinedbythecolumnscorrespondingtotheinterceptand
modeleffects.
602
Technical Details
The Alias Matrix
Appendix B
Design of Experiments Guide
Undertheusualregressionassumptions,theexpectedvalueof 1 isgivenby:
E 1 = 1 + A 2
where A = X 1'X 1 1 X 1'X 2 .
ThematrixAiscalledthealiasmatrix.
X1
X1 V
X2
whereVistheblockdiagonalcovariancematrixoftheresponses.
A = X 1 X 1 + K
X 1 X 2
whereKisadiagonalmatrixwiththesevalues:
k=0forNecessaryterms
k=1forIfPossiblemaineffects,powers,andinteractionsinvolvingacategoricalfactor
withmorethantwolevels
k=4forallotherIfPossibleterms
IntheBayesiancase,thealiasmatrixgivesthealiasingofeffectscorrespondingtoaridge
1
regressionwithapriorvarianceof K .ForadditionaldetailonBayesiandesigns,see
BayesianDOptimalityonpage 121intheCustomDesignschapterandBayesian
IOptimalityonpage 123intheCustomDesignschapter.
IntheCustomDesignplatform,youcancontroltheweightsusedforIfPossibletermsby
selectingAdvanced Options > Prior Parameter Variancefromtheredtrianglemenu.Thereyou
cansetpriorvariancesforallmodeltermsbyspecifyingthediagonalelementsofK.The
optionupdatestoshowthedefaultweightswhenyouclickMakeDesign.
Appendix C
References
Agresti,A.,andCoull,B.A.(1998),ApproximateIsBetterthanExactforIntervalEstimation
ofBinomialProportions,TheAmericanStatistician,52,2,119126.
Agresti,A.,andCaffo,B.N.(2000),SimpleandEffectiveConfidenceIntervalsfor
ProportionsandDifferencesofProportionsResultfromAddingTwoSuccessesandTwo
Failures,TheAmericanStatistician,54,4,280288.
Atkinson,A.C.andDonev,A.N.(1992),OptimumExperimentalDesigns,ClarendonPress,
Oxfordp.148.
Barker(2011),C.,PowerandSampleSizeCalculationsinJMP,SASInstitute.Retrieved
November12,2013from
http://www.jmp.com/blind/whitepapers/wp_jmp_powersample_104887.pdf.
Bose,R.C.,(1947),MathematicalTheoryoftheSymmetricalFactorialDesignSankhya:The
IndianJournalofStatistics,Vol.8,Part2,pp.107166.
Box,G.E.P.(1988),SignaltoNoiseRatio,PerformanceCriteria,andTransformations,
Technometrics30,140.
Box,G.E.P.andBehnken,D.W.(1960),SomeNewThreeLevelDesignsfortheStudyof
QuantitativeVariables,Technometrics2,455475.
Box,G.E.P.andDraper,N.R.(1987),EmpiricalModelBuildingandResponseSurfaces,NewYork:
JohnWileyandSons.
Box,G.E.P.,Hunter,W.G.,andHunter,J.S.(1978),StatisticsforExperimenters,NewYork:John
WileyandSons,Inc.
Box,G.E.P.,Hunter,W.G.,andHunter,J.S.(2005),StatisticsforExperimenters:Design,Innovation,
andDiscovery,2ndedition,NewYork:JohnWileyandSons,Inc.
Box,G.E.P.andMeyer,R.D.(1986),AnAnalysisofUnreplicatedFractionalFactorials,
Technometrics28,1118.
Box,G.E.P.andWilson,K.B.(1951),OntheExperimentalAttainmentofOptimum
Conditions,JournaloftheRoyalStatisticalSociety,SeriesB,13,145.
Byrne,D.M.andTaguchi,G.(1986),ASQC40thAnniversaryQualityControlCongress
Transactions,Milwaukee,WI:AmericanSocietyofQualityControl,168177.
Chen,J.,Sun,D.X.,andWu,C.F.J.(1993),ACatalogueofTwolevelandThreeLevel
FractionalFactorialDesignswithSmallRuns,InternationalStatisticalReview,61,1,
p131145,InternationalStatisticalInstitute.
Clopper,C.,Pearson,E.S.(1934),Theuseofconfidenceorfiduciallimitsillustratedinthe
caseofthebinomial,Biometrika26,404413.
604
References
Appendix C
Design of Experiments Guide
Cochran,W.G.andCox,G.M.(1957),ExperimentalDesigns,SecondEdition,NewYork:John
WileyandSons.
Cohen,M.B.,Gibbons,P.B.,Mugridge,W.B.,Colbourn,C.J.(2003),ConstructingTestSuites
forInteractionTesting,Proceedings25thInternationalConferenceonSoftwareEngineering,
3848.
Cohen,M.B.,Dwyer,M.B.,andShi,J.(2007)InteractionTestingofHighlyConfigurable
SystemsinthePresenceofConstraints,Proceedingsofthe2007InternationalSymposiumon
SoftwareTestingandAnalysis,129139.
Colbourn,C.(2004),CombinatorialAspectsofCoveringArrays,LeMatematiche,58,
121167.
Colbourn,C.andDinitz,J.,eds.(2010),HandbookofCombinatorialDesigns,2ndEdition,CRC
Press.
Cornell,J.A.(1990),ExperimentswithMixtures,SecondEditionNewYork:JohnWiley&Sons.
Cook,R.D.andNachtsheim,C.J.(1990),LettertotheEditor:ResponsetoJamesM.Lucas,
Technometrics32,363364.
Dalal,S.R.andMallows,C.L.(1998),FactorCoveringDesignsforTestingSoftware,
Technometrics40,234243.
Daniel,C.(1959),UseofHalfnormalPlotsinInterpretingFactorialTwolevelExperiments,
Technometrics,1,311314.
DanielC.andWood,F.(1980),FittingEquationstoData,RevisedEdition,NewYork:John
WileyandSons,Inc.
Derringer,D.andSuich,R.(1980),SimultaneousOptimizationofSeveralResponse
Variables,JournalofQualityTechnology,Oct.1980,12:4,214219.
DuMouchel,W.andJones,B.(1994),ASimpleBayesianModificationofDOptimalDesigns
toReduceDependenceonanAssumedModel,Technometrics,36,3747.
Fang,K.T.andSudfianto,A.(2006),DesignandModelingforComputerExperiments,Chapman
andHallCRC,BocaRatan.Florida
Gotwalt,C.M.,Jones,B.A.,andSteinberg,D.M.,(2009)FastComputationofDesignsRobust
toParameterUncertaintyforNonlinearSettings,Technometrics,51:1,8895.
Goos,P.(2002)TheOptimalDesignofBlockedandSplitPlotExperiments,NewYork:Springer.
Goos,P.andJones,B.(2011),OptimalDesignofExperiments:ACaseStudyApproach,JohnWiley
andSons.
Haaland,P.D.(1989),ExperimentalDesigninBiotechnology,NewYork:MarcelDekker,Inc.
Hahn,G.J.,Meeker,W.Q.,andFeder,P.I.,(1976),TheEvaluationandComparisonof
ExperimentalDesignsforFittingRegressionRelationships,JournalofQualityTechnology,
8:3,pp.140157.
Hamada,M.andWu,C.F.J.(1992),AnalysisofDesignedExperimentswithComplex
Aliasing,JournalofQualityTechnology,24:3,130137.
Hartman,A.andRaskin,L.(2004),ProblemsandAlgorithmsforCoveringArrays,Discrete
Mathematics284,149156.
Appendix C
Design of Experiments Guide
References
605
Hartman,A.andRaskin,L.(2004),ProblemsandAlgorithmsforCoveringArrays,Discrete
Mathematics,284:1,149156.
John,P.W.M.(1972),StatisticalDesignandAnalysisofExperiments,NewYork:Macmillan
PublishingCompany,Inc.
Johnson,M.E.andNachtsheim,C.J.(1983),SomeGuidelinesforConstructingExact
DOptimalDesignsonConvexDesignSpaces,Technometrics25,271277.
Jones,B.(1991),AnInteractiveGraphForExploringMultidimensionalResponseSurfaces,
1991JointStatisticalMeetings,Atlanta,Georgia.
Jones,B.andGoos,P.(2007),ACandidatesetfreeAlgorithmforGeneratingDoptimal
Designs,AppliedStatistics,56,Part3,pp118.Availableat
http://www.ncbi.nlm.nih.gov/pmc/articles/PMC3001117/.
Jones,B.andGoos,P.(2014),OptimalDesignofBlockedExperimentsinthePresenceof
SupplementaryInformationabouttheBlocks,toappearinTechnometrics.
Jones,B.,Lin,D.K.J.,andNachtsheim,C.J.(2008),BayesianDOptimalSupersaturated
Designs,JournalofStatisticalPlanningandInference,138,8692.
Jones,B.andNachtsheim,C.J.(2011),AClassofThreeLevelDesignsforDefinitiveScreening
inthePresenceofSecondOrderEffects,JournalofQualityTechnology,43,115.Availableat
http://www.jmp.com/software/pdf/definitive_screening.pdf.
Jones,B.andNachtsheim,C.J.(2011),EfficientDesignswithMinimalAliasing,
Technometrics,53:1,6271.
Jones,B.andNachtsheim,C.J.(2013),DefinitiveScreeningDesignswithAddedTwoLevel
CategoricalFactors,JournalofQualityTechnology,45,121129.
Jones,B.andNachtsheim,C.J.(2014),BlockingSchemesforDefinitiveScreeningDesigns,
Technometrics,forthcoming.
Joseph,V.R.,Gul,E.,andBa,S.(2014),MaximumProjectionDesignsforComputer
Experiments,forthcoming.
Khuri,A.I.andCornell,J.A.(1987),ResponseSurfaces:DesignandAnalysis,NewYork:Marcel
Dekker.
Kowalski,S.M.,Cornell,J.A.,andVining,G.G.(2002)SplitPlotDesignsandEstimation
MethodsforMixtureExperimentswithProcessVariables,Technometrics44:7279.
Lenth,R.V.(1989),QuickandEasyAnalysisofUnreplicatedFractionalFactorials,
Technometrics,31,469473.
Lekivetz,R.,Sitter,R.,Bingham,D.,Hamada,M.S.,Moore,L.M.,andWendelberger,J.R.
(2014),OnAlgorithmsforObtainingOrthogonalandNearOrthogonalArraysforMain
EffectsScreening.ToappearinJournalofQualityTechnology.
Lin,D.K.J.(1993),ANewClassofSupersaturatedDesign,Technometrics,35,2831.
Lucas,J.M.,(1990),LettertotheEditor:CommentsonCookandNachtsheim(1989),
Technometrics,32,363364.
Mahalanobis,P.C.(1947),Sankhya,TheIndianJournalofStatistics,Vol8,Part2,April.
606
References
Appendix C
Design of Experiments Guide
Martirosyan,S.(2003),PerfectHashFamilies,IdentifiableParentPropertyCodesand
CoveringArrays,Ph.D.thesis,UniversitatDuisburgEssen,FakultatfurMathematik.
Meyer,R.K.andNachtsheim,C.J.(1995),TheCoordinateExchangeAlgorithmfor
ConstructingExactOptimalDesigns,Technometrics,Vol37,pp.6069.
Meyer,R.D.,Steinberg,D.M.,andBox,G.(1996),FollowupDesignstoResolveConfounding
inMultifactorExperiments,Technometrics,38:4,p307.
Mitchell,T.J.(1974),AnalgorithmfortheConstructionofDOptimalExperimentalDesigns,
Technometrics,16:2,pp.203210.
Montgomery,D.C.(2009),DesignandAnalysisofExperiments,SeventhEdition,Hoboken:John
Wiley&Sons,Inc.
Morgan,J.(2009),ConstrainedCoveringArrays:ResolvingInvalidLevelCombination
Constraints,TechnicalReport,CaryNC:SASInstituteInc.,alsoinSupplementalProceedings
ofthe20thInternationalSymposiumonSoftwareReliabilityEngineering.
Morgan,J.(2014),ComputingCoverageandDiversityMetricsforConstrainedCovering
Arrays,TechnicalReport,CaryNC:SASInstituteInc.
Morris,M.D.,Mitchell,T.J.,andYlvisaker,D.(1993),BayesianDesignandAnalysisof
ComputerExperiments:UseofDerivativesinSurfacePrediction,Technometrics35:2,
243255.
Myers,R.H.(1976)ResponseSurfaceMethodology,Boston:AllynandBacon.
Myers,R.H.(1988),ResponseSurfaceMethodology,VirginiaPolytechnicandStateUniversity.
Myers,R.H.,Montgomery,D.C.,andAndersonCook,C.M.(2009),ResponseSurface
Methodology,ProcessandProductOptimizationUsingDesignedExperiments,ThirdEdition,
Hoboken:JohnWiley&Sons,Inc.
Mylona,K.,Goos,P.,andJones,B.(2014),OptimalDesignofBlockedandSplitplot
ExperimentsforFixedEffectsandVarianceComponentEstimation,Technometrics,56:2,
132144.
Nayeri,P.,Colbourn,C.,andKonjevod,G.(2013),RandomizedPostoptimizationofCovering
Arrays,EuropeanJournalofCombinatorics,34,91103.
Peipel,G.F.(1988),ProgramsforGeneratingExtremeVerticesandCentroidsofLinearly
ConstrainedExperimentalRegions,JournalofQualityTechnology20:2,125139.
Plackett,R.L.andBurman,J.P.(1947),TheDesignofOptimumMultifactorialExperiments,
Biometrika,33,305325.
Santner,T.B.,Williams,B.,andNotz,W.(2003),TheDesignandAnalysisofComputer
Experiments,Springer,NewYork.
Schoen,E.D.(1999),DesigningFractionalTwolevelExperimentswithNestedError
Structures,JournalofAppliedStatistics26:495508.
Shannon,C.E.andWeaver,W.(1949),TheMathematicalTheoryOfCommunication,
UniversityOfIllinoisPress,Urbana,Illinois.
Scheff,H.(1958)ExperimentswithMixtures,JournaloftheRoyalStatisticalSocietyBv20,
344360.
Appendix C
Design of Experiments Guide
References
607
Shewry,M.C.andWynn,H.P.(1987),MaximumEntropySampling,JournalofApplied
Statistics14,165170.
Snee,R.D.andMarquardt,D.W.(1974),ExtremeVerticesDesignsforLinearMixture
Models,Technometrics,16,391408.
Snee,R.D.(1975),ExperimentalDesignsforQuadraticModelsinConstrainedMixture
Spaces,Technometrics,17:2,149159.
Snee,R.D.(1979),ExperimentalDesignsforMixtureSystemswithMulticomponent
Constraints,Commun.Statistics:TheoryandMethods,8(4),303326.
Snee,RonaldD.(1985),ComputerAidedDesignofExperimentsSomePractical
Experiences,JournalofQualityTechnology,17,222236.
St.John,R.C.andDraper,N.R.(1975),DOptimalityforRegressionDesigns:AReview,
Technometrics,17,523.
Taguchi,G.(1976),AnIntroductiontoQualityControl,Nagoya,Japan:CentralJapan
QualityControlAssociation.
Vivacqua,C.A.,andBisgaard,S.(2004),StripBlockExperimentsforProcessImprovement
andRobustness,,QualityEngineering,16,495500.
Welch,W.J.(1984),ComputerAidedDesignofExperimentsforResponseEstimation,
Technometrics,26,217224.
Wu,C.F.J.,andHamada,M.S.(2000),Experiments:Planning,Analysis,andOptimization,second
edition,Wiley.
Xiao,L.,Lin,D.K.J.,andBai,F.(2012),ConstructingDefinitiveScreeningDesignsUsing
ConferenceMatrices,JournalofQualityTechnology,44,28.
Yilmaz,C.,Fouche,S.,Cohen,M.B.,Porter,A.,Demiroz,G.,andKoc,U.(2014),Moving
ForwardwithCombinatorialInteractionTesting,Computer47,3745.
Zahran,A.,AndersonCook,C.M.,andMyers,R.H.(2003),FractionofDesignSpaceto
AssessthePredictionCapabilityofResponseSurfaceDesigns,JournalofQualityTechnology,
35,377386.
Zhang,Z.andZhang,J.(2011),CharacterizingFailureCausingParameterInteractionsby
AdaptiveTesting,Proceedingsofthe2011InternationalSymposiumonSoftwareTestingand
Analysis,331341.
608
References
Appendix C
Design of Experiments Guide
Index
Design of Experiments Guide
A
ABCDdesigns 320
acceleratedlifetestdesign 35
acceptablevaluesSeelowerlimitsandupper
limits
ActualbyPredictedplots 269
AddFactorbutton 8687
adding
centerpointsinaugmentdesigns 514,516
factors 157
linearconstraints 315
runsandtermsinaugmentdesigns 518
additionalruns 99,255,290,302
advancedoptions(nonlineardesigner) 445
Aefficiency 493
AliasMatrix 488,601
explanation 132
hardorveryhardfactors 602
Aliasoptimaldesigns 124,134
aliasingeffects 249
Alpha 532
animationscripts 533
Anovareports 325
anticipatedcoefficients 104,226,392,479
AnticipatedRMSE 478
Appearance 486
ApplyChangestoAnticipated
Responses 480481
assigningimportance(ofresponses) 242,456
assumedmodel 39,65
asterisk 561
attribute,discretechoicedesigns 366
augmentnonlineardesigntable 445
AugmentedDesigns 499
addcenterpoints 510,514
addnewrunsandterms 511,518
addingaxialpoints 511,516
description 36
Doptimal 518
extendingexperiments 510
foldover 511,515
modifyDorIoptimalitycriterion 525
replicate 510511
saveddesign(X)matrix 525
specialcommands 525
specifysphereradiusvalue 526
averagevarianceofprediction 493
axial
points 277
scaling,centralcompositedesigns 288
B
BayesianDoptimaldesigns 121
BayesianIoptimaldesigns 123
blocksizes 145
Blockingfactor 87
Borehole Sphere Packing.jmp 412
Bounce Data.jmp 279
Bounce Factors.jmp 279280
BoxBehnkendesigns 277,279,288
SeealsoResponseSurfacedesigns
Byrne Taguchi Factors.jmp 452453
C
Categoricalfactor 87,220,244,386
CCDSeecentralcompositedesigns
centerpoints
augmentdesigns 514,516
centralcompositedesigns 277
responsesurfacedesigns 277
simplexcentroiddesigns 309
centerpolynomials 574
centralcompositedesigns 277,288
Seealsoresponsesurfacedesigns
centroidpoints 315
610
Chakravarty 247
ChemicalKinetics.jmp 431
chemicalmixture,examples 326
choicedesigns
description 35
example 359
purpose 359
choiceset,discretechoicedesigns 366
ClusterFillingdesign
SpaceFillingdesigns
ClusterFilling 407
coding 573579
assigning 577
centerpolynomials 574
example 574
lowandhighvalues 573
ColorMaponCorrelations 470,490
columnproperty
about 559
adding 561
coding 573579
ConstraintState 103,226,391,595
designrole 570572
designroles 570
factorchanges 585
factorsformixtureexperiments 579
mixture 579585
mixtureexperiments 579
responselimits 562569
runsperblock 594
valuelabels 591
valueordering 588591
viewing 561
combinations,disallowing 109
CONAEVmethod 319
confounding 250
pattern 250
resolutionnumbers 246
Constantfactor 88
constraints
adding 315
disallowingcombinations 109
linear 318
constraintstate 595
Continuousfactor 87,220,243,386
Contourmenu 487
Index
Design of Experiments Guide
Contrast 265
controlfactors 449,451
CONVRTmethod 319
coordinateexchangealgorithm 125
Corn.jmp 443
Cotterdesigns 247
countsperunit(powerandsamplesize) 548
covariateexamples 171181
Covariatefactor 88
coveringarray 34
customdesign
aliastermsoutline 96
commands 102
datatables 101
definefactorconstraintsoutline 91
description 33
designevaluationoutline 100
designgenerationoutline 97
designoutline 100
example 6682
factorsoutline 8591,384,510
modeloutline 95
options 102110
responsesoutline 83
splitplot 111
splitsplitplot 112
stripplot 115
D
DEfficiencyWeight 105
defects 548
Defficiency 124,492
definitivescreening
advantages 227
blocking 221
designevaluationoutline 223
designoutline 223,390
designs 33,198
examples 199216
experimentaldata 228
factorsoutline 219
options 225,391
orthogonalblockingoptions 221
outputoptions 224
overview 197
platform 199
Index
Design of Experiments Guide
responsesoutline 217,347
structureofdesigns 227
window 216390
describingmodels 309
design
matrixtableproperties 106
MomentsMatrix 106
resolutions 245
SaveXMatrix 106
DesignDiagnostics 471,491
AEfficiency 493
AverageVarianceofPrediction 493
DEfficiency 492
GEfficiency 492
table 390,401
DesignEvaluation 476
DesignGeneration 252
Designoutline 476
designrolecolumnproperty 570572
DesignSearchTime 104
designs
ABCD 320
aberration 246
augment 510
BayesianDoptimal 121
BayesianIoptimal 123
BoxBehnken 277,279,288
centralcomposite 277
discretechoice 359
foldover 515
fractionalfactorial 245
fullfactorial 233,301
fullfactorials 245
GaussianprocessIMSEoptimalspace
filling 406
Ioptimal 122
Latinhypercubespacefilling
design 396399
maximumentropyspacefilling 404
minimumaberration 246
minimumpotentialspacefilling 402
mixedlevel 247
mixture 305,326
nonlinear 35,431
orthogonal
screeningdesigns 245
611
screeningexperiments 305
surfacedesigns 288
orthogonalarrays 247
PlackettBurman 246
replicating 511512
responsesurface 277
saturated 99
screening 231
simplexcentroid 309
simplexcentroids 309
simplexlattice 312
spacefilling 320,381416
spherepackingspacefilling 393
splitplot 111
splitsplitplot 112
stripplot 115
uniformprecision 288
uniformspacefilling 399
desirability
functions 283,455
maximizing 283
traces 283
values 242
diagnosticsforcustomdesigns 525
Difference to Detect option 532533,537,540
DisallowedCombinations 105,109,526
discretechoicedesigns
analysis 370,374
attribute 366
attributespanel 368
choiceset 366
definition 359
designgenerationpanel 368
dialog 367
example 367368
priorinformation 372
profile 366
survey 366
DiscreteNumericfactor 87,386
DOE
simpleexamples 234
workflow 39,54
workflowexample 40
DOE Sphere Radius 527
Donev Mixture Factors.jmp 164,169
Doptimal
612
Index
Design of Experiments Guide
augmentation 518
designs 120121
E
effect
aliasing 250
eigenvalue 282
eigenvector 282
nonestimable 245
orthogonal 289,449
sparsity 233,247,263
efficiencies
D,G,andA 491
eigenvalueofeffect 282
eigenvectorofeffect 282
errorstandarddeviation 532
EstimationEfficiency 469,487
EvaluateDesign
AliasTerms 476
Crossbutton 475
description 35
DesignCreationTime 493
example 464472
Factorsoutline 475
Interactionsbutton 475
launchwindow 473
lostruns 464
MainEffectsbutton 475
Modeloutline 475
powercalculations 494497
Powersbutton 476
relativepredictionvariancecalculation 497
RSMbutton 475
ScheffeCubicbutton 476
window 473
X,Factor 473
Y,Response 473
excludingfactorcombinations 109
experimentaldesign 39,59
extraparameters 532
extremevertices 314
algorithms 319
findingoptimalsubsets 316
rangeconstraints 316
F
factorchanges 585
factorcombinations,disallowing 109
Factor Profiling option 282,284,300,329,454
factorialdesigns
fractional 245
full 233,245,301
threelevel 247
factors
adding 87,157
categorical 87,220,244,386
continuous 243
controlfactors 449,451
covariate 171
keyfactors 231
mixtureexperiments 579
tables,creating 103,225,356,391
types 87,220,386
falsenegatives 247
FastFlexibleFillingdesigns
SetAverageClusterSize 407
findingoptimalsubsets(extremevertices) 316
fittingmixturedesigns 324
fixedcovariatefactors 171
fixedcovariatesexample 172
foldingthecalculation 325
foldoverdesigns 515
FractionofDesignSpacePlot 468,484
fractionalfactorialdesigns 245
FractionalIncreaseinCILength 487
FullFactorialDesigns 245,293303
description 34
examples 295
functions,desirability 283,455
G
GaussianprocessIMSEoptimaldesign 406
Gefficiency 492
goaltypes 242
matchingtargets 242
minimizingandmaximizing 242
Group New Runs into Separates
Blockoption 514
613
Index
Design of Experiments Guide
H
HalfNormalplot 265,268
hiddenintercepts 325
hyperspheres 104,526
I
identifyingkeyfactors 231
Importancecolumn 102,225,391
importanceofresponses 242,456
IndependentVariables 486
industrialexperimentation 359
innerarrays,innerdesigns 449,451
Inscribe option 289
interactions 247
highorder 246
intercepts,hidden 325
Ioptimal
designs 122123
Ioptimaldesigns 122
J
JMPStarter 31
JSL(JMPScriptingLanguage)
animationscripts 533
augmenteddesigns 505
sphereradius 527
K
Keep the Same 101,224
kSampleMeans(powerandsamplesize) 539
L
L18Chakravarty 247
L18Hunter 247
L18John 247
L36 247
L9Taguchi 452
Labelcolumn 256,291
largerthebetterformulas(LTB) 453
Latinhypercubespacefillingdesign 396399
LenthsPSE 265,275
linearconstraints 103,226,315,318,391
LoadConstraints 103,226,391
LoadFactors 103,225,356,391
LoadResponses 102,225,391
Lock Z Scale 486
LowerLimit 102,225,391
M
maineffectsdesign 129
Make Model 265
matchingtargetgoals 242
matrices
alias 601
model 601
matrix,design 106
maximize
desirability 283,483484
goals 242
responses 242
maximumentropyspacefillingdesign 404
means,oneandtwosample(powerand
samplesize) 531
menutips 30
methods
CONAEV 319
minimize
goals 242
responses 242
minimum
aberrationdesigns 246
potentialdesign 402
mixedleveldesigns 247
mixturecolumnproperty 579585
example 582585
LPseudoComponentCoding 581
LowerLimit 580
PseudoComponentCoding,about 581
SumofTerms 581
UPseudoComponentCoding 581
UpperLimit 580
MixtureDesigns 305332,359
ABCDdesign 320
comparedtoscreeningdesigns 305
definition 305
description 34
examples 163171,326328
tutorialexamples
614
Index
Design of Experiments Guide
mixture designs
326
extremevertices 314
fitting 324
linearconstraints 318
optimal 308
optimalsubsets 316
responsesurfaces 329
SetAverageClusterSize 321
simplexcentroids 309
simplexlattice 312
spacefilling 320
ternaryplots 323
Mixturefactor 88
mixtureofmixtures 168
MixtureSum 105
modelmatrix 601
Modelscript
ModelSpecificationdialog 266,280
models
describing 309
MonteCarlosimulation 263
N
NMonteCarloSpheres(nonlineardesign
option) 446
N Responsesbutton 242
nointerceptmodel 580
noisefactors 449,451
nonestimableeffect 245
nonlineardesign 429447
advancedoptions 445
augmenttable 437,445
createusingpriorparameterestimates 434
creating 442
creatingwithnopriordata 438
description 35
distributionofparameters 439
examples 35,431
fittingtofindpriorparameterestimates 431
introduction 429
launchdialog 434,443
numberofMonteCarlosamples 436
numberofstarts 436
overlayplotofdesignpoints 441
usingpriorparameterestimates 434
NumberofCenterPointsoption 99
NumberofMonteCarloSamples(nonlinear
designoption) 446
NumberofReplicatesoption 99
numberofruns,screeningdesigns 245
NumberofStarts 104,108
numberofstarts 104
NumberofSubplots 120
NumberofWholePlots 120
O
On Faceoption 289
onesampleandtwosamplemeans(power
andsamplesize) 531
onesampleandtwosampleproportion
(powerandsamplesize) 542
onesamplevariance(powerandsample
size) 540
optimalsubsets(mixturedesigns) 316
OptimalityCriterion 104,525
orderofruns 101,224,255,290,302,310,315,320
orthogonalarraydesigns 247,449
orthogonalblockingoptions 221
orthogonaldesigns
screeningdesigns 245
screeningexperiments 305
surfacedesigns 288
Orthogonal option 289
Orthographicprojection 487
outerarrays,outerdesigns 449,451
P
parameters,extra 532
Patterncolumn 236,256,291,303
patterns,confounding 250
performancestatistics 451
PlacketBurmandesigns 256
PlackettBurmandesigns 246
Plastifactors.jmp 326
platformoverviews 33
plots
ActualbyPredicted 269
Scatterplot3D 286
ternary 305,323
points
615
Index
Design of Experiments Guide
axial 277
centerSeecenterpoints
centroid 315
PowerAnalysis 465,477483
calculations 494
categoricaleffect 495
singleparameter 494
powerandsamplesizecalculations 529551
analyses 531
animation 536
countsperunit 548
instatisticaltestsonmeans 541
ksamplemeans 539
onesampleandtwosample
proportions 542
onesamplemean 532533
onesamplevariance 540,543,545
Sigmaqualitylevel 550
twosamplemeans 537
prediction
profilers 160161
traces 282
variances 288
predictionformulas,saving 328
predictionprofiler 282
PredictionVarianceProfile 466,483
PredictionVarianceSurface 485
predictionvariancesurfaceplot 486
PriorParameterVariance 105
profile,discretechoicedesigns 366
profilers
mixtureresponsesurface 329
predictionprofilers 282
predictionVarianceprofiler 160161
proportions(powerandsamplesize) 542
prospectivepowerandsamplesize 529
prospectivepowerandsamplesize
calculations(seepowerandsample
size) 551
pureerror 514
Q
quadraticmodel 150
R
radius,sphere 104,526
randomblockdesigns 110
randomstarts 108
randomizationrestrictions 110
examples 181
RandomizewithinBlocks 101,224
randomizingruns 101,224
rangeconstraints 314
ReactionKineticsStart.jmp 438439
ReactionKinetics.jmp 440
Reactor 8 Runs.jmp 501
Reactor Factors.jmp 295296
Reactor Response.jmp 295
regressorcolumns 248
relativepredictionvariance 483,497
relativeproportionsSeemixturedesigns
RelativeStdErrorofEstimate 488
relativevarianceofprediction 483
replicating
designs 512
replicatingdesigns 511
requestingadditionalruns 99,255,290,302
rescalingdesigns 289
resolutionnumbers 246
Resolutionslider 486
resolutionsofdesigns 245
ResponseGoal 102,225,391
ResponseGridSlider 486
responselimits 562569
Desirability 563
editing 567
example 564567
Goal 563
Importance 563
Showasgraphreferencelines 563
Value 563
ResponseSurfaceDesigns 277291
description 34
examples 150,279285
introduction 286
purpose 277
reports 281
withcategoricalfactors 156
responsesurfaceeffects 325
ResponseSurfaceMethodology(RSM) 286
616
responsesurfaces
mixturedesigns 329
responses
customdesigns 242,287
desirabilityvalues 242
goals 242
goals,desirabilityfunctions 283
lowerlimits 242
upperlimits 242
RMSE 269,299
robustdesign 178
robustengineering 449
roles,design 570
Rotatableoption 289
RSM(ResponseSurfaceMethodology) 286
Run Model 265
RunOrder 101,224
runs
additional 99,255,290,302
ordertheyappearintable 101,224,255,290,
302,310,315,320
requestingadditional 99,255,290,302
screeningdesigns 245
runsperblock 594
S
samplemeans(powerandsamplesize) 531
samplesizeandpower 36
samplesizes
examplecomparingsingledirection
onesamplevariances 540,543
examplewithcountsperunit 548
oneandtwosamplemeans 533
prospectivepoweranalysis 540
screeningdesigns 293
saturateddesigns 99
SaveConstraints 103,226,356,391
SaveFactors 103,225,356,391
SaveResponses 102,225,391
SaveScripttoScriptWindow 105,227,392
SaveXMatrix 104,106
saving
predictionformulas 328
XMatrix 525
scaling
axial 288
Index
Design of Experiments Guide
designs 289
Scatterplot3D
BoxBehnkendesigns 286
Scheffpolynomial 324
screening
examples 129
standarddesigns 197
screeningdesign
about 231
ChooseScreeningType 244
description 34
DesignGeneration 252
designtypes 245
dialogs 237,256
examples 237290
NearOrthogonaldesigns 252
NumberofColumnStarts 253
NumberofStarts 253
scripts
animation 533
generatingtheanalysismodel 266,280
ModelscriptSeeModeltableproperty
scriptingSeeJSL
SetAverageClusterSize 321,407
SetDeltaforPower 105,227,493
SetRandomSeed 103,226,391
sigmaqualitylevel(powerandsample
size) 550
signalfactors 449
signaltonoiseratios 449
SignificanceLevel 478
simplex 305
centroiddesigns 309
latticedesigns 312
SimulateResponses 103,226,392
singlesamplemeans(powerandsample
size) 533
Sort Left to Rightoptions 101,224
Sort Right to Leftoption 101,224
SpaceFillingdesigns 381416
boreholeproblem,spherepacking
example 411
description 35
GaussianprocessIMSEoptimal 406
Latinhypercube 396399
maximumentropy 404
617
Index
Design of Experiments Guide
minimumpotential 402
SetAverageClusterSize 407
spherepacking 379,393
uniform 399
SpaceFillingMixturedesigns 320323
SetAverageClusterSize 321
sparsity,effect 233,247
spherepackingdesign 379,393
sphereradius 104,526
SphereRadiusoption 104
splitplotdesigns 111
SplitPlotVarianceRatio 105,493
splitplot
designs 111
example 181
splitsplitplotdesigns 112
starpoints 277
starts,numberof 104
starts,random 108
statistics,performance 451
stripplotdesigns 115
subsets,findingoptimal 316
supersaturateddesigns 138163
surfacedesignsSeeresponsesurfacedesigns
survey,discretechoicedesigns 366
T
tables
factorstable,creating 103,225,356,391
makingincustomdesigns 101
taguchiarrays
description 35
Taguchidesigns 449455
description 449
methods 449
targetvalues 84,218,243,384
Term 479
ternaryplots 305,323
threedimensionalscatterplot
BoxBehnkendesigns 286
tooltips 30
traces,desirability 283
tradeoffinscreeningdesigns 245
tutorialexamples
augmentdesigns 501510
DOE 234
fullfactorialdesigns 295
mixturedesigns 326328
responsesurfacedesigns 279,284285
screeningdesigns 237
tutorials 29
twofactorinteractions 132137
twolevelfractionalfactorials 245
twolevelfullfactorials 245
twosampleandonesamplemeans 537
twosamplemeans(powerandsample
size) 531
twosampleproportion(powerandsample
size) 542
twowaysplitplot
designs 115
example 186
U
Uncontrolledfactor 88
Uniform(spacefillingdesign) 399
uniformprecisiondesigns 288
UpperLimit 102,225,391
User Definedoption 289
V
valuelabels 591
valueordering 588591
values
target 84,218,384
varianceofprediction 289
vertices
extreme 314,316
W-Z
weight,importanceofresponse 242,456
Weld-Repaired Castings.jmp 271
wholemodeltest 325
XMatrix,saving 106,525
XVERTmethod 319
618
Index
Design of Experiments Guide