June 10, 2020

SE Assignment

Submitted To :Prof. Hirra Nazeer

Briefly Describe
Orthogonal Array Testing?

Submitted By:
Gohar Riaz (26)
MSC IT (4th)pre
Software Quality Assurance…. Assignment 4

What is Orthogonal array testing (OATS)?

OATS testing can be defined as a methodical, statistical method of testing pair-

wise interactions. It offers in depth and evenly distributed coverage for all variable
pairs. OATS testing makes use of an array of values signifying variable factors that
are merged pair-wise. Usual testing methods represent all arrangements of factors
and levels, which increases the number of test cases.

OATS testing technique is usually used in intricate applications and web

applications. If the AUT involves large number of factors and each factor consists
of more number of values, it will make the testing process quite difficult. Black
box testing will not be enough to offer enough testing coverage.

Example: There are four parameters

 A1: five values

 A2: four values

 A3: three values

Page 1
Software Quality Assurance…. Assignment 4
 A4: two values

Therefore, test cases are found out for A1 and A2 first and they come out 20. Then
A1 pairs up with A3 .Then A2 pairs up with A3 so that no combination is repeated
simultaneously and all probable combinations are covered. This continues until all
the parameters are covered.

Why use OATS testing?

Being prudent about which test cases you select can make all the difference
between:

-Ceaselessly executing tests that just are not expected to identify defects and do not
boost your assurance in the application.

-Executing a brief, well-defined set of tests that are probable to uncover most (not
all) of the defects and that offer users more comfort in the quality of your
application.

How OAT's is represented?

The formula to calculate OAT

 Runs (N) – Number of rows in the array, which translates into a number of
test
cases
that
will be generated.
 Factors (K) – Number of columns in the array, which translates into a
maximum number of variables that can be handled.
 Levels (V) – Maximum number of values that can be taken on any single
factor.

A single factor has 2 to 3 inputs to be tested. That maximum number of inputs

decide the Levels.

Page 2
Software Quality Assurance…. Assignment 4
Terms used in OATS testing:
Let us have a glance at the terminologies used in OATS

1. Runs: The term runs denote the number of rows in the array. The number
of runs is equal to the number of test cases that can be created using OATS
technique.
2. Factors: This term denotes the number of columns in an array ,
independent variables
3. Levels: This term denotes the maximum number of values that can be
taken on by any single factor.
4. Strength: In any sub matrix the no. of the distinct rows all occurring.

Steps for OATS:

1. Identify the number of business components that need to be tested for
interaction. This parameter signifies the factors of array. It is directly
translated from number of columns present in an array.
2. Identify an appropriate orthogonal array with the least number of Runs. A
suitable array is one that has at least as many Factors as required from Step 1
and has at least as many levels for each of those factors as determined in
Step 2.
3. Map the Factors and values onto the array.
4. Select values for any “left over” Levels.
5. Transcribe the Runs into test cases, adding any specifically dubious
combinations that are not generated.
Parameters

1. Measures: eight values

2. Products: six values
3. Countries: sixty values
4. Months: twelve

Page 3
Software Quality Assurance…. Assignment 4
Number of test cases according to traditional black box testing: 8*6*12*60 =
34560

1. No. of Factors – 4
2. No. of Levels – 60,12,8,6
3. No. of runs – 720
Number of test cases after applying OAT parameters with maximum number of
values

Country: 60

Months: 12

Test cases after OATS testing = 720

Test cases for country and months are found out initially and then pairs are created
for rest of the factors between country /months so that each combination remains
unique and no combination is redundant.

Important concepts related to OATS testing:

1. Two-way iteration: When exhaustive test cases are found for 2 parameters.
2. Three-way iteration: When exhaustive test cases are found for 3 parameters.
3. Single Mode Faults – Single mode faults occur only due to one parameter.
4. Double Mode Fault – is caused by the 2precise Parameters values which
interact together.
5. Multimode Faults –If there are more than 2 interacting components produce
consistent inaccurate output, then it is called as multimode fault.

Tool that can be used for OATS testing:

http://hexawise.com is the tool that can be used for implementing OATS. The tool
is user friendly and enables users to define 2-way iteration and 3-way iteration.
Test coverage can be analyzed using this tool.

Page 4
Software Quality Assurance…. Assignment 4
Benefits of OATS testing:
OATS testing is used to identify defects in an optimal manner. Pairwise technique
is one of the techniques that can be used for this.

1. This would help in decreasing effort and foster productivity and saving cost.
2. Reduces testing cycle time
3. Analysis is easier
4. Smart Risk based Testing method
5. Makes use of variable pair combination
6. Balanced test cases ensure straightforward defect isolation and performance
assessments. This offers substantial cost savings compared to traditional
methods
7. Offers uniformly distributed coverage
8. Helpful for integration testing of software components.

OAT Disadvantages
 As the data inputs increase, the complexity of the Test case increases. As a
result, manual effort and time spent increases. Hence, the testers have to go
for Automation Testing.
 Useful for Integration Testing of software components.

Terminologies in Orthogonal Array Testing

Before understanding the actual implementation of Orthogonal Array Testing, it is
essential to understand the terminologies related to it.

Enlisted below are the widely used terminologies in Orthogonal Array

Testing:

Page 5
 Software Quality Assurance…. Assignment 4
Term Description
Runs It is the number of rows which represents the number of test conditions to be
performed.

Factors It is the number of columns which represents in the number of variable to be tested

Levels It represents the number of values for a Factor

 As the rows represent the number of test conditions (experiment test) to be

performed, the goal is to minimize the number of rows as much as possible.
 Factors indicate the number of columns which is the number of variables.
 Levels represent the maximum number of values for a factor (0 – levels – 1).
Together, the values in Levels and Factors are called LRUNS
(Levels**Factors).

Mistakes or errors while performing OAT

1. The testing effort should not be focused on the wrong area of the
application.
2. Avoid picking the wrong parameters to combine
3. Avoid using Orthogonal Array Testing for minimal testing efforts.
4. Applying Orthogonal Array Testing manually
5. Applying Orthogonal Array Testing for high-risked applications

Conclusion:
Here we have seen how OAT (Orthogonal Array Testing) can be used to reduce
the testing efforts and how test case optimization can be achieved.

Page 6