Department of Computer Engineering

Unit 5
(12 Marks)

Testing Tools & Measurement

G.H.RAISONI Institute of engineering & technology,

NAGPUR
RAISONI
RAISONI
GROUP
GROUP
OF INSTITUTIONS
OF INSTITUTIONS
 What is Manual Testing
l
Manual Testing :

1. Manual testing is the process of manually testing

software for defects.

2. It requires a tester to play the role of an end user

whereby they use most of the application's features to
ensure correct behavior.

RAISONI GROUP OF INSTITUTIONS

 Limitations of Manual Testing

Limitations of Manual Testing :

1) Time Consuming Process
2) Manual tests don't scale well.
3) Error prone Testing
4) Not suitable for large scale projects
5) Manual testing is not consistent or repeatable
6) Limited Scope
7) No Batch testing
Explain each in detail
RAISONI GROUP OF INSTITUTIONS
Manual Testing Vs Automated Testing

RAISONI GROUP OF INSTITUTIONS

 What is Automated Testing
Automation Testing?
1. Automation testing is a Software testing
technique to test and compare the actual
outcome with the expected outcome.

2. This can be achieved by writing test scripts or

using any automation testing tool.

3. Test automation is used to automate repetitive

tasks and other testing tasks which are difficult
to perform manually.

Benefits:-
4. Efficient & consistency testing
5. Better quality software
6. It is cheaper ,faster & more reliable.

RAISONI GROUP OF INSTITUTIONS

 Types of Automation Tools

1) Static Testing Tools

2) Dynamic Testing Tools
1) Static Testing Tools:-
• These tools are used by developers.
• Code is not executed
• It is extension of compiler technology
• Helps to understand the structure of code
2) Dynamic Testing Tools:-
• These tools require the code to be in a “running state”.
• They analyse rather than testing.
• They also help to understand background processes.
• Also perform web site testing to check whether each link does actually link to something else, it can find
dead links.
RAISONI GROUP OF INSTITUTIONS
 Need for Automated Testing Tools

1. Using Testing Effectively

Automation of testing processes allows machines to complete the tedious, repetitive work
while human personnel perform other tasks.
2. Reducing testing costs
The cost of performing manual testing is prohibitive when compared to automated methods.
3. Replicating testing across different platforms
Automation allows the testing organization to perform consistent & repeatable test.
4. Greater application coverage
Greater application test coverage also reduces the risk. If exposing users to malfunctioning or
non-compliant software.
5. Results reporting
These report provides a standardized measure of test status & results,thus allowing more
accurate implementation of testing outcomes.
RAISONI GROUP OF INSTITUTIONS
 Advantages of Using Tools

1. Save Time /Speed: Due to advanced computing facilities, automation test tools prevail in
speed of processing the tests. Automation saves time as software can execute test cases
faster than human.
2. Reduces the tester’s involvement in executing tests: It relieves the testers to do some other
work.
3. Simulated Testing : Automated tools can create many concurrent virtual users/data and
effectively test the project in the test environment before releasing the product.
4. Test case design : Automated tools can be used to design test cases also through
automation, better coverage can be guaranteed than if done manually.
5. Reusable : The automated tests can be reused on different versions of the software, even if
the interface changes.
6. Avoids human mistakes : Manually executing the test cases may incorporate errors. But this
can be avoided in automation testing.
7. Internal Testing : Testing may require testing for memory leakage or checking the coverage
of testing. Automation can done this easily.
8. Cost Reduction : If testing time increases cost of the software also increases. Due to testing
tools time and therefore cost is reduced.
RAISONI GROUP OF INSTITUTIONS
 Disadvantages of Using Tools

Disadvantages of Using Tools :

1. Automated testing is very much expensive than the manual testing.

2. It's more expensive to automate. Initial investments are bigger than manual
testing
3. Manual tests can be very time consuming.
4. You cannot automate everything; some tests still have to be done manually.
5. You cannot rely on testing tools always.

RAISONI GROUP OF INSTITUTIONS

 Selecting Testing Tool

Criteria for Selecting Test Tools :

The Categories for selecting Test Tools are mentioned below
1. Meeting requirements
2. Technology expectations
3. Training/skills
4. Management aspects

RAISONI GROUP OF INSTITUTIONS

 Selecting Testing Tool
1. Meeting requirements : There are plenty of tools available in the market but rarely
do they meet all the requirements of a given product or a given organization.
Evaluating different tools for different requirements involve significant effort, money,
and time. Given of the plethora of choice available, huge delay is involved in selecting
and implementing test tools.
2. Technology expectations : Test tools in general may not allow test developers to
extends/modify the functionality of the framework. So extending the functionality
requires going back to the tool vendor and involves additional cost and effort. A good
number of test tools require their libraries to be linked with product binaries.

3. Training/skills : While test tools require plenty of training, very few vendors provide
the training to the required level. Organization level training is needed to deploy the
test tools, as the user of the test suite are not only the test team but also the
development team and other areas like configuration management.

4. Management aspects : A test tool increases the system requirement and requires the
hardware and software to be upgraded. This increases the cost of the already-
expensive test tool.

RAISONI GROUP OF INSTITUTIONS

 What is Metrics

METRICS :
1. A Metric is a quantitative measure of the degree to which a system, system component,
or process possesses a given attribute. Metrics can be defined as STANDARDS OF
MEASUREMENT.
2. Software Metrics are used to measure the quality of the project.
3. Metric is a unit used for describing an attribute. Metric is a scale for measurement.
4. A Metric is a measurement of the degree that any attribute belongs to a system,
product or process.
5. For example the number of errors per person hours would be a metric. Thus, software
measurement gives rise to software metrics.

Types of software metrics are:

1. Process metrics
2. Product metrics
3. Project metrics

RAISONI GROUP OF INSTITUTIONS

 Types of software metrics

1. Process metrics
• These characteristics can be used to improve the development & maintenance activities of the
software.
• The process metrics are those metrics which are concerned with SDLC.
2. Product metrics
• Describes the characteristics of the product such as size, complexity, design feature,performance
& quality level.
3. Project metrics
• Describes the project characteristics & execution.
• These are more relevant to a project team.

RAISONI GROUP OF INSTITUTIONS

 Types of Product metrics

• Mean time to failure:-

The average time the product runs before experiencing a crash which is important for systems like air traffic
control that are required to have no more than a few seconds of down time in a full year.

• Defect density:-
Refers to number of imperfections per:- Lines of code , Function definitions, Lines on input screen.

• Customer problem
is a measure of problems customers have encountered with the product over the total usage of the product.

• Customer satisfaction metrics

is generally a survey asking customers to rate their satisfaction with the product or its features on a five point
RAISONI GROUP OF INSTITUTIONS
scale.
 Metrics Lifecycle

RAISONI GROUP OF INSTITUTIONS

 What is Measurement

Measurement :
1. A measurement is an indication of the size, quantity, amount or dimension of a
particular attribute of a product or process.
2. For example : The number of errors in a system is a measurement.

Need of Software measurement:

1. Establish the quality of the current product or process.
2. To predict future qualities of the product or process.
3. To improve the quality of a product or process.
4. To determine the state of the project in relation to budget and schedule.

RAISONI GROUP OF INSTITUTIONS

 Object Oriented Metrics

1) Coupling Metrics:-
• Coupling relation increase complexity, reduce encapsulation, potential reuse, & limit understanding
& maintainability.
• Coupling measures requires information about attributes usage & method invocations of other class.

2)Cohesion Metrics:-
• Cohesion is the measure of the degree to which the elements of a module are functionally related.
• Cohesion measures requires information about attributes usage & method invocations within a class.

3) Inheritance Metrics:-
• Inheritance measures requires information about ancestors & descendants of a class.

4) Size metrics:-
• It indicates the length of a class in terms of lines of source code & methods used in the class.
• If a class has a large number of methods with greater complexity then more test cases will be
required to test that class.

RAISONI GROUP OF INSTITUTIONS

Thank you

RAISONI GROUP OF INSTITUTIONS