A testing-coverage software reliability model considering fault removal efficiency and error

generation.
Li Q1,2, Pham H3.
Abstract
In this paper, we propose a software reliability model that considers not only error generation but
also fault removal efficiency combined with testing coverage information based on a
nonhomogeneous Poisson process (NHPP). During the past four decades, many software reliability
growth models (SRGMs) based on NHPP have been proposed to estimate the software reliability
measures, most of which have the same following agreements: 1) it is a common phenomenon that
during the testing phase, the fault detection rate always changes; 2) as a result of imperfect
debugging, fault removal has been related to a fault re-introduction rate. But there are few SRGMs
in the literature that differentiate between fault detection and fault removal, i.e. they seldom
consider the imperfect fault removal efficiency. But in practical software developing process, fault
removal efficiency cannot always be perfect, i.e. the failures detected might not be removed
completely and the original faults might still exist and new faults might be introduced meanwhile,
which is referred to as imperfect debugging phenomenon. In this study, a model aiming to
incorporate fault introduction rate, fault removal efficiency and testing coverage into software
reliability evaluation is developed, using testing coverage to express the fault detection rate and
using fault removal efficiency to consider the fault repair. We compare the performance of the
proposed model with several existing NHPP SRGMs using three sets of real failure data based on five
criteria. The results exhibit that the model can give a better fitting and predictive performance.

A Detailed Study of NHPP Software Reliability Models (invited paper)

Richard Lai Mohit Garg
Abstract
Software reliability deals with the probability that software will not cause the failure of a system for
a specified time under a specified condition. The probability is a function of the inputs to and use of
the system as well as a function of the existing faults in the software. The inputs to the system
determine whether existing faults, if any, are encountered. Software Reliability Models (SRMs)
provide a yardstick to predict future failure behavior from known or assumed characteristics of the
software, such as past failure data. Different types of SRMs are used for different phases of the
software development life-cycle. With the increasing demand to deliver quality software, software
development organizations need to manage quality achievement and assessment. While testing a
piece of software, it is often assumed that the correction of errors does not introduce any new
errors and the reliability of the software increases as bugs are uncovered and then fixed. The models
used during the testing phase are called Software Reliability Growth Models (SRGM). Unfortunately,
in industrial practice, it is difficult to decide the time for software release. An important step towards
remediation of this problem lies in the ability to manage the testing resources efficiently and
affordably. This paper presents a detailed study of existing SRMs based on Non-Homogeneous
Poisson Process (NHPP), which claim to improve software quality through effective detection of
software faults.

Software error detection model with applications

Amrit L. Goel
Abstract
This paper deals with the modeling of software errors encountered in a small and a large software
system. A deterministic analysis of software failure process is presented to obtain an appropriate
mean value function for a nonhomogeneous Poisson process. Several quantitative measures for
software quality assessment are also proposed. Statistical techniques of inference about unknown
parameters are discussed and detailed analyses of software error data from two systems are
presented.
An NHPP Software Reliability Model and Its Comparison
Hoang Pham and Xuemei Zhang
Abstract
In this paper, software reliability models based on a nonhomogeneous Poisson process (NHPP) are
summarized. A new model based on NHPP is presented. All models are applied to two widely used
data sets. It can be shown that for the failure data used here, the new model fits and predicts much
better than the existing models. A software program is written, using Excel & Visual Basic, which can
be used to facilitate the task of obtaining the estimators of model parameters.
Keywords: Software Reliability, NHPP, Maximum Likelihood Estimation, Probability Distribution,
Mean Value Function, Sum of Squared Errors, Reliability Prediction.

Non-parametric Estimation for NHPP Software Reliability Models

Abstract
The non-homogeneous Poisson process (NHPP) model is a very important class of software reliability
models and is widely used in software reliability engineering. NHPPs are characterized by their
intensity functions. In the literature it is usually assumed that the functional forms of the intensity
functions are known and only some parameters in intensity functions are unknown. The parametric
statistical methods can then be applied to estimate or to test the unknown reliability models.
However, in realistic situations it is often the case that the functional form of the failure intensity is
not very well known or is completely unknown. In this case we have to use functional (non-
parametric) estimation methods. The non-parametric techniques do not require any preliminary
assumption on the software models and then can reduce the parameter modeling bias. The existing
non-parametric methods in the statistical methods are usually not applicable to software reliability
data. In this paper we construct some non-parametric methods to estimate the failure intensity
function of the NHPP model, taking the particularities of the software failure data into consideration.
Keywords: Software reliability, NHPP model, intensity function, non-parametric estimation

Analysis of software reliability growth model under two types of fault and warranty cost
G Goutham Kumar, Richa Sharma
2nd International Conference on System… 2017
DOI:10.1109/icsrs.2017.8272866
Abstract
The reliability growth is a major quality attribute for the assessment of maintainability and capability
of the software. In order to increase the software reliability, warranty is provided by the
manufacturer at the time of software release. The present investigation deals with the analysis of
software reliability growth model (SRGM) based on non-homogenous poisson process (NHPP) under
two types of faults and warranty cost. Software testing is considered into two phases (i) testing
phase, and (ii) operational/warranty phase for the prediction of software reliability. To find the
accurate total expected delivery cost including with warranty and penalty cost of the software
system, a warranty cost model for the software system is proposed in this paper. To validate the
analytical results, numerical results are performed using MATLAB software.

A Discussion of Software Reliability Growth Models with Time-Varying Learning Effects

Chiu, Kuei-Chen
Volume 2, Issue 3, June 2013, Pages: 92-104 
Abstract
Over the last few decades, software reliability growth models (SRGM) has been developed to predict
software reliability in the testing/debugging phase. Most of the models are based on the Non-
Homogeneous Poisson Process (NHPP), and an S or exponential-shaped type of testing behavior is
usually assumed. Chiu et al. (2008) provided an SRGM that considers learning effects, which is able
to reasonably describe the S and exponential-shaped behaviors simultaneously. This paper considers
both linear and exponential-learning effects in an SRGM to enhance the model in Chiu et al. (2008),
assumes the learning effects depend on the testing-time, and discusses when and what learning
effects would occur in the software development process. This research also verifies the
effectiveness of the proposed models with R square (Rsq), and compares the results with these of
other models by using four real datasets. The proposed models consider constant, linear, and
exponential-learning effects simultaneously. The results reveal the proposed models fit the data
better than other models, and that the learning effects occur in the software testing process. The
results are helpful for the software testing/debugging managers to master the schedule of the
projects, the performance of the programmers, and the reliability of the software system.
Keywords: Software Reliability, Non-Homogeneous Poisson Process (NHPP), Learning Effects, Time-
Varying Learning Effects.

Optimal release policies for a software system with warranty cost and change-point phenomenon
D. R. Prince WILLIAMS
Abstract
Determining the software quality and release time of the software is an important role of software
reliability. Software reliability growth models (SRGMs) are applications of software reliability. The
change-point is defined as the prominent change in the software testing time, in connection with the
quality of a software error occurrence or error-detection phenomenon. As a result, the software
reliability growth process, based on the change-point, affects the precision of the software reliability
prediction, based on the SRGMs. To find the accurate total expected delivery cost with a suitable
warranty period of the software system, a new cost model for the software system with the
warranty and change-point phenomenon is proposed in this paper. The entire expected delivery cost
and the reliability of the software system is calculated using the change-point SRGM. The optimal
release time is calculated by reducing the overall estimated delivery cost for various desired
reliability levels. Based on the proposed warranty cost model and the reliability of the software
system, we have derived some optimal release policies. Numerical illustrations and interconnected
discussed data are itemized. From the testing outcome, we get software release policies that provide
a comprehensive analysis of software based on the total expected delivery cost with a suitable
warranty period, desired level of reliability, and change-point. Moreover, these policies will be
helpful for project managers to decide where to stop the testing for customer release at the exact
time with a suitable warranty period.
Keywords: Software reliability, optimal release policies, change-point

Software reliability growth models: A comparison of linear and exponential fault content functions
for study of imperfect debugging situations
Javaid Iqbal, Duc Pham
Abstract
The software testing process basically aims at building confidence in the software for its use in real
world applications. The reliability of a software system is always important to us. As we carry out the
error detection and correction phenomenon on our software, the reliability of the software grows.
With an aim to model this growth in the software reliability, many formulations in the form of
Software Reliability Growth Models have been proposed. Many of these are based on Non-
Homogeneous Poisson Process framework.
In this paper, a parallel comparison of the performance of the proposed software reliability growth
models is carried out, considering linear and exponential fault content functions for study of
imperfect debugging situations. The performance of the proposed models has been compared with
some famous existing software reliability models and the proposed models have been validated on
some real-world datasets. Three goodness-of-fit criteria that include mean square error, predictive-
ratio risk and predictive power are used to carry out the performance comparison of the models.
Using these comparison criteria on six actual failure datasets, it is concluded that the proposed
Model-2 which always outperforms Model-1, fits the actual failure data better and has better
predictive power than other considered SRGMs for at least two data sets.
Keywords: software reliability, reliability growth, software reliability growth model (SRGM), non-
homogeneous Poisson process (NHPP), learning effect, fault detection rate (FDR), imperfect
debugging