Resource Monitoring in Cloud Computing
Akshay Mehta
Institute of Technology (ITNU)
Nirma University
Ahmedabad, India
17bce061@nirmauni.ac.in
Abstract—Cloud computing is emerging evolutionary tech-
nology.In cloud computing,user have to pay-per-usage of ser-
vices.Resource monitoring plays major role in cloud comput-
ing.Any cloud computing company’s faith depends on how
it manages and monitoring resources which are allocated to
their users.Resources should be divided in three parts stor-
age,computing and networking.Resource monitoring is used for
billing purpose,auto scaling purpose,task management purpose
etc.
Keywords—cloud computing,resource monitoring,resource
monitoring metrics
I. I NTRODUCTION
In this paper we will see various resource monitoring
techniques and different metrics which are used for resource
monitoring.The rest of the paper is organized as follows.
Section 2 provides an overview of cloud computing and it’s
benefits.Various types of clouds are also discussed in this
section.Resource monitoring and metrics which are currently
used in cloud computing are discussed in section 3 and
4.Finally in Section 5, we conclude the paper with remarks
on future work.
II. OVERVIEW OF C LOUD C OMPUTING
Cloud is group of connected servers which pro-
vides on-demand storage services,on-demand computer
power,application services and more other resources on in-
ternet.There various benefits of cloud computing which are
enumerated below:
1) Cost Efficiency: Recently a study done by Rackspace
surveyed that 80 percent of cloud users experienced
cost savings and 56 percent users noted an increase
in profit.Hardware cost reduces,labour cost reduces and
maintenance cost becomes to zero because cloud ser-
vices are available over internet.Cloud services are avail-
able in pay-per-usage model.So it also decreases capital
investment and increases productivity.
2) Highly Reliability and availability: As day-by-day cloud
users are increasing,the services and resources provided
by cloud is highly available and reliable.One illusions
about cloud is that it has infinite pool of resources
which means that resources are always available.The
applications running on cloud are easily transferred to
other servers if a server fails.
3) Storage capacity: Cloud computing has no bound-
aries.User can increase storage when needed and trim
down when user don’t need.Cloud also keep backup of
data and user can backup many times as user wish.
4) Elastic and customizable: Cloud have infinite pool of
resources.User expects cloud to provide resources at
any time.It is expected that additional resources should
be provisioned automatically when load increases and
released when load decreases.On cloud,different config-
uration resources available which can used to make user
resource customize as user want.
5) Self service: For using cloud services,user have to re-
quest resources which will allocated to them dynami-
cally and without human interventions.
There are mainly three layers of cloud
• Representation: Different learning methods may adopt
different representation formalism for the data and knowl-
edge (functions) to be learned. In some learning method,
the target function is not explicitly defined [5].
• Characteristics of learning process: Learning can be su-
pervised or unsupervised. Different methods may have
different inductive bias, different search strategies, differ-
ent guiding factors in search, and different needs regard-
ing the availability of a domain theory. For a target func-
tion, its generalization can be eager (at learning stage) or
lazy (at classification stage), and its approximation can
be obtained either locally or globally with regard to a set
of training cases. Learning can result in either knowledge
augmentation or knowledge (re)compilation. Depending
on the interaction between a learner and its environment,
there are query learning and reinforcement learning [5].
• Properties of training data and domain theories: Data
gathered for the learning process can be small or large in
quantity, and noisy or accurate in terms of random errors.
Data can have different valuations. Different learning
methods can have different criteria regarding training
data, with some methods requiring large amount of data,
others being very sensitive to the quality of data, and
yet another needing both training data and a domain
theory. On the other hand, the quality of domain theories
(correctness, completeness) will have direct impact on the
outcome of analytical learning methods. Finally, based on
the way in which training data are generated and provided
to a learner, there are batch learning and on-line learning.
• Target function output: Depending on the output, learning
problems can be categorized as binary classification,
 multi-value classification and regression [5].
• Theoretical underpinnings and practical considerations:
Underpinning learning methods are different justifica-
tions: statistical, probabilistic, or logical. What are the
frameworks for analyzing learning algorithms? How can
we evaluate the performance of a generated function, and
determine the convergence issue? What types of practical
problems do we have to come to grips with [5]?
III. M ACHINE L EARNING A LGORITHMS
Machine learning deals with the issue of how to build
computer programs that improve their performance at some
task through experience. Machine learning algorithms have
been utilized in:
1) Data mining problems where large databases may con-
tain valuable implicit regularities that can be discovered
automatically
2) Poorly understood domains where humans might not
have the knowledge needed to develop effective algo-
rithms
3) Domains where programs must dynamically adapt to
changing conditions.
Learning a target function from training data involves many
issues (function representation, how and when to generate the
function, with what given input, how to evaluate the perfor-
mance of generated function, and so forth). Major types of
learning include: concept learning (CL), decision trees (DT),
artificial neural networks (ANN), Bayesian belief networks
(BBN), reinforcement learning (RL), genetic algorithms (GA)
and genetic programming (GP), instance-based learning (IBL),
inductive logic programming (ILP), and analytical learning
(AL). Not surprisingly, machine learning methods can be
(and some have already been) used in developing better tools
or software products. Our preliminary study identifies the
software development and maintenance tasks in the following
areas to be appropriate for machine learning applications:
requirement engineering (knowledge elicitation, prototyping);
software reuse (application generators); testing and validation;
maintenance (software understanding); project management
(cost, effort, or defect prediction or estimation)
IV. A PPLYING M ACHINE L EARNING TO S OFTWARE
E NGINEERING TASKS
A. Quality Requirement analysis
For any software creation, SRS is created and each detail of
software listed in SRS documents. Quality Requirements are
the major parts of software engineering. Software requirement
specifications should be met. In SRS documents requirements
are listed with there class. The SRS is written in natural
language(English), we can here use NLP and machine learning
techniques to detect and classify quality requirements state-
ments.
To classify requirements statements, we are mining sen-
tences from SRS and based on written words, fetch keywords
from sentences and based on keywords label the sentences
based on req. on user interface(FR),req. on database(FR),
req. on system functions(FR), compatibility, performance effi-
ciency, security, maintainability etc [3]. If there is a word like
utilization, capacity in a sentence then this sentence labeled
as performance efficiency. If there is a word like authenticity,
confidentiality in a sentence then this sentence labeled as
security. To classify data machine learning methods like the
k-nearest neighbor, the Naive Bayesian method is used [3].
B. Product Cost estimation
In software engineering, major issues are cost estimation
and effort allocation. With the help of a software cost estima-
tion model, project managers perfectly utilize their resources.
For cost estimation, we have to take many things into consid-
eration. The growth of software depends upon software cost
and effort calculation. Software cost estimation is done by two
methods: algorithmic and non-algorithmic.
In non-algorithmic methods, the human brain is used. It
includes expert judgment method, estimating by analogy,
bottom-up estimating model, etc. Expert judgment the method
uses an expert or group of experts to decide the estimated cost
of the product. The analogy technique compares the proposed
product with a similar product build earlier and makes cost
estimation. In bottom-up, the product is divided into segments
and their estimated cost added to make a final estimation of
the proposed product.
Algorithmic methods are based on formulas. The variables
in these formulas are code size,effort,estimated duration etc.
There are several machine learning algorithm is also used
to estimate the cost of the project [1]. Case-based reasoning
used to collect and store the cost results of previous project
functionalities with effort and used language. We compare
the proposed product with the past one and estimate cost.
If any new functionalities found then it will recollect the
functionalities. A decision tree is widely used to estimate the
cost of the product. By extracting attributes, use the most
informative attributes to create a tree and split attributes where
it is needed. By providing input variables, we can easily
estimate cost from traveling root to leaf [1].
Fig. 1. Productivity based on software complexity distribution
One most simple method which is used to predict cost is
shown in Fig. 1. Here, software complexity is distributed in
low, average, high and very high. If complexity is low or
average then a line of code generated by a person per hour is
between 30 to 60. If complexity is high or very high then if
team size less than 5 then productivity per team per hour is
between 60 to 80 lines of code and if team size is greater than
productivity per team per hour between 80 to 120 lines of code.
There are other factors also affect the cost like development
language, the platform used for development, etc.
C. Software Reusability prediction
While developing new software, we can use previously built
software or we can partially modify it for a new system. This
method is a cost-effective, reliable and speedy development
for new systems. Here we are measuring reusability level(low,
medium, high) of function-based software components [2].
The main benefit of reusability is that they provide error-
free codes because they are previously tested. There is a
problem also associated with reusability like maintenance cost,
support tool, etc. There are mainly two ways to develop
functionality. One from scratch and another from extracting
needed functionality which was built earlier. Software reuse
also reduces project risk, time to market.
In this model, various metrics are used to predict the
reusability level. The metrics used are cyclomatic complexity,
Halstead volume, reuse frequency, Maintainability index [2].
Cyclomatic complexity gives values of decision nodes in code
like if-else, for, while, etc. Halstead volume shows the volume
of source code with respect to the operator and operands.
Reuse frequency calculates the ratio of static calls to the
total call of the component. The maintainability index shows
how code easily supported and changed. Maintainability index
takes variables such as cyclomatic complexity, line of code
and volume of code. Based on code, these metrics are calcu-
lated. These metrics also have some influences on reusability
attributes like commonality of functions, ease of modification,
performance with respect to time and space, cost, etc. Based
on these metrics,KNN machine learning algorithm is used to
classify code into reusability levels [2]. Here computed metrics
are used to find the distance.
To predict more precisely we have to take each reusability
metric into consideration because some metrics influencing
commonality of functions, some influencing testability, some
influencing cost. The given components are analyzed based
on metrics value. Based on metrics value, each component
assigned re-usability level for every metrics and based on this
finally component classify.
D. Software Testing
There are several test cases that require repetitive actions to
be performed by a human tester. Machine learning can learn
these actions and automate the actions without a programmer
having to write scripts to execute those actions.
Machine learning can also find out outliers or corner cases
that are likely to break the production deployment in a cloud
based distributed application [4]. When there are several
interdependent micro services being deployed in containers
in a clustered environment, it’s very hard to imagine a rare
combination of circumstances that can lead to a race condition.
Outlier analysis on logs can flag out these special circum-
stances [4].
V. C ONCLUSION
In this paper, we show how Machine learning can be used
for solving software engineering problems and not only can
machine learning be used to build tools for software develop-
ment and maintenance tasks, but can also be implemented into
software products to make them reliable and self-configuring.
The software engineering discipline will definitely be able to
benefit from the usefulness of machine learning.
We can also clearly see that proper implementation of
machine learning in software engineering is not only beneficial
but also a field worth pursuing.
ACKNOWLEDGMENT
We would like to thank Prof. Vivek Prasad for giving us
the opportunity to dwell into the fascinating world of Cloud
Computing and helping us realize how well cloud computing
change the tech world. We would also like to thank our parents
without whom none of this would have been possible to begin
with.
R EFERENCES
[1] Mahmood Mohd Al Asheeri and Mustafa Hammad. Machine learning
models for software cost estimation. In 2019 International Conference on
Innovation and Intelligence for Informatics, Computing, and Technologies
(3ICT), pages 1–6. IEEE, 2019.
[2] Surbhi Maggo and Chetna Gupta. A machine learning based efficient
software reusability prediction model for java based object oriented
software. International Journal of Information Technology and Computer
Science (IJITCS), 6(1):1–12, 2014.
[3] Tetsuo Tamai and Taichi Anzai. Quality requirements analysis with
machine learning. In ENASE, pages 241–248, 2018.
[4] Du Zhang. Applying machine learning algorithms in software devel-
opment. In Proceedings of the 2000 Monterey workshop on modeling
software system structures in a fastly moving scenario, volume 26, pages
275–291, 2000.
[5] Du Zhang and Jeffrey JP Tsai. Machine learning applications in software
engineering, volume 16. World Scientific, 2005.