Date of publication xxxx 00, 0000, date of current version xxxx 00, 0000.

Digital Object Identifier 10.1109/ACCESS.2021.DOI

Multi-stream deep convolution neural

network with blending ensemble
classification for Human Posture
Recognition
Amer Hamza Aamir1 , Syed Farooq Ali1 , Afifa Hameed 2 , Aaima Parvez1 , Ahmed Hasnain
Mirza 1 , Muhammad Bilal 3 and Muhammad Shehzad Hanif 3
1
Department of Software Engineering, School of Systems and Technology, University of Management and Technology, Lahore, Pakistan (e-mail:
f2019279026,farooq.ali @umt.edu.pk)
2
Department of Software Engineering, Faculty of Information and Technology, University of Central Punjab, Lahore, Pakistan
3
Center of Excellence in Intelligent Engineering Systems, Department of Electrical and Computer Engineering, King Abdulaziz University, Jeddah 21589, Saudi
Arabia
Corresponding author: Syed Farooq Ali (e-mail: farooq.ali@umt.edu.pk).
This research work was funded by Institutional Fund Projects under grant no. (IFPIP: 941-135-1443). The authors gratefully acknowledge
technical and financial support provided by the Ministry of Education and King Abdulaziz University, DSR, Jeddah, Saudi Arabia.

ABSTRACT
Human Posture Recognition has been a focal point of research for over a decade. It’s primarily used
for remote detection of human postures, such as sitting, standing, lying, and walking, particularly in the
context of elderly care. While sensor-based, vision-based, and feature-based solutions exist, the advent
of affordable processing power has shifted researchers’ interest towards deep learning-based approaches.
These approaches have shown promising results in posture recognition. This study introduces a multi-
stream deep convolutional neural network for this purpose. We utilize pre-trained deep learning architectures
namely ResNet-50, ResNet-101, and VGG-16 to extract features. Principle Component Analysis (PCA) has
been applied for dimensionality reduction, thereby reducing computational costs. Furthermore, ensemble
machine learning classifiers are used to achieve high accuracy on the deep features obtained. Among various
ensemble methods used to enhance accuracy, Blending proved to be the most effective. Our proposed
approach, in contrast to existing state-of-the-art methods, was evaluated on five publicly available datasets:
KARD, MCF, NUCLA, URFD, and UP Fall. The results indicate that our approach surpasses existing
methods in terms of accuracy, precision, and recall, demonstrating its effectiveness.

INDEX TERMS
Human Posture Recognition, Ensemble Classification, Convolution Neural Network, Deep Learning

I. INTRODUCTION and to capture any kind of abnormal activities. The statistics

HE importance in the research domain of computer
T vision has drastically elevated in recent years and
extensive research has been conducted in the domain of
Human Posture Recognition (HPR). The HPR can be referred
to as a complicated field due to the colossal number of
postures to deal with. The arrangement of the body’s skeleton
in posture is brought about either naturally or involuntarily
by a person’s motion. Due to advancements in surveillance
systems, a copious amount of cameras by the year 2023
has been placed at public places to deal with security issues
as shown in Figure 1 demonstrate that the surveillance
technology market size is expected to have a drastic increase
from the year 2020 to the year 2026 [1]. These cameras
installed at public places record videos that further help in
deciding for any kind of unusual activity that is happening
such as the detection of crimes like kidnapping and assault
[2]. The surveillance systems capture the human posture
that assist in identifying the correct or incorrect posture
thus, aiding in different type of applications as shown in
Table 1 such as in home environment, care centers for

VOLUME 4, 2016 1

FIGURE 1: Surveillance technology market size worldwide from
2020 to 2026
elders and patients, yoga centers and gyms etc. [3] to
identify imminent danger from their posture in domestic
surroundings, to assists older persons specifically who lives
alone and have difficulties executing specific duties, gaming
industry [4] and as an IOT application for smart cities [5].
Recently, researchers have also been exploiting automatic
human posture detection to guide sportsmen to enhance their
sporting prowess and correct their postures [6]. Likewise,
all kinds of anomalies and abnormal events or activities can
be automatically identified using these recorded videos after
deploying the techniques of Deep Learning (DL). Numerous
researchers have been working on the recognition of human
posture using the DL however, despite the research being
done in Computer Vision (CV) along with DL, the issues
persist due to lack of training data, depth ambiguities, and
occlusion.
Several methods for recognizing human positions have
been put out as a result of real-world applications; these
methods can be broadly divided into sensor-based and vision-
based approaches. Various wearable gadgets with sensors
or emergency buttons have been designed and developed to
monitor human posture [7]. However, there is a limitation
to this. it is not practically possible to wear these devices
all the time to enable monitoring. These limitations were
later overcome by the use of video cameras [8]. For the 2D
approach, there are two methods used. In the first, moving-
pixel projections are made based on the axis. However, the
second approach dissociate the human features into blocks
and further uses Principle Component Analysis to learn
the 2D postural appearances. Then, to make the earlier
techniques independent of the camera position, a 3D posture
model was used. Finally, some preliminary findings about the
effectiveness of this strategy were presented and discussed.
This is still a challenging task due to the wide number of
postures a person has [8]. Other drawbacks include varied
backgrounds, carrying objects, shadows, reflections, crowded
settings, etc. This problem is later addressed in [9] as they
provided a mechanism known as multi-view human bounding
for estimating volume to recognize human postures.
Among all the numerous approaches proposed in the past
2 VOLUME 4, 2016
TABLE 1: Applications exploiting human posture recognition
Real-Time Applications References
1 Supportive Home Environments [20], [21]
2 Care Centers for the disabled [22]
3 Physiotherapy [23]–[25]
4 Surveillance Systems [26], [27]
5 Yoga [28]–[30]
6 Gym [6], [31], [32]
to improve the performance of HPR systems, the researchers
further began to incorporate the latest techniques known as
convolutional neural networks (CNN) [10]. Over the past
ten years, scholars have become increasingly inquisitive
in ensemble learning approaches along with Convolutional
Neural Networks [11] [12] and have been rigorously applying
these techniques in different real-time application to enhance
their performance measures. Some of the common domains
where the ensemble learning techniques have been widely
exploited are healthcare systems [13], finance companies
[14], insurance companies [15], cyber security [16] and
many others. Hence, many models and classifiers have been
developed and integrated via ensemble learning to improve
the classification accuracy of all such real-time systems
working in different domains. Different types of ensemble
techniques have been practiced by the researchers such as
Bagging, Boosting, Stacking, Bayesian Model Combination,
and Bucket of Models [17]. In [18], stacking ensemble
learning [19] is proposed, which requires the creation of
linear combinations of several predictors to get generally
better outcomes.
Due to its widespread use, a novel approach has been
proposed in this study that involves ensemble learning in
the domain of Human Posture Recognition. In the presented
study, multiple individual learners were initially stacked,
namely J48, Random Forest (RF), Decision Table, SVM,
and Naive Bayes, generating a new model. Later, Blending
was done using AdaBoost. To increase the prediction of
our suggested model without sacrificing time efficiency,
the meta-learner aggregates the outcomes of separate base
learners.
Our contributions to this paper include:
• A new approach using a multi-stream deep convolutional
neural network for the recognition of Human Posture has
been proposed.
• The proposed architecture outstripped the existing
architectures with respect to both accuracy and time
efficiency on the KARD, MCF, URFD, NUCLA, and UP Fall
datasets.
• To achieve better performance, improve robustness, and
make better predictions, the ensembling technique known as
blending has been used.
The remainder of the paper is organized as follows:
Section II reviews the current methods for Human Posture
Recognition while Section III gives the details of various
datasets used in this research work. Section IV describes the
proposed framework for Human Posture Recognition. The
Section V provides an overview of the experimental results
along with detailed discussion whereas the Section VI finally,
concludes the paper and provides future implications
II. RELATED WORK
The researchers and scholars have been actively working
on the Human Posture Recognition for several years now.
According to the literature, it has been observed that the
research work can be categorized into thresholding-based
methods [33]–[36] where the extracted features are compared
with a defined threshold to identify whether the fall has
occurred or not. While the other techniques often used by
researchers to detect human posture are machine learning and
deep learning algorithms [37]–[42].
According to Pramerdorfer et al. [43] a model was
presented to detect the occurrence of a fall consisting of
three different states: initially the state of the person was
predicted in each frame followed by the detection of events
using temporal analysis and finally the verification of fall
was carried out using different tests to reduce the false alarm
rate. Similarly, Hung et al. in their subsequent research work
[44], [45] presented a model to detect fall incidents using two
orthogonal cameras by considering the following feature: a
person’s height along with the occupied area. Fall incidents
were encountered based on a defined threshold using the
time-series analysis of human postures. The experiment was
conducted on the Multiple Camera Fall (MCF) Dataset [46]
yielding a sensitivity of 95.8%.
Matilainen et al. [47] also presented a model known as
BPS (Body Part Segmentation) to classify the usual and
unusual activities. BPS simply compares the current posture
of humans to the postures available in the training data.
Walking and sitting were categorized as normal whereas
all other postures including falls were classified as unusual
or abnormal activity. However, there is a limitation to
this work as the set of activities chosen was minimal
moreover, choosing an optimal threshold value is difficult
and inefficient. Kang et al. [48] also presented a method for
fall detection (SW-FDM) based on the occurrence of event
pattern using the particular human body postures and the
postures such as lying, or fall are classified using a predefined
threshold value. The results of the experiment showed that
the processing cost as well as the time compared to other
existing front-line techniques, was low and the memory
required was also minimum.
All these methods defined previously fail to adapt to the
changing position of the cameras as well as the environment.
Due to these limitations of the threshold-based techniques,
the researchers were diverted towards the methods that are
based on machine learning or deep learning in order to
acquire better performance in the fall detection systems.
Abedi et al. [49] his study proposed multi-stage technique
to recognize human body postures by constructing a 3D-
RCNN with spatiotemporal processes using two datasets
namely the Fall Detection Dataset and the Human 3.6M
VOLUME 4, 2016
dataset. Another study conducted by Liaqat et al. in 2021
[50] presented a hybrid approach that was based on ML
(Machine Learning) classifiers such as KNN, SVM, LDA, RF
(Random Forest), QDA (Quadratic Discrete Analysis) and
DL (Deep Learning) classifiers such as 1D-CNN, 2D-CNN,
LSTM (Long Short Term Memory) and Bidirectional LSTM
to detect the postures. Similarly, another study presented in
2020 by Ren et al. [51] proposed a hybrid approach using a
Kinect sensor, Fuzzy Logic and Machine Learning algorithm
(SVM) to detect 20 human in-bed lying postures. In the year
2021, Noreen et al. [52] proposed a 2D Convolutional Neural
Network to detect different Hand Poses such as Fist, Test1,
Pinch, Thumb, Tiger Grasp, Test2 using datasets that are
publicly available on Kaggle, First Person and Dexter.
Iazzi et al. presented a study in the year 2018 considering
the horizontal and vertical variations of human silhouette
area and deploying a Support Vector Machine on MCF
dataset where an accuracy of 93.7% was achieved [53].
Correspondingly, in the years 2020 and 2021, Iazzi el al.
improved their work by presenting a combination of shape
and motion features while in the latter year, a framework was
proposed consisting of three phases: according to the initial
phase the human silhouette was extracted, in the subsequent
phase the local as well as global features of human silhouette
were extracted and finally the combined features were fed to
different classifiers including RF, NN, DT, SVM, and KNN.
An accuracy of 96% and 97.29% was achieved using the
SVM classifier, respectively, in the year 2020 and 2021 [54]
[55].
In the year 2017, Ge et al. [56] presented an approach that
was based on sparse dictionaries along with CNN features
to detect human fall. The experimental results showed an
accuracy of 83% on the MCF dataset. The similar dataset
was used by another researcher, Ali et al [57], in the year
2018, where he presented a model for the detection of
human fall using novel geometric and motion features. As
a result, an accuracy of 97.5% was obtained. In the same
manner, Mousse et al. implemented their proposed approach
on the MCF dataset to classify the postures of humans by
calculating the human bounding volume using the person’s
height and the area of surface that was in contact with the
ground. The outcome depicted a sensitivity of 95.8% [58].
Since promising results were obtained on fall detection
using machine learning classifiers and deep learning
algorithms, therefore, another researcher proposed a
recurrent model based on ConvLSTM by analyzing temporal
pooling on the same MCF dataset and demonstrated a
specificity of 95.8% [59]. Fan et al. [60] in his study proposed
a method based on slow feature sequences using shape-based
features and Directed Acyclic Graph SVM. An accuracy
of 94% and 96.57% was achieved on MCF and SDU Fall
datasets, respectively. Due to the popularity of CNN and
transfer learning, Liu et al. [61] in his study presented
invariant feature extractor using trained CNN model and
transfer learning from RGB-D frames for the recognition of
human action.
3
 Lahiri et al. [62], in the year 2017, proposed an approach details of the five datasets used in the research paper are given
known as Average Energy Image (AEI) that incorporates below.
the spatio-temporal features with the use of Histogram
Oriented Gradient (HOG) and Principle Component Analysis
(PCA). The experiment was conducted on URFD and
AbHa datasets, obtaining an accuracy of 92.5% and 98.9%,
respectively. However, the dataset of URFD was used by
FIGURE 2: Sample of NUCLA Dataset in Sitting Position
another researcher [63] in the same year for the detection of
fall on furniture where the proposed approach used Faster
R-CNN model while yielding an accuracy of 95.5%. Feng
et al. [64] in the year 2020, presented a complex scene fall
dataset using an LSTM to detect different variants of fall such
as side fall, backward fall and forward fall. The proposed
approach was evaluated on two datasets namely, MCF and FIGURE 3: Sample of KARD Dataset in Raising hand position
URFD, yielding a specificity of 93.5% and F-Measure of
93% on both the datasets, respectively. Youssfi et al. [65]
in the forthcoming year, demonstrated an approach that is
based on V2V-PoseNet Model detecting 2D images of the
Body Skeleton. The presented approach was analysed using
the similar dataset where a specificity of 93% was obtained. FIGURE 4: Sample of MCF Dataset in Laying Position
In the year 2022, Gomes et al. [66] proposed an
approach using the YOLO object detection algorithm
in combination with temporal classification methods and
incorporates the filter tracking algorithm to track the falls of
each person present in the scene. The two versions of the
proposed approach were created namely YOLOK+3DCNN
and YOLOK+2DCNN+LSTM. Correspondingly, Salimi et FIGURE 5: Sample of UP Fall Dataset in Falling Position
al. in the same time [67] proposed a solution based on the
method called as Fast Pose Estimation that incorporates the
use of Time-Distributed CNN LSTM along with 1D-CNN to
categorize the extracted frames. The proposed technique was
evaluated on the URFD dataset and the accuracy of 97% was
acquired as a result. Another work presented by Wu et al. [68] FIGURE 6: Sample of URFD Dataset in No Fall Position
deployed the Gated Recurrent Unit (GRU), a deep learning
model for the detection of fall on publically available datasets
and achieved a good accuracy when compared to other state- A. KARD
of-the-art machine learning algorithms. Kinetic Activity Recognition Dataset (KARD) contains 18
Thus, inspired by the encouraging results of the already activities [69] including hand raise, as shown in Figure 3,
discussed methods, we propose an approach with major horizontal arm wave, high arm wave, side kick, walk, and
contributions. We propose an ensemble classifier based on bend etc with each activity performed three times by 10
multiple streams of deep convolutional neural networks to different subjects. The total number of files is 2160. The
detect human postures. The robustness and strength of our dataset consists of 540 sequences for about a total of 1 hour
proposed approach is evaluated on five different datasets of videos captured at a resolution of 640x480 pixels at 30fps.
where different scenarios are exploited and the comparison is In this paper, KARD’s 5 categories were used with a total of
shown with the existing cutting-edge techniques. Hence, by 7698 frames.
exploiting the results of posture recognition, the efficient and
effective algorithm is proposed to detect fall while ensuring B. MCF
that proposed approach leads to an improvement in the The MCF dataset has frequent categorization of fall
accuracy of fall detection while minimizing the false alarms. occurrences [73]. It consists of 192 videos, 96 of which
represent fall and the remaining 96 normal events. This
III. DATASETS dataset includes 24 different circumstances where nine
The experiments were conducted on 5 datasets namely: different activities, such as crouching, walking, falling, and
KARD [69], UP Fall [70], MCF [71], URFD [71], and laying etc. are present as shown in Table 4. The video
NUCLA [72]. Samples from each dataset have been shown sequences have a frame rate of 30 fps and a 720 x 480
in Figure 2 through Figure 6. The focus of these datasets is frame size. In this paper, MCF’s 2 categories i.e. laying and
on human posture recognition and human fall detection. The walking, have been used with a total of 690 frames.
4 VOLUME 4, 2016
C. NUCLA
The Northwestern-UCLA Multiview Action 3D Dataset
(NUCLA) contains RGB [72], depth, and human skeleton
data captured simultaneously by three Kinect cameras. The
ten action categories in this dataset are donning, doffing,
tossing, carrying, picking up with one/two hands, dropping
garbage, moving around, sitting down, standing up, and
walking. Ten performers participated in each action. The
sample has been collected from various viewpoints. In this
paper, NUCLA’s 5 categories have been used with a total of
531 frames.
D. URFD
The dataset known as URFD consists of 70 sequences
(40 everyday life activities + 30 falls) [74] as shown in
Figure 6. The two Kinect cameras along with the associated
accelerometric data were used to apprehend the incidents of
fall occurrences. However, the events are merely captured
using the camera numbered 0 as well as accelerometer.
Devices such as PS Move (60Hz) along with x-IMU (256Hz)
were used to gather the data generated by sensor. The dataset
is set up as described below. Similarly, for the cameras
numbered 0 and 1, which are placed parallel to the ceiling
as well as the floor, each of them includes an arrangement
of depth along with the RGB pictures, synchronization
information, and the data of raw accelerometer. Every single
video stream is therefore, kept in its subsequent zip folder as
a sequence of png images. In this paper, URFD’s 2 categories
have been used with a total of 917 frames.
E. UP FALL
The dataset consists of raw data and feature sets that were
collected from 17 young and healthy people who conducted
11 activities and fell three times each [70]. The Figure 5
shows a falling position. Additionally, more than 850 GB
of data has been collected from several systems such as
vision systems, environmental and wearable sensors. Two
test use scenarios were displayed and in this paper, UP Fall’s
2 categories have been used with a total of 1165 frames.
IV. PROPOSED METHODOLOGY
In this study, we proposed a ensemble learning approach
using multi-stream deep convolution neural network
with human posture recognition while encoding precise
posture changes through feature enrichment. The datasets
were initially run through ResNet-50, and features from
the pooling layer were retrieved. This procedure was
then repeated using ResNet-101 and VGG-16. These
architectures’ dimensions were reduced using PCA after we
extracted their features. Next, we used with a blending meta
learner and three base learners (Naive Bayes, Random Forest,
and SVM).
A. DEEP LEARNING ARCHITECTURES
This section discusses the features of the three architectures
namely ResNet-50, ResNet-101, and VGG-16.
VOLUME 4, 2016
1) Residual Network ResNet-50
ResNet-50 has 48 Convolutional layers and is a version of
the ResNet-50 model. There are 3.8 x 109 Floating point
operations with 1 MaxPool and 1 Average Pool layer [75].
The architecture provided by the ResNets makes it flexible to
train the large complex deep neural networks, which means
that a network is able to perform and function efficiently with
hundreds or thousands of layers. ResNet offers two different
types of mapping: identity mapping and residual mapping.
Identity mapping relates to the short cut connection [76] with
an addition i.e. the output is y = F(x)+x while the residual
mapping refers to the difference, that is, y-x. To complete
classification jobs, ResNet-50 first performs a convolution
operation on the input, then applies 4 residual blocks, and
finally performs a full connection operation. The ResNet-50
has the following elements:
• A 7×7 kernel convolution
• A layer of max pooling
• There are 9 layers with 3×3,64 kernel convolution, the
second feature kernels, and the other 1×1,256 kernels.
All 3 layers gets repeated 3 more times.
• There are 12 layers including 1 by 1 with 128 kernels,
3 by 3 with 128 kernels, and 1 by 1 with 512 kernels,
Each gets repeated 4 more times.
• There are 18 layers consisting of 1 by 1 with 256 cores,
and 2 cores 3 by 3,with 256 and 1 by 1 with 1024. Each
gets repeated 6 times.
2) Residual Network ResNet-101
A convolutional neural network having 101 layers is known
as ResNet-101 [77]. The pre-trained network ca classify
images into 1000 different category of objects. Therefore, the
network can capture rich feature representations suitable for a
variety of images. The input image resolution of this network
224x224.
3) Visual Geometry Group-16
The 2014 ILSVRC competition’s runner-up was the Visual
Geometry Group (VGG). The major contribution of the
work is that it visualizes the importance of network depth
which is used for improving the accuracy of classification
and recognition in CNNs [78]. The size of the input is 224
x 224 x 3 whereas, the same padding along with the 64
channels with a filter size of 3*3 are mainly considered in
the 1st two layers of the network. The next two layers of the
network have convulational layers having the filter size of
128 along with the max pool layers. The pooling layer (2,2)
is similar to the layer proceeding this layer, thus there are
altogether 256 filters which are disseminated across the two
convulational layers with filter size of 3*3. Finally, there are
two corresponding sets of 3 convulational layers where each
filter has the equal padding along with 512 filters of size 3*3.
The image at the end is received by the stack of these two
convulational layers for the final output.
5
FIGURE 7: Proposed Architecture with features extracted from VGG-16, ResNet-50 and ResNet-101 followed by dimensionality reduction
by PCA followed by ensemble classification (Blending).

TABLE 2: Optimized hyperparameters for the backbone deep networks of the proposed approach. AF*-Activation Function

Datasets
Model Hyperparameters

MCF UP URFD KARD NUCLA

Fall

Epochs 50 10 100 30 100

Batch Size 32 32 32 32 32
ResNet-101 Optimizer adam adam SGD adam adam
Hidden relu relu relu relu relu
Layer(AF*)
Dense softmax softmax sigmoid softmax softmax
Layer(AF*)

Epochs 50 10 32 30 100
Batch Size 32 32 100 32 32
ResNet-50 Optimizer adam adam SGD adam adam
Hidden relu relu relu relu relu
Layer(AF*)
Dense softmax softmax softmax softmax softmax
Layer(AF*)

Epochs 50 10 100 30 100

Batch Size 32 32 32 32 32
VGG-16 Optimizer adam adam SGD adam adam
Hidden relu relu relu relu relu
Layer(AF*)
Dense softmax softmax softmax softmax softmax
Layer(AF*)

B. HYPERPARAMETER TUNING these models to be ultimately employed by the proposed

Hyperparameter tuning is a critical step in machine learning
model development. It involves adjusting parameters like
learning rate, batch size, or number of layers to optimize
model performance. For instance, the optimal parameters for
VGG16, ResNet50, and ResNet101 are crucial for achieving
the best results. These parameters, such as the number
of filters or the learning rate, can significantly impact the
model’s accuracy and efficiency. The best parameters for
6 VOLUME 4, 2016
framework have been meticulously tuned and are depicted
in Table 2.
C. FEATURES EXTRACTION
In the context of image classification tasks, feature extraction
is a crucial step that involves transforming raw image data
into a suitable form for modeling by a machine learning
algorithm. When using Convolutional Neural Networks
(CNNs), the process begins with the input of raw images
into the network. These images are then processed through
a series of convolutional layers, each of which applies a
set of filters and generates a feature map. These feature
maps capture local dependencies in the original image (such
as edges, corners, and other texture details) through the
application of various filters. Following the convolutional
layers, pooling layers are used to reduce the spatial
dimensions of the data, thereby controlling overfitting and
reducing computational complexity. The output of these
layers is a high-level representation of the input image which
captures the essential features needed for classification. This
output is then flattened into a one-dimensional vector and
fed into a dense layer that is fully connected network, which
performs the task of final classification. The fully connected
layer uses these extracted features to classify the images
taken as an input into several different classes based on the
training phase. Thus, CNNs automate the process of feature
extraction and classification, making them highly effective
for image classification tasks. In this work, we extract deep
features from pooling layers of ResNet-101, VGG-16, and
ResNet-50 for UP Fall, URFD, MCF, NUCLA, and KARD
respectively. The low values of the misclassification rate
demonstrate the efficiency with which our suggested deep
features were able to categorize postures as seen later in the
results section. Similarly to that, each category’s percentage
error in the aforementioned datasets is quite low.
1) Dimensionality Reduction
Due to their extremely large dimensions and high
computational cost, the combined deep features employed
in the suggested methodology are exceedingly expensive
to process. So, to reduce dimensionality, we used
principle component analysis (PCA). By reducing a large
set of variables while retaining the majority of the data
in the larger set, PCA is oftenly used to minimize the
dimensionality of large complex data set. Due to reduction in
dimensions, accuracy gets affected as variables in a dataset
are reduced, but a trade-off to dimensionality reduction is
to compromise a bit of the accuracy to achieve a simpler
model. Machine learning algorithms can handle smaller data
sets more quickly since there are fewer additional factors to
consider. PCA generates a projection of the original data into
the same number of dimensions or fewer dimensions using
straightforward matrix operations from linear algebra and
statistics. Following the application of PCA to each dataset,
we took the first three components. We then aggregated every
element from each dataset to get deep features with smaller
dimensions.
D. BLENDING
Blending, a widely known ensemble classification technique,
is used to combine the predictions generated from different
multiple machine learning models called ensemble models.
This stacking model’s architecture includes more than one
base models that are indicated as level-0 while the rest are
VOLUME 4, 2016
indicated as level-1 model. These meta models, are thus,
trained on the predictions generated by the base models on
the given sample dataset.
• Level-0 Models (Base-Models): These base models are
trained on the data, and their predictions are collected to
establish the final output.
• Level-1 Model (Meta-Model): These are the meta-
models that are used in succeeding order of base models
and are used to gather the predictions generated by the
base models.
However, the concept of blending carries particular
implications regarding the construction of a stacking
ensemble model. Blending implies the creation of a stacking
ensemble wherein the base models consist of machine
learning models of various kinds, while the meta-model is
a linear model that combines or "blends" the predictions
generated by the base models.
V. EXPERIMENTS & RESULTS
The performance of the proposed approach (PA) was
analyzed and the results were compared with the cutting-
edge techniques. The publically available datasets used for
the evaluation purpose were UP Fall with two categories,
URFD with two categories, KARD with five categories,
NUCLA with five categories, and MCF (with two and three
categories). The split ratio of 80:20 was used to compare the
PA with the state-of-the-art deep learning architectures like
VGG-16, ResNet-101 and ResNet-50 in terms of precision,
recall and accuracy.
A. ENVIRONMENT
The ensemble classification, and blending, were implemented
using Weka version 3.9.6. The extraction of the deep features
was done in Google Colab environment. Because of the large
datasets, the WEKA execution was done using hardware
with 8GB RAM, 128GB SSD, and a 2.3 GHz Intel core i5
processor.
B. EXPERIMENT 1: COMPARING ACCURACY WITH
COMPETING METHODS
PA is compared with existing state-of-the-art approaches
using the following datasets i.e. KARD, MCF, UP Fall,
URFD, and NUCLA as shown in Figure 8. It can be
observed that PA outperformed the other approaches and
achieved highest accuracy on all datasets. The proposed
approach demonstrated superior accuracy on the UP Fall
dataset compared to other datasets, most likely attributed to
its high-resolution images.
While certain datasets like URFD contained images with
low resolution, the deep features, when combined with
ensemble classification (blending) of PA, resulted in the
second-highest accuracy (98.51%). The highest accuracy
(97.95%) was achieved by Mohd et al. in 2017, and
PA surpassed the performance of the previous approach.
Similarly, the PA achieved the highest accuracy using UP fall
7
 (a) (b)

(c) (d)
FIGURE 8: Performance comparison of PA with other existing approaches using a)NUCLA b)URFD c)UP Fall and d)KARD Dataset

datasets exceeding all other approaches. Using NUCLA, the
accuracy of PA was 19.6, 11.2, 6.6, 9.1 times higher than
Liu, Dhiman, Aftab and Fang, respectively. While the PA was
4.42, 0.48, 0.85 times better than Aftab, Dhiman and Ahad
for the KARD dataset, respectively.
accuracy. This was observed across multiple datasets, namely
URFD, NUCLA, KARD, UP Fall, and MCF, as illustrated in
Figure 9. Notably, ResNet-101 showed the least performance
on the URFD dataset. A possible explanation for this could
be the lower resolution of the URFD dataset, which is at 30
frames per second. This lower resolution might not provide
enough detail for the ResNet-101 architecture to accurately
classify the data.

FIGURE 9: Accuracy Comparison with state-of-the-art deep

architectures

C. EXPERIMENT 2-5: COMPARING THE ACCURACY OF FIGURE 10: Performance comparison using URFD Dataset
PA WITH CUTTING-EDGE DEEP ARCHITECTURES
PA outperformed other advanced deep learning architectures,
including ResNet-101, ResNet-50, and VGG-16, in terms of
8 VOLUME 4, 2016
D. EXPERIMENT 6-9: PERFORMANCE COMPARISON OF most significant decline in PA’s performance was noted on
PA WITH ITS VARIANTS the MCF dataset. This dataset is uni-modal, meaning it only
After replacing the classifier of PA with AdaBoost, J48, considers a single visual modality. Furthermore, the dataset’s
Decision Table, Random Forest, SVM, and Naive Bayes, we small size and other constraints, such as the relatively low
were able to compare the performance of PA in terms of frame rate of 30 fps used to generate the samples, could
accuracy, precision, and recall. The graphical representation have contributed to this performance degradation. Table 3
as shown in Figure 10, 11 and 12 represents that the proposed summarizes the performance impact when the proposed
approach outperforms existing state-of-the-art techniques approach (blending) has been replaced with other classifiers.
given the URFD, NUCLA and KARD dataset. Moreover,
Figure 13 demonstrates that the proposed approach obtained
good results on UP Fall Front dataset. Similarly, according
to Figure 14, it can be observed that the proposed approach
achieved better accuracy, precision, and recall on the MCF
dataset with 2 and 3 categories.

FIGURE 13: Performance comparison using UP Fall Front Dataset

TABLE 3: Comparison of PA in terms of percentage accuracy by

replacing various classifiers using URFD, KARD, UP Fall, NUCLA
and MCF datasets.

URFD KARD UP Front NUCLA MCF

J48 93.3 90.52 83.52 92.3 71.42
FIGURE 11: Performance comparison using NUCLA Dataset SVM 90.37 78.56 97.64 98.71 84.03
NB 56.29 56.15 35.00 57.69 56.30
RF 97.7 91.58 97.64 96.15 79.83
PA 98.51 94.24 95.29 97.43 85.71

E. EXPERIMENT 10-12: PERFORMANCE COMPARISON

FIGURE 12: Performance comparison using KARD Dataset
The PA exhibited the best accuracy on UP Fall and URFD
datasets as compared to other datasets. Both the datasets
are multi-modal datasets. The UP Fall dataset has high-
resolution images and it has also taken into consideration
around 11 various types of activities such as falling in
different directions, walking, standing, sitting, picking up
an object, and lying down. Similarly, with URFD, the PA
observed high accuracy as the dataset contains frontal and
overhead video sequences which give good accuracy. The
VOLUME 4, 2016
OF BLENDING IN PA WITH BOOSTING AND BAGGING
We have compared the result of our proposed approach
incorporating blending with bagging and boosting in terms
of accuracy, precision, and recall as shown in Figure 15,
16 and 17, respectively. The comparison demonstrates that
the proposed approach (blending) outperforms the other
methods. One of the prominent reasons for achieving better
results with blending is that it is a heterogeneous ensemble
method giving efficient results by handling the data leakage
issues using the hold-out approach. Therefore, blending
leverages the strengths of multiple base methods to improve
the performance of predictive models.
VI. CONCLUSION & FUTURE WORK
In the proposed framework, we introduced a novel ensemble
technique called blending, coupled with deep features, for
the recognition of human posture. To ensure thorough
experimentation, we compared this approach (referred
to as PA) with existing state-of-the-art methods. The
experimental findings illustrate that PA outperformed all
9
 a)
b)
FIGURE 14: Performance comparison using a)MCF with 2
categories, b) MCF with 3 categories
FIGURE 15: Accuracy Performance of the Proposed Approach
compared with boosting and bagging
existing methods, achieving accuracies of 98.51%, 97.40%,
85.71%, 100%, and 97.12% on URFD, NUCLA, MCF,
UP Front, and KARD datasets, respectively. Deep features
for our proposed architecture were extracted from ResNet-
101, VGG-16, and ResNet-50 architectures. To mitigate
overfitting, PCA was applied to reduce dimensionality.
Moreover, PA demonstrated superior performance compared
to state-of-the-art deep networks, including ResNet-101,
ResNet-50, and VGG-16.
In an effort to boost the efficacy of our proposed method,
10
FIGURE 16: Precision performance of the Proposed Approach
with boosting and bagging
we integrated a blending technique into the algorithm. This
integration led to a noticeable improvement in the model’s
accuracy. Furthermore, we conducted a comparative analysis
of our results with various other ensemble techniques
and classifiers. These included boosting, Random Forest,
bagging, Decision Table, J48, SVM, Naive Bayes, and
AdaBoost. The experimental outcomes demonstrated that our
proposed method outperformed these other techniques and
classifiers. It achieved superior results not only in terms
of accuracy but also in precision and recall. This indicates
the robustness and reliability of our approach in diverse
scenarios.
FIGURE 17: Recall performance of the Proposed Approach
compared with boosting and bagging
In future endeavors, we aim to expand upon the proposed
study to address more challenging aspects, particularly
those that have received less attention thus far in human
posture recognition. This includes tackling scenarios such
as crowded areas, managing occlusion and camouflage,
and dealing with poorly lit environments. Additionally, we
intend to explore the application of various deep learning
algorithms, or a fusion of deep learning and machine learning
algorithms, thus incorporating a hybrid framework. We
believe that such an approach will enhance the results and
provide valuable insights for other researchers working in the
VOLUME 4, 2016
same domain.

VOLUME 4, 2016 11
REFERENCES
[1] H. J. C. Friedrich Schwandt (CEO), “Statista,” https://www.statista.com/
statistics/1251839/surveillance-technology-market-global/, 2023.
[2] J. Park, K. Song, and Y.-S. Kim, “A kidnapping detection using human
pose estimation in intelligent video surveillance systems,” Journal of the
Korea Society of Computer and Information, vol. 23, pp. 9–16, 2018.
[3] M. H. J. Fanchamps, H. L. D. Horemans, G. M. Ribbers, H. J.
Stam, and J. B. J. Bussmann, “The accuracy of the detection of body
postures and movements using a physical activity monitor in people
after a stroke,” Sensors, vol. 18, no. 7, 2018. [Online]. Available:
https://www.mdpi.com/1424-8220/18/7/2167
[4] B. Qiang, S. Zhang, Y. Zhan, W. Xie, and T. Zhao, “Improved
convolutional pose machines for human pose estimation using image
sensor data,” Sensors, vol. 19, no. 3, 2019. [Online]. Available:
https://www.mdpi.com/1424-8220/19/3/718
[5] J. Han, W. Song, A. Gozho, Y. Sung, S. Ji, L. Song, L. Wen, and Q. Zhang,
“Lora-based smart iot application for smart city: an example of human
posture detection,” Wireless Communications and Mobile Computing, vol.
2020, 2020.
[6] A. Nadeem, A. Jalal, and K. Kim, “Automatic human posture estimation
for sport activity recognition with robust body parts detection and entropy
markov model,” Multimedia Tools and Applications, vol. 80, pp. 21 465–
21 498, 2021.
[7] A. Lmberis and A. Dittmar, “Advanced wearable health systems and
applications - research and development efforts in the european union,”
IEEE Engineering in Medicine and Biology Magazine, vol. 26, no. 3, pp.
29–33, 2007.
[8] B. Boulay, F. Brémond, and M. Thonnat, “Human posture recognition in
video sequence,” 2003.
[9] M. A. Mousse, C. Motamed, and E. C. Ezin, “A multi-view human
bounding volume estimation for posture recognition in elderly monitoring
system,” in ICPR 2016, 2016.
[10] Y.-H. Byeon, J.-Y. Lee, D.-H. Kim, and K.-C. Kwak, “Posture recognition
using ensemble deep models under various home environments,”
Applied Sciences, vol. 10, no. 4, 2020. [Online]. Available: https:
//www.mdpi.com/2076-3417/10/4/1287
[11] M. Graczyk, T. Lasota, B. Trawinski, and K. Trawiński, “Comparison of
bagging, boosting and stacking ensembles applied to real estate appraisal,”
in Asian Conference on Intelligent Information and Database Systems,
2010.
[12] T. G. Dietterich, “An experimental comparison of three methods
for constructing ensembles of decision trees: Bagging, boosting, and
randomization,” Mach. Learn., vol. 40, no. 2, p. 139–157, aug 2000.
[Online]. Available: https://doi.org/10.1023/A:1007607513941
[13] J. Abdollahi, B. Nouri-Moghaddam, and M. Ghazanfari, “Deep neural
network based ensemble learning algorithms for the healthcare system
(diagnosis of chronic diseases),” arXiv preprint arXiv:2103.08182, 2021.
[14] H. Faris, R. Abukhurma, W. Almanaseer, M. Saadeh, A. M. Mora,
P. A. Castillo, and I. Aljarah, “Improving financial bankruptcy prediction
in a highly imbalanced class distribution using oversampling and
ensemble learning: a case from the spanish market,” Progress in Artificial
Intelligence, vol. 9, pp. 31–53, 2020.
[15] A. A. Khalil, Z. Liu, A. Salah, A. Fathalla, and A. Ali, “Predicting
insolvency of insurance companies in egyptian market using bagging
and boosting ensemble techniques,” IEEE Access, vol. 10, pp. 117 304–
117 314, 2022.
[16] N. Lower and F. Zhan, “A study of ensemble methods for cyber security,”
in 2020 10th Annual Computing and Communication Workshop and
Conference (CCWC). IEEE, 2020, pp. 1001–1009.
[17] L. Rokach, “Ensemble methods for classifiers,” Data mining and
knowledge discovery handbook, pp. 957–980, 2005.
[18] D. H. Wolpert, “Stacked generalization,” Neural Networks, vol. 5, pp. 241–
259, 1992.
[19] S. Deroski and B. Ženko, “Is combining classifiers with stacking better
than selecting the best one?” Machine Learning, vol. 54, pp. 255–273,
2004.
[20] N.-S. Pai, P.-X. Chen, P.-Y. Chen, and Z.-W. Wang, “Home fitness and
rehabilitation support system implemented by combining deep images and
machine learning using unity game engine,” Sens. Mater, vol. 34, pp.
1971–1990, 2022.
[21] V. Muralidharan and V. Vijayalakshmi, “A real-time approach of fall
detection and rehabilitation in elders using kinect xbox 360 and supervised
machine learning algorithm,” in Inventive Computation and Information
Technologies: Proceedings of ICICIT 2021. Springer, 2022, pp. 119–138.
12
[22] F. Hajjej, M. Javeed, A. Ksibi, M. Alarfaj, K. Alnowaiser, A. Jalal,
N. Alsufyani, M. Shorfuzzaman, and J. Park, “Deep human motion
detection and multi-features analysis for smart healthcare learning tools,”
IEEE Access, vol. 10, pp. 116 527–116 539, 2022.
[23] S. P. Godse, S. Singh, S. Khule, V. Yadav, and S. Wakhare,
“Musculoskeletal physiotherapy using artificial intelligence and machine
learning,” International Journal of Innovative Science and Research
Technology, vol. 4, no. 11, pp. 592–598, 2019.
[24] A. Tannoury, E. Choueiri, and R. Darazi, “Human pose estimation
for physiotherapy following a car accident using depth-wise separable
convolutional neural networks.” Advances in transportation studies,
vol. 59, 2023.
[25] T. Hellsten, J. Karlsson, M. Shamsuzzaman, and G. Pulkkis, “The
potential of computer vision-based marker-less human motion analysis
for rehabilitation,” Rehabilitation Process and Outcome, vol. 10, p.
11795727211022330, 2021.
[26] A. R. Shahzad and A. Jalal, “A smart surveillance system for pedestrian
tracking and counting using template matching,” in 2021 International
Conference on Robotics and Automation in Industry (ICRAI). IEEE,
2021, pp. 1–6.
[27] O. F. Arowolo, E. O. Arogunjo, D. G. Owolabi, and E. D. Markus,
“Development of a human posture recognition system for surveillance
application,” International Journal of Computing and Digital Systems,
vol. 10, 2021.
[28] D. P. P. Nagalakshmi Vallabhaneni, “The analysis of the impact of yoga
on healthcare and conventional strategies for human pose recognition,”
Turkish Journal of Computer and Mathematics Education (TURCOMAT),
vol. 12, no. 6, pp. 1772–1783, 2021.
[29] S. Jain, A. Rustagi, S. Saurav, R. Saini, and S. Singh, “Three-dimensional
cnn-inspired deep learning architecture for yoga pose recognition in the
real-world environment,” Neural Computing and Applications, vol. 33, pp.
6427–6441, 2021.
[30] S. Kothari, “Yoga pose classification using deep learning,” 2020.
[31] N. Faujdar, S. Saraswat, and S. Sharma, “Human pose estimation using
artificial intelligence with virtual gym tracker,” in 2023 6th International
Conference on Information Systems and Computer Networks (ISCON).
IEEE, 2023, pp. 1–5.
[32] H. Pardeshi, A. Ghaiwat, A. Thongire, K. Gawande, and M. Naik,
“Fitness freaks: A system for detecting definite body posture using
openpose estimation,” in Futuristic Trends in Networks and Computing
Technologies: Select Proceedings of Fourth International Conference on
FTNCT 2021. Springer, 2022, pp. 1061–1072.
[33] A. Iazzi, M. Rziza, R. Oulad Haj Thami, and D. Aboutajdine, “A
new method for fall detection of elderly based on human shape and
motion variation,” in Advances in Visual Computing, G. Bebis, R. Boyle,
B. Parvin, D. Koracin, F. Porikli, S. Skaff, A. Entezari, J. Min, D. Iwai,
A. Sadagic, C. Scheidegger, and T. Isenberg, Eds. Cham: Springer
International Publishing, 2016, pp. 156–167.
[34] C. Pramerdorfer, R. Planinc, M. V. Loock, D. Fankhauser, M. Kampel,
and M. Brandstötter, “Fall detection based on depth-data in practice,” in
European Conference on Computer Vision. Springer, 2016, pp. 195–208.
[35] H.-G. Kang, M. Kang, and J.-G. Lee, “Efficient fall detection based on
event pattern matching in image streams,” in 2017 IEEE International
Conference on Big Data and Smart Computing (BigComp). IEEE, 2017,
pp. 51–58.
[36] V. A. Nguyen, T. H. Le, and T. T. Nguyen, “Single camera based fall
detection using motion and human shape features,” in Proceedings of
the Seventh Symposium on Information and Communication Technology,
2016, pp. 339–344.
[37] N. Zerrouki, F. Harrou, A. Houacine, and Y. Sun, “Fall detection using
supervised machine learning algorithms: A comparative study,” in 2016
8th international conference on modelling, identification and control
(ICMIC). IEEE, 2016, pp. 665–670.
[38] K. Fan, P. Wang, Y. Hu, and B. Dou, “Fall detection via human posture
representation and support vector machine,” International journal of
distributed sensor networks, vol. 13, no. 5, p. 1550147717707418, 2017.
[39] A. Manzi, F. Cavallo, and P. Dario, “A 3d human posture approach for
activity recognition based on depth camera,” in European Conference on
Computer Vision. Springer, 2016, pp. 432–447.
[40] H. F. T. Ahmed, H. Ahmad, and C. Aravind, “Device free human
gesture recognition using wi-fi csi: A survey,” Engineering Applications
of Artificial Intelligence, vol. 87, p. 103281, 2020.
VOLUME 4, 2016
[41] Y. M. Galvão, J. Ferreira, V. A. Albuquerque, P. Barros, and B. J.
Fernandes, “A multimodal approach using deep learning for fall detection,”
Expert Systems with Applications, vol. 168, p. 114226, 2021.
[42] M. M. Islam, O. Tayan, M. R. Islam, M. S. Islam, S. Nooruddin, M. N.
Kabir, and M. R. Islam, “Deep learning based systems developed for fall
detection: a review,” IEEE Access, vol. 8, pp. 166 117–166 137, 2020.
[43] C. Pramerdorfer, R. Planinc, M. Van Loock, D. Fankhauser, M. Kampel,
and M. Brandstötter, “Fall detection based on depth-data in practice,” in
Computer Vision – ECCV 2016 Workshops, G. Hua and H. Jégou, Eds.
Cham: Springer International Publishing, 2016, pp. 195–208.
[44] D. H. Hung and H. Saito, “Fall detection with two cameras based on
occupied area,” in Proc. of 18th Japan-Korea Joint Workshop on Frontier
in Computer Vision, 2012, pp. 33–39.
[45] ——, “The estimation of heights and occupied areas of humans from two
orthogonal views for fall detection,” IEEJ Transactions on Electronics,
Information and Systems, vol. 133, no. 1, pp. 117–127, 2013.
[46] E. Auvinet, C. Rougier, J. Meunier, A. St-Arnaud, and J. Rousseau,
“Multiple cameras fall dataset,” DIRO-Université de Montréal, Tech. Rep,
vol. 1350, p. 24, 2010.
[47] M. Matilainen, M. Barnard, and O. Silvén, “Unusual activity recognition in
noisy environments,” in International Conference on Advanced Concepts
for Intelligent Vision Systems. Springer, 2009, pp. 389–399.
[48] H.-G. Kang, M. Kang, and J.-G. Lee, “Efficient fall detection based on
event pattern matching in image streams,” in 2017 IEEE International
Conference on Big Data and Smart Computing (BigComp), 2017, pp. 51–
58.
[49] W. M. S. Abedi, D. Ibraheem Nadher, and A. T. Sadiq, “Modified deep
learning method for body postures recognition,” International Journal of
Advanced Science and Technology, vol. 29, pp. 3830–3841, 2020.
[50] S. Liaqat, K. Dashtipour, K. Arshad, K. Assaleh, and N. Ramzan, “A
hybrid posture detection framework: Integrating machine learning and
deep neural networks,” IEEE Sensors Journal, vol. 21, no. 7, pp. 9515–
9522, 2021.
[51] W. Ren, O. Ma, H. Ji, and X. Liu, “Human posture recognition using a
hybrid of fuzzy logic and machine learning approaches,” IEEE Access,
vol. 8, pp. 135 628–135 639, 2020.
[52] I. Noreen, M. Hamid, U. Akram, S. Malik, and M. Saleem, “Hand pose
recognition using parallel multi stream cnn,” Sensors, vol. 21, no. 24,
2021. [Online]. Available: https://www.mdpi.com/1424-8220/21/24/8469
[53] A. Iazzi, M. Rziza, and R. O. H. Thami, “Fall detection based on
posture analysis and support vector machine,” in 2018 4th International
Conference on Advanced Technologies for Signal and Image Processing
(ATSIP), 2018, pp. 1–6.
[54] ——, “Efficient fall activity recognition by combining shape and motion
features,” Computational Visual Media, vol. 6, no. 3, pp. 247–263, 2020.
[55] A. Iazzi, M. Rziza, and R. Oulad Haj Thami, “Fall detection system-based
posture-recognition for indoor environments,” Journal of Imaging, vol. 7,
no. 3, 2021. [Online]. Available: https://www.mdpi.com/2313-433X/7/3/
42
[56] C. Ge, I. Y.-H. Gu, and J. Yang, “Human fall detection using segment-
level cnn features and sparse dictionary learning,” in 2017 IEEE 27th
International Workshop on Machine Learning for Signal Processing
(MLSP), 2017, pp. 1–6.
[57] S. F. Ali, R. Khan, A. Mahmood, M. T. Hassan, and M. Jeon, “Using
temporal covariance of motion and geometric features via boosting for
human fall detection,” Sensors, vol. 18, no. 6, 2018. [Online]. Available:
https://www.mdpi.com/1424-8220/18/6/1918
[58] M. Mousse, IET Conference Proceedings, pp. 2 (6 .)–2 (6 .)(1),
January 2016. [Online]. Available: https://digital-library.theiet.org/
content/conferences/10.1049/ic.2016.0026
[59] K. Zhou, Y. Zhu, and Y. Zhao, “A spatio-temporal deep architecture for
surveillance event detection based on convlstm,” in 2017 IEEE Visual
Communications and Image Processing (VCIP), 2017, pp. 1–4.
[60] K. Fan, P. Wang, and S. Zhuang, “Human fall detection using slow feature
analysis,” Multimedia Tools Appl., vol. 78, no. 7, p. 9101–9128, apr 2019.
[Online]. Available: https://doi.org/10.1007/s11042-018-5638-9
[61] J. Liu, N. Akhtar, and A. Mian, “Learning human pose models from
synthesized data for robust rgb-d action recognition,” 2017. [Online].
Available: https://arxiv.org/abs/1707.00823
[62] D. Lahiri, C. Dhiman, and D. K. Vishwakarma, “Abnormal human
action recognition using average energy images,” in 2017 Conference on
Information and Communication Technology (CICT), 2017, pp. 1–5.
VOLUME 4, 2016
[63] W. Min, H. Cui, H. Rao, Z. Li, and L. Yao, “Detection of human falls
on furniture using scene analysis based on deep learning and activity
characteristics,” IEEE Access, vol. 6, pp. 9324–9335, 2018.
[64] “Spatio-temporal fall event detection in complex scenes using attention
guided lstm,” Pattern Recognition Letters, vol. 130, pp. 242–249, 2020,
image/Video Understanding and Analysis (IUVA). [Online]. Available:
https://www.sciencedirect.com/science/article/pii/S016786551830504X
[65] A. Youssfi Alaoui, Y. Tabii, R. Oulad Haj Thami, M. Daoudi, S. Berretti,
and P. Pala, “Fall detection of elderly people using the manifold of
positive semidefinite matrices,” Journal of Imaging, vol. 7, no. 7, 2021.
[Online]. Available: https://www.mdpi.com/2313-433X/7/7/109
[66] M. E. N. Gomes, D. Macêdo, C. Zanchettin, P. S. G. de Mattos-Neto,
and A. Oliveira, “Multi-human fall detection and localization in videos,”
Computer Vision and Image Understanding, vol. 220, p. 103442, 2022.
[67] M. Salimi, J. J. Machado, and J. M. R. Tavares, “Using deep neural
networks for human fall detection based on pose estimation,” Sensors,
vol. 22, no. 12, p. 4544, 2022.
[68] X. Wu, Y. Zheng, C.-H. Chu, L. Cheng, and J. Kim, “Applying deep
learning technology for automatic fall detection using mobile sensors,”
Biomedical Signal Processing and Control, vol. 72, p. 103355, 2022.
[69] M. Morana, G. L. Re, and S. Gaglio, “Kard - kinect activity recognition
dataset,” 2017.
[70] L. Martínez-Villaseñor, H. Ponce, J. Brieva, E. Moya-Albor, J. Núñez-
Martínez, and C. Peñafort-Asturiano, “Up-fall detection dataset: A
multimodal approach,” Sensors, vol. 19, no. 9, 2019. [Online]. Available:
https://www.mdpi.com/1424-8220/19/9/1988
[71] S. Ali, R. Khan, A. Mahmood, M. Hassan, and a. Jeon, “Using temporal
covariance of motion and geometric features via boosting for human fall
detection,” Sensors, vol. 18, p. 1918, 06 2018.
[72] G. Goyal, N. Noceti, and F. Odone, “Cross-view action recognition with
small-scale datasets,” Image and Vision Computing, vol. 120, p. 104403,
2022. [Online]. Available: https://www.sciencedirect.com/science/article/
pii/S0262885622000324
[73] E. Alam, A. Sufian, P. Dutta, and M. Leo, “Vision-based human
fall detection systems using deep learning: A review,” Computers in
Biology and Medicine, vol. 146, p. 105626, 2022. [Online]. Available:
https://www.sciencedirect.com/science/article/pii/S0010482522004188
[74] S. Aftab, S. F. Ali, A. Mahmood, and U. Suleman, “A boosting framework
for human posture recognition using spatio-temporal features along with
radon transform,” Multimedia Tools and Applications, pp. 1–27, 2022.
[75] A. S. B. Reddy and D. S. Juliet, “Transfer learning with resnet-50 for
malaria cell-image classification,” in 2019 International Conference on
Communication and Signal Processing (ICCSP), 2019, pp. 0945–0949.
[76] B. Li and D. Lima, “Facial expression recognition via resnet-50,”
International Journal of Cognitive Computing in Engineering, vol. 2, pp.
57–64, 2021. [Online]. Available: https://www.sciencedirect.com/science/
article/pii/S2666307421000073
[77] P. Ghosal, L. Nandanwar, S. Kanchan, A. Bhadra, J. Chakraborty, and
D. Nandi, “Brain tumor classification using resnet-101 based squeeze and
excitation deep neural network,” in 2019 Second International Conference
on Advanced Computational and Communication Paradigms (ICACCP),
2019, pp. 1–6.
[78] K. Simonyan and A. Zisserman, “Very deep convolutional networks
for large-scale image recognition,” 2014. [Online]. Available: https:
//arxiv.org/abs/1409.1556
13
 AMER HAMZA AAMIR BUTT is a graduate
of software engineering. He completed his
bachelor’s in software engineering at the
University of Management and Technology,
Lahore, Pakistan, where he had the honor
of being rewarded with the Rector’s Merit
Award. Amer is currently working as a
Mendix specialist with a mission to bridge
the gap between the low-code and AI fields.
AHMED HASNAIN MIRZA is a software
engineer and a researcher, focusing on Artificial
Intelligence and Machine Learning. He earned
his degree in Software Engineering from the
University of Management and Technology, where
he was honored with the Rector’s Merit Award.
Currently, Hasnain is employed as a Software
Engineer and is preparing to embark on a Master’s
degree program in Applied Computing from
University of Windsor, Canada.

SYED FAROOQ ALI did his PhD (CS) from

UMT, Pakistan. He did his Ph.D. Course work,
Ph.D. Comprehensive exam and MS (CS) from
Ohio State University, Columbus, USA. He also
completed his MS (CS) from LUMS, Lahore, MUHAMMAD BILAL is an educator, researcher
Pakistan with Deans Honor List. During his stay in and a maker. His research interests include Digital
MS, he was on LUMS fellowship. He is currently Image/Signal Processing, Machine Learning/AI,
working as an Assistant Professor, UMT. His Digital/Analog circuit design, Embedded systems
research interest includes computer vision, digital and Robotics. His research work has been
image processing, and medical imaging. He is a extensively published. He is an Associate
reviewer for various IEEE conferences and journals. Professor in the Department of Electrical
and Computer Engineering, King Abdulaziz
University, Jeddah, Saudi Arabia. Prior to joining
KAU in 2014, he worked as a post-doctoral
researcher at KAIST, South Korea.
AFIFA HAMEED is a faculty member at Software
Engineering Department at University of Central
Punjab, UCP. She is involved in teaching and
research for the last six years. She won the highest
prestigious Award i.e., Rector Award during her
studies. She did BS from Government College
University, Lahore and later, completed her MS
from Kinnaird College University, Lahore. Her
research interests include computer vision, image
processing and artificial intelligence.
MUHAMMAD SHEHZAD HANIF received
the B.Sc. degree in electrical engineering from
the University of Engineering and Technology,
Lahore, Pakistan, in 2001, and the M.S. degree
in engineering sciences and the Ph.D. degree in
computer engineering from Sorbonne University,
AAIMA is a graduate student at the University
Paris, France, in 2006 and 2009, respectively.
of Management and Technology. She won the
He is currently an Associate Professor with the
Rector’s Merit Award during her studies, which
Department of Electrical and Computer, King
is the most prestigious award at the university.
Abdulaziz University, Jeddah, Saudi Arabia. His
Apart from that, she is currently working as
research interests include machine learning, image analysis, and information
a manager in the digital marketing sector in
fusion.
Pakistan. Her areas of interest include artificial
intelligence, knowledge management, and project
management.

14 VOLUME 4, 2016