Cabrillas Mariel Dit Concept Paper

LA CONSOLACION UNIVERSITY PHILIPPINES
Bulihan, City of Malolos, Bulacan 3000
GRADUATE STUDIES DEPARTMENT
DEVELOPMENT AND VALIDATION OF A MOBILE-BASED CLASSROOM
OBSERVATION TOOL USING CONVOLUTIONAL NEURAL NETWORK
A Concept Paper Submitted as Requirement for Research Methods 1 and 2
Submitted by:
MARIEL Y. CABRILLAS
DIT
Maximo Mudlong
March 2023

APPROVAL SHEET
In partial fulfillment of the requirements for the Research Methods 1 and 2

subject, this Concept Paper with the working title “Mobile-Based Classroom
Observation Tool Using Convolutional Neural Network” has been prepared and
submitted.
MARIEL Y. CABRILLAS
(Student Name)
Graduate School Student
March 2023
Approved in partial fulfillment of the requirements for the subject Research Methods 1
and 2 subject.
MAXIMO MUDLONG
NAME
Professor
Accepted and approved as a partial fulfillment of the requirements for the Research
Methods 1 and 2 subject.
_________________________________
ENRICO F. ROSALES, Ph.D.
Vice President, Graduate Studies
************************************************************************
List of Suggested Advisers
1. ___________________________________________
2. ___________________________________________
3. ___________________________________________

Brief Introduction
The Department of Education’s mission is to protect and promote the right
of every Filipino to quality, equitable, culture-based, and complete basic
education. Quality education enables students to develop all of their attributes and
skills to achieve their potentiality as human beings and members of society
(Rashid, 2019). Consequently, Joshi (2018) stated that, in able to bring quality
learning outcomes, schools must have qualified and competent teachers since they
are the most influential factor in students’ learning process.
An online article from Safety Culture entitled “Teacher Evaluation
Methods for Effective Quality Teaching” it emphasizes that teacher evaluation as
a standardized process that involves rating and assessing the teaching
effectiveness of educators. The primary objective of teacher performance
evaluations is to promote a better learning experience for students and facilitate
professional growth for educators. By evaluating teachers' performance,
institutions can identify areas of strength and areas in need of improvement,
which can inform professional development opportunities and support better
teaching practices. Teacher evaluations can also be used to inform decisions
related to promotion, retention, and compensation. Ultimately, teacher evaluations
aim to improve teaching quality and contribute to the overall success of
educational institutions (https://safetyculture.com/topics/teacher-evaluation).
Background of the study/Rationale
According to DepEd, one of the tools being used to evaluate teacher’s
performance is the Results-Based Performance Management System or also


known as RPMS that ensures quality teacher performance at different career
stages with specific objectives in each Key Result Areas. The teachers require to
present in detail the various Means of Verification (MOV) that serve as a proof of
the attainment of specific objectives alongside performance indicators, from
outstanding to poor performance, to help both Ratees and Raters in the assessment
process. Among various MOV’s, the Classroom Observation Tool (COT) is the
most important and frequent basis in each KRA in the RPMS that allows the
administrators to assess classroom practices, in as much as to identify the
strengths and areas for improvements of teacher’s teaching strategies based on
professional standards. In addition, COT can be done through face to face
classroom observations that serve as a key component of many schools in teacher-
evaluation systems which aims to provide a positive critical framework for
evaluating one’s practice, improving skills, and developing strengths (Llego,
2020). However, this practice can create stress and test the confidence of the one
being observed. Sawchuk (2014) affirmed that, instead of judging the teachers
solely on their instructional and teaching strategies during classroom
observations, raters tend to give some of them an unfair grade performance due to
personal bias since raters are only human or sometimes based on the students
assigned to teachers.
Hence, through the continuous evolution of technology, an artificial
intelligence (AI) was discovered that refers to the simulation of human
intelligence in machines programmed to think like humans and mimic their
actions associated with such learning and problem-solving (Frankfield, 2022).


Deep learning algorithm is a subset of artificial intelligence which involves
system’s training to recognize and match objects based on learned set of data like
image, video, gender, and documents that supports better decision making
(Goldmeier, 2019). It mines and processes large amounts of data to get insights
and make recommendations for better decision-making. It does this by analyzing
multiple sources of data and identifying patterns, trends and associations to
emulate human decision-making capabilities. (Jan., 2022). Another significant
branch of artificial intelligence is the Natural Processing Language or NLP that
aims to understand and illustrate the cognitive mechanisms generate from human
languages. Through the intelligent analysis of natural human languages, NLP
aims to bridge the gap between computer understanding and natural human
languages (Vadaplli, 2020)
Thus, the researcher aims to develop a mobile-based classroom
observation tool using artificial intelligence that allows to evaluate teacher’s
teaching performance within the classroom set-up resulting into more reliable,
efficient and non-bias classroom observation grade result.
The following presents the ideas relevant to the current subject relating to
the condition of the local issues and other studies that briefly discusses them to
provide the foundation of the proposed system.
Classroom Observation
In the Department of Education, class observation, known as
Teacher Assessment is conducted to all teachers, after which post-


conference will follows. Classroom observation is an important part of
teaching that ensures teachers are providing a satisfactory learning
experience for the student (Ritchie, 2021). During classroom observation,
it is important to observe the interaction between teacher-learner within
the classroom because it can determine the learning opportunities that
students get. It also encourages colleagues to collaborate to improve
teacher practice and student learning (Halim et.al, 2018). According to
Torsh (2019), classroom observation is critical in helping teachers get
feedback on how to develop and mold their classroom management and
instruction techniques but through this feedback, teachers can become
aware of how their classroom functions and bring about changes they want
(Wahid, 2018).
According to Richards (2019), many believe that continuous
classroom observations develop the teaching, provide in-depth
pedagogical discussions between teachers/educators but there is a feeling
of uneasiness where a certain person is critically examining everything
you do in the classroom that affects teaching styles and strategies.
Consequently, James Madison University stated that when classroom
observation is on-going, the observer sits anywhere in the classroom and
records the questions and interrogative statements that a teacher makes.
After a short period of practice, it will be possible for the observer to
record all questions in most discussions. Classroom observers often make
judgments based on an emotional response because of their own


preferences on what good teaching looks like and can project that as they
complete the observation instrument. This might be accurate in terms of
what good teaching practice looks like, but then again, it might not be
(Werner, 2018).
Result-Based Performance Management System
Through DepEd Number 42, s. 2017, Philippine Professional
Standards for Teachers (PPST) has been developed and nationally
validated as part of reform initiatives on teacher quality. PPST set the
standards on what teachers should know, be able to do and value to
achieve competence, improved student learning outcomes and eventually
quality education. It also articulated what constitutes teacher quality
through well-defined domains, strands and indicators that provide
measures of professional accountability.
RPMS Tools are assessment instruments used to ensure quality
teacher performance at different career stages. It describes the duties and
responsibilities of teachers across career stages; the Key Result Areas
(KRAs) for the realization of those duties and the specific objectives to
attain the KRAs. It also presents in detail the various Means of
Verification (MOV) that serve as proof of the attainment of specific
objectives alongside performance indicators, from outstanding to poor
performance, to help both Ratees and Raters in the assessment (Llego,
2019). In addition, RPMS tools pertain to the two different teacher
performance assessment instruments, for Teachers I to III they are


classified as Proficient Teachers, another is for Master Teachers I-IV and
they are classified as Highly Proficient Teachers. Each tool presents the
duties and responsibilities of teachers respectively (Lacayanga, 2019).
Classroom Observation Tool
The Classroom Observation Tool - Results-based Performance
Management System (COT-RPMS) is a subset of the full COT. All tools
in the RPMS package are aligned with the Philippine Professional
Standards for Teachers (PPST). The COT-RPMS captures the quality of
classroom performance and practices of teachers captured through
classroom observation which is a non-negotiable means of
verification (MOV) for some objectives in the Key Result Areas (KRAs)
(Jocson et.al., 2016). In line with this, one of the tools to measure
performance of the teacher and to ensure that they inculcate the standard
competencies of the learner should acquire inside the classroom is
conducting Classroom Observation Tool (COT) for every quarter. The
Principal, Head Teacher and Master Teacher will conduct the COT to their
teacher announce and they have agreement what indicators that they will
going to observe with this the teacher have time for instructional materials
needed, what strategies should be used for effective teaching and
classroom preparations. The teacher will probably get a very satisfactory
or even an outstanding performance because she was very prepared before
the observation. This is so significant for the teacher because they were
given a chance to show the best practices in classroom management and


they were challenged to be more effective and efficient when it comes in
teaching which is the very important role in teaching profession (Tayag,
2018). Thus, COT accurately come up with professional development
programs, targeted at the specific needs of teachers (Barrogo, 2020).
Artificial Intelligence
Schroer (2022) described artificial intelligence (AI) as a wide-
ranging branch of computer science concerned with building smart
machines capable of performing tasks that typically require human
intelligence. While AI is an interdisciplinary science with multiple
approaches, advancements in machine learning and deep learning, in
particular, are creating a paradigm shift in virtually every sector of the
tech industry. In addition, software systems that uses AI make decisions
which normally require human level of expertise and help people
anticipate problems or deal with issues as they come up. As such, they
operate in an intentional, intelligent, and adaptive manner (West et.al.,
2018). In connection to this, the rapid development of artificial
intelligence (AI) technology integrates with the concept of smart
education has been constantly improved and gradually penetrated into all
aspects of education application. Considering the dominant position of
classroom teaching in elementary and undergraduate education, the
introduction of AI technology into in-class teaching evaluation has
become a research hotspot (Guo et.al., 2021). Artificial Intelligence
consists of many sets whose common goal is to decide based on data and

provide output. machine learning, deep learning, Natural language
processing and virtual assistants (Pedemkar, 2021).
Deep Learning Algorithm
Deep Learning is a subset of Machine Learning, and Machine
Learning is a subset of AI, which is an umbrella term for any computer
program that accomplishes something smart Furthermore, deep Learning
brings into service the alleged neural systems, which learn from
processing the labeled information provided during training. It starts with
data such numbers, photos, or text, like bank transactions, pictures of
people or even bakery items, repair records, time series data from sensors,
or sales reports. The data is gathered and prepared to be used as training
data, or the information the machine learning model will be trained on.
The more data, the better the program. From there, programmers choose a
machine learning model to use, supply the data, and let the computer
model train itself to find patterns or make predictions (Thapa, 2022).
According to Brownlee (2019), deep learning allows computational
models that are composed of multiple processing layers to learn
representations of data with multiple levels of abstraction such as deep
neural network models. It was originally inspired by neurobiology
wherein a biological neuron receives multiple signals through the synapses
contacting its dendrites and sends a single stream of action potentials out
through its axon. The complexity of multiple inputs is reduced by
categorizing its input patterns. Inspired by this intuition, artificial neural


network models are composed of units that combine multiple inputs and
produce a single output (Boesch, 2022).
Natural Language Processing
Natural Language Processing (NLP) is a subfield of artificial
intelligence. It helps machines process and understand the human
language so that they can automatically perform repetitive tasks
(Gruetzemacher, 2022). NLP is trained with machine learning that takes
large amounts of data into an algorithm and trains itself to produce
accurate predictions. The more data and time the algorithm has, the better
it gets. This is why NLP machines are so much better today than they were
ten years ago (Harfield, 2021). Correspondingly, to be able to understand
such complex and diversified data, NLP uses two processing states. The
first state is called the data pre-processing state where the AI algorithms
help machines to understand the natural language by transforming the data
(speech/text) into the machine-interpretable mode. The second state is
Building the NLP Algorithms, which involves the training of the
algorithms on the data so it can analyze and interpret the language, as well
as, perform specific tasks (Imran, 2021). NLP techniques rely on Deep
Learning and algorithms to interpret and understand human languages and,
in some cases, predict a human’s intention and purpose.
Classroom Teaching Analysis Using Natural Language Processing
and Computer Vision


Sun, Yu, & Zu, 2022, conducted a study on how artificial
intelligence works in classroom teaching analysis wherein teaching events
can be extracted and identified from the lesson plan and classroom
teaching videos of each teaching case. Lesson plans are mainly composed
of texts. Therefore, the use of natural language processing (NLP) and
computer vision (CV) technologies to analyze texts and videos and
identify teaching events has become the key approach in this stage.
Compared with the common method of relying on manual classroom
observation, the use of CV/NLP technology has significant advantages in
time and resource savings but fails to recognize the deep meaning of the
word, accurately locate the changing expressions of the same type of
activities or events, and find the meaningful sequence in the teaching
structure.
The first stage involves the collection of videos of each lesson and
the random selection of static images. The researchers classify part of the
scene data, and these labelled data are used as the training set to train the
neural network model of scene classification. Then, computer vision
technology is applied to detect the key scenes and cut the video into pieces
for possible teaching events recognition. Second, NLP technology is
applied to select teaching events using key words of every event. The
researchers divide the teaching events into labels and mark texts to form
corresponding judgment rules. Then, deep learning model Word2vec is
used to generate an event classifier on the basis of the gate recurrent unit

(GRU) to judge the accuracy of the model. Furthermore, the specific
teaching event was recognized through NLP technology, and the time
distribution map of teaching events for a lesson could be generated
visually
Convolutional Neural Network
A local study entitled “Convolutional Neural Network for
Automatic Speech Recognition of Filipino Language” by Hernandez et.al.
(2020), highlights the advantages of Convolutional Neural Networks
(CNN) in using for character recognition. It is affirmed that, CNN's ability
to identify features rather than individual pixels makes it suitable for
image recognition and classification tasks, such as character recognition.
Despite being primarily designed for image recognition and classification,
CNNs have achieved high accuracy rates in the classification of the
MNIST dataset. Compared to multilayer perceptrons, CNNs require fewer
neurons, resulting in lower computational requirements during training.
Another local study with the title “Baybáyin Character Recognition
Using Convolutional Neural Network” by Nogra et.al. (2020) of Cebu
Institute of Technology, found out that within their 7000 hand-drawn
Baybáyin characters used for training and tested, nine CNN models to
determine the best one for this type of classification. The results indicated
that the best model was composed of three convolutional layers with 32,
64, and 128 channels, respectively, using 3x3 filters. The final model also
had three max pooling layers, with a 2x2 size right after each

convolutional layer, and two fully connected layers at the end. The model
produced an accuracy rate of 94% using the validation data. The other
eight CNN models also performed well, with accuracy rates ranging from
57% to 92%.
Moreover, international studies supported the validity and
effectiveness of CNN in various deep learning systems. As stated by Saha
(2018), Convolutional Neural Network (ConvNet/CNN) is a deep learning
algorithm that can take in an input image, assign learnable weights and
biases to various objects in the image and be able to differentiate one from
the other. ConvNet also required the pre-processing but it is much lower
compared to other classification algorithms. As a further matter,
Convolutional Neural network is composed of multiple building blocks,
such as convolution layers, pooling layers, and fully connected layers, and
is designed to automatically and adaptively learn spatial hierarchies of
features through a backpropagation algorithm (Nishio et al., 2018).
Basically, Convolutional Neural Network (CNN) handles a greater
amount of complexity around pre-processing, and computation of data.
CNNs were designed for image data and might be the most efficient and
flexible model for image classification problems. Gupta (2019) affirmed
that although CNNs were not particularly built to work with non-image
data, they can achieve stunning results with non-image data as well.
Reddy (2017) claimed that, CNN achieved 96.2% accuracy in the face
recognition process when 400 images of 40 individuals with classification


time is less than 0.5 second, but the training time is as long as 4 hours
features in a hierarchical set of layers.
Thus, based on the research studies made, the researcher found out
that CNN is more powerful than other deep learning methods since it has a
processing cells considered as shunting inhibitory neurons that have been
used in conventional feed forward architecture for classification and non-
linear regression and were shown to be more. In conformity with deep
learning algorithm as artificial intelligence, it is like a human brain
working for all the processes of data and creation of patterns use for
decision making (Kaur, 2020).
Statement of the problem
The study aims to design, develop and evaluate a mobile-based classroom
observation using CNN for Senior High School Teachers based on artificial
intelligence.
Specifically, it aimed to describe the following:
1. How may the proposed Mobile-Based Classroom Observation Tool
Using Convolutional Neural Network be developed using Agile Model
Phases in terms of:
1.1 defining requirements;
1.2 system design;
1.3 development;
1.4 quality assurance;


1.5 user acceptance testing; and
1.6 releasing?
Using Convolutional Neural Network be evaluated by IT Experts of
Sto. Domingo National Trade School based on the following ISO/IEC
25010 criteria:
2.1 functional suitability;
2.2 performance efficiency;
2.3 compatibility;
2.4 usability;
2.5 reliability;
2.6 security;
2.7 maintainability; and
2.8 portability?
Using Convolutional Neural Network be evaluated by the Users based
on selected ISO/IEC 25010 criteria:
3.1 functional suitability;
3.2 performance efficiency; and
3.3 usability?
4. How may the level of effectiveness of the developed system upon
implementation be described?
Conceptual Framework

This study focused on the development of classroom observation tool
using artificial intelligence that follows the Agile Software Development
model.
Figure 1 shows the Agile model used for the development of the Mobile-
Based Classroom Observation Tool Using Convolutional Neural Network
(MBCOTUCNN).
(Implementation and Evaluation)
5.
Figure 1
Agile Model
The project was conceptualized through the use of Agile model based on
System Development Life Cycle that consists of six (6) different phases that was
used to design, develop, and test the quality of the system.
Defining Requirement is the basic fundamental phase in Agile Model. All
necessary information gathered gives a clear picture of the entire project and helps
to conduct a product feasibility study to anticipate possible issues that may occur
in terms of economical, operational and technical areas. Design phase clearly


defines the over-all architectural design of the system that serves as an input for
the next phase of the model which is the Development phase that follows the
design structure of the system by means of creation of database and actual coding
to complete the system based on the given specification. Testing activities will be
conducted still under the Development phase to check for bugs and errors and to
guarantee the quality of the software resulting to Quality Assurance phase. User
Acceptance Testing is almost the final phase of this model wherein the actual
users test the system to see if all the required specifications is being carried out by
the system and then Releasing phase will follows for the final output of the
system.
Figure 2 shows the paradigm process that will help the researcher in
designing and developing the proposed system.
Implementa
tion
-Level of
Effectiveness
0

Figure 2
Research Paradigm
The Agile software development model is an iterative development intended
for building a project that can adapt to change requests quickly. Each incremental
part is developed over iteration for a full software development life cycle
including planning, requirements, analysis, design, coding and testing before a
working product will be released (Tutorials Point, 2020).
Significance of the study
The following are the people who will benefit from the proposed system:
School Administrators. The administrators, department heads, and
subject group heads will be more productive on their other duties and
responsibilities since MBCOTUCNN will lessen their task specifically classroom
observation that takes much of their time to finish observing all of the teachers.
Teachers. Teacher will be able to be himself and boost his confidence in
executing his lesson for the day without intimidation. The system will also be able
to avoid human bias in grading teacher’s performance during classroom
observation since the system itself will decide on what particular grades must be
given to a teacher based on trained data sets during deep learning process.
IT Experts. This study will enable IT experts to stay updated with the
latest advancements, explore new career opportunities, contribute to business
applications, address ethical considerations, and enhance strategic decision-


making capabilities. It equips IT experts with the skills and knowledge needed to
thrive in the era of AI-powered technologies and shape the future of IT.
Future Researchers. Acquiring knowledge and expertise about AI, which
researchers may gain from this study, will help them stay at the forefront of
research and innovation as it becomes increasingly important.
Scope and limitation
This study was limited to the development and evaluation of Mobile-
Based Classroom Observation Tool Using Convolutional Neural Network
(MBCOTUCNN) specifically for senior high school teacher of Sto. Domingo
National Trade School. The system followed the Agile Software Development
Life Cycle (SDLC) model.
The respondents of this study were the one (1) vocational school
administrator, one (1) assistant school principal, four (4) department heads, nine
(9) subject group heads and five (5) selected IT professionals (ICT Coordinators,
LIS Coordinators, and ICT Teachers of SDNTS) of Sto. Domingo National Trade
School.
The server part requires a desktop computer with Windows operating
system, Core i5 7th generation processor, 8gb RAM, 1tb hard disk and at least 6gb
NVIDIA GEFORCE video card. A Wi-Fi router is also required that will serve as
a gateway for sending demo teaching video (input) to the server and sending back
the class observation result (output) to the user.


The mobile monitoring is another part of the system that requires smart
phone preferably with Android, iOs, and Harmony operating system. It must also
have an updated web browser for users to access the developed application and a
camera with at least 24mp to capture teacher’s demo teaching vividly for more
reliable result. Then system can evaluate teacher’s teaching performance locally
even without internet connection but useless without LAN or WLAN connection.
This research has the following delimitations such wherein the reliability
of the classroom observation grade result (output) of the system depends on the
quality of speech and video (input) sent by the user. Camera specification,
ambiance lighting condition, and proper position of device while taking video is
exclusively required. The server and the mobile part can only run together if
Wireless Fidelity is on, otherwise, monitoring will not be executed.
Research Design
The researcher used a developmental method of research. Development
research is the systematic study of designing, developing, and evaluating
instructional programs, processes, and products that must meet criteria of internal
consistency and effectiveness (Majewski, 2019).
The study has two phases: development and evaluation of the
MBCOTUCNN. The Agile Model which is based on System Development Life
Cycle (SDLC) was used as a developmental research design of the
MBCOTUCNN. Evaluation was made by the IT experts, school administrator,
and classroom observers.


Research Locale
The study was conducted in Sto. Domingo National Trade School located
at Baloc, Sto. Domingo, Nueva Ecija, Philippines. It is an autonomous secondary
public school composing of 1100 students and 32 teachers from senior high
school and considered as one of the notable vocational schools in Nueva Ecija
excelling in both academic and vocational track.
Figure 3 shows the map site development plan of Sto. Domingo National
Trade School.
Figure 3
SDNTS Map Site Development Plan
Population and Sampling
The respondents of this study will compose of one (1) vocational school
administrator, one (1) assistant school principal, four (4) department heads, nine
(9) subject group heads and five (5) selected IT professionals (ICT Coordinators,

LIS Coordinators, and ICT Teachers of SDNTS) of Sto. Domingo National Trade
School.
Table 1 shows the distribution of the respondents.
Table 1
Distribution of Respondents
Respondents Number of Respondents
IT Experts 5
Vocational School Administrator 1
Assistant School Principal 1
Department Heads 4
Subject-Group Heads 9
TOTAL 20
Their role in the study is to evaluate the quality of the system based on the
ISO/IEC 25010 Software Quality Criteria. The IT practitioners will be selected
through purposive sampling on the bases of their academic preparation and length
of professional experience in the field. Holders of bachelor’s degree with IT
related course and having continued Professional Education subjects with a
minimum of two (2) years in the practice of his/her profession serve as the bases

in the selection. Their expertise added validity to the assessment of the different
functionalities of the system.
End – users are the school administrators, assistant school principal,
department heads, and subject-group heads of SDNTS. It is essential that
feedback from members of this group be gathered because they will be using and
maintaining the system especially after the turnover.
Research Instrument
The researcher will use two sets of questionnaire based on the ISO/IEC
Software Quality criteria to evaluate the proposed mobile-based classroom
observation tool using convolutional neural network.
A questionnaire is an instrument to be utilized in gathering data for
evaluating the MBCOTUCNN. The first questionnaire is for IT experts composed
of thirty items (30) for the criteria of functionality, suitability, performance
efficiency, compatibility, usability, reliability, security, maintainability and
portability. The second questionnaire is for users composed of twelve (12) items
covering the criteria of functionality suitability, performance efficiency, and
usability.
The items in the instruments were lifted from the standard ISO/IEC 25010
developed by International Organization for Standardization (ISO) and
International Electro-Technical Commission (IEC) was used as shown in Figure
4.
Figure 4
ISO/IEC 25010 Quality Standards
The ISO/IEC Quality Standards served as a basis for the software product
quality of the developed system.
An additional instrument will utilize to assess the level of effectiveness of
the implementation of the developed system. The instrument serves as a basis in
describing the effectiveness of the system upon implementation and it has ten (10)
statements that will use in certain condition. The process of evaluation will
administer through online using Google Forms by the researcher to the chosen
respondents.
It is presented in Table 2 the scoring guide for Functional Suitability. This
characteristic represents the degree to which the MBCOTUCNN met stated and
implied needs. The IT experts and End–users used this criterion to assess the
system.
Table 2
Response Mode for Functional Suitability
Verbal Descriptors
Response
Interpretation
4 Very Functional The MBCOTUCNN was highly satisfactory
and had met stated and implied needs and no


weakness were found.
The MBCOTUCNN had satisfactorily met
3 Functional the stated and implied needs and tolerable
weaknesses were found.
The MBCOTUCNN had met some stated
2 Needs Improvement and implied needs with minor weaknesses
found that slightly affected its function.
The MBCOTUCNN had met few stated and
1 Poor implied needs with major weaknesses found
that greatly affected its function.
Table 3 presents the scoring guide for Performance Efficiency. This
criterion presents the performance of the MBCOTUCNN relative to its resources.
The IT experts and End–users used this criterion to assess the system.
Table 3
Response Mode for Performance Efficiency
Response Verbal Interpretation Descriptors
The MBCOTUCNN showed highly
satisfactory performance relative to the

4 Very Efficient
amount of resources used and no
3 Efficient The MBCOTUCNN showed satisfactory

performance relative to the amount of
resources used and tolerable weaknesses
were found.
The MBCOTUCNN showed below
satisfactory performance relative to the
2 Needs Improvement amount of resources used and minor
weaknesses were found that slightly
affected its efficiency.
The MBCOTUCNN showed poor
performance relative to the amount of
1 Poor resources used and major weaknesses
were found that greatly affects its
efficiency
Table 4 depicts the scoring guide for Compatibility. This characteristic
represents the degree to which the MBCOTUCNN exchanges information with
other components in performing its function. The IT experts assessed the system
based on this criterion.
Table 4
Response Mode for Compatibility
4 Very Compatible The MBCOTUCNN could perform


highly satisfactory exchange of
information with other products, systems
or components, and/or performed its
required function and no weakness were
found.
The MBCOTUCNN could perform
satisfactory exchange of information with
3 Compatible other products, systems or components,
and/or performed its required function
and tolerable weaknesses were found.
The MBCOTUCNN could perform some
exchange of information with other
products, systems or components, and/or

2 Needs Improvement
performed its required function and
minor weaknesses were found that had
slightly affected its compatibility.
The MBCOTUCNN could perform only
few exchange of information with other
products, systems or components, and/or

1 Poor
performed its required function and
major weaknesses were found that had
greatly affected its compatibility.


Table 5 presents the scoring guide for Usability. The IT experts and End –
users assessed the system based on this criterion. Usability refers to the degree to
which the MBCOTUCNN can be used by specified users.
Table 5
Response Mode for Usability
The MBCOTUCNN could be used by
specified users to achieve specified goals

4 Very Usable
with high satisfaction and no weaknesses
were found.
specified users to achieve specified goals

3 Usable
with satisfaction and tolerable
specified users to achieve some specified

2 Needs Improvement
goals but minor weaknesses were found
that had slightly affected its usability.
1 Poor The MBCOTUCNN could be used by
specified users to achieve few specified
goals and major weaknesses were found

that had greatly affected its usability.
Table 6 presents the scoring guide for Reliability. Reliability presents the
degree to which the MBCOTUCNN performs its function under a specified
period of time. The IT experts assessed the system based on this criterion.
Table 6
Response Mode for Reliability
satisfactory performance of
4 Very Reliable functionalities under specified conditions
and period of time and no weaknesses
were found
The MBCOTUCNN showed satisfactory
performance of functionalities under

3 Reliable
specified conditions and period of time
satisfactory performance of
2 Needs Improvement functionalities under specified conditions
and period of time and minor weaknesses
found that slightly affected its reliability.

performance of functionalities under
1 Poor specified conditions and period of time
and major weaknesses were found that
greatly affected its reliability.
From Table 7, it shows the scoring guide for Security. This characteristic
presents the degree to which the MBCOTUCNN protects information. The IT
experts assessed the system based on this criterion.
Table 7
Response Mode for Security
satisfactory for protection of information
4 Very Secure and data and provided appropriate degree
of data access and no weaknesses were
found.
protection of information and data and

3 Secure
provided appropriate degree of data access
but tolerable weaknesses were found.
2 Needs Improvement The MBCOTUCNN showed below

satisfactory for protection of information
and data and provided appropriate degree
of data access with minor weaknesses
found that slightly affected its security.
protection of information and data and
1 Poor provided appropriate degree of data access
with major weaknesses found that greatly
affected its security.
It can be observed from Table 8 the scoring guide for Maintainability.
This criterion refers to the degree to which the MBCOTUCNN can be modified,
corrected, or adapted to changes in environment and requirements. The IT experts
assessed the system based on this criterion.
Table 8
Response Mode for Maintainability
satisfactory option of modification to
4 Very Maintainable improve, correct, adapt to changes in
environment and no weaknesses were
found.
option of modification to improve,

3 Maintainable
correct, adapt to changes in environment
satisfactory option of modification to
improve, correct, adapt to changes in

2 Needs Improvement
environment and minor weaknesses were
found that slightly affected its
maintainability.
The MBCOTUCNN showed poor option
of modification to improve, correct, adapt
1 Poor to changes in environment and major
weaknesses were found that greatly
affected its maintainability.
As shown, Table 9 presents the scoring guide for Portability. Portability
refers to the degree to which the MBCOTUCNN can be transferred from one
component to another. The IT experts assessed the system based on this criterion.
Table 9
Response Mode for Portability


satisfactory option to transfer from one
4 Very Portable hardware, software, or other operational or
usage environment to another and no
option to transfer from one hardware,
3 Portable software, or other operational or usage
environment to another and tolerable
satisfactory option to transfer from one
hardware, software, or other operational or

2 Needs Improvement
usage environment to another and minor
weaknesses were found that slightly
affected its portability.
The MBCOTUCNN showed poor option
to transfer from one hardware, software, or
1 Poor other operational or usage environment to
another and major weaknesses were found
that greatly affected its portability.


An additional instrument was used to describe the level of
effectiveness of the system at the time it was initially implemented.
Table 10 shows the scoring guide to assess the level of effectiveness of the
system. The IT experts and End – users evaluated the system based on this
criterion.
Table 10
Response Mode for the Level of Effectiveness of the
MBCOTUCNN
The M MBCOTUCNN’s implementation
was very satisfactorily done. The system

4 Highly Effective
outstandingly met all the stated criteria
and no weaknesses are found.
The MBCOTUCNN’s implementation
was satisfactorily done. The system
satisfactorily met all the stated criteria

3 Effective
and acceptable weaknesses are found
which will however not affect its
function.
2 Less Effective The MBCOTUCNN’s implementation
was fairly done. The system met only
some of the stated criteria and minor

weaknesses are found that will slightly
affect its function. It somehow needs
improvement.
The MBCOTUCNN’s implementation
was poorly done. The system met only
very few stated criteria and major

1 Not Effective
weaknesses are found that will greatly
affect its function. The system is poor
and ineffective.
Data Processing Methods
The data gathering procedure will divide into four main phases, namely:
(1) preparation of request letter for permission to conduct the study, (2)
administration and (3) retrieval of instrument; and (4) organization and analysis of
data.
The request letter will be sent to the office of the Vocational School
Administrator of SDNTS requesting their cooperation in the data gathering
procedure of IT experts, school administrators, and classroom observers.
The researcher will utilize an online survey platform thru Google Form
based on the ISO/IEC 25010 to measure the user’s acceptability of the system.
The survey forms and system presentation were sent to the respondents and were
then gathered the following day.


Amidst the testing stage, the researcher will also conduct an interview to
describe the respondents’ experience in using the website and device. Comments
and suggestions from the respondents will be taken into consideration for the
improvement of the system.
During the testing phase, the researcher will consolidate all the comments
and suggestions from the respondents to describe their experience in using the
system. All comments and suggestions will take into consideration for the
improvement of the system.
The MBCOTUCNN will submit to the School Administrator Office for
the implementation stage. After ten (10) days or so of implementation, another
instrument will be used to identify the level of effectiveness of the developed
system. School heads, department heads including subject-group heads are the
respondents of the study.
The data gathered will be analyzed using the appropriate technique and
statistical tools to give substantial descriptive interpretation of the results and
findings of the study.
1. The development phase of the device will be described according to
the six (6) phases of the AGILE model namely: define requirements,
system design, development, quality assurance, user acceptance
testing, and releasing.
2. Weighted mean and percentage will be used to analyze the data
gathered as to how the system was evaluated by the IT experts and


end-users based on the ISO/IEC 25010 criteria on functional
suitability, performance efficiency, compatibility, usability, reliability,
security, maintainability, and portability as well as in describing the
level of effectiveness of the system upon implementation. The
weighted mean from each statement in the questionnaire was
determined using the four-point Likert scale.
Table 11 presents the level of responses for each criterion for ISO/IEC
25010.
Table 11
Scoring Guide for MBCOTUCNN’s Software Quality
Range Verbal Interpretation
3.5-4.00 Very Functional/ Very Efficient/ Very Compatible/
Very Usable/ Very Reliable/ Very Secured/ Very
Maintainable/ Very Portable
2.50-3.49 Functional/ Efficient/ Compatible/ Usable/
Reliable/ Secured/ Maintainable/ Portable
1.5-2.49 Needs Improvement
1.00-1.49 Poor
Table 12 presents the response option to determine the level of effectiveness
of the developed system at the time it was initially used or implemented.
Table 12

Scoring Guide for MBCOTUCNN’s Level of Effectiveness
Range Verbal Interpretation
3.5-4.00 Highly Effective
2.50-3.49 Effective
1.5-2.49 Less Effective
1.00-1.49 Not Effective
References
Brown, S.(2021). Machine learning, explained. Retrieved from

https://mitsloan.mit.edu/ideas-made-to-matter/machine-learning-explained
Brownlee , J.(2019). What is Deep Learning?. Retrieved from https://machinelearning

mastery.com/what-is-deep-learning/
Duncan, R. (2021). The Importance of Classroom Observation. Retrieved from

https://www . codimg.com/education/blog/en/classroom-observation
Gruetzemacher, R.(2022). The Power of Natural Language Processing. Retrieved from

https://hbr.org/2022/04/the-power-of-natural-language-processing
Guo, J., Bai, L., Yu, Z., Zhao, Z., Wan, B.(2021). An AI-Application-Oriented In-Class
Teaching Evaluation Model by Using Statistical Modeling and Ensemble
Learning. Retrieved from https://pubmed.ncbi.nlm.nih.gov/33401482/
Gupta, R.(2019). 6 Deep Learning models — When should you use them?. Retrieved
from https://towardsdatascience.com/6-deep-learning-models-10d20afec175
Halim, S., Abdul Wahid R., Halim T. (2018). Classroom Observation – A Powerful
Tool for Continuous Professional Develoopment (CPD). Retrieved from
http://jurnal.uinsu.ac .id/ index.php/ijlres/article/view/1479/

Harfield, J.(2021). What Is Natural Language Processing and How Does It Work?.
Retrieved from https://www.makeuseof.com/what-is-natural-language-
processing-and-how-does-it-work/
Imran, M.(2021). How Does Natural Language Processing Work for Startups, SMEs and
Enterprises. Retrieved from https://www.folio3.ai/blog/how-does-natural-
language-processing-work/
Jocson, J., Lampos, I., Pegg, J., McPhan, G., Gonong, G.(2016).
A Report on the Drafting and Validation of Classroom Observation Tool – RPMS.
Retrieved from https://rune.une.edu.au/web/handle/1959.11/52021
Khurana, D., Koli, A., Khatter, K., Singh , S.(2022). Natural Language Processing: state
of the art, current trends and challenges. Retrieved from
https://link.springer .com/ article /10.100 7/s11042-022-13428-4
Lacayanga, R.(2019). Problems Encountered Among Teachers on RPMS: Inputs for

Teachers Enhancement Program. Retrieved from
https://www.teacherph.com/action-research-rpms-teachers-enhancement-program/
Llegeo M.A.(2017). RPMS Tools for Teachers and Master Teachers. Retrieved from
https://www.teacherph.com/rpms-tools/
Madison J. (2019). University Observation Strategies* At Task. Retrieved from

https://www. jmu.edu/coe/esc/_files/ST-Performance-Guide.pdf
Pedamkar, P.(2019). Subsets of Artificial Intelligence. Retrieved from

https://www.educba. com/subsets-of-artificial-intelligence/
Richards J. (2019). Classroom Observation in Teaching Practice. Retrieved from

https://www.professorjackrichards.com/wp-content/uploads/Practice-Teaching-A-
Reflective-Approach-Chap-7-Classroom-Observation-in-Teaching-Practice.pdf
Schroer A.(2022). What Is Artificial Intelligence. Retrieved from

https://builtin.com/artificial-intelligence
Tayag, P.(2018). COT (Classroom Observation Tool): Significance for Teachers.

Retrieved from https://www.pressreader.com/philippines/sunstar
pampanga/20181116 /281 586 65162994
Thapa, S.(2022). What is AI? | Artificial Intelligence and Its Subsets. Retrieved from
https://insights.squadery.com/what-is-ai-artificial-intelligence-and-its-subsets/
Torsh, T. (2019). A Comprehensive Guide to Effective Classroom Observation.

Retrieved from A Comprehensive Guide to Classroom Observation - Torsh

Werner, S. (2018). Citation:The Inherent Challenges. Retrieved from
https://chemonics .com/blog/problem-teacher-observation
West, D., Allen, J. (2018). How Artificial Intelligence is Transforming the World.
Retrieved from https://www.brookings.edu/research/how-artificial-intelligence-is-
transforming-the-world/
Zhong S., Zi Chun Y., Fei Yun X. (2022). Analysis and Improvement of Classroom
Teaching Based on Artificial Intelligence. Retrieved from
https://link.springer .com/chapter/ 10.1007/978-3-031-09687-7_

Cabrillas Mariel Dit Concept Paper

Uploaded by

Document Information

Original Description:

Original Title

Copyright

Available Formats

Share this document

Share or Embed Document

Sharing Options

Did you find this document useful?

Is this content inappropriate?

Copyright:

Available Formats

Cabrillas Mariel Dit Concept Paper

Uploaded by

Copyright:

Available Formats

LA CONSOLACION UNIVERSITY PHILIPPINES

Bulihan, City of Malolos, Bulacan 3000

GRADUATE STUDIES DEPARTMENT

DEVELOPMENT AND VALIDATION OF A MOBILE-BASED CLASSROOM

OBSERVATION TOOL USING CONVOLUTIONAL NEURAL NETWORK

A Concept Paper Submitted as Requirement for Research Methods 1 and 2

GRADUATE STUDIES DEPARTMENT

In partial fulfillment of the requirements for the Research Methods 1 and 2

List of Suggested Advisers

GRADUATE STUDIES DEPARTMENT

The Department of Education’s mission is to protect and promote the right

of every Filipino to quality, equitable, culture-based, and complete basic

skills to achieve their potentiality as human beings and members of society

are the most influential factor in students’ learning process.

An online article from Safety Culture entitled “Teacher Evaluation

Methods for Effective Quality Teaching” it emphasizes that teacher evaluation as

a standardized process that involves rating and assessing the teaching

effectiveness of educators. The primary objective of teacher performance

evaluations is to promote a better learning experience for students and facilitate

professional growth for educators. By evaluating teachers' performance,

institutions can identify areas of strength and areas in need of improvement,

which can inform professional development opportunities and support better

teaching practices. Teacher evaluations can also be used to inform decisions

related to promotion, retention, and compensation. Ultimately, teacher evaluations

aim to improve teaching quality and contribute to the overall success of

educational institutions (https://safetyculture.com/topics/teacher-evaluation).

Background of the study/Rationale

According to DepEd, one of the tools being used to evaluate teacher’s

performance is the Results-Based Performance Management System or also

GRADUATE STUDIES DEPARTMENT

the attainment of specific objectives alongside performance indicators, from

administrators to assess classroom practices, in as much as to identify the

strengths and areas for improvements of teacher’s teaching strategies based on

professional standards. In addition, COT can be done through face to face

classroom observations that serve as a key component of many schools in teacher-

evaluation systems which aims to provide a positive critical framework for

evaluating one’s practice, improving skills, and developing strengths (Llego,

solely on their instructional and teaching strategies during classroom

Hence, through the continuous evolution of technology, an artificial

intelligence (AI) was discovered that refers to the simulation of human

intelligence in machines programmed to think like humans and mimic their

actions associated with such learning and problem-solving (Frankfield, 2022).

GRADUATE STUDIES DEPARTMENT

and make recommendations for better decision-making. It does this by analyzing

multiple sources of data and identifying patterns, trends and associations to

emulate human decision-making capabilities. (Jan., 2022). Another significant

branch of artificial intelligence is the Natural Processing Language or NLP that

languages. Through the intelligent analysis of natural human languages, NLP

languages (Vadaplli, 2020)

Thus, the researcher aims to develop a mobile-based classroom

observation tool using artificial intelligence that allows to evaluate teacher’s

efficient and non-bias classroom observation grade result.

provide the foundation of the proposed system.

In the Department of Education, class observation, known as

Teacher Assessment is conducted to all teachers, after which post-

GRADUATE STUDIES DEPARTMENT

teaching that ensures teachers are providing a satisfactory learning

experience for the student (Ritchie, 2021). During classroom observation,

it is important to observe the interaction between teacher-learner within

the classroom because it can determine the learning opportunities that

students get. It also encourages colleagues to collaborate to improve

teacher practice and student learning (Halim et.al, 2018). According to