Professional Documents
Culture Documents
Usability Testing and Evaluation of A Cloud Computing-Based Mobile Learning App: Students' Perspective
Usability Testing and Evaluation of A Cloud Computing-Based Mobile Learning App: Students' Perspective
net/publication/306098370
CITATIONS READS
6 659
2 authors:
Some of the authors of this publication are also working on these related projects:
Assessing the impact of an intervention to improve the quality of Emergency Obstetric Care on Maternal and Perinatal Outcomes (EOBC) in Nigeria View project
All content following this page was uploaded by David Emmanuel Aniobi on 14 August 2016.
SaaS is used to provide software and application Usability refers to the quality of a user's experience
services to users as they need to access. Today, most of when interacting with products or systems, including
what we use the web on a day-to-day basis aren’t just websites, software, devices, or applications. Usability is
web pages they are applications. In this model software about effectiveness, efficiency and the overall
applications are no longer monolithic. Applications and satisfaction of the user. Usability is not a single, one-
processing of applications are segregated into distributed dimensional property of a product, system, or user
application logic and user interaction logic. Application interface. It is a combination of factors including:
logic and the user data reside on network cloud but
interaction logic is delivered to users in the form of web Intuitive design/Aesthetic: a nearly effortless
pages; users can view and interact with application by understanding of the architecture and
using web browsers [7]. Figure 1 portray the relation of navigation of the site
MAFHIL with cloud computing. Ease of learning: how fast a user who has never
seen the user interface before can accomplish
This concept gives the user the opportunity to only use basic tasks
an internet enabled thin-client connected to cloud (where Efficiency of use: How fast an experienced user
all processing power has been transferred to) to access can accomplish tasks
the app. The major advantage of these online Memorability: after visiting the site, if a user
applications is a decrease in the need for flash drives or can remember enough to use it effectively in
the extra space for storing the documents and files on future visits
desktop Error frequency and severity: how often users
make errors while using the system, how
serious the errors are, and how users recover
from the errors
question will appear and the time before they could download a material
timer starts counting irrespective of the byte size of material, some could
3. Provide appropriate answer for not download materials, while some other
each question, if it is multiple participants downloaded successfully and all these
choice question then you are to were attributed to internet connectivity problem.
select the correct option; if
essay-type question then you are
From the result of the experiment, it was discovered
expected to type-in the correct
that:
answers.
4. After answering then press the By using MAFHIL, students can collaborate
“Submit” button to submit the with one another to share data and ideas as they
test study a course or work on a project.
5. In multiple choice question, test
The interface of the login page is very simple as
if after submitting the test is
it provides direct and clear instruction on how
graded automatically and the
to login.
score is displayed.
By using the app students can have access to
6. Repeat the step 1 again and you
up-to-date course materials and can as well
will be prompted with the
download them.
message “You have already
taken this test” With this application, there is no need for paper
7. Click on “Dashboard” to return and pencil style of conducting assessment as it
to the Student’s dashboard provides the platform for e-testing.
Most students will no longer miss test in any
Task 1. Click on “Read All” to view all course as the system is used to send prompt
6 messages in the student’s inbox information/alert to students on upcoming
(internal mails) assessment.
2. Click on “Compose” to send a The major defect of the app as observed was in the area
message to a fellow student or of course material download as not all participants were
Lecturer able to easily download course materials. It was also
3. Click on “Sent” to view all Sent discovered that the app has no provision for participants
messages to open or preview content of any course material before
4. Open a message in the inbox to downloading it, which is a major requirement that has to
read and after reading click on be incorporated into the app. Screen shots of MAFHIL
“mark as unread” to return the can be found in Appendix A.
status of the message as unread
5. When a message is open then 3.4 Questionnaire for Usability Evaluation
Click on “Delete” to remove
message from inbox Questionnaire is a well known tool used to collect
6. Click on “Dashboard” to return demographic data and users’ opinions. It consists of a
to the Student’s dashboard sequence of questions which are structured together in a
Task 1. click on “Update profile” to coherent manner so that they would be simple, clear and
7 update a student’s profile(here easy to understand. The questions to measure the user’s
you can change student’s detail) satisfaction can be quite sophisticated. The questions in
2. click on the “Update” to save all the questionnaire were carefully designed so that they
changes made in the database give the clear meaning for which they are asked.
3. Click on “Dashboard” to return
[12]said that questionnaire is used due to the following
to the Student’s dashboard
reasons: cost effectiveness; evaluator analyzes the
Task 8 1. click on “Sign-out” to exit from usability issues by user’s points of view and the last one
the application is to make a reliable comparison on the basis of data
gathered from questionnaire. It is designed to check the
reliability, interactivity and usability aspect. For the
evaluation of any system, the questionnaire is a very
3.3 Result of Experiment and Analysis important tool that can be used to get data from users, it
has been in use since 1990 as the cheapest tool for
The results obtained from the experiment are as follows: usability evaluation [9][13].
all the students participating completed the tasks The questionnaire for the evaluation was carefully
given them as specified in the task schedule. designed to elicit usability information from
time taken to complete all tasks varied amongst participants. It was distributed to the participants after
participants in the range of 40 - 70 minutes. the experiments. The questionnaire was designed to
some participants had problems downloading collect the users’ understanding and experiences with
course materials. In some instance, it took longer MAFHIL. Twenty (20) students from the university of
Table 2: Feedback from students Questionnaire
A B C D E
20
5. Conclusion and Discussion
10
This work analyzed the usability of the cloud-based
0 mobile app (MAFHIL) and the Students’ attitude and
1 2 3 4 5 6 7 8 9 10 11 12 requirements towards the app. MAFHIL gives the
(Criteria) students’ the opportunity to explore the prowess of the
cloud computing technology. Students from the
University of Agriculture, Makurdi were selected for the
Strongly Agreed Agreed usability testing and evaluation. None of the students’
Undecided Disagreed had a previous experience in using MAFHIL.
students.
Level3 9.5
APPENDIX A
Level2 31.1
Level1 54.7
Fig. 3: Overall results of Questionnaire
Fig. 6: E‐books download
Fig. 4: login
Fig. 7: starting test
Fig. 5: Student Dashboard
Fig. 8: Assessment(test) in progress Fig. 9: messaging interface
APPENDIX B
The table below shows the number of statements used for evaluation.
Usability Evaluation Questionnaire for Students
PURPOSE : This questionnaire evaluates the usability of the developed Mobile Application Framework for Higher Institutions of
Learning (MAFHIL) prototype. MAFHIL is a mobile app meant for academic purposes. Your fair response is humbly solicited in the
next few minutes.
S/N Questionnaire statements Strongly Agreed Undecided Disagreed Strongly
o. Agree d[A] [B] [C] Level 3 [D] Level 4 disagreed
Level 1 Level 2 [E] Level 5