Nama : Rhista Bella

NIM : 20200803137

Prodi : S1 Sistem Informasi

Tugas Sesi 5

1. Jelaskan setiap phase yang terdapat pada Usability Evaluation Methodology pada gambar
berikut :

2. Jelaskan apa yang dimaksud dengan project portofolio management ?

3. Tuliskan dan jelaskan tahapan – tahapan yang dilakukan pada project portofolio management
?
4. Carilah sebuah jurnal dan review berkaitan tentang Continuous Usability Evaluation of
Increasingly Complex Systems ?

Jawaban

1. Phase Usability Evaluation Methodology :

- Evaluasi tugas dan proses yang ada dalam layanan domain tertentu,
- Evaluasi sistem informasi yang saat ini mendukung layanan,
- Identifikasi jalur keputusan dan tindakan (bersama dengan pola interaksi) yang
dapat mengambil manfaat dari sistem yang lebih kompleks (mis., Sistem realitas
campuran), serta
- Desain dan implementasi sistem yang kompleks, dengan fokus pada kegunaan
dan integrasi.

2. MPP (Manajemen portofolio proyek) adalah suatu proses,metode dan teknologi yang
dapat digunakan organisasi untuk mengatur, memprioritaskan dan mendapatkan
keuntungan dari proyek.
3.

4. Continuous Usability Evaluation of Increasingly Complex Systems

Overview of Usability Evaluation Methodology Our methodology focuses on

continuous usability evaluation of increasingly complex systems. To cope with the
growing complexity we use an iterative approach (see Figure 1) that covers usability
aspects continuously throughout the following phases :

1. Evaluation of existing tasks and processes within the specific domain service,
2. Evaluation of the information systems that currently support the service,
3. Identification of decision paths and actions (together with interaction
patterns) that can benefit from a more complex system (e.g., a mixed reality
system), as well as
4. Design and implementation of the complex system, with focus on usability
and integration.

Process Evaluation of Domain Service

In order to capture the current state of the domain service we use a standard
processoriented approach – system analysis (Krallmann, Schoenherr, & Trier, 2007).
It consists of several steps as depicted in Figure 2 and is designed as a general
blueprint for process optimization projects (Krallmann et al., 2007).
Figure 2. Process Model of System Analysis
For the process evaluation of the domain service we focus on the situation analysis
part of the approach. Here we use notations such as event-driven process chains
(EPCs) and Business Process Modeling Notation (BPMN). We use usability evaluation
techniques such as cognitive walkthrough, action analysis, field observation and
questionnaires (Holzinger, 2005). Our user groups are professionals from the problem
domains, (e.g., clinicians from hospitals with large surgical departments and
specialized clinics, or project portfolio managers from industrial companies.

Evaluation of the Existing Information

Systems In this phase we focus on the evaluation of the information systems (IS) that
currently support the service. This activity is the second main aspect of the situation
analysis (Krallmann et al., 2007). During this phase we enhance the process models
from the previous step with details about the information systems used at every step
of the process. This gives us a complete set of the current process activities, decision
paths, as well as information systems, currently in use for the provision of the domain
service

Usability Evaluation
Techniques "One of the basic lessons we have learned in human-computer interaction
(HCI) is that usability must be considered before prototyping takes place" (Holzinger,
2005). This applies particularly to the healthcare domain. Nevertheless, usability
studies are still not considered an obligatory part of design in this domain. A
comprehensive overview of usability evaluation techniques is presented in (Holzinger,
2005). It differentiates between inspection methods (heuristic evaluation, cognitive
walkthrough, and action analysis) and test methods (thinking aloud, field observation,
and questionnaires). These techniques are categorized according to their applicability
in different phases of the system development process, to their time requirements
and the number of users, evaluators and the complexity of equipment needed for the
evaluation, as well as to their intrusiveness. A historic overview and recent
developments in usability research of augmented and mixed reality systems in the
healthcare domain is presented in (Behringer,Christian, Holzinger, & Wilkinson, 2007).
Our approach considers intrusiveness as particularly important aspect in healthcare,
therefore we apply cognitive walkthrough and action analysis as inspection methods.
These methods can also be applied in different phases of our iterative methodology
and are therefore well suited for continuous evaluation. They also require high
expertise from the evaluators, who are either clinicians themselves, or design
specialists with extensive domain knowledge. As test methods we use questionnaires
and expert interviews.

Design of the System

Approaches to redesign and reorganize perioperative patient flow and work processes
in operating rooms often bring changes in operating room architecture (Sandberg et
al., 2005).

Usability Evaluation in Increasingly Complex Systems for Project Portfolio

Management Portfolio management is one of the key activities within innovation
management. Authors such as Wheelwright (Wheelwright, 1984), Clarke (Clarke,
Silva, & Sapra, 2004), Cooper (R. G. Cooper & Edgett, 2007), and diBenedetto
(Calantone, Benedetto, & Schmidt, 1999) have written extensively on this subject.
There is also a variety of methods these authors have proposed for project selection
and portfolio optimization. Quality criteria for project selection and priority such as
value creation and strategic fit are becoming even more important (Rajegopal, Waller,
& McGuin, 2007). Such criteria, more specifically: value enhancement, strategic
conformity, and risk balancing are the deciding factors for resource distribution to
projects (R. G. Cooper & Edgett, 2007).

Increasingly Complex Systems for Project Portfolio Management Currently there

are more than 200 different systems available in the area of software for project
management support. These include systems for management of singular
projects (10%), multi-project management systems (70%) and enterprise project
management systems (EPM) (20%). Systems for management of singular projects
support scheduling and critical path estimations. They also allow for visualization
of results and resource planning. Multi-project management systems offer
extended functionality for management and coordination of multiple projects
with respect to resources, timeframes and cost forecasting. The EPM systems
cover planning and management of all projects within an enterprise throughout
the life of a project.

Conclusion

This chapter presented an approach for continuous evaluation of increasingly

complex systems based on such a mix of empirical and technical methods. The
iterative and holistic essence of the approach allows us to better address usability
aspects in increasingly complex systems. The verification of the approach was
conducted in two complex application domains – healthcare, more specifically
clinical environments, and industrial engineering, more specifically project
portfolio management.
Future work is focused primarily in the further development of the methodology
with respect to professional communication and its application in additional
problem domains.