Professional Documents
Culture Documents
Cib DC26936
Cib DC26936
Cib DC26936
net/publication/320076020
CITATION READS
1 9,143
1 author:
Gopikrishnan Seshadhri
School of Planning and Architecture
12 PUBLICATIONS 134 CITATIONS
SEE PROFILE
Some of the authors of this publication are also working on these related projects:
All content following this page was uploaded by Gopikrishnan Seshadhri on 17 November 2017.
5.3
Col S Gopikrishnan
Post graduate student, Veermata Jijabai Technological Institute, Mumbai, India
gopikrishnanvidya@gmail.com
+91 9167009141
Dr Vinay Topkar
Professor, Civil and Environmental Engineering Department
Veermata Jijabai Technological Institute
vmtopkar@vjti.org.in
ABSTRACT
Purpose: Develop a questionnaire for evaluation of performance of built facilities using at-
tribute descriptors that can elicit more objective user response during user satisfaction sur-
veys.
Background: Among present methods in vogue to elicit user feedback, questionnaire re-
mains the foremost and most common tool. Questionnaires presently being used to gauge
user satisfaction being subjective, feedback obtained do not necessarily reflect actual perfor-
mance. Hence, there is a requirement of a survey instrument to gauge user satisfaction that
truly reflects ground reality. Such survey instrument comprises of questions framed on vari-
ous attributes of a built facility. These attributes need appropriate description for incorpora-
tion in a survey instrument.
Results: The data obtained in the form of user feedback has been analyzed to validate the
survey instrument for its translational validity, construct validity and internal consistency.
Research limitations: The study is based on a few case studies which limit the possibility to
generalise and the new methodology for questionnaire design needs further validation.
1 INTRODUCTION
2.1 Objective
The aim of this study is addressing an issue in questionnaire design, towards improving the
objectivity in user response obtained through questionnaires. The focus area of this study is to
develop a questionnaire based on attribute descriptors to elicit user objective user feedback in
performance evaluation of built facilities.
2.2 Methodology
In order to achieve the above objective, the under mentioned methodology was formulated:
3.2.1 Questionnaire
Questionnaire is a well-established tool for acquiring information on participants’ social
characteristics, standards of behaviour or attitudes and their beliefs and reasons for action
with respect to topic under investigation. (DK Bird, 2009) Questionnaire is a measuring de-
vice used to query a population/sample in order to obtain information for analysis. (PMT,
Fairfax County, 2007) Questionnaires enable collection of information in a standardized
manner which, when gathered from a representative sample of a defined population allows
the inference to a wider population. (Janice Rattray and Martyn C Jones, 2005) Cognitive
research into survey methodology starts from the premise that responding to survey questions
involves many, frequently iterative, steps of complex information processing. The process
begins with comprehension of the question and proceeds to the retrieval of relevant infor-
mation. (Petra Lietz, 2009)
194
CIB Facilities Management Conference 2014 Technical University of Denmark
(b) Range of scale – There are range of scales and response styles that may be used in
developing a questionnaire. These produce different types of data levels and this will influ-
ence the analysis options. Hence, it is important to be clear on the range of scale and the style
of response that need to be adopted in formulating the survey instrument. Though many types
of frequency scales like Thurstone scales, Guttman scale, Rasch scale are available, likert
scale is the most widely used frequency scale. Likert scale use fixed choice response formats
and are generally used to measure attitudes and opinions. Likert type scale assumes that the
intensity of experience is linear i.e. on a continuum from strongly agree to strongly disagree
and also assumes that the attitudes can be measured. Generally, a likert scale of 5 is adopted
for measuring satisfaction levels of participants. (Janice Rattray and Martyn C Jones, 2005)
(c) Item generation, wording and order – Generation of items during questionnaire devel-
opment requires considerable pilot work to refine the wording and content. Items need to be
generated from a number of sources including consultation with industry experts, proposed
respondents and also extensive literature review. This stage is a very important stage as the
type of question, language used and the order of items may all bias response. Consideration
should be given to the order in which items are presented e.g. it is best to avoid controversial
or emotive items at the beginning of a questionnaire. In order to keep the participant engaged,
data like demographic details can be presented at the end of the questionnaire. Certain types
of questions should be avoided e.g. those that lead or include double negatives or double bar-
reled questions. A mixture of both positively and negatively worded items may minimize the
danger of acquiescent response bias i.e. the tendency of the respondent to agree with a state-
ment or respond in a same way to questions. In certain cases, open ended questions may in-
terest the respondents. But it may be difficult to interpret, quantify and analyze the input from
such open ended questions. (Janice Rattray and Martyn C Jones, 2005)
195
CIB Facilities Management Conference 2014 Technical University of Denmark
tions might not elicit the exact response from the users that the researchers were looking for.
The questions were designed based on the attributes. The manner in which the questions were
framed, the participant may not truly perceive what the researcher might be meaning about
the attribute, leaving it to the imagination of the participant to respond. Ultimately, the re-
sponse of the user may be subjective or arbitrary. One of the sample questions is depicted in
Figure 1.
Figure 1: A sample of the format used by Eziyi Offia Ibem et al (2013)
How satisfied or dissatisfied are you with the house where you live in terms of the fol-
lowing? Please tick ( )
Building type
Quality of natural light
Quality of artificial light
3.2.2 Example 2
Two sample questions of a questionnaire used by the Energy Systems Research Unit, Univer-
sity of Strathclyde, UK in a questionnaire for post occupancy evaluation is depicted in Figure
2 and Figure 3 below.
Figure 2: A sample question for occupant of a dwelling unit used by ESRU, UK (2010)
Figure
3:
A
sample
question
for
occupant
of
a
dwelling
unit
used
by
ESRU,
UK
(2010)
196
CIB Facilities Management Conference 2014 Technical University of Denmark
(a) In the sample question depicted in fig 2, safety can be interpreted by respondents in
the form of physical safety, fire safety, safety against calamities, safety against theft and bur-
glary, and so on. This interpretation will depend on factors like social, economic, educational
and financial background of the respondent. The researcher might not exactly be conveying
the information that he requires from the respondent, which may lead to arbitrary response.
(b) Similarly, in the sample question depicted in fig 3, ‘amount of natural light’ leading to
satisfaction will again vary depending on the tasks being performed, characteristics, personal
likes and dislikes of the respondent etc. Also, by providing space for additional comments in
every question may result in the respondent recording contradictory information with respect
to the rating and the description on additional comments. This may render the response in-
consistent.
3.3 Attributes
3.3.1 Attributes are functions/metrics/indicators through which performance of a facility
can be measured. These attributes vary depending on the type of facility and the purpose of
performance evaluation. The selection of attributes also depends on the type of users like
occupants, managers, supervisors etc. The choice of attributes should be made in such a man-
ner that they are useful in holistic as well as assessment of any specific aspect of a facility.
(Sarel Lavy et. al., 2011) In case of performance evaluation of buildings also, the selection of
attributes is governed by the purpose of the evaluation. Literature survey on building perfor-
mance evaluation indicates that a no of researchers have grouped various attributes together
depending on the purpose of evaluation of the building. Many of the attributes have been
clubbed as under in different groups by the various researchers. However, choice of attributes
is generally governed by the intended purpose of the evaluation.
3.3.3 There are other case studies (Abdul Lateef et al, 2011, Igal M Shohet et. al., 2003)
available too, wherein the performance of a built facility is assessed based on a number of
factors. The modus operandi for all such assessments has been to obtain feedback from vari-
ous agencies including occupants/users through questionnaire. In all these methods, there is a
scope of bringing more objectivity in response of the users by improving the manner in which
the questions are put across to the participants in the user satisfaction surveys.
197
CIB Facilities Management Conference 2014 Technical University of Denmark
identified which was reduced to 29 after closely scrutinizing these attributes with respect to
the purpose of evaluation. A list of these attributes was circulated amongst construction in-
dustry experts including architects, engineers, consultants and academicians. Interaction was
carried out through email and personal interviews to draw their opinion on adequacy and ap-
propriateness of the attributes for building performance evaluation. 19 responses were re-
ceived that lead to the choice of attributes listed in Table 1 as adequate to obtain user satisfac-
tion level while evaluating performance of a built facility. A cryptic mention of aspects cov-
ered by each attribute is also made against each.
S No Attributes
1 Physical condition Building integrity like cracks, leakage, seepage, dampness etc
2 Space Size/grouping of rooms, common areas, open spaces etc
3 Indoor air Ventilation and air conditioning for thermal comfort
4 Illumination For adequacy and visual comfort
5 Safety and security Against fire, lightning, accidents, infections, insects and crime
level
6 Accessibility Connectivity, internal roads, staircases, lifts, escalators
7 Air, Noise and wa- Environmental aspects of quality of air, water and noise
ter
8 Waste disposal Including garbage collection and disposal
9 Drainage Rain water, sewage and sullage
10 Finishes Internal and external finishes
11 Amenities Drinking water, washrooms, water and electricity supply etc
12 Aesthetics Including landscaping, visual comfort, psychological comfort
etc
13 Parking Its location and adequacy
3.4.2 There is a requirement to put across the above questions in a manner that a participant
in the survey, irrespective of his background, perceives the requirement of the researcher and
offer an objective feedback. Though the rating of users may vary depending on their social,
economic, educational, financial background etc, the researcher can ensure to convey what he
exactly looks for in their reply, through adequate description of each attribute. This descrip-
tion facilitates forming of each item as a question under each attribute. National Building
Code 2005 (India) which is followed across the country as baseline for construction projects
in India has been referred to formulate characteristics of each attribute. Descriptors for two
attributes ‘Safety and security’ and ‘Illumination’ are enumerated in the following para-
graphs.
(a) Description of safety and security – In order to formulate questions on safety and se-
curity, the attribute ‘safety and security’ is described in Table 2 below.
198
CIB Facilities Management Conference 2014 Technical University of Denmark
S No Characteristic Description
1 Physical safety Provides safety against accidents due to falling, tripping etc
2 Safety against Protects from insects in the form of mosquito proofing, Fumi-
insects gation etc
2 Fire safety With adequate fire extinguishers, water sprinklers, fire alarms
etc
Placed at prominently visible places for access
Has signboards indicating location of equipment, fire exits
With passages and fire exits free of obstructions
Sufficient ventilation to avoid choking due to smoke during
fire
With adequate water supply dedicated for fire fighting
4 Electric safety Against electrical accidents due to loose fittings, wires etc
5 Security Against theft, burglary, crime rate in the area etc
(b) Description for illumination – As lighting comprises of both natural and artificial
lighting, in order to obtain the satisfaction level of the users on lighting, the attribute has been
named more appropriately as ‘Illumination’ description of which is described in Table 3 be-
low.
3.4.3 Only two examples of descriptors for safety and security and illumination have been
included in this paper to illustrate the formulation. Similarly, characteristics and descriptions
for each attribute identified as relevant to the type of evaluation can be framed and incorpo-
rated in the survey instrument so that the ultimate goal of obtaining objective feedback from
the users/occupants is achieved. The descriptions for each attributes are drawn bases on the
theoretical content that characterizes the attributes. Relevant literature needs to be referred to,
in order to describe the attributes. In the Indian context, the descriptions of attributes were
formulated predominantly referring to the national building code, 2005.
199
CIB Facilities Management Conference 2014 Technical University of Denmark
3.4.4 Once the descriptors for an attribute are formulated, they need to be transformed in
the form of questions. Basic rules of question formulation like avoiding double barreled ques-
tions, negative terminology and simple language should be followed while generating the
questions. Threatening questions, ambiguous questions, danger words, questions leading to
bias and generic questions also should be avoided in the process.
(a) Likert scale of 5 has been uniformly adopted for all questions.
(b) The questions are all predominantly ‘How’ with an aim to obtain the opinion of respond-
ents with respect to what they feel about each and every item related to the variable.
(c) All the questions are framed positively starting with ‘Higly positive opinion’ rated 1 and
‘Highly negative opinion’ rated 5.
(d) The ratings are labeled specific to the nature of opinion likely to be endorsed by the re-
spondent rather than keeping it common to all the questions like ‘Highly satisfied’ to ‘Highly
dissatisfied’
(e) The questionnaire has been divided into four sections. Section I comprises of demograph-
ic details of the respondents that will enable confirm the sampling population. Section II
comprises of the technical content wherein all the questions are grouped under each attribute.
Section III is a section dedicated to additional comments, wherein the respondent can record
his/her additional comments and opinions on building performance. Section IV lists down all
the attributes and asks the respondent to rank them in order of importance. This will enable
the researcher to understand the weightage the respondent had in his/her mind whole rating
every item under each attribute.
(f) The section IV of the questionnaire has been incorporated to give an idea to the research-
er on the degree of importance the occupants attach to each attribute from which the re-
searcher can derive the weightage to be allotted to the ratings of these attributes during analy-
sis.
200
CIB Facilities Management Conference 2014 Technical University of Denmark
4 RESULTS
4.3 Reliability
The reliability of the questionnaire was checked through internal consistency reliability. The
cronbach item inter relation coefficient for the attributes varied from 0.7 to 0.9, which indi-
cates a good correlation between the items and the questionnaire is consistently reliable.
5 PRACTICAL IMPLICATIONS
201
CIB Facilities Management Conference 2014 Technical University of Denmark
6 CONCLUSIONS
A near correct picture of actual performance of the built facility from the user point of view
will enable facility managers to address pertinent issues. Objectivity can be brought into the
questionnaire by carefully describing the attributes and transforming them into sub questions
as discussed above. Such type of questionnaire is likely to elicit more objective response
from the users which will be a near correct reflection of ground reality. Effectiveness of the
questionnaire and utility of data obtained depends on the choice of correct attributes, appro-
priate identification and description of their characteristics and converting them into easily
understandable questions. The questionnaire designed for building performance evaluation
has been validated and found consistent for subsequent application in user satisfaction sur-
veys.
REFERENCES
[1] Ahmad E Hashim, Hasnizan Aksah and Sharul Yani Said, (2012), “Functional assessment
through post occupancy review on refurbished historical public buildings in Kualalumpur”,
Journal of social and behavioural sciences, Elsevier Procedia, Vol 68, pp 330-340
[2] DK Bird, (2009), “The use of questionnaires for acquiring information on public percep-
tion of natural hazards and risk mitigation –a review of current knowledge and practice”
Journal of Natural Hazards and Earth System Sciences, Copernicus Publications, Vol 9,
pp1307-1325
[3] Energy System Research Unit, (2010), “Post occupancy evaluation questionnaire”, Uni-
versity of Strathcylde, UK
[4] Eziyi Offia Ibem, AkunnayaP.Opoko, AlbertB.Adeboye and Dolapo Amole, (2013),
“Performance evaluation of residential buildings in public housing estates in Ogun State,
Nigeria: Users’ satisfaction perspective”, Elsevier Science direct, Frontiers of Architectural
research, Vol 2, pp 178-190
[5] Igal M Shohet, Sarel Lavy-Leibovich and Dany Bar-On, (2003), “Integrated Maintenance
Management of Hospital Buildings in Israel”, Journal of Construction Management and
Economics, Vol 21, pp 197-208
[6] Janice Rattray, Martyn C Jones, (2007), “Essential elements of questionnaire design and
development”, Journal of Clinical Nursing, Vol 16, pp 234-243
[7] Khalil N, Nawawi AH (2008), “Performance assessment of government and public build-
ings via post occupancy evaluation”, Asian School of Science, Vol 4(9), pp 103-112
[8] Kian PS, Feriadi H, Sulistio W, Seng KC (2001), “A case study on total building perfor-
mance evaluation an intelligent office building in Singapore”, Dimensi Technik Sipil, Vol
3(1), pp 9-15
[9] Kim S, Yang I, Yeo M and Kim K, (2005), “Development of a housing performance
evaluation model for multifamily residential building in Korea”, Journal of Building and
Environment, Vol 40, pp 1103-1116
[10] Meir IA, Garb Y, Jiao D, Cicelsky A, (2009), “Post Occupancy Evaluation: An inevita-
ble step towards sustainability”, Advances in Building energy and research, Vol 3, pp 189-
220
[11] Mohammad Abdul Mohit and Mohammad Azim, (2012), “Assessment of residential
satisfaction with public housing in Hulhumale’, Maldives” Jouranl of social and behavioral
sciences, Elsevier Procedia, Vol 50, pp 756-770
[12] Nasrin Parsian, Trisha Dunning AM, (2009), “Developing and validating a question-
naire-A psychometric process”, Global Journal of Health Science, Vol 1, No 1, pp 2-10
202
CIB Facilities Management Conference 2014 Technical University of Denmark
[13] Natasha Khalil, Husrul Nizam Husin, Hamimah Adnan and Abdul Hadi Nawawi,
(2010), “Correlation analysis of building performance and occupants’ satisfaction via post
occupancy evaluation for Malaysia’s public buildings”, Munich Personal RePEc Archives,
paper No 19634
[14] The National Building Code, 2005, Government of India Publications
[15] Petra Lietz, (2009), “Research into questionnaire design-A summary of the literature”,
International Journal of Market Research, Vol 52, Issue 2, pp 249-272
[16] PMT Fairfax County, (2007), “Manual for surveying for customer satisfaction”, De-
partment of Management and Budget, United Kingdom, pp 1-17
[17] Sarel Lavy, John A. Garcia and Manish K Dixit, (2011), “Establishment of KPIs for fa-
cility performance measurement: Review of Literature”, Journal of facilities, Emerald
Group Publishing, pp 445-464
[18] Vischer JC, (2008), “Towards a user centred theory of built environment”, Journal of
building research and information, Vol 36(3), pp 231-240
[19] Xianhai Meng and Michael Minouge, (2011), “Performance Measurement Models in
Facilities Management”, Journal of Facilities, Emerald Group Publishing, Vol 29, pp 472-
484
203