Professional Documents
Culture Documents
Validation Survey-Ali Raza Khoso-Phd
Validation Survey-Ali Raza Khoso-Phd
Validation Survey-Ali Raza Khoso-Phd
Dear Sir/Madam,
I am a full-time research student at University Technology Malaysia (UTM), Skudai, Malaysia. This research
developed a decision support model that will help the key stakeholders in justified assessments of contractors
while awarding the contracts in public projects in Pakistan. The successful completion of this research is based
on your sincere opinion regarding the validation of the developed model.
I believe this validation process would not take more than 30 minutes. I have taken the necessary measures to
keep the data confidential. Your participation in this research is a volunteer, and you may decline to answer
any question.
Your contribution to this research is highly appreciated and would be regarded and acknowledged. Thank you
very much for your sincere efforts in making this research possible.
Sincerely,
Ali Raza (PKA183025)
Full-Time Research Student,
School of Civil Engineering, Faculty of Engineering
University Technology Malaysia (UTM)
Email: raza.ali@graduate.utm.my; +92 3342558073; +60 11 11885957
1
PART A. Respondents’ Demographic Information
1. Please specify the ownership of your organization.
4. How long have you been working in public tendering and related works?
2
Part B: Identification and Weightages of Criteria and Sub-criteria for Contractor’s Selection in
Public Tendering
This section aims to highlight the identified criteria and sub-criteria initially from the literature review and
later by taking responses from survey participants throughout Pakistan. Later, the weightages of identified
criteria and sub-criteria along with the initial weightage (as per judgements of experts) and current weightages
after modification are calculated as shown in Figure 1-3.
The criteria are divided into four (4) different types.
1. Essential criteria: These criteria indicate prime eligibility requirements without which the eligibility of
competition would not be possible. These criteria are shown in Table 1.
2. Critical Criteria: These criteria indicate a requirement that has a high level of consideration and essential
for the achievement of the performance. These criteria are shown in Figure 1.
3. Value-Added Criteria: These criteria indicate a modernized level of consideration that enhances the
chances of the contractor’s performance and would add further value in performance if these are possessed
by the contractor. These criteria are shown in Figure 2.
4. Desirable Criteria: Such criteria indicate a lesser consideration level that is supplementary required in
achieving the performance and beneficial but not a key factor in the competition. These criteria are shown
in Figure 3.
Q1. Essential criteria presented in Table 1 are finalized after analysis of gathered data from the previous round
of experts’ survey. Do you consider that identified criteria are important for extensive contractor selection in
public projects in Pakistan? Please mention your opinion in Table 1 in the form of Agree or Disagree
3
Technical Phase Category
50
Critical Criteria (CC)
Management Potential Capability (MPC)
6 Quantity of technical staff (MPC2)
weightage
Category
5 Experience of technical personnel
(MPC1)
4
20 Qualification of technical staff (MPC3)
3 Major criteria
Quantity of skilled and non-skilled
2 labors (MPC5)
Availability of HSE supervisor (MPC4)
in hand (FE5)
Relationships (RS)
15
Relationship with past consultants (RS2)
10
30 Relationship with past clients (RS1)
5
Relationship with past suppliers (RS3)
3
Organizational Structure (OS)
13
Size of firm (OS1)
9
25 Hierarchy of firm (OS3)
3
Senior management (OS2)
6
Q2. The criteria and sub-criteria are ranked according to decreasing order of their importance, and
later weightages are determined from experts’ opinion in the previous round, as shown from Figure
1-3. Please rate the level of satisfaction on the validation aspects shown in Table 2 at a scale from
1-5 (1=Poor, 2=Satisfactory, 3=Good, 4=Very good, 5=Excellent).
Table 2: Validation of contractor selection criteria
Sr. Validation aspect Level of satisfaction
No. Poor Satisfactory Good Very good Excellent
1. Selection of evaluation criteria
2. Formulation of categories of criteria
3. Classification of criteria
4. Understandability of criteria and
sub-criteria
5. Easiness in data collection from
contractors on criteria and sub-
criteria
6. Importance of criteria categories
(i.e. in decreasing order; critical
criteria, value-added criteria,
desirable criteria)
7. Ranking of criteria
8. Ranking of sub-criteria
9. Computed weightages of categories
(i.e. critical, value-added, and
desirable)
10. Computed weightages of major
criteria
11. Computed weightages of sub-
criteria
Q3. In case, you do not fully agree with mentioned validation aspects; please identify any changes
you feel that can improve the criteria and sub-criteria.
7
PART C: Contractor’s Assessment System
This part aims to demonstrate the comprehensive assessment system of contractor evaluation.
Table 3 illuminates the various grading levels developed for each sub-criterion.
Table 3: Grading Assessment Levels of Attributes
9
Grading Assessments Levels of Attributes
Major Criteria Sub-criteria Grading Assessment Levels
2=if satisfactory qualification and experience is available for
majority of staff
Quality of 1=if moderate qualification and experience is available for
managerial staff majority of staff
0=if unsatisfactory qualification and experience is available
for majority of staff
2= if a strong HSE policy is available
HSE policy 1= if a moderate HSE policy is available
0= No HSE policy available
Management Project 2= if project management system is satisfactory
Potential (MP) management 1= if project management system is moderate
system 0= if project management system is unsatisfactory
Firms’ planning 2= if the project planning is satisfactory
for completing the 1= if the project planning is moderate
work 0= if the project planning is unsatisfactory
2=if satisfactory qualification and above 10 years of
Project Manager experience is available
qualification & 1=if moderate qualification and experience is available (5 to
experience 10 years)
0=if qualification and experience is unsatisfactory
Value-Added Criteria
2=if satisfactory measures are designed to deal risk
Approaches to
1=if moderate measures are designed to deal risk
dealing risk
0=if unsatisfactory/no measures are designed to deal risk
2=if satisfactory measures are designed to control risk
Risk control plan 1=if moderate measures are designed to control risk
Risk Management
0=if unsatisfactory/no measures are designed to control risk
for the project
2= if sufficient HSE records are available
(RM)
HSE Records 1= if a few HSE records are available
0= if no HSE record is available
Identification of 2=if appropriate list is identified
risks/List of 1=if moderately appropriate list is identified
expected risk 0=if no list is identified
Itemized detail of 2=if satisfactory information of all major works is provided
sub-contracting 1=if satisfactory information of a few works is provided
work 0= if no satisfactory information of works is provided
Expected list of 1= if the proper expected list of sub-contractors is provided
sub-contractors on 0= if the proper expected list of sub-contractors is not
current projects provided
Experience of sub- 2=if sufficient experience is available within last 5 to 10 yrs.
Sub-contracting contractors in 1=if moderate experience is available within last 5 to 10 yrs.
(SC) similar works in
0=if no experience in last 5 to 10 years
last 5 years
Reputation of sub- 2= if a well reputed firm
contractors worked 1= if a moderately reputed firm
in the past 0= if less reputed firm
List of sub- 1= if the satisfactory list is provided
contractors in last
0= if satisfactory list is not provided
5 years
2= if portfolio of past projects is satisfactory
Past achievements 1= if portfolio of past projects is moderate
on relevant
Software
software
Command (SWC)
works/portfolio of 0= if portfolio of past projects is unsatisfactory
past projects
10
Grading Assessments Levels of Attributes
Major Criteria Sub-criteria Grading Assessment Levels
Cost & material 2= if satisfactory command on the cost & material software
estimation 1= if moderate command on the cost & material software
software 0=if unsatisfactory/no command on the cost & material
commands software
2= if satisfactory command on planning software such as
Primavera P6/MS Project
Primavera P6/MS 1= if moderate command on planning software such as
project expertise Primavera P6/MS Project
0=if unsatisfactory/no command on planning software such as
Primavera P6/MS Project
2= if satisfactory command on AutoCAD or other drafting
AutoCAD or other tools
drafting tools 1= if moderate command on AutoCAD or other drafting tools
expertise 0=if unsatisfactory/no command on AutoCAD or other
drafting tools
Availability of 2=if satisfactory computer-based software for VECP available
computer-based 1=if moderate level computer-based software for VECP
software’s/program available
for value-
0=if unsatisfactory/no computer-based software for VECP
engineering
available
proposal
2=if suggested contractual changes are satisfactory
Working on
1=if suggested contractual changes are moderately
contract changes
Value satisfactory
due to VECP
Engineering 0=if unsatisfactory/no changes are suggested
Change Proposal Experience of 2=if satisfactory experience of VECP possesses in last 5 years
(VECP) designing VECP 1=if moderate experience possesses of VECP in last 5 years
during last 5 years 0=if unsatisfactory/no experience of VECP in last 5 years
Submission of a 2=if satisfactory proposal is submitted
design change 1=if less satisfactory proposal is submitted
proposal 0=if no proposal is submitted
Detail plan of time 2=if satisfactory plan is submitted
cost differences 1=if less satisfactory plan is submitted
with the previous
0=if no plan is submitted
design
2=if satisfactory financial plan is submitted
Estimated financial
1=if less satisfactory financial plan is submitted
plan for each task
0=if no plan financial plan is submitted
List of major 2=if satisfactory work plan is submitted
project tasks along 1=if moderately satisfactory work plan is submitted
with the schedule,
i.e. Work plan of 0=if no work plan is submitted
the project
2= if a satisfactory technical team structure with experiences
Team Management
Technical and qualification is available.
structure along
Proposal (TP) 1= if a moderate level of technical team structure with
with their
experiences and qualification is available
experiences and
0=if unsatisfactory /no technical team structure with
qualification
experiences and qualification is available
Methodology of 2= if satisfactory methodology is provided
achieving major 1= if a moderate level of methodology is provided
tasks 0=if unsatisfactory /no methodology is provided
2=if satisfactory equipment plan is submitted
Equipment plan for 1=if less satisfactory equipment plan is submitted
each major task
0=if no equipment plan is submitted
11
Grading Assessments Levels of Attributes
Major Criteria Sub-criteria Grading Assessment Levels
2=if satisfactory experience in last 3-5 years
Experience in off-
1=if moderate experience in last 3-5 years
site construction
0=if unsatisfactory/no experience in last 3-5 years
Progress 2=if sufficient number of proper tools are available
monitoring and 1=if moderate number of proper tools are available
controlling tools 0=if no proper tools are available
2=if sufficient facilities are available for the project
Remote monitoring monitoring
facilities such as 1=if moderate level of facilities are available for the project
Use of Advanced camera, CCTV, monitoring
Technology (AT) etc. 0=if no proper facilities are available for the project
monitoring
2=if sufficient modern equipment are available for the project
Modern equipment 1=if lesser modern equipment are available for the project
0=if no modern equipment is available for the project
2=if sufficient number of required equipment are available for
the project
GPS controlled
1=if moderate number of required equipment are available for
equipment
the project
0=if no required equipment is available for the project
Desirable Criteria
2=if larger number of strong relationships with past
consultants
Relationship with
1=if moderate number of strong relationships with past
past consultants
consultants
0=if very less or no strong relationships with past consultants
Relationships 2=if larger number of strong relationships with past clients
Relationship with
(RS) 1=if moderate number of strong relationships with past clients
past clients
0=if very less or no strong relationship with past clients
2=if larger number of strong relationships with past suppliers
Relationship with 1=if moderate number of strong relationships with past
past suppliers suppliers
0=if very less or no strong relationship with past suppliers
3=if a large firm
Size of firm 2=if a medium level firm
1= if a small level firm
3=if a larger hierarchy
Organizational Hierarchy of firm 2=if moderate level of hierarchy
Structure (OS) 1=if smaller level of hierarchy
3=if large number of senior staff
Senior 2=if moderate number of senior staff
management 1=if a smaller number of senior staff
0=if no senior staff
2=if most of the staff are regular
Availability of
1=if a few staff are regular
regular staff
0=if no staff is regular
2=if most of the staff is well-trained
Availability of
Client’s 1=if a few staff is well-trained
well-trained staff
Satisfaction (CS) 0=if no staff is well-trained
Contractor’s 1=if contractor has already worked in the region with local
familiarity with labours and suppliers
local labours and 0=if contractor has no experience with local labours and
suppliers suppliers
12
Grading Assessments Levels of Attributes
Major Criteria Sub-criteria Grading Assessment Levels
Quality
1=if ISO 9000 quality certification is available
certification such
as ISO 0=if no certification is available
2=if majority of equipment are owned by firm
Ownership of
1=if a few equipment is owned by firm
equipment
0=if no equipment is owned by firm
Equipment’s 2=if majority of equipment are in operational condition
Condition of
Characteristics 1=if a few equipment is in operational condition
equipment
(EQ) 0=if no equipment is in operational condition
2=if majority of equipment are insured
Insurance of
1=if a few of equipment are insured
equipment
0=if no equipment is insured
Onsite internet and 2=if satisfactory arrangements are available
communication 1=if moderate arrangements are available
access capacity 0=if no arrangement is available
Information Online record- 1=if a firm has online record keeping and updating system
Technology keeping and
0=if a firm has no online record keeping and updating system
Capacity (ITC) updating systems
IT support team’s 2=if satisfactory team is available to deal IT matters
strength and 1=if a moderate level of team is available to deal IT matters
capability 0= if no team is available to deal IT matters
Q1. The comprehensive assessment system of contractor evaluation is shown in Table 3 that
illuminates the various grading assessment levels developed for each sub-criterion. Please rate the
satisfaction level on the validation aspects shown in Table 4 at a scale from 1-5 (1=Poor,
2=Satisfactory, 3=Good, 4=Very good, 5=Excellent).
Table 4: Validation of assessment system of contractor evaluation
Sr. Validation aspect Level of satisfaction
No. Poor Satisfactory Good Very good Excellent
1. Sense of actual evaluation system
2. Understanding of grading assessment
levels
3. Depth of grading assessment levels
4. Degree of uniformity in each sub-
criteria
5. Easiness of evaluation system
6. The practicability of the evaluation
system
Q2. Please brief alteration in the assessment system of contractor evaluation (Table 3), if any.
13
Assessment 1st Stage 2nd Stage
Pakistan
criteria
calculation mechanism.
L4 Bid submission
Screening
Go Criteria weightage 75/25
Outstanding
Contractor s 70/30
CC1,CC2,..CC8
Evaluation TBS=90-95 Bid Assessment 65/35
Critical Criteria-
Total Marks: 60/40
Essential Criteria 100
Eligible L3 Highly weightage ratio=Technical
Acceptable Type A bid-Feasible Assessment/Financial
Total Technical Bid Assessment
Value-Added Value-Added score (TBS)=100
Criteria TBS=81-90
Criteria-Bonuses
Type B bid Highest Final
L2 (Abnormally lowest Sum Scorer
VA1,VA2,..VA6 Acceptable
14
Desirable criteria- Bid)
Out of
competition
PART D: Decision Support Model For Selection of Contractor’s In Public Projects In
the form of a flow diagram shown in Figure 4 below. Moreover, Table 5 describes the weightage
This section aims to demonstrate the proposed contractor selection process of public tendering in
Table 5: Contractor’s final selection score mechanism
Performance Technical Bid Financial Bid
Levels of Weightage (TBW) Weightage (FBW)
contractors (%) (%)
L4 80 20
L3 75 25
L2 70 30
L1 65 35
𝐴𝑝∗100
𝐹𝐵𝑆 = ……………………….(1)
As
Where;
Ap=Amount of the lowest submitted bid
As=Amount of a bid under consideration
Q1. The entire flow of contractor selection model is shown in Figure 4. Further, different weightage
mechanisms are proposed for different performance levels of contractors in Table 5. Eq. 1 and 2
help in computing the final score of each contractor. Please rate the satisfaction level on the
validation aspects shown in Table 6 at a scale from 1-5 (1=Poor, 2=Satisfactory, 3=Good, 4=Very
good, 5=Excellent).
Table 6: Validation of contractor selection model
Sr. Validation aspect Level of satisfaction
No. Poor Satisfactory Good Very good Excellent
1. Justification of score mechanisms
(Table 5)
2. Suitability of Eq. 1 & Eq. 2 as per
Pakistan Public Procurement
Authority (PPRA)
3. Satisfaction on 70% passing marks
(threshold marks)
4. Applied 2nd-stage of the financial
assessment system in the model
(Figure 4) as per the public tendering
concept
5. The essence of value for money
contractor selection via model
15
Sr. Validation aspect Level of satisfaction
No. Poor Satisfactory Good Very good Excellent
6. A practical approach for public
tendering in Pakistan
7. Easy adaptability of the model for
public projects in Pakistan
8. Extend of the simplicity of the model
9. Degree of the feasibility of the model
10. Degree of user-friendly
Q2. Please give your opinion on any stage of the model that can be further modified, keeping in
view the public tendering process in Pakistan.
Q3. Please suggest your opinion (in Table 5) in case of any modifications in the scoring mechanism
(Note: Technical bid weightage + Financial bid weightage =100).
16