A Proposed Model For Variation Order Management in
A Proposed Model For Variation Order Management in
Article
A Proposed Model for Variation Order Management in
Construction Projects
Esam M. H. Ismaeil 1,2, * and Abu Elnasr E. Sobaih 3,4, *
Abstract: This study aims to identify the causes of excessive change orders and their impact on
public construction projects in Saudi Arabia. This should support the organizations working in the
construction industry to improve variation order management (VOM) as a preventive action by
dealing proactively with variation order causes. Therefore, a new methodology was proposed to
minimize change orders and their impact on the successful completion of projects as well as cost
during the project lifecycle. The methodology involved ten selected turnkey building projects at King
Faisal University (KFU) campus, Saudi Arabia. Statistical analyses were conducted to predict the cost
overrun in project size and contract value. The findings showed the most significant causes leading to
variation order in public construction projects. These include the combined effect of the designer and
owner technical committee, designer document, and owner stakeholder committee. Hence, a new
model for VOM was developed as a best practice approach, including three stages. The first stage is
the initiation process, which includes seven procedures, seven tools, and key responsibilities. The
second stage deals with the course of change orders based on a certain number of procedures and
weight for each parameter assigned to this phase. It supports decision processes based on a certain
Citation: Ismaeil, E.M.H.; Sobaih,
average ratio of weights calculation. The third stage is the decision to support decision makers in
A.E.E. A Proposed Model for
proceeding or not proceeding with the variation order. Although the present study was conducted
Variation Order Management in
in Saudi Arabia’s public building construction project, it is envisaged that these research results are
Construction Projects. Buildings 2024,
widely applicable to other developing countries. The paper presents a direction for further research
14, 726. https://doi.org/10.3390/
buildings14030726
to enhance the impact of cost overrun in public sector construction projects in developing countries,
i.e., Saudi Arabia.
Academic Editors: Wenzhe Tang,
Wenxin Shen and Jin Xue
Keywords: change order; construction projects; Saudi Arabia; variation order; variation order
Received: 14 January 2024 management (VOM)
Revised: 3 March 2024
Accepted: 5 March 2024
Published: 8 March 2024
1. Introduction
In the construction industry, several change orders are issued during the project life
Copyright: © 2024 by the authors.
cycle, mainly due to ambiguous client requirements mentioned in the contract, incomplete
Licensee MDPI, Basel, Switzerland. tender contract documents, and design errors [1,2]. However, extensive change orders result
This article is an open access article in cost overruns, schedule delays, lower productivity, and conflicts, leading to arbitration
distributed under the terms and and litigation [2,3]. Construction projects address geography, site conditions, communities,
conditions of the Creative Commons physical environments, existing infrastructure, and many stakeholder requirements [1].
Attribution (CC BY) license (https:// Construction projects are considered long-term complex projects, which are character-
creativecommons.org/licenses/by/ ized by a dynamic nature [2,3]. Construction projects include multiple organizations, like
4.0/). the owner, the consultant for the design work, the main contractor, subcontractors, the
include the value of alteration, addition, omission, and substitution in terms of quality,
quantity, and work schedule [23–26].
The negative impacts of variation orders include project cost increase, overhead ex-
penses increase, invoice delays in logistics processes, blemishing of reputation, poor safety
conditions, degradation of quality of productivity, procurement delay, official disputes,
delay in completion schedule, cost overruns, owner’s financial problems, impediments to
the decision-making processes, design document complexity changes, insufficient working
drawing details, skilled human resources shortage, contractor’s financial difficulties, and
source of disputes [27–29]. The most significant percentage of claims and disputes in the
Gulf areas, especially Saudi Arabia, Oman, and the United Arab Emirates, are variation
orders. These include new client requirements (78%), variations in quantities (74%), contrac-
tor work delay (74%), design errors or omissions (72%), and drawings and specifications
inconsistencies (70%) [12,13,24,30].
The causes of variation orders attributed to the construction project organizations are
classified into six categories. The first category is variation orders related to the owner, i.e.,
additional requirements; technically disrupted or interrupted work; financial difficulties;
performance expedition request; delay in actions; and value engineering study. The second
Buildings 2024, 14, 726 5 of 22
2. Methodology
The construction industry encounters several variation orders issued during the project
lifecycle, which are often managed in a traditional way of processing by the organization
management team (see Figure 1). Change orders mainly affect cost overruns and schedule
Buildings 2024, 14, 726 6 of 22
delays. Hence, organizations in the construction industry need to improve variation order
management processes as preventive processes to deal with the variation order causes.
Therefore, the study methodology was built practically in two stages. The first stage
included discovering all gaps and reasons that cause variation orders inside the ongoing
case study construction project by conducting an analysis of 10 selected implemented
construction projects with different functions. The second stage is the formation of a
robust and practical guide model for variation order management and control to support
construction industry organizations in overcoming variation order risks.
The first stage included selecting 10 construction projects (selected from 33 imple-
mented projects on the KFU city campus, Saudi Arabia, from 2020 to 2022). The study
draws on interviews with construction organization experts working on these projects.
It relied on comprehensive numerical analysis using several types of software, i.e., Excel
spreadsheets v11.0, Revit v 24.1.11.26, AutoCAD v 24.2, and Primavera v 23.12. The main
purpose was to evaluate all change orders occurring within the execution processes of the
selected 10 projects’ original tender documents and as-built documents. The study precisely
revealed the variation order causes and cost overrun from the original tender contract
budget and conditions. The analysis classified the variation order causes in all construction
disciplines. Therefore, the volume and rate of changes in each project were studied based on
final invoices, which include initial tender quantities items, variation order quantities items,
and the final as-built quantities items of all the disciplines implemented until the project
primary handover. The analysis process with Excel spreadsheets was used to determine
the types of changes for all items listed in the final invoices to identify and calculate the
status of the following items:
• The items with no changes based on the tender design.
• Increased quantities of items beyond the tender design and the effect on additional changes.
• Decreased quantities of items from the tender design and the effect on deduction change.
• New items, the new items inside the tender design, and the effect on addition or
deduction changes.
• Omitted items from the tender design and the effect on addition or deduction changes.
The study used Excel sheet calculation for analyzing the types of change that have
been matched according to the final invoices and approved change orders. The study
analyzed the changes in types, sizes, and item rates in each discipline level in the CSI bill
of quantities divisions. The change rate was determined based on the financial cost of the
engineering disciplines (structural/architecture/mechanical/electrical) inside each project.
The second stage in methodology started based on significant procedures, which include
the following:
(a) Interviews were conducted with project managers (contractors, consultants, and
the project management office of the owner KFU-PMO to verify the reasons and
conditions for the changes and to classify the effects of quantities, cost, and ratio that
occurred in each discipline as significant findings.
(b) Classifying the phases of VOM approach in two phases includes the initiation pro-
cesses phase and the variation order course processes phase based on a certain number
of procedures and weight for each parameter assigned to this phase to support deci-
sion processes based on a certain average ratio of weights calculation. Applying VOM
supported the decision maker of the case study campus organization in the ongoing
32 projects, which positively reduced the negative impacts of the variation order on
cost and schedule overrun issues and presented a comprehensive and robust model
in the construction industry that can be adopted and updated according to project
conditions. Figure 2 shows the study method flowchart.
Buildings2024,
Buildings 14,x726
2024,14, FOR PEER REVIEW 7 7ofof23
22
for discoveringfor
thediscovering
causes andthe routes
causes and routes of variation
of variation orders orders until each
until each engineering
engineering discipline
discipline
level of launching.
level of launching.
KING FAISAL
1
UNIVERSITY
8 7 CAMPUS LAYOUT
Figure 3. Selected 10 projects locations from General Master Plan–King Faisal University–Al-Ahsa–
Figure 3. SelectedSaudi
10 projects
Arabia. locations from General Master Plan–King Faisal University–Al-Ahsa–
Saudi Arabia.
The financial values (according to the contract value of the bill of quantities based
on the tender documents before handover processes and according to the final invoice
The financial values (according to the contract value of the bill of quantities based on
values from the contractor after submitting the primary projects handed over) include
the tender documents before handover processes and according to the final invoice values
the following:
from the contractor
■ Theafter submitting
financial theonprimary
value based the bill of projects
quantitieshanded over) include
= 1,196,916,993.70 the fol-
Saudi riyals
lowing: ■ The final financial value after the handover completion = 1,282,271,123.98 Saudi riyals
The final financial value of the change = 85,354,130.28 Saudi riyals; the final total change
■
The financial value based on the bill of quantities = 1,196,916,993.70 Saudi riyals
was 7.13%.
The final financial value after the handover completion = 1,282,271,123.98 Saudi riyals
Table 1 shows the analysis for the variation orders for selected projects as a case study.
The final financial
The data invalue
Table 1of the the
show change = 85,354,130.28
case study Saudi
addition quantity in ariyals;
million the
Saudi final total
riyals, the
change was 7.13%. quantity in a million Saudi riyals, the quantity of variation orders, the variation
deduction
order percentage, and the quantity of invoice items.
Table 1 shows the analysis for the variation orders for selected projects as a case
study. The dataTable
in Table 1 show
1. Analysis the case
of variation study
order addition quantity in a million Saudi riyals,
for 10 projects.
the deduction quantity in a million Saudi riyals, the quantity of variation orders, the var-
iation order percentage, and the quantity of invoice Variation Orders
items.
Addition Deduction Invoice
Study Case Project VO Quantity Value Item
Million Million Saudi
Number Percent % Quantity
Table 1. Analysis of variation order
Saudifor 10 projects.
Riyals Riyals
1 Dormitories (Boys and Girls) 20.3 12.2 5 10 2090
2 Main Administration Variation Orders
2.3 6.8 8 8.4
3 Mosque 2.3
Invoice600
Item
udy Case Project Addition Million Deduction Mil-6.8 VO Quantity
8 Value 8.4 330
4 Computer sciences college (Boys) 11.2 1.4 9 8.7 Quantity
610
5 Computer sciencesSaudi
collegeRiyals
(Girls) lion
15.9Saudi Riyals
11.7 Number11 Percent %
3.9 1156
6 and Girls)Science college20.3
itories (Boys 11.2 12.2 11.3 5 11 10 0.3 1208
2090
7 English language 4.9 4.1 12 0.1 1026
ain Administration
8 Education college 2.3 14.5 6.8 8.5 8 15 8.4 3.2 600681
Mosque9 Activity (Boys) 2.3 17.6 6.8 7.8 8 12 8.4 4 330326
10 Activity (Girls) 17.7 7.9 12 5.5 485
er sciences college (Boys) 11.2 1.4 9 8.7 610
er sciences college (Girls) 15.9 11.7 11 3.9 1156
The highest addition quantity was in the dormitories (boys and girls) project with
Science college 11.2 11.3 11 0.3 1208
20.3 million Saudi riyals, and the lowest quantity was in the main administration and
English language 4.9 4.1 12 0.1 1026
Education college 14.5 8.5 15 3.2 681
Activity (Boys) 17.6 7.8 12 4 326
Activity (Girls) 17.7 7.9 12 5.5 485
Buildings 2024, 14, x FOR PEER REVIEW 9 of 2
Buildings 2024, 14, 726 9 of 22
quantity was in the education college project with 15 VO, and the lowest variation orde
mosque projects, with 2.3 million Saudi riyals. The highest deduction quantity was in the
quantity was
dormitories in and
(boys the girls)
dormitories (boys
project with and
12.3 girls)Saudi
million project withand
riyals, 5 VO. The highest
the lowest quantityvalue per
centage was in the dormitories (boys and girls) project, and the lowest value
was in the English language project with 4.1 million Saudi riyals. The highest variation percentage wa
in thequantity
order Englishwaslanguage project. The
in the education highest
college value
project withof15invoice
VO, and item
the quantity was 2090 item
lowest variation
and the
order lowestwas
quantity value wasdormitories
in the 326 items. This
(boysanalysis explored
and girls) project awith
significant
5 VO. Thegaphighest
in dealing wit
value percentage was in the dormitories (boys and girls) project, and
variation order processes inside the campus according to different influences the lowest value
from all or
percentage
ganizationswas in the English
involved languageand
in designing project. The highest
managing thesevalue of invoice item quantity
projects.
was 2090 items, and the lowest value was 326 items. This analysis explored a significant
gap in dealing with variation order processes inside the campus according to different
3. Results and Discussions
influences from all organizations involved in designing and managing these projects.
3.1. Analysis of Change Order Types
3. Results and Discussions
The data from 10 projects were analyzed to investigate the realistic variation orde
3.1. Analysis of Change Order Types
causes to build variation order management processes as prevention, and controlling fo
anyThe data
issue fromto10a projects
leads were analyzed
new project variationtoorder.
investigate the realistic
The results of thevariation order
five types of change
causes to build variation order management processes as prevention, and controlling for
indicate that the total percentage change was 7.13%, and the change types can be clarifie
any issue leads to a new project variation order. The results of the five types of changes
as follows:
indicate that the total percentage change was 7.13%, and the change types can be clarified
Type
as 1: No change items implemented based on the original design and contract docu
follows:
ments
Type 1: Nowith rate items
change 18.65% and arithmetic
implemented based average 18.58%.
on the original Thisand
design means that
contract 81% of the draw
documents
ing rate
with and 18.65%
original design
and for all
arithmetic the study
average sample
18.58%. projects
This means has
that been
81% changed.
of the drawing and
original
Type 2:design for all
Quantity the study
increase sample
with rate projects
+ 20.72% has
ofbeen changed.
the total value of projects according to th
Type 2: Quantity
bill of quantities increase with rate +average
and arithmetic 20.72% ofofthe total value of projects according to the
22.97%.
bill
Typeof quantities
3: Quantityanddecrease
arithmeticwith
average of 22.97%.
−10.87% of the total value of projects according to the bi
Type 3: Quantity decrease with −10.87% of the total value of projects according to the bill
of quantities and arithmetic average of −10.79%.
of quantities and arithmetic average of −10.79%.
Type4: 4:
Type New
New items
items withwith a of
a rate rate of + 8.94%
+ 8.94% of the project’s
of the project’s total
total value value according
according to the bill ofto the bi
of quantities
quantities and arithmetic
and arithmetic averageaverage
of 9.56%.of 9.56%.
Type5:5:Deducted
Type Deducted items
items withwith a rate
a rate of −11.66%
of −11.66% of theof thevalue
total total of
value of projects
projects according according
to t
thebill
the billofof quantities
quantities andand an arithmetic
an arithmetic average
average rate ofrate of −10.47%.
−10.47%.
Figure
Figure4 shows the total
4 shows percentage
the total of eachof
percentage change
each type analysis
change typeinanalysis
the 10-construction
in the 10-construc
project case study.
tion project case study.
Vo new
items, 8.9%
Vo quality Vo quality
decrease, increase,
-10.9% 20.7%
Figure4.4.The
Figure The total
total percentage
percentage of each
of each change
change type analysis
type analysis in the
in the case case
study study project.
project.
The statistics analysis investigated each discipline deeply in each change type to in
vestigate the details of changes that lead to the negative and/or positive variation orde
The analysis led to the following results. Figure 5 shows a comparison of all total tende
BOQ values, actual BOQ values, and total change percentages for each project in the stud
case.
Buildings 2024, 14, 726 10 of 22
The statistics analysis investigated each discipline deeply in each change type to
investigate the details of changes that lead to the negative and/or positive variation order.
The analysis led to the following results. Figure 5 shows a comparison of all total tender
Buildings 2024, 14, x FOR PEER REVIEW
BOQ values, actual BOQ values, and total change percentages for each project10inofthe 23
study case.
Figure 5. Tender BOQ value, the actual BOQ, and total change % for each project in the case study.
Figure 5. Tender BOQ value, the actual BOQ, and total change % for each project in the case study.
In
In the no change
the no change category,
category, the
the highest
highest value
value was
was inin the
the computer
computer sciences
sciences college
college
(girls) project with 31.6%, and the lowest value was in the main administration
(girls) project with 31.6%, and the lowest value was in the main administration project project
with
10.4%. With regard to the VO quantity increase percentage, the highest value waswas
with 10.4%. With regard to the VO quantity increase percentage, the highest value in
in the
the activity
activity building
building (boys)(boys) project
project with with
42.5%,42.5%,
and theand the lowest
lowest value
value was in was in the science
the science college
college
project with 9.4%. Regarding the VO quantity decrease percentage, the highestthe
project with 9.4%. Regarding the VO quantity decrease percentage, highest
value was
value
in the was in the dormitories
dormitories (boysproject
(boys and girls) and girls)
withproject
−14.5%, withand−14.5%, and the
the lowest valuelowest
was invalue
the
was in the
English Englishbuilding
language language building
project withproject
9.4%. with 9.4%. Regarding
Regarding the VOofquantity
the VO quantity new items of
new items percentage, the highest value was in the main administration
percentage, the highest value was in the main administration building project with 23.9%, building project
with
and the23.9%, andvalue
lowest the lowest
was in value was in
the science the science
college buildingcollege building
project project
with 9.4%. with 9.4%.
Regarding the
Regarding
VO omittedthe VO omitted
quantity items quantity
percentage,items
thepercentage,
highest valuethewas
highest
in thevalue was in the
dormitories dormi-
(boys and
tories (boys and
girls) project girls)
with projectand
−12.5%, with −12.5%,
the lowestand the was
value lowest
in value was inproject
the activity the activity project
(girls) with
(girls) with −0.3%. Figure 6 shows the analysis status for each change type
−0.3%. Figure 6 shows the analysis status for each change type for each study case project. for each study
case project.
Buildings
Buildings 14, 726
2024,2024, 14, x FOR PEER REVIEW 11 23
11 of of 22
Figure 6. The analysis status for each change type for each study case project.
Figure 6. The analysis status for each change type for each study case project.
3.2. The Design and Tender Document Quality
The designer’s work on the design documents influenced all case study projects in
increasing and decreasing item types, which caused variation orders. The total designer
effect on the design document of dormitories (boys and girls) was 45.5%, the percentage for
3.2. The Design and Tender Document Quality
The designer’s work on the design documents influenced all case study projects in
Buildings 2024, 14, 726 increasing and decreasing item types, which caused variation orders. The total designer
12 of 22
effect on the design document of dormitories (boys and girls) was 45.5%, the percentage
for increasing item types was 31%, and the percentage for decreasing item types was
−14.5%. Theitem
increasing totaltypes
designer effectand
was 31%, on the
the percentage
design document of the main
for decreasing administration
item types was −14.5%. pro-
ject was 35.5%; for increasing item types, it was 22%, and for decreasing
The total designer effect on the design document of the main administration project was item types, it was
−13.4%. Theincreasing
35.5%; for total designer effect iton
item types, wasthe22%,
designanddocument
for decreasingof the
item mosque
types, itbuilding
was −13.4%.project
was
The44.9%, the percentage
total designer for design
effect on the increasing item types
document was 34.5%,
of the mosque and for
building decreasing
project was 44.9%, item
types, the percentage
the percentage was −10.4%.
for increasing itemThe typestotal
was designer
34.5%, effect
and for ondecreasing
the designitem document of the
types, the
computer was −10.4%.
percentagesciences college Theproject
total designer
(boys) effect on the design
was 33.8%; documentitem
for increasing of thetypes,
computer
it was
sciences
21.8%, andcollege project (boys)
for decreasing item was
types,33.8%;
it was for−11.9%.
increasing
Theitem
totaltypes,
designer it was 21.8%,
effect on theanddesign
for
decreasing
document ofitem types, it was
the computer −11.9%.
sciences The total
college designer
project (girls)effect
was on 22.4%;the design document
for increasing item
types, it was 15.4%, and for decreasing item types, it was −7%. The total designer effectit on
of the computer sciences college project (girls) was 22.4%; for increasing item types,
was 15.4%, and for decreasing item types, it was −7%. The total designer effect on the
the design document of the science college project was 16.6%; for increasing item types, it
design document of the science college project was 16.6%; for increasing item types, it
was 9.4%, and for decreasing item types, it was −7.2%. The total designer effect on the
was 9.4%, and for decreasing item types, it was −7.2%. The total designer effect on the
design document of the English language project was 17.2%; for increasing item types, it
design document of the English language project was 17.2%; for increasing item types, it
was
was10.3%,
10.3%,andandforfor decreasing
decreasing item item types,
types,ititwas was−−6.9%.
6.9%. TheThetotal
totaldesigner
designer effect
effect ononthethe
design
designdocument
documentof ofthe
the education college project
education college projectwas was28.7%;
28.7%;for forincreasing
increasing itemitem types,
types, it it
was
was 18.1%, and for decreasing item types, it was −10.6%. The total designer effect on thethe
18.1%, and for decreasing item types, it was −10.6%. The total designer effect on
design
designdocument
documentof ofthe
the activity project (boys)
activity project (boys)was was54.2%;
54.2%;forforincreasing
increasing item
item types,
types, it was
it was
42.5%,
42.5%,and
andfor
fordecreasing
decreasing itemitem types,
types,ititwaswas−−11.7%. Thetotal
11.7%. The totaldesigner
designereffect effect onon thethe design
design
document
documentofofthe theactivity
activity project
project (girls) was 38.9%;
(girls) was 38.9%;forforincreasing
increasingitem itemtypes,
types, it was
it was 24.5%,
24.5%,
andfor
and fordecreasing
decreasing itemitem types, itit waswas−−14.3%.
14.3%. Figure
Figure77shows
showsthe thestatistical
statisticalanalysis
analysis forfor
designer and design document effects on causing variation orders
designer and design document effects on causing variation orders in the case study pro- in the case study projects
to investigate
jects the weakness
to investigate the weakness gatesgates
to be toavoided.
be avoided.
Figure
Figure7.7.Statistical
Statisticalanalysis
analysisfor
fordesigner
designerand
anddesign
designdocument
document effects on causing
effects on causing variation
variationorders.
orders.
Therefore, the level of inefficiency and lack of preparation quality of contract docu-
ments is because of the inaccuracy of the inventory of quantities. This led to the difference,
which is greater than the proportions allowed contractually and is the responsibility of the
designer office and the participants in the preparation of documents for the tasks of the
Buildings 2024, 14, 726 13 of 22
designer to investigate the accuracy quality of the bill of quantities and non-conflicting
descriptions in the tender documents.
Figure
Figure8.8.Statistical
Statisticalanalysis
analysisfor
for owner and design
owner and designdocument
documentand
andexecution
execution procedures
procedures effects
effects forfor
causing variation orders.
causing variation orders.
while
Whilethe
thepercentages
percentages for thecivil
for the civildiscipline
discipline related
related to the
to the no change
no change category,
category, quan-
quantity
tity increase
increase category,
category, quantity
quantity decrease
decrease category,
category, quantity
quantity newnew
itemsitems category,
category, and omit-
and omitted
ted quantity
quantity items items category
category were, were, sequentially,
sequentially, 1.76%, −28.31%,
1.76%, 28.31%, 11.58%, −11.58%, −5.93%.
3.34%, and3.34%, and
The total
−5.93%. Thechange in the architectural
total change discipline
in the architectural reached about
discipline reached9.6%, while
about the percentages
9.6%, while the per-
for the architectural
centages discipline discipline
for the architectural related to the no change,
related to thequantity increase,
no change, quantity
quantity decrease,
increase, quan-
quantity new items, and omitted quantity items categories were, sequentially,
tity decrease, quantity new items, and omitted quantity items categories were, sequen- 11.5%, 18.9%,
−11.14%,
tially, 11.5%,16%,
18.9%, −14.1%. The
and −11.14%, 16%, total
andchange
−14.1%.in The
the mechanical
total change discipline reached about
in the mechanical disci-
−
pline reached about −6.1%, while the percentages for the mechanical disciplinecategory,
6.1%, while the percentages for the mechanical discipline related to the no change related to
quantity increase category, quantity decrease category, quantity new items category, and
the no change category, quantity increase category, quantity decrease category, quantity
omitted quantity items category were, sequentially, 37.58%, 16.3%, −15.2%, 36%, and
new items category, and omitted quantity items category were, sequentially, 37.58%,
−10.2%. The total change in the electrical discipline reached about 6.25%, while the
16.3%, −15.2%, 36%, and −10.2%. The total change in the electrical discipline reached about
percentages for the electrical discipline related to the no change category, quantity increase
6.25%, while
category, the percentages
quantity for the electrical
decrease category, quantitydiscipline
new itemsrelated to the
category, andno changequantity
omitted category,
quantity increase category, quantity decrease category, quantity new items
items category were, sequentially, 36.52%, 18.2%, −4.8%, 9.3%, and −16.5%. In Figure 9, category, and
omitted quantity items category were, sequentially, 36.52%, 18.2%,
the total change percentage for each discipline is compared with each change type in the−4.8%, 9.3%, and
−16.5%. In Figure
study case’s 9, the total change percentage for each discipline is compared with each
projects.
change type in the study case’s projects.
Buildings 2024, 14, 726
x FOR PEER REVIEW 1515of
of 23
22
Figure 9. Total change % for each discipline compared with each change type in the study case’s projects.
Figure 9. Total change % for each discipline compared with each change type in the study
case’s projects.
The change rate in the architectural discipline was according to owner requirements
to beThematched
changewith new
rate in the technology
architecturaland modernized
discipline in the sections
was according to ownerofrequirements
metalwork,
wooden works,
to be matched doors
with newand windows,
technology andfinishes, special
modernized in works, and of
the sections furniture. Thewooden
metalwork, change
rate in civil
works, doorsworks
and was based on
windows, redesigning
finishes, specialthe foundation
works, structure The
and furniture. calculation
change andratein-
in
creasing quantities
civil works for on
was based excavations andthe
redesigning backfilling.
foundation The change rate
structure in the electrical
calculation works
and increasing
that encountered
quantities changes was
for excavations and based on redesigning
backfilling. The change therate
electrical
in the loads to be
electrical matched
works that
with mechanical and electrical equipment, as well as increasing the wiring,
encountered changes was based on redesigning the electrical loads to be matched with cables, and
electrical
mechanical choices. The change
and electrical rate in the
equipment, mechanical
as well worksthe
as increasing that encountered
wiring, changes
cables, and was
electrical
based
choices.onThe
redesigning the in
change rate mechanical loads works
the mechanical to be matched with mechanical
that encountered changes equipment
was based
from the suppliers,
on redesigning as well as increasing
the mechanical loads to bethe ducting,
matched firefighting,
with mechanical and plumbingfrom
equipment fixtures
the
choices.
suppliers, as well as increasing the ducting, firefighting, and plumbing fixtures choices.
3.5. The
3.5. The Effect
Effect of
of Changes
Changes in in Projects
Projects on
on Claims
Claims and
and Disputes
Disputes
The sample
The sample of of projects
projects under
under study
study has
has not
not been
been subjected
subjected toto any
any kind
kind of
ofsuspension,
suspension,
force majeure, or lack of financial allocations from the owner during implementation,
force majeure, or lack of financial allocations from the owner during implementation, and and
there are no penalties or contractual deductions affecting the contractor.
there are no penalties or contractual deductions affecting the contractor. The claims for The claims for
financial cost have been compensated because of the increase in quantities
financial cost have been compensated because of the increase in quantities due to the de- due to the
designer
signer or or
thethe creation
creation ofof newitems
new itemsdueduetotothe
theowner
owneraccording
accordingto to the
the approved
approved change
change
orders, which have resulted in an increase in the cost of all projects compared
orders, which have resulted in an increase in the cost of all projects compared to the con- to the contract
valuevalue
tract in theinbill
theofbill
quantities.
of quantities.
The time claims
The time claims for for the
the project
project extension
extension have
have been
been compensated
compensated for for another
another period.
period.
The arithmetic average of the extension period to the original project period is 42.17%asasa
The arithmetic average of the extension period to the original project period is 42.17%
result of the approved changes in the increase in quantities and the creation of new items.
a result of the approved changes in the increase in quantities and the creation of new
Changes in general have resulted in improving the quality of all systems and materials
items. Changes in general have resulted in improving the quality of all systems and ma-
included in the various engineering departments, such as the architectural department and
terials included in the various engineering departments, such as the architectural depart-
electromechanical department, in line with the contemporary developments and technology
ment and electromechanical department, in line with the contemporary developments
of the project implementation lifecycle due to the large period between the completion
and technology of the project implementation lifecycle due to the large period between
phase of the design of all tender documents, the tender and awarding phase, and the start
the completion phase of the design of all tender documents, the tender and awarding
Buildings 2024, 14, 726 16 of 22
of implementation phase, so that many systems and materials have meanwhile developed
in the production market for engineering construction projects.
• Specifying a record of previous risks, which is the responsibility of the owner using
site surveys, interviews, presentations, and site visits.
• Specifying a list of approved suppliers and sub-contractors, which is the responsibility
of the owner using site surveys, interviews, presentations, and site visits.
• The approval of all calculations for structural, mechanical, and electrical systems is the
responsibility of suppliers and subcontractors and requires the approval of the owner
using programs such as SAP.
3.6.2. Procedures for Dealing with the Course of Change Orders Stage
This stage is divided after the need to submit the change order, based on either new
items or increases in quantities. In both cases, sequential procedures are used that end with
a quantitative determination that controls the approval or disapproval of the change orders.
In the case of new items, a series of procedures can be followed as follows:
• Conducting the initial determination of the reason for the request to make a variation
order if it is a formal request from the stakeholders, improving the quality or techno-
logical progress or an inevitable technical necessity, and then agreeing to continue the
study with technical and financial analysis or refusing to study the change order.
• Procedures for studying and analyzing the quantitative criteria, technically and finan-
cially, to determine the degree of approval or disapproval of a change order, which can
be controlled through the four main focuses in the project management methodology
(quality, cost, lifecycle, and project scope).
• Inspection by the specialists of technical, financial, and contractual analysis: first, the
quality department to prove compliance with the technical specifications of the item
with a rate of 30%; second, the scheduling department to study the impact on the
project time and supply and installation time with a rate of 30%; third, other technical
departments for determining the impact and technical and financial relationship with
a rate of 20%; fourth, the department of accounting and finance to determine its
impact on the cost of the technical department with a rate of 10%; and fifth, using
value engineering to study alternatives for cost, supply time, installation time, and
technical compliance with item specifications at a rate of 30%. Figure 10 illustrates the
methodology of the VOM approach as a significant finding for this study.
1. Bidding document and actual quantity comparison for archi- 1. Contractor, consultant, 1. REVIT software, expert, and
tectural, civil, mechanical, and electrical work owner project teams
2. Submission and approving long lead items supply installa- 2. Owner, consultant 2. Primavera software
tion 3. Owner, consultant 3. Meetings
3. Determination of the stakeholder influences 4. Consultant, owner, sup- 4. Bill of quantities, specifica-
4. Determination of the architectural, civil, mechanical, and plier, sub-contractor tions, Primavera software
electrical work cost 5. Consultant, owner 5. Meetings, lessons learned
5. Determination of the risk register 6. Consultant, owner 6. Vendor list modification
6. Determination of approved suppliers and subcontractor list 7. Consultant and owner 7. SAP, HAP, ETABS software
7. Approval of the architectural, civil, mechanical, and electrical teams of tender document.
system calculation data
YES
COMPLIANCE WITH THE TIME OF SUPPLY & DETERMINATION OF THE • DETERMINATION OF THE
EFFECT RATIO 25% EFFECT RATIO 15% EFFECT RATIO 15% EFFECT RATIO 15%
USING VALUE ENGINEERING TO STUDY ALTERNATIVES FOR COST, SUPPLY TIME, INSTALLATION TIME, AND
3 DECISION
CANCEL= VO RATIO LESS THAN 75% APPROVED = VO RATIO MORE THAN 75%
The study results submitted a robust variation order model enabled the client techni-
cal representative team to conduct several efforts and changes related to several aspects
on purpose to eliminate and control the occurrence of variation orders. These aspects
Buildings 2024, 14, 726 19 of 22
include contractual aspects, including modification of the design contract document and
the bidding document for consultant and contractor for the organizations working on
the remaining 32 projects of the case study. These modifications include the contractual
aspects, the environmental aspects, and the social aspects. The contractual aspects in-
clude the design phase and execution phase for each project throughout the main five
project documents. These consist of the bill of quantities, specifications, drawings, and
general/special conditions to improve the accounting of quantities, avoid document con-
flicts, adjust delivery time and installation time in each project’s scheduled time for the
long lead items, and conduct value engineering methods and processes. Therefore, the
client obligated all designers to update the design software to Revit software, improve the
input data in Primavera software, conduct value engineering processes, identify the risk
items in long lead items supply and installation, identify authorized stakeholders, improve
tracking procedures in the project schedule from purchase order until installation for each
item, and identify and approve the deliverables processes and commitment with project
scope procedures. Thus, the client committee, after applying VOM, discovered significant
numerical results in variation order quantity and its influence on the deduction of the
remaining project budget, with a total average of 68%. Whereas, in the study case sample
project (10 projects), the additional items causing the additional project budget was 11.79%
(from Table 1), the deduction items causing the reduction in project budget was 7.85% (from
Table 1), and the average of the total VO quantity was 10.3. On the other side, in the study
case remaining project (32 projects), the client committee, after applying VOM, discovered
that the additional items caused the additional project budget to be 3.2% (from Table 1), and
the deduction items caused the reduction in the project budget to be 2.5% (from Table 1).
The average of the total VO quantity was 3.3. The environmental aspects improvement
appeared in the cohesive specifications between the manufacturing source in the vendor
list qualifications and the installing method in the all-discipline items. The social aspects
appeared in developing robust communication channels for all team members for the seven
organizations working on the campus, which include client, designer, consultant, main
contractor, subcontractor, supplier, and manufacturer.
The study provided the educational organizations in construction project management
with a robust model as lessons learned to mitigate the risks associated with construction
projects. This study provided the international and local organizations working in the con-
struction project management industry with a comprehensive model that can be updated
according to project conditions. This study provided the nonprofit international and local
organizations working on issuing project management guidelines with an update on the
processes of risk and integration management and chapters working in the construction
projects management industry with a comprehensive model that can be adjusted according
to project conditions. This study opens the gate for other studies to update the variation
order controlling models in commercial and healthcare projects, merging global economic
and environmental cost impacts on variation order, and compromising the global and local
crises with codes and contractual conditions can be another area of research.
These study results can contribute effectively to the Saudi Vision 2030, which has
three main pillars: a vibrant society, a thriving economy, and an ambitious nation. The
study results can contribute to the thriving economic pillar of the construction industry.
The study supports diversifying the economy in public investment with minimum risks in
the construction project budget, enhancing assets growth of the public investment fund,
and localizing edge technology and knowledge through the public investment fund with a
robust system for minimizing the occurrence of variation orders in construction projects.
The study contributes effectively to enhancing government effectiveness by presenting a
comprehensive method to control the construction project budget and the public balance
construction projects budget, which improves the performance of the government appa-
ratus in the construction industry. In addition, the study results contribute to enhancing
the effectiveness of financial planning and the efficiency of government spending in the
construction industry by enhancing the performance of government entities working in
Buildings 2024, 14, 726 20 of 22
the construction industry by developing a robust matrix for controlling the causes of cost
overruns in construction projects.
The study encountered several challenges, such as environmental culture. These
included discussions and negotiations about technical and financial solutions for variation
orders in the construction industry, stockholder interpretation in the financial and tech-
nical procedures of the construction projects, compensation difficulties from the related
ministries, technical weakness of the main contractor organization, and lack of updating
the construction project information from the consultant office. Despite the study being
limited and designed for specific conditions and types, VOM processes and procedures
contain flexibility and the possibility to be updated and adjusted for other construction
projects according to construction project conditions, location, time, client nature, financial
source, and organization type.
4. Conclusions
Variation orders in construction project management are one of the most complex
challenge processes for project success because of their direct influence on scope, time,
cost, and quality processes. The processes for prediction, prevention, and controlling the
variation orders in construction project management within the project lifecycle, starting
from the design phase until the handover phase, are a great concern for all construction
project organizations. Therefore, the study built a variation order management model
applicable to construction project processes based on financial and technical analysis for the
10 selected implemented construction project types and functions that constitute 30% of the
implemented construction project cost in the megaproject case study. The selected projects
in the case study contained 103 variation orders with a total cost of 86 million Saudi riyals.
Therefore, the study, based on interviews with experts, provided a comprehensive and
numerical analysis for the selected projects of the case study using several software and
documents, i.e., Excel spreadsheets, Revit, AutoCAD, and Primavera. Final invoices include
initial tender quantities of items, variation order quantities of items for all disciplines, and
the final as-built quantities of items to discover the variation order causes implemented in
all engineering disciplines until the project primary handover.
The results enabled the study to establish, develop, and classify a new model for the
VOM approach as a best practice approach. This approach includes three stages. The
first phase is the initiation process, which includes seven procedures, seven tools, and
key responsibilities. The second stage deals with the course of change orders based on
a certain number of procedures and weights for each parameter assigned to this stage
to support decision processes based on a certain average ratio of weights calculation to
support decision makers in proceeding with a variation order or not. The third stage is
the decision stage to support decision makers in proceeding or not proceeding with a
variation order. The study tested the results by applying VOM in the remaining 32 projects,
which supported the decision maker of the case study campus organization to eliminate
and control the variation order. The study contributes to the Saudi Vision 2030 in thriving
the Kingdom’s economy, albeit it opens the gates for several studies in variation order
management in the construction industry.
References
1. Construction Extension to the Pmbok®Guide, PMI Institute. 2021. Available online: http://faspa.ir/wp-content/uploads/2017
/03/faspa.ir-Constrauction.pdf (accessed on 10 January 2024).
2. AIA Document A201–2017 General Conditions of the Contract for Construction; American Institute of Architects: Washington, DC,
USA, 2017.
3. Mahamid, I. Effect of change orders on rework in highway projects in Palestine. J. Financ. Manag. Prop. Constr. 2017, 22, 62–76.
[CrossRef]
4. Hussein, A.F.F.; Al-Mamary, Y.H. S, Conflicts: Their types, and their negative and positive effects on organizations. Int. J. Sci.
Technol. Res. 2019, 8, 10–13.
5. Hughes, W.; Champion, R. Construction Contracts: Law and Management; Routledge: London, UK, 2021; Volume 87.
6. Balbaa, A.A.K.; El-Nawawy, O.A.M.; El-Dash, K.M.; El-Mageed Badawy, M.B.A. Risk assessment for causes of variation orders
for residential projects. J. Eng. Appl. Sci. 2019, 14, 701–708.
7. Mohammad, N.; Ani, A.I.C.; Rakmat, R.A.O. Causes and effects of variation orders in the construction of terrace housing projects:
A case study in the state of Selangor, Malaysia. Int. J. Supply Chain Manag. 2017, 6, 226–232.
8. Naji, K.K.; Gunduz, M.; Naser, A.F. The effect of change-order management factors on construction project success: A structural
equation modeling approach. J. Constr. Eng. Manag. 2022, 148, 04022085. [CrossRef]
9. Msallam, M.; Abojaradeh, M.; Jrew, B.; Zaki, I. Controlling of variation orders in highway projects in Jordan. J. Eng. Archit. 2015,
3, 95–104. [CrossRef]
10. Khanzadi, M.; Nasirzadeh, F.; Dashti, M.S. Fuzzy cognitive map approach to analyze causes of change orders in construction
projects. J. Constr. Eng. Manag. 2018, 144, 04017111. [CrossRef]
11. Mohammad, K.H.; Ali, N.S.; Najm, B.M. Assessment of the cost and time impact of variation orders on construction projects in
Sulaimani governorate. J. Eng. 2021, 27, 106–125. [CrossRef]
12. Alsuliman, J.A. Effective Stakeholder Engagement in Variation Order Management at the Design Stage of Public Sector Construc-
tion Projects in Saudi Arabia. Ph.D. Thesis, Heriot-Watt University, Edinburgh, UK, 2014.
13. El-Sayegh, S.; Ahmad, I.; Aljanabi, M.; Herzallah, R.; Metry, S.; El-Ashwal, O. Construction disputes in the UAE: Causes and
resolution methods. Buildings 2020, 10, 171. [CrossRef]
14. Hayati, K.; Latief, Y. Risk analysis and prevention system to minimize claim and dispute on construction projects. IOP Conf. Ser.
Earth Environ. Sci. 2019, 365, 012030. [CrossRef]
15. Illankoon, I.M.C.S.; Tam, V.W.; Le, K.N.; Ranadewa, K.A.T.O. Causes of disputes, factors affecting dispute resolution and effective
alternative dispute resolution for Sri Lankan construction industry. Int. J. Constr. Manag. 2019, 22, 1–11. [CrossRef]
16. Nachatar, J.S.; Hussin, A.A.; Omran, A. Variations in government contract in Malaysia. Manag. J. 2010, 12, 40–53.
17. Oyewobi, L.O.; Jimoh, R.; Ganiyu, B.O.; Shittu, A.A. Analysis of causes and impact of variation order on educational building
projects. J. Facil. Manag. 2016, 14, 139–164. [CrossRef]
18. Mahmoud, S.Y.; Elshaikh, E.A. The potential effects of variation orders on building projects in Khartoum State-Sudan. Int. J.
Constr. Eng. Manag. 2019, 8, 70–79.
19. Gobana, A.B.; Thakur, A.S. Critical review on causes and effects of variation order on construction project. Crit. Rev. 2017, 4,
1602–1606.
20. Enshassi, A.; Arain, F.; Al-Raee, S. Causes of variation orders in construction projects in the Gaza Strip. J. Civ. Eng. Manag. 2010,
16, 540–551. [CrossRef]
21. Sadewo, A.P. Identifying Causes, Effects, Benefits, and Remedies of Change Orders on Building Projects in Yogyakarta.
Ph.D. Thesis, Uajy, Sleman, Indonesia, 2018.
22. Demirkesen, S.; Ozorhon, B. Impact of integration management on construction project management performance. Int. J. Proj.
Manag. 2017, 35, 1639–1654. [CrossRef]
23. Diekmann, J.E.; Nelson, M.C. Construction claims: Frequency and severity. J. Constr. Eng. Manag. 1985, 111, 74–81. [CrossRef]
24. Assaf, S.A.; Al-Hejji, S. Causes of delay in large construction projects. Int. J. Proj. Manag. 2006, 24, 349–357. [CrossRef]
25. Desai, N.; Pitroda, J.; Bhavsar, J. A review of change order and assessing causes affecting change order in construction. Int. Acad.
Res. Multidiscip. 2015, 2, 152–162.
26. Bakhary, N.A.; Adnan, H.; Ibrahim, A. A study of construction claim management problems in Malaysia. Procedia Econ. Financ.
2015, 23, 63–70. [CrossRef]
27. Arain, F.M. Strategic management of variation orders for institutional buildings: Leveraging on information technology. Proj.
Manag. J. 2005, 36, 66–77. [CrossRef]
28. Memon, A.H.; Rahman, I.A.; Hasan, M.F.A. Significant causes and effects of variation orders in construction projects. Res. J. Appl.
Sci. Eng. Technol. 2014, 7, 4494–4502. [CrossRef]
29. Elziny, A.A.; Mohamadien, M.A.; Ibrahim, H.M.; Fattah, M.A. An expert system to manage dispute resolutions in construction
projects in Egypt. Ain Shams Eng. J. 2016, 7, 57–71. [CrossRef]
30. Alnuaimi, A.; Taha, R.; Mohsin, M.; Alharthi, A. Causes, Effects, Benefits, and Remedies of Change Order on Public Construction
Projects in Oman. J. Constr. Eng. Manag. 2010, 136, 615–622. [CrossRef]
31. Ndihokubwayo, R. An Analysis of the Impact of Variation Orders on Project Performance. Ph.D. Thesis, Cape Peninsula
University of Technology, Cape Town, South Afirca, 2008.
Buildings 2024, 14, 726 22 of 22
32. Tran, N.N.; Do, S.T.; Nguyen, T.A.; Le, L.H. Variation Order Management in Vietnam Construction Projects; Springer: Singapore, 2020;
pp. 1007–1014.
33. Soliman, E. Recommendations to mitigate delay causes in Kuwait construction projects. Am. J. Civil Eng. Archit. 2017, 5, 253–262.
[CrossRef]
34. Ammar, Y. Management of Change in Construction Projects—Study of Its Causes and Analysis of Its Effects on Claims and Disputes;
Faculty of Engineering in Matarya—Helwan University: Cairo, Egypt, 2016.
35. International Federation of Consulting Engineers. FIDIC Conditions of Contract for Construction for Building and Engineering Works
Designed by the Employer; International Federation of Consulting Engineers: Geneva, Switzerland, 1999.
36. Khalifa, W.M.; Mahamid, I. Causes of change orders in construction projects. Eng. Technol. Appl. Sci. Res. 2019, 9, 4956–4961.
[CrossRef]
37. Rashid, I.; Elmikawi, M.; Saleh, A. The impact of change orders on construction projects sports facilities case study. J. Am. Sci.
2012, 8, 628–631.
38. Zawawi, N.A.W.A.; Azman, N.F.I.N.; Kamar, S.; Shamil, M. Sustainable construction practice: A review of change orders (CO) in
construction projects. In Proceedings of the International Conference on Environment, Pulau Pinang, Malaysia, 23–25 March 2010.
39. Arun, C.O.; Rao, B.N. Knowledge based decision support tool for duration and cost overrun analysis of highway construction
projects. J. Inst. Eng. 2007, 88, 27–33.
40. Wu, C.; Hsieh, T.; Cheng, W. Statistical Analysis of Causes for Design Change in Highway Construction in Taiwan. Int. J. Proj.
Manag. 2005, 23, 554–563. [CrossRef]
41. Alaryan, A.; Beltagi, E.; Elshahat, A.; Dawood, M. Causes and effects of change orders on construction projects in Kuwait. Int. J.
Eng. Res. Appl. 2014, 4, 1–8.
42. Soomro, F.A.; Memon, M.J.; Chandio, A.F.; Sohu, S.; Soomro, R. Causes of time overrun in construction of building projects in
Pakistan. Eng. Technol. Appl. Sci. Res. 2019, 9, 3762–3764. [CrossRef]
43. Dastyar, B.; Esfahani, A.F.; Askarifard, M.; Abbasi, A.M. Identification, Prioritization and Management of Construction Project
Claims. J. Eng. Proj. Prod. Manag. 2018, 8, 90–96. [CrossRef]
44. Hanna, A.; Camlic, R.; Peterson, P.; Lee, M. Cumulative effect of project changes for electrical and mechanical construction.
J. Constr. Eng. Manag. 2004, 130, 762–771. [CrossRef]
45. Perkins, R.A. Sources of changes in design/build contracts for a governmental owner, management of engineering and technology.
Portland Int. Cent. Publ. 2009, 5–9, 2148–2153.
46. Hwang, B.G.; Zhu, L.; Ming, J.T.T. Factors affecting productivity in green building construction projects: The case of Singapore.
J. Manag. Eng. 2017, 33, 04016052. [CrossRef]
47. Johnson, J. Practitioner’s Forum: Construction Quality Assurance under Change Conditions. J. Archit. Eng. 2000, 6, 103–104.
[CrossRef]
48. McEniry, G.; Ibbs, W. The cumulative effect of change orders on labour productivity: The Leonard study ‘reloaded’. Revay Rep
2007, 26, 1–8.
49. Sun, M.; Sexton, M.; Aouad, G.; Fleming, A.; Senaratne, S.; Anumba, C.; Chung, P.; El-Hamalawi, A.; Motawa, I.; Yeoh, M.L.
Managing changes in construction projects. EPSRC Ind. Rep. 2004, 185–190.
50. Love, P.; Irani, Z.; Edwards, D. A Rework Reduction Model for Construction Projects. IEEE Trans. Eng. Manag. 2004, 51, 426–440.
[CrossRef]
51. Osama, M.; Assem, I.; El-Rayes, K. Change order impacts on labor productivity. J. Constr. Eng. Manage. 2005, 13, 354–359.
52. Ibbs, W.; Nguyen, L.D.; Lee, S. Quantified impacts of project change. J. Prof. Issues Eng. Educ. Pract. 2007, 133, 45–52. [CrossRef]
53. Assbeihat, J.M.; Sweis, G.J. Factors affecting change orders in public construction projects. Int. J. Appl. 2015, 5, 56–63.
54. Hao, Q.; Shen, W.; Neelamkavil, J.; Thomas, R. Change management in construction projects. In Proceedings of the International
Conference on Information Technology in Construction, Beijing, China, 16–18 October 2008.
55. Yadeta, A.E. The impact of variation orders on public building projects. Int. J. Constr. Eng. Manag. 2016, 5, 86–91.
56. Alnaas, K.A.A.; Khalil, A.H.H.; Nassar, G.E. Guideline for preparing comprehensive extension of time (EoT) claim. HBRC J. 2014,
10, 308–316. [CrossRef]
57. Thani, H.A.; Saleh, M.E.; Amer, N.H. Identification and analysis of main reasons of variation orders and their impacts during
construction project life cycle. In Proceedings of the International Conference on Civil and Architecture Engineering, Cairo, Egypt,
3–5 April 2018; pp. 1–19.
58. Quarter Report, Quality Control Department; New Administration Project; King Faisal University: Al-Hofuf, Saudi Arabia, 2017.
59. Accountant Department Report; New Administration Project; King Faisal University: Al-Hofuf, Saudi Arabia, 2017.
60. Final Reports, Change Orders, Invoices, (APTEC–ALKIFAH–ALARAB—ALKHODARY–SOUTH STAR) Contractor Head Quarter; New
Administration Project; King Faisal University: Al-Hofuf, Saudi Arabia, 2017.
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual
author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to
people or property resulting from any ideas, methods, instructions or products referred to in the content.