Automatic Generation of Building Information Models From Digitized Plans
Automatic Generation of Building Information Models From Digitized Plans
Automation in Construction
journal homepage: www.elsevier.com/locate/autcon
A R T I C LE I N FO A B S T R A C T
Keywords: This paper proposes a new approach to creating Building Information (BIM) models of existing buildings from
Artificial intelligence digitized images. This automatic approach is based on three main steps. The first involves extracting the useful
Automation information automatically from rasterized plans by using image processing techniques that include segmenta-
Digitized plans tion, filtering, dilation, erosion, and contour detection. This information feeds the knowledge base of an expert
Expert system
system for BIM model generation. In the second step, using the knowledge base of the expert system, the in-
Knowledge base
formation required to inform the BIM model can be deduced. The range of information thus obtainable can be
extended beyond the examples given. The paper concludes with a discussion of the final stage: the automatic
generation of an Industry Foundation Classes (IFC) information model with all the desired geometric, physical
and technical information. This can be accomplished by using one of the available open-source application
program interfaces (APIs). This stage is currently work-in-progress and will be the subject of a future publication.
⁎
Corresponding author.
E-mail addresses: [email protected] (O. Doukari), [email protected] (D. Greenwood).
https://doi.org/10.1016/j.autcon.2020.103129
Received 8 November 2019; Received in revised form 26 December 2019; Accepted 7 February 2020
Available online 26 February 2020
0926-5805/ © 2020 Published by Elsevier B.V.
O. Doukari and D. Greenwood Automation in Construction 113 (2020) 103129
2
O. Doukari and D. Greenwood Automation in Construction 113 (2020) 103129
Table 1
Knowledge base of dwelling types with typical surface areas and construction materials.
Min. density Max. density Dwelling type Surface area (m2) Materials
represents a fundamental step in creating the expert system. In this a) The Building (B1) is situated in Region R;
paper, we present a simplified prototype version of the knowledge base b) If the Housing density observed is between 5 and 8, then:
that simply allows it to deduce information, for incorporation into a Dwelling type = Housing estate and
BIM model, relating to ‘Dwelling type’ and ‘Construction materials’ (see Construction materials = Waterproofed Insitu concrete.
Table 1). We intend subsequently to develop and enrich this initial
proof-of-concept version to take into account other types of informa- A very simple representation in propositional language can be:
tion. In France, buildings are classified by geographical zone (urban,
suburban, rural, etc.) and according to dwelling type (see [30]). In − To calculate the Housing density of Region R: such as c) R6 (The
order to simplify automation, we have here classified the different Housing density of Region R is 6). Rx (The Housing density of Region
dwelling types (e.g. as ‘detached’, ‘semi-detached’, ‘terraced’, ‘dense R is x).
housing complex’, etc.) in line with the types that commonly occur − To infer consequences from rules (a), (b) and (c), on this list: B1 is a
throughout the regions of France. Housing estate and B1
Table 1 shows a simplified version of the knowledge base as far as it Construction material is Waterproofed Insitu concrete.
currently extends. For these purposes ‘Housing density’ is defined as
Number of dwellings/Site area. To enable this, we must first address ‘Housing density’ and its means
in hectares (Ha). of calculation as explained in the next section.
From the knowledge base created, the type of housing and the type
of materials that it is typically composed of can be readily deduced. 2.2. Base information: housing density
The most commonly-used representation of knowledge-based rea-
soning is propositional language. Representing human expertise with The information base of our expert system consists of a set of sa-
propositional language takes advantage of the simplicity of expression tellite images taken on regions, building facades, etc. in .TIFF, .JPEG or
of this language and, from a computational point of view, of its deci- .PNG formats. To enable us to extract information that can be used by
siveness. In addition, most of the reasoning and inference operators the expert system (example: ‘Housing density’) it is necessary to carry
defined in the area of knowledge representation are defined in propo- out image processing.
sitional calculus [9]. Thus, our approach is essentially based upon the use of program-
Consider the statements (derived from Table 1): ming and image-processing tools such as: Python, OpenCV, NumPy,
SciPy, Skimage (scikit-image), and Matplotlib. The approach follows
3
O. Doukari and D. Greenwood Automation in Construction 113 (2020) 103129
the stages that are shown in Fig. 3, each of which is explained in the
subsequent text.
To illustrate how this algorithm works, in the following sections we
apply it step by step on a real-life example with data taken from
Nanterre City (France).
2.2.1. Data
We selected two types of data, namely, cadastral sources (maps) and
satellite images (see Figs. 4 and 5, respectively) of a part of Nanterre, a
suburb of Paris. The original format of the data is .TIFF, .JPEG or .PNG
and each represents a surface area of 1 ha.
4
O. Doukari and D. Greenwood Automation in Construction 113 (2020) 103129
other pixels classified as ‘accepted’ edges. The minValue and maxValue shapes with irregular contours that require treatment by reducing and
threshold values may need to be varied depending upon the data input weakening their shapes into a curve called a skeleton. This enables an
quality and data acquisition method in order to get reliable edge re- average contour to be obtained in cases where the size of the contours is
cognition results. not uniform. In the case shown in Fig. 7, however, the process is not
‘Skeletonization’: This stage may be necessary where there are necessary and skeletonization had no effect.
5
O. Doukari and D. Greenwood Automation in Construction 113 (2020) 103129
Extraction, evaluation and selection of contours: The next step is to distinguishing (using colour) those that appear to be of interest, as
select those contours that are of interest: i.e. those that are likely to shown in Fig. 9.
represent buildings (as opposed to vehicles, natural spaces and other Closing contours: There remains the potential problem of unclosed
images that do not represent built assets). This is done by calculating contours. This distorts area calculations, counting, and contour selec-
the area and perimeter of the contours before selecting and tions. An example of this is shown in close-up (zoomed) in Fig. 10.
6
O. Doukari and D. Greenwood Automation in Construction 113 (2020) 103129
7
O. Doukari and D. Greenwood Automation in Construction 113 (2020) 103129
Fig. 12. Image after selection of chosen contours (178 contours selected and coloured). (For interpretation of the references to colour in this figure legend, the reader
is referred to the web version of this article.)
8
O. Doukari and D. Greenwood Automation in Construction 113 (2020) 103129
Material type:
Brick Concrete
References
[1] M. Andersen, J.M.L. Gagne, S. Kleindienst, Interactive expert support for early stage
full-year daylighting design: a user’s perspective on Lightsolve, Autom. Constr. 35
(2013) 338–352, https://doi.org/10.1016/j.autcon.2013.05.014.
[2] S. Aram, C. Eastman, R. Sacks, Requirements for BIM platforms in the concrete
reinforcement supply chain, Autom. Constr. 35 (2013) 1–17, https://doi.org/10.
1016/j.autcon.2013.01.013.
[3] Y. Arayici, Towards building information modelling for existing structures, Struct.
Surv. 26 (3) (2008) 210–222, https://doi.org/10.1108/02630800810887108.
[4] J. Canny, A computational approach to edge detection, IEEE Trans. Pattern Anal.
Mach. Intell. (6) (1986) 679–698, https://doi.org/10.1109/TPAMI.1986.4767851.
[5] J.C. Cevallos, J.A. Villagomez, I.S. Andryshchenko, Convolutional neural network
in the recognition of spatial images of sugarcane crops in the Troncal region of the
coast of Ecuador, Procedia Computer Science 150 (2019) 757–763, https://doi.org/
10.1016/j.procs.2019.02.001.
[6] J.S. Chou, J.P.P. Thedja, Metaheuristic optimization within machine learning-based
Fig. 15. Building facade image processing. classification system for early warnings related to geotechnical problems, Autom.
Constr. 68 (2016) 65–80, https://doi.org/10.1016/j.autcon.2016.03.015.
[7] Z. Ding, S. Liu, L. Liao, L. Zhang, A digital construction framework integrating
Table 2 building information modeling and reverse engineering technologies for renovation
projects, Autom. Constr. 102 (2019) 45–58, https://doi.org/10.1016/j.autcon.
Knowledge base of window types. 2019.02.012.
Windows standard size: Window type [8] O. Doukari, B. Naudet, R. Teulier, Merging IFC-based BIM models: a new paradigm
and co-design support tool, Int. J. 3-D Inf. Model. 6 (1) (2017), https://doi.org/10.
height × width (metre)
4018/IJ3DIM.2017010104.
[9] O. Doukari, W. Würbel, R. Jeansoulin, A new model for belief representation and
0.75 × 0.60 Simple window:1 door wing
belief revision based on inconsistencies locality, ICTAI 2007 (2) (2007) 262–269,
1.15/1.25/1.35 × 1 Simple window: 2 door wings https://doi.org/10.1109/ICTAI.2007.37.
1.25/1.35 × 1.20 Simple window: 2 door wings [10] L.M. González, R.E. Giachetti, G. Ramirez, Knowledge management-centric help
2.15 × 0.60/0.80 French window: 1 door wing desk: specification and performance evaluation, Decis. Support. Syst. 40 (2) (2005)
2.15 × 1/1.20 French window: 2 door wings 389–405, https://doi.org/10.1016/j.dss.2004.04.013.
2.15 × 1.80/2.10/2.40 Sliding bay: 2 door wings [11] F. Hayes-Roth, The knowledge-based expert system: a tutorial, Computer 9 (1984)
11–28 https://doi.ieeecomputersociety.org/10.1109/MC.1984.1659242.
[12] D.E. Heckerman, E.J. Horvitz, B.N. Nathwani, Toward normative expert systems:
part i the pathfinder project, Methods Inf. Med. 31 (2) (1992) 90–105, https://doi.
Table 3 org/10.1055/s-0038-1634867.
Knowledge base of maximum storey height of building types. [13] ISO, ISO 29481-1: 2016 Building Information Models - Information Delivery
Manual - Part 1: Methodology and Format, International Organization for
French building level height (metre) Building type Standardization, Geneva, Switzerland, 2016 Web page at https://www.iso.org/
standard/60553.html , Accessed date: 23 December 2019.
2.66 Parking; Hotel [14] Y. Ji, A. Borrmann, J. Beetz, M. Obergrießer, Exchange of parametric bridge models
3 Older residential building using a neutral data format, J. Comput. Civ. Eng. 27 (6) (2013) 593–606, https://
3.3 Office building; Hospital doi.org/10.1061/(ASCE)CP.1943-5487.0000286.
4 Station; Exhibition hall; Superstore [15] M. Kassem, B. Succar, Macro BIM adoption: comparative market analysis, Autom.
> 4 Cathedral Constr. 81 (2017) 286–299, https://doi.org/10.1016/j.autcon.2017.04.005.
[16] H. Kim, K. Anderson, S. Lee, J. Hildreth, Generating construction schedules through
automatic data extraction using open BIM (building information modeling) tech-
nology, Autom. Constr. 35 (0) (2013) 285–295, https://doi.org/10.1016/j.autcon.
Declaration of competing interest 2013.05.020 (2013).
[17] H. Kim, Z. Shen, I. Kim, K. Kim, A. Stumpf, J. Yu, BIM IFC information mapping to
The authors declare that they have no known competing financial building energy analysis (BEA) model with manually extended material informa-
tion, Autom. Constr. 68 (2016) (2016) 183–193, https://doi.org/10.1016/j.autcon.
interests or personal relationships that could have appeared to influ- 2016.04.002.
ence the work reported in this paper. [18] E. Laptali, N.M. Bouchlaghem, Expert systems within the construction industry in
the UK, Automation in Construction, 3(4) Elsevier, Amsterdam, 1995, pp. 321–325,
, https://doi.org/10.1016/0926-5805(94)00037-N 1995.
Acknowledgements [19] A.H. Lee, W.C. Chen, C.J. Chang, A fuzzy AHP and BSC approach for evaluating
performance of IT department in the manufacturing industry in Taiwan, Expert
This is a substantially extended and enhanced version of the paper Syst. Appl. 34 (1) (2008) 96–107, https://doi.org/10.1016/j.eswa.2006.08.022.
[20] G. Lee, R. Sacks, C.M. Eastman, Specifying parametric building object behavior
presented at the CIB W78 Annual Conference held at Northumbria (BOB) for a building information modeling system, Automation in Construction,
University in Newcastle UK in September 2019. We would like to
9
O. Doukari and D. Greenwood Automation in Construction 113 (2020) 103129
15(6) Elsevier, Amsterdam, 2006, pp. 758–776, , https://doi.org/10.1016/j.autcon. urban building structures based on discriminant analysis techniques, Trans. GIS 12
2005.09.009 2006. (1) (2008) 31–59, https://doi.org/10.1111/j.1467-9671.2008.01085.x.
[21] Y.-C. Lee, C.M. Eastman, W. Solihin, R. See, Modularized rule-based validation of a [31] N. Stuurstraat, F. Tolman, A product modeling approach to building knowledge
BIM model pertaining to model views, Automation in Construction, 63 2016, pp. integration, Autom. Constr. 8 (3) (1999) 269–275, https://doi.org/10.1016/S0926-
1–11, , https://doi.org/10.1016/j.autcon.2015.11.006 March 2016. 5805(98)00076-4 1999.
[22] S. Lockley, C. Benghi, M. Cerny, Xbim. Essentials: a library for interoperable [32] A. Sundaram, An introduction to intrusion detection, Crossroads 2 (4) (1996) 3–7
building information applications, The Journal of Open Source Software 2 (20) Web page at http://neuro.bstu.by/ai/To-dom/My_research/Paper-0-again/For-
(2017) 473, https://doi.org/10.21105/joss.00473. research/D-mining/Anomaly-D/Intrusion-detection/Intrusion-Detection-Intro.pdf ,
[23] P.E.D. Love, J. Matthews, The ‘how’ of benefits management for digital technology: Accessed date: 23 December 2019.
from engineering to asset management, Autom. Constr. 107 (2019) 102930, , [33] A. Vinay, A. Gupta, A. Bharadwaj, A. Srinivasan, K.B. Murthy, S. Natarajan, Deep
https://doi.org/10.1016/j.autcon.2019.102930. learning on binary patterns for face recognition, Procedia Computer Science 132
[24] N.F. Matsatsinis, M. Doumpos, C. Zopounidis, Knowledge acquisition and re- (2018) 76–83, https://doi.org/10.1016/j.procs.2018.05.164.
presentation for expert systems in the field of financial analysis, Expert Syst. Appl. [34] R. Volk, J. Stengel, F. Schultmann, Building information modeling (BIM) for ex-
12 (2) (1997) 247–262, https://doi.org/10.1016/S0957-4174(96)00098-X. isting buildings—literature review and future needs, Autom. Constr. 38 (2014)
[25] V. Mayya, R.M. Pai, M.M. Pai, Automatic facial expression recognition using DCNN, 109–127, https://doi.org/10.1016/j.autcon.2013.10.023.
Procedia Computer Science 93 (2016) 453–461, https://doi.org/10.1016/j.procs. [35] R. Volk, T.H. Luu, J.S. Mueller-Roemer, N. Sevilmis, F. Schultmann, Deconstruction
2016.07.233. project planning of existing buildings based on automated acquisition and re-
[26] I. Motawa, A. Almarshad, A knowledge-based BIM system for building main- construction of building information, Autom. Constr. 91 (2018) 226–245, https://
tenance, Autom. Constr. 29 (2013) 173–182, https://doi.org/10.1016/j.autcon. doi.org/10.1016/j.autcon.2018.03.017.
2012.09.008. [36] S.T. Waters, Answerman, the expert information specialist: an expert system for
[27] N.F. Noy, C.D. Hafner, The state of the art in ontology design: a survey and com- retrieval of information from library reference books, Inf. Technol. Libr. 5 (3)
parative review, AI Mag. 18 (3) (1997) 53, https://doi.org/10.1609/aimag.v18i3. (1986) 204–212 Web page at http://www.learntechlib.org/p/138219/ , Accessed
1306. date: 23 December 2019.
[28] Pardis Pishdad-Bozorgi, Xinghua Gao, Charles Eastman, Alonzo Patrick Self, [37] R. Zeibak-Shini, R. Sacks, L. Ma, S. Filin, Towards generation of as-damaged BIM
Planning and developing facility management-enabled building information model models using laser-scanning and as-built BIM: first estimate of as-damaged locations
(FM-enabled BIM), Autom. Constr 87 (2018) 22–38, https://doi.org/10.1016/j. of reinforced concrete frame members in masonry infill structures, Adv. Eng.
autcon.2017.12.004 March 2018. Inform. 30 (3) (2016) 312–326, https://doi.org/10.1016/j.aei.2016.04.001.
[29] S.A. Prieto, B. Quintana, A. Adán, A.S. Vázquez, As-is building-structure re- [38] J.P. Zhang, L.H. Liu, R.J. Coble, Hybrid intelligence utilization for construction site
construction from a probabilistic next best scan approach, Robotics and layout, Autom. Constr. 11 (5) (2002) 511–519, https://doi.org/10.1016/S0926-
Autonomous Systems, 94 2017, pp. 186–207, , https://doi.org/10.1016/j.robot. 5805(01)00071-1.
2017.04.016 August 2017. [39] X. Zhao, A scientometric review of global BIM research: analysis and visualization,
[30] S. Steiniger, T. Lange, D. Burghardt, R. Weibel, An approach for the classification of Autom. Constr. 80 (2017) 37–47, https://doi.org/10.1016/j.autcon.2017.04.002.
10