A review of heritage building information modeling (H-BIM)

Multimodal Technologies and Interaction Review A Review of Heritage Building Information Modeling (H-BIM) Facundo JoséLópez 1,*ID , Pedro M. Lerones 2, JoséLlamas 2ID , Jaime Gómez-García-Bermejo 3ID and Eduardo Zalama 3 1DISA, University of Valladolid, 47011 Valladolid, Spain 2Cartif foundation, Parque tecnológico de Boecillo, 47151 Valladolid, Sapin; [email protected] (P.M.L.); [email protected] (J.L.) 3ITAP, University of Valladolid, 47011 Valladolid, Spain; [email protected] (J.G.-G.-B.); [email protected] (E.Z.) *Corresponding author: [email protected]; Tel.: +34-610-687-429 Received: 28 March 2018; Accepted: 3 May 2018; Published: 5 May 2018   Abstract: Many projects concerning the protection, conservation, restoration, and dissemination of cultural heritage are being carried out around the world due to its growing interest as a driving force of socio-economic development. The existence of reliable, digital three-dimensional (3D) models that allow for the planning and management of these projects in a remote and decentralized way is currently a growing necessity. There are many software tools to perform the modeling and complete three-dimensional documentation of the intervened monuments. However, the Architecture, Engineering and Construction (AEC) sector has adopted the Building Information Modeling (BIM) standard over the last few decades due to the progress that has been made in its qualities and capabilities. The complex modeling of cultural heritage through commercial BIM software leads to the consideration of the concept of Heritage BIM (H-BIM), which pursues the modeling of architectural elements, according to artistic, historical, and constructive typologies. In addition, H-BIM is considered to be an emerging technology that enables us to understand, document, advertize, and virtually reconstruct the built heritage. This article is a review of the existing literature on H-BIM and its effective implementation in the cultural heritage sector, exploring the effectiveness and the usefulness of the different methodologies that were developed to model families of elements of interest. Keywords: cultural heritage documentation; BIM; H-BIM; H-BIM literature review; as-is model H-BIM; 3D heritage modeling; point clouds; Laser scanner 1. Introduction and Aims According to UNESCO, the World Heritage is divided into Natural, Cultural, and Underwater Heritage. In turn, Cultural Heritage (CH) is divided into two broad categories, tangible cultural heritage and intangible cultural heritage. All of them reflect universal values that must be a legacy for future generations [ 1 , 2 ]. Tangible cultural heritage, particularly immovable assets (monuments, archaeological sites, and so on), is the main subject of application in the new approaches. However, there is a decided lack of documentation and technical information in many existing historic buildings [ 3 , 4 ]. This can result in inefficient project management, loss of time, and increased costs in maintenance or updating processes [5]. So, a structured digital three-dimensional (3D) model as part of the architectural heritage improvement process is an urgent need, nowadays. Moreover, the digital 3D model must be converted into a crucial reference frame for the understanding and monitoring of Multimodal Technologies and Interact. 2018,2, 21; doi:10.3390/mti2020021 www.mdpi.com/journal/mti Multimodal Technologies and Interact. 2018,2, 21 2 of 29 documentation [ 6 , 7 ], thus creating a data source (graphics and semantics) that is suitable for assisting in conservation, restoration, and reconstruction projects [8]. 3D scanning and photogrammetry technologies are particularly relevant for accelerating spatial data collection from existing buildings, as well as for rapid intervention conditions are dangerous. Laser scanners, in particular, provide a precise geometric reproduction of three-dimensional objects in a short time, in the form of millions of points, with geometric coordinates (X, Y, Z) [ 9 ]. Moreover, color information can also be incorporated or mapped by using internal or external calibrated cameras [ 10 ]. A series of steps, such as cleaning and filtering the “noise” of the point cloud, is required before the raw point cloud can be used, thus obtaining a final global cloud that aims to preserve the original complexity of the documented heritage. The processed point clouds can be incorporated into Building Information Modeling (BIM) platforms, which have been adopted by scientific communities and the Architecture, Engineering, and Construction (AEC) sector in recent years as a new paradigm for the design, documentation, and digital management of existing assets, especially of the built historical monuments [11,12]. There are currently many BIM platforms that are used by experts to perform the modeling, virtual visualization, and management of the integral and incremental knowledge of architectural heritage. However, it is important to note that the libraries and tools of the BIM platforms focus on the design and construction of new buildings with simple, regular, and standardized objects [ 13 , 14 ]. For this reason, the virtual and detailed reconstruction of cultural-historical heritage has revealed some limitations of BIM platforms, such as the unavailability of historical parametric object libraries and the lack of tools for managing complex, irregular, and uncertain shapes that are obtained from point clouds. Moreover, obtaining parametric 3D models of the building elements from the point clouds is considered a time-consuming process. Therefore, according to Murphy et al., (2009) [ 15 ] and Volk et al., (2014) [ 16 ], once the parametric objects are modeled using the architectural historical documentation and the laser scanning data, libraries of the modeled elements should be generated, thus encapsulating the concept of Heritage Building Information Modeling (H-BIM). These new H-BIM libraries, which work as a plug-in for BIM within the general framework of “Smart heritage”, allow for the design, rehabilitation, reconstruction, management, and maintenance processes of architectural heritage to become simpler, clearer, and quicker during the rest of its life cycle [17]. The growing necessity to recover and digitally represent heritage buildings [ 18 ], and the limitations of software to automate the direct transformation of the point cloud to solid components, has led the experts to face the challenge of choosing different BIM platforms that will be used to manage the implementation of the semi-automatic design and the reconstruction processes of virtual modeling. These processes are possible thanks to a common data structure called Industry Foundation Classes (IFC), which was developed by BuildingSMART [ 19 , 20 ]. This structure guarantees the existence of collaborative interventions, as well as the interoperability, exchange, and storage of relevant data between experts and different BIM software platforms [ 21 , 22 ]. Therefore, it is considered that the developed H-BIM components can be shared and used by all of those experts that are interested in the topic. It should be noted that the semi-automatic construction of H-BIM models is a current topic in R&D. This is demonstrated in the context of the EU H2020 research framework program under two leading projects: DURAARK (Durable Architectural knowledge: http://duraark.eu/) and INCEPTION (Inclusive cultural heritage in Europe through 3D semantic modeling: www.inception-project.eu). The INCEPTION project, in particular, includes a special focus on H-BIM graphic, semantic, and topological interoperability, in which the graphic and semantic information of interest in Cultural Heritage, its sources and suppliers, the technologies and formats, and the applicable directives have all been defined and agreed as an object of research. In short, this paper addresses a comprehensive review that includes 131 recent publications on the implementation of BIM for the maintenance, diagnosis, management, or complete parametric Multimodal Technologies and Interact. 2018,2, 21 3 of 29 modeling “as-is model” of existing buildings, specifically those belonging to the cultural heritage (CH). In addition, the most relevant methods, tools, and technologies for the acquisition, management, and exchange of information in BIM are also described. On the other hand, the scope includes the collection of data and knowledge concerning H-BIM/BIM and other software used for the 3D modeling and information management of CH. However, it ignores considerations concerning construction programming, cost estimation, analyses and simulations, residual management, and demolition, due to the different requirements and the fact that most of the bibliographies mainly deal with new buildings [23,24]. The aim this bibliographic review is to develop an H-BIM conceptual framework based on this information and to highlight its implementation and functionality in the reconstruction, documentation, management, or maintenance projects of the world’s architectural heritage. In this context, the present research will be useful for understanding the potentialities and difficulties of the most influential methodologies in the processes of the parametric modeling of cultural heritage. 2. Methodology and Literature Review This research exhibits a critical review of the scientific and technical literature that will allow for us to identify, evaluate, and understand current trends and gaps in knowledge concerning the documentation and 3D virtual modeling of existing buildings. In addition, this research will be useful for those researchers that are involved in the implementation of BIM for modeling historic buildings and for H-BIM modeling. According to Wong & Zhou, 2015 [ 25 ] and Heradio et al., 2016 [ 26 ], due to the large flow of existing studies on the aforementioned subject, a filter or bibliometric study is required to recognize the most influential publications, the evolution of the interest in those subjects over time, and the relationship between them. With this purpose, the data collection of the scientific literature was carried out through a search using keywords in the different sources of contributions, such as academic journals, proceedings of congresses, regulations, and book sections. The keywords that are covered are “BIM”, “BIM for existing buildings”, “Cultural Heritage modeling”, “H-BIM” “Heritage BIM”, “Historic BIM”, and “heritage management and documentation as built”. In addition, these keywords are grouped according to their theme to improve interpretability [26]. In this context, it is worth clarifying that the search of the scientific contribution sources was carried out through Scopus, ScienceDirect, and Google Scholar. In addition, the BuildingSMART standard committee and some sections of software providers have been revised to obtain information beyond the academic publications. In relation to the scientific contributions found, those with the highest frequency of the key words used and the highest number of citations have been selected and examined. A total of 131 contributions that were published between 2007 and 2018 were analyzed, of which 87 correspond to papers in journals with an international impact, 23 to proceedings of congresses, five to data obtained from sections of books, two to international regulations, and 14 to Internet sources. Table 1shows how the publication flow is distributed. As shown in Figure 1, 38 papers, focus on the implementation of BIM or BIM functionalities in existing buildings, 36 papers include the word ‘H-BIM’ in the title, abstract, keywords, or main text, and 19 papers do not mention BIM or do not explicitly build BIM models, but they do deal with the 3D virtual modeling of existing buildings (CAD models, 3D MAX, Rhino, Skp., Semantic Web services, etc.). In addition, 13 documents deal with issues that are related to data capture and processing, while the nine remaining publications focus on other issues (heritage, data exchange, demolition, etc.). In addition, Figure 1shows how the flow of publications has evolved, intensifying over the years. Furthermore, according to Table 1, the largest number of selected publications is from “Automation in Construction (AIC)”, “The International Archives of Photogrammetry,Remote Sensing and Space Information Sciences (ISPRS)”, “Journal of Cultural Heritage”, “Survey Review”, and the “IEEE Digital Heritage International Congress”. Multimodal Technologies and Interact. 2018,2, 21 4 of 29 Table 1. Flow of publication. Journals Main Topics Impact Factor * Number of Selected Publications 1 Journal of Cultural Heritage Material science, Multidisciplinary 1.838 (JCR) 8 2 International Journal of Architectural Heritage Construction & Building Technology 1.053 (JCR) 3 3 Advanced Engineering Informatics Computer Science, AI 2.680 (JCR) 2 4 Automation in Construction Construction & Building Technology 2.919 (JCR) 12 5 Computer-Aided Civil and Infrastructure Engineering Construction & Building Technology 5.786 (JCR) 1 6 Studies in Conservation Analytical 0.578 (JCR) 1 7 International Journal of Project Management Management 4.034 (JCR) 1 8 Structural Survey Buildings and Construction 0.28 (SJR) 2 9 Procedia Engineering Engineering 0.74 (CiteScore) 1 10 International Journal of Architectural Computing Computer-aided Architectural design 0.122 (SJR) 2 11 ISPRS Journal of Photogrammetry and Remote Sensing Remote sensing 6.387 (JCR) 23 12 Survey Review Remote sensing 0.929 (JCR) 5 13 Computers in Industry Computer Science 2.691 (JCR) 1 14 Digital Applications in Archaeology and Cultural Heritage 3D digital models of the cultural heritage 0.252 (SJR) 3 15 DISEGNARE CON Heritage Architecture - 3 16 Journal of Computing in Civil Engineering Computer Science, Engineering 2.310 (JCR) 1 17 Computers Environment and Urban Systems Environmental Science 2.659 (JCR) 1 18 Information and Software Technology Information Systems, Software Engineering, Graphics 2.694 (JCR) 1 19 WIT Transactions on The Built Environment Buildings and Construction 0.12 (SJR) 4 20 Science China Information Sciences Engineering, Material Science 1.719 (JCR) 1 21 Archives of Computational Methods in Engineering Computer Science, Interdisciplinary Applications 5.061 (JCR) 1 22 Journal of Information Technology in Construction Buildings and Construction 0.352 (SJR) 2 23 Leadership and Management in Engineering Civil and Structural Engineering 0.144 (SJR) 1 24 Virtual Archaeology Review Conservation, Documentation, 3D surveying - 2 25 International Journal of Building Pathology and Adaptation Buildings and Construction 0.82 (Scopus) 1 26 Built Environment Project and Asset Management Design and Construction management 1.07 (Scopus) 1 27 CSE-City Safety Energy - - 1 28 SCIRES-IT-SCIentific RESearch and Information Technology Cultural and environmental Heritage documentation - 2 Congress Proceedings 1 Annual Conference of the Association for Computer Aided Design in Architecture 1 2 eCAADe Conference 1 3 ICB World Building Congress 1 4 International Conference on Computing in Civil and Building Engineering 2 5 International Conference on Big Data (Big Data) IEEE 1 6 Digital Heritage International Congress (DigitalHeritage) IEEE 7 7 CIB W78 Conference 1 8 International Building Control Conference 1 9 International Conference on Virtual Systems and Multimedia 2 10 International Scientific Committee for Documentation of Cultural Heritage (CIPA) 2 11 International Symposium on Automation and Robotics in Construction (ISARC) 1 12 Digital Documentation International Conference 1 13 EuroMed 1 14 International Conference of Science and Computation ICCSA 1 Multimodal Technologies and Interact. 2018,2, 21 5 of 29 Table 1. Cont. Books 1 Recording, Documentation, and Information Management for the Conservation of Heritage Places 1 2 Heritage Building Information Modelling 1 3 Computational Modeling of Objects Presented in Images 1 4 Handbook of Research on Emerging Technologies for Digital Preservation and Information Modeling 1 5 BIM Handbook: A Guide to Building Information Modeling for Owners, Managers, Designers, Engineers and Contractors 1 Internet Sources 1 ClearEdge 3D 1 2 IMAGINiT 1 3 Graphisoft 1 4 Tekla 1 5 MicroStation 1 6 BuildingSMART 3 7 Autodesk 1 8 DAYSIM 1 9 SKETCHUP 1 10 DURAARK 1 11 Innovmetric 1 12 Meshlab 1 Regulations 2 * Impact Factor according to: (JCR) InCites Journal Citation Reports, (SJR) Scimago Journal & Country Rank, CiteScore and Scopus. Multimodal Technologies and Interact. 2018,2, 21 6 of 29 In particular, most of the scientific contributions that were analyzed describe the combination of new data acquisition technologies (laser scanner and photogrammetry) with BIM platforms to achieve virtual and parametric modeling of architectural heritage. However, only a few documents deal with the automation of the reverse engineering process, with or without BIM, as well as the processes of interoperability, management, documentation, and maintenance of the “as-is model” building. It is important to highlight that the main difference that is presented in this research with regard to the research of Volk et al., 2014 [ 16 ] and Bruno et al., 2018 [ 27 ] is that this research focuses on the description of the H-BIM library as a possible tool for projects of reconstruction, documentation, management, or maintenance of CH. The paper is structured, as follows. This section has shown the implemented method to collect and examine the scientific publications that are related to the methodology, functionality, and implementation of H-BIM. The next section (Section 3) defines the approaches for the surveying, acquisition and processing of geometric data of the analyzed building. In addition, it also explains some aspects related to 3D geometric modeling from the use of point clouds. In Section 4, BIM is defined in a broader sense to ensure its terminology. In addition, the functionalities and tools that are available in BIM are briefly described. Once the general background regarding the virtual modeling of existing buildings has been set out, Section 5describes the concept of H-BIM as the first measure. Subsequently, it focuses on the evolution and the implementation of H-BIM in the processes of the documentation, management, and modeling of architectural heritage. The last section discusses the issues and limitations that were found during the analysis and also describes the conclusions of this research. Multimodal Technol. Interact. 2018, 2, x FOR PEER REVIEW 7 of 30 It is important to highlight that the main difference that is presented in this research with regard to the research of Volk et al., 2014 [16] and Bruno et al., 2018 [27] is that this research focuses on the description of the H-BIM library as a possible tool for projects of reconstruction, documentation, management, or maintenance of CH. The paper is structured, as follows. This section has shown the implemented method to collect and examine the scientific publications that are related to the methodology, functionality, and implementation of H-BIM. The next section (Section 3) defines the approaches for the surveying, acquisition and processing of geometric data of the analyzed building. In addition, it also explains some aspects related to 3D geometric modeling from the use of point clouds. In Section 4, BIM is defined in a broader sense to ensure its terminology. In addition, the functionalities and tools that are available in BIM are briefly described. Once the general background regarding the virtual modeling of existing buildings has been set out, Section 5 describes the concept of H-BIM as the first measure. Subsequently, it focuses on the evolution and the implementation of H-BIM in the processes of the documentation, management, and modeling of architectural heritage. The last section discusses the issues and limitations that were found during the analysis and also describes the conclusions of this research. Figure 1. This figure shows the most used approaches in the analyzed publications. How the flow of publications has evolved, intensifying over the years, is also noticeable. Source: Own figures. 3. Data Capture and Processing The technological revolution that has been achieved over the last few decades brought with it new technologies that have improved and accelerated the topographic techniques of spatial data acquisition to generate accurate construction information models. In this section, the two most influential techniques nowadays are described: photogrammetry and terrestrial laser scanning (TLS). In addition, the necessary processing steps for the captured data to be used are explained. Furthermore, in this section, some approaches related to 3D geometric modeling from the use of the point clouds are also explained. 3.1. Photogrammetry Photogrammetry is a precise 3D measurement technique, without contact, which is based on several high-quality images that allow for the collection of semantic and spatial data of a building or object to be accelerated [28]. Photogrammetry is a technique based on triangulation, where the lines Figure 1. This figure shows the most used approaches in the analyzed publications. How the flow of publications has evolved, intensifying over the years, is also noticeable. Source: Own figures. 3. Data Capture and Processing The technological revolution that has been achieved over the last few decades brought with it new technologies that have improved and accelerated the topographic techniques of spatial data acquisition to generate accurate construction information models. In this section, the two most influential techniques nowadays are described: photogrammetry and terrestrial laser scanning (TLS). In addition, the necessary processing steps for the captured data to be used are explained. Furthermore, in this section, some approaches related to 3D geometric modeling from the use of the point clouds are also explained. 3.1. Photogrammetry Photogrammetry is a precise 3D measurement technique, without contact, which is based on several high-quality images that allow for the collection of semantic and spatial data of a building or Multimodal Technologies and Interact. 2018,2, 21 7 of 29 object to be accelerated [ 28 ]. Photogrammetry is a technique based on triangulation, where the lines of vision of cameras, which are located in several places, are joined at a common point in the object. The results obtained with the photographic survey are orthographic images or models of triangulated and textured surfaces. According to Grussenmeyer, 2008 [ 29 ] and Furukawa et al., 2009 [ 30 ], the post-processing of photographic reconstruction can be considered to be a great disadvantage. This is because it is a process that generates a great manual effort and consumes a lot of time, especially when the texture of the object is poor and its shape is very complex. In addition, for the images to be used as 2D or 3D models of high precision, processes of intersection of characteristic points and scalability must first be applied to each capture obtained and later combined with precise topographic or empirical measurements [31]. Although the current development of computational intelligence does not allow for complete automation, the combination of photogrammetry with computer vision (basically incorporating Structure for Motion (SfM) algorithms) is beginning to provide accurate results in 3D modeling in cultural heritage [ 32 ]. Free and online access to a multitude of quality photographs is becoming an incomparably fast, cheap, and realistic way of capturing reality to virtually reproduce artifacts and buildings [ 33 ]. That is why an increasing number of software tools are easily found to reconstruct 3D models from photos as automatically as possible. 3.2. Laser Scanning Technique Laser scanning technologies are adopted for their ability to accelerate the spatial data collection of existing buildings or complex surfaces, as well as for the accuracy and precision of the acquired data. Laser scanners are subdivided into two specific areas, aerial and terrestrial. Each one has a range and precision that is suitable for the use to which it will be destined. In particular, Laser Scanner Technologies (TLS) work via a laser beam that travels towards the area being scanned and back, measuring angles and distances with accuracies from millimeters to centimeters [ 34 ] (Figure 2a). In this context, TLS obtain a precise and detailed geometric reproduction of three-dimensional objects in a short time [ 35 ], in the form of millions of points (a cloud of points), with geometric coordinates (X, Y, Z) (Figure 2b) [ 9 ], in a digital environment, with both metric and radiometric information. In addition, three different types stand out among the TLS systems: triangulation, phase difference, and Time of Flight (TOF). Each of these TLS systems are capable of producing point clouds of the objects; however, the accuracy and the density of the obtained point clouds will vary depending on the selected scanner type, as well as the number of scans made (Figure 3) [36]. Currently, TLS play a very important role in a wide range of purposes that can be directly extrapolated to cultural heritage [ 37 ], including the follow-up of an intervention [ 38 ], defect detection [ 39 ], or the reproduction of existing models [ 40 , 41 ]. However, the high cost of these technologies, the need for specialized management and the pre-processing of the information acquired can be considered as challenges and/or disadvantages. It should be taken into account that it is not generally possible to capture all of the geometric information of some objects or external surfaces from a single scanning position, since there may be elements that block the scanner view. For this reason, it is necessary to place the scanner in different positions with respect to the object. The data extracted from the different scans creates partial-point clouds {(xi, yi, zi)}, and then each one of these point clouds is merged to give rise to a global cloud that will describe the site. This process is known as point cloud registration. In order to perform the registration, a certain overlapping between adjacent points sets (i.e., 20–30%) is necessary. In this overlap, several common tie points or targets between point clouds must be identified. The alignment of point clouds is commonly performed using an Iterative Closest Point (ICP)-based optimization algorithm [ 42 ]. The alignment is frequently aided by the user with 3D data editing and processing software. Subsequently, so that the raw point cloud can be used, a series of steps, such as cleaning and filtering the “noise” of the point cloud data, is performed. Cleaning and filtering is Multimodal Technologies and Interact. 2018,2, 21 8 of 29 generally user aided, with specific point cloud handling software (i.e., Polyworks ® ) [ 43 ], as scene interpretation is necessary (e.g., clean points from trees, people, or outliers). Alternatively, polygon surface meshing can be used as the data processing method. With this method, a surface that is composed of triangles is created on the point cloud. This mesh is edited to fill holes in the cloud, as well as to soften and to reduce the points of the model [ 44 ]. The pre-processing of the information is considered to be vital, since the alignment and debugging of the cloud of points is what allows for the captured information to be accurately referenced. Multimodal Technol. Interact. 2018, 2, x FOR PEER REVIEW 9 of 30 Alternatively, polygon surface meshing can be used as the data processing method. With this method, a surface that is composed of triangles is created on the point cloud. This mesh is edited to fill holes in the cloud, as well as to soften and to reduce the points of the model [44]. The preprocessing of the information is considered to be vital, since the alignment and debugging of the cloud of points is what allows for the captured information to be accurately referenced. Figure 2. (a) Laser scanning process to create a point cloud; (b) Georeferenced point cloud, (X, Y, Z). Source: Own figures. Triangulation Phase difference Time of Flight Accuracy <1 mm <5 mm 5–10 mm Figure 3. Systems and Accuracy of the terrestrial laser scanning (TLS). Source: Own figures. 3.3. Point Cloud Approach The captured and processed point clouds describe, in detail, the surface of the scanned elements [45,46]. Unfortunately, these point clouds do not contain additional information about the objects whose geometry they represent. Therefore, to obtain geometrical, topological, and semantic attributes, it is necessary to produce 3D geometric models or parametric objects. This 3D modeling can be described as a reverse engineering process. The segmentation and recognition of point clouds currently represent the fundamental steps for identifying the correct surfaces and facilitating the tracing or the modeling of parametric objects. These steps can be carried out semi-automatically or fully automatically through the advances added to BIM platforms, as well as the new algorithms of object recognition and point cloud segmentation [16]. 3.3.1. Semiautomatic Modeling Approach L a s e r β α D Object Lens Camera Mirror Laser Object Receiver Signal Phase difference R e f e r e n c e Δ Φ Laser O bject / Surface D etector R eceiver Tim er Ref l ect ed beam Emi t t ed beam Figure 2. ( a ) Laser scanning process to create a point cloud; ( b ) Georeferenced point cloud, (X, Y, Z). Source: Own figures. Multimodal Technol. Interact. 2018, 2, x FOR PEER REVIEW 9 of 30 Alternatively, polygon surface meshing can be used as the data processing method. With this method, a surface that is composed of triangles is created on the point cloud. This mesh is edited to fill holes in the cloud, as well as to soften and to reduce the points of the model [44]. The preprocessing of the information is considered to be vital, since the alignment and debugging of the cloud of points is what allows for the captured information to be accurately referenced. Figure 2. (a) Laser scanning process to create a point cloud; (b) Georeferenced point cloud, (X, Y, Z). Source: Own figures. Triangulation Phase difference Time of Flight Accuracy <1 mm <5 mm 5–10 mm Figure 3. Systems and Accuracy of the terrestrial laser scanning (TLS). Source: Own figures. 3.3. Point Cloud Approach The captured and processed point clouds describe, in detail, the surface of the scanned elements [45,46]. Unfortunately, these point clouds do not contain additional information about the objects whose geometry they represent. Therefore, to obtain geometrical, topological, and semantic attributes, it is necessary to produce 3D geometric models or parametric objects. This 3D modeling can be described as a reverse engineering process. The segmentation and recognition of point clouds currently represent the fundamental steps for identifying the correct surfaces and facilitating the tracing or the modeling of parametric objects. These steps can be carried out semi-automatically or fully automatically through the advances added to BIM platforms, as well as the new algorithms of object recognition and point cloud segmentation [16]. 3.3.1. Semiautomatic Modeling Approach L a s e r β α D Object Lens Camera Mirror Laser Object Receiver Signal Phase difference R e f e r e n c e Δ Φ Laser O bject / Surface D etector R eceiver Tim er Ref l ect ed beam Emi t t ed beam Figure 3. Systems and Accuracy of the terrestrial laser scanning (TLS). Source: Own figures. 3.3. Point Cloud Approach The captured and processed point clouds describe, in detail, the surface of the scanned elements [ 45 , 46 ]. Unfortunately, these point clouds do not contain additional information about the objects whose geometry they represent. Therefore, to obtain geometrical, topological, and semantic attributes, it is necessary to produce 3D geometric models or parametric objects. This 3D modeling can be described as a reverse engineering process. The segmentation and recognition of point clouds currently represent the fundamental steps for identifying the correct surfaces and facilitating the tracing or the modeling of parametric objects. These steps can be carried out semi-automatically or fully automatically through the advances added to BIM platforms, as well as the new algorithms of object recognition and point cloud segmentation [16]. 3.3.1. Semiautomatic Modeling Approach The semi-automatic process is guided by the user in the form of adjustments, sections, extractions, and extrusions of faces made on the point cloud. In principle, the process consists of using the design software tools to manually configure a series of levels and sections in the X, Y, Z geometric coordinates Multimodal Technologies and Interact. 2018,2, 21 9 of 29 of the point clouds [ 47 ]. The planes and two-dimensional views that detail the geometric profile of the scanned objects are obtained thanks to the sections and levels [ 48 ]. In addition, levels and sections are also used as the start and end points of each geometry represented. Finally, these mentioned actions will be used as guides to start the geometric modeling of the scanned architectural components. This process is valuable for documenting and disseminating information that is related to existing buildings. However, achieving its implementation is a difficult and time-consuming task that requires skilled workers [ 49 ]. These problems are mainly due to the orthogonal constraints that are present in a large part of the design software and the high numbers of necessary steps to parametrically model the complex geometries that are present in point clouds. 3.3.2. Automatic Modeling Approach Over the last few years, several commercial and academic research works have investigated the automated reconstruction of existing buildings from point clouds, especially since BIM platforms have gained prominence with their parametric models. From an academic point of view, the most consolidated methods are found in the investigations of Jung et al., 2014 [ 50 ]; Hong et al., 2015 [ 51 ]; Wang et al., 2015 [ 52 ]; Zheliazkova et al., 2015 [ 53 ]; and, Liu, 2016 [ 54 ]. These researchers have experimented with algorithms to automatically extract the geometric characteristics of the elements through the segmentation of the point clouds. In the work of Wang et al., 2015 [ 52 ] and Liu, 2016 [ 54 ], the region growing plane segmentation algorithm is proposed to divide the raw data into point cloud segments, which are located on the same plane. Subsequently, they introduce a boundary detection algorithm that automatically recognizes the shape, size, and position of the surfaces, thus generating contour polygons for each detected feature. The approaches of Jung et al., 2014 [ 50 ] and Hong et al., 2015 [ 51 ] use the Random Sample Consensus (RANSAC) algorithm to optimize the automatic segmentation of wall planes in the point clouds and extract the components of each surface. Subsequently, refinement and boundary tracing processes are carried out. The first is done to filter points that do not belong to the planes of interest, while the second is used to model the boundaries of a plane segment. The simplified characteristics of each plane found are used as a reference for the manual modeling of parametric geometries. The main issue of Zheliazkova et al., 2015 [ 53 ] was to use the Open Source Software (OSS) Meshlab ® [ 55 ] and the Ball-Pivoting algorithm (BPA) to create closed meshes and polygons on the surfaces of the point clouds. They then use commercial software to reconstruct the mesh surface in 3D models. Other algorithms, investigated to identify and classify objects within the point clouds, are those of color recognition with spectral images [56] and those of feature recognition [49,57,58]. In spite of the progress achieved, these analyzed approaches do not automate the entire process of point clouds to BIM (Scan-to-BIM). Therefore, the obtained results will be 2D and 3D CAD surface models, which must still be manually converted into parametric BIM models. In this context, according to Volk et al., 2014 [ 16 ], the automatic transformation of complex architectural elements into volumetric and semantic entities is still in its infancy. From another point of view, the research that was carried out by the commercial software companies has led to the development of new complements or solutions to automate the generation of BIM geometries from point clouds. EdgeWise ® was created as an independent complement software for Autodesk Revit. This complement classifies and separates the cloud into uniform surfaces. Subsequently, the software automatically searches for candidates of points between pairs of similar horizontal planes and creates the parametric model that is based on the extracted geometry [ 59 ]. Scan-to-BIM ® , from IMAGINiT Technologies, was also developed as a complement to Autodesk Revit. This complement provides detection algorithms and adjustments for the management of the point clouds [ 60 ]. With the detection of points, it automatically creates walls or simple objects surfaces in parametric elements [ 61 ]. Other complements that also help with the segmentation, detection, processing, and modeling of architectural elements on the point clouds are Kubit PointSense Buildings and Pointfuse from Arithmetica. Multimodal Technologies and Interact. 2018,2, 21 16 of 29 the bibliographic review that is described below has been subdivided into categories according to the tools used in each. The first category corresponds to those researchers who have adopted only the commercial BIM platforms to develop BIM “as-is model” models, and in turn create the parametric H-BIM libraries. The second category consists of that research that combines commercial BIM platforms with other auxiliary tools for the modeling and development of virtual buildings and H-BIM libraries. Some of these tools do not belong to the BIM world. The third category consists of those works that combine commercial BIM platforms, Open-Source Software (OSS), and non-BIM auxiliary tools with geographic information systems (GIS) software for the modeling and storage of the 3D models. Finally, the fourth category represents those documents that do not use BIM platforms for modeling heritage monuments. The created categories can be seen in Figure 5. The analysis of the current literature on the virtual modeling of existing buildings has demonstrated the benefits of the use of BIM and H-BIM for the preservation, management, or parametric modeling of cultural heritage (CH). Multimodal Technol. Interact. 2018, 2, x FOR PEER REVIEW 17 of 30 bibliographic review that is described below has been subdivided into categories according to the tools used in each. The first category corresponds to those researchers who have adopted only the commercial BIM platforms to develop BIM “as-is model” models, and in turn create the parametric HBIM libraries. The second category consists of that research that combines commercial BIM platforms with other auxiliary tools for the modeling and development of virtual buildings and H-BIM libraries. Some of these tools do not belong to the BIM world. The third category consists of those works that combine commercial BIM platforms, Open-Source Software (OSS), and non-BIM auxiliary tools with geographic information systems (GIS) software for the modeling and storage of the 3D models. Finally, the fourth category represents those documents that do not use BIM platforms for modeling heritage monuments. The created categories can be seen in Figure 5. The analysis of the current literature on the virtual modeling of existing buildings has demonstrated the benefits of the use of BIM and H-BIM for the preservation, management, or parametric modeling of cultural heritage (CH). Figure 5. Categories classification. Source: Own figures. Figure 5. Categories classification. Source: Own figures. Multimodal Technologies and Interact. 2018,2, 21 17 of 29 Table 3. Current approaches and tools used in the modeling of historic buildings. Reference Case Study Category Software Summary Methodology (Del Giudice & Osello, 2013) The old thermal power plant of Politecnico di Torino, Italy First category/Only BIM Tools Autodesk Revit Creates grids to check consistency between point clouds and historical data. They also model 4D (Lòpez et al.; 2017) Santa Maria la real de Mave church, Spain Autodesk Revit Creates parametric components by modifying and developing new Revit families (Brumana et al., 2013) The church of St. Maria, Italy Autodesk Revit, Autodesk Green Building Studio Architectural components are divided into hierarchies and typology. The final product carries out an energy analysis (Ma et al., 2015) The Huji Temple, traditional Taiwan wooden structure, Taiwan Autodesk Revit Creates a workflow methodology to repair historical constructions (Adami et al., 2016) Varius type of Churches of the province of Mantua, Italy Autodesk Revit, Examines the difficulty for rehabilitating damaged churches (Dore et al., 2015) The Four Courts of Dublin, Ireland Second category/BIM/OSS and auxiliary tools 3D “RULED” plug-in, Graphisoft ArchiCAD Creates an H-BIM library using point cloud and historical data. (Nieto et al., 2016) The Pavilion of Charles V, Seville, Spain Graphisoft ArchiCAD, GDL Creates an H-BIM library (Oreni et al., 2013, 2014a, 2014b) Types of wooden vaults and bean floors and the Basilica di Santa Maria di Collemaggio, Italy Autodesk Revit, Rhinoceros + NURBS plug-in, MIDAS, AutoCAD. Uses point clouds and photogrammetry. Subsequently extracts the NURBS curves and creates the 3D models surfaces (Quattrini et al., 2015) The Church of Santa Maria at Portonovo, Italy Autodesk Revit + plug-in Protégé, CloudCompare, Cyclone 8.1.3, ReCap The profiles were designed according to the measurements extracted from the point cloud (Fregonese et al., 2015) The Galvagnina church, Italy AutoCAD, Autodesk Revit + plug-in BIM3DGS The information of each model object is combined with their 3D model using BIM3DGS Baik et al., 2014, 2015) Historical Jeddah and the Nasif Historical House, Saudi Arabia Third category BIM/OSS/and GIS tools Autodesk Revit, Autodesk InfraWorks platform, Rhinoceros Creates a special library (JHBIM). Integrates BIM with GIS Dore & Murphy, 2012 Is an 18th century Georgian street, Ireland SketchUp + CityGML plugin, Graphisoft ArchiCAD, Create sections and levels on the point cloud. Also, use historical data to create the model. (San Jose et al., 2013) Several types of very damaged heritage buildings in Castilla y León, Spain Fourth category/OSS/AUX/GIS/non BIM tools GIS adapted to the open standard CityGML, WebGL, e-Learning, MACE, AVT, ATRAECOM They have developed a new open source software platform for e-Learning that facilitates the tasks of Architectural Cultural Heritage conservation and rehabilitation. Multimodal Technologies and Interact. 2018,2, 21 18 of 29 5.1.1. First Category: only BIM Methodologies In this category, thirteen documents that present case studies to achieve virtual and parametric 3D modeling of the buildings that are analyzed have been studied. From these thirteen documents, ten have adopted the Autodesk Revit software and three the Graphisoft Archicad software to illustrate the implemented methods. In turn, four documents create H-BIM parametric libraries and the other ten only develop the complete parametric model of the analyzed heritage. Despite the BIM tools used and the purpose of their results, the methodologies that are proposed in the most representative documents of this category have particular similarities for performing such actions as cuts, sections, and levels on the acquired point clouds, which allow for the parametric modeling to be accelerated and optimized. Most of the analyzed works do not declare the degree of automation or the diagnostic and management processes implemented. For Murphy et al. [ 15 , 82 , 99 ], the process of creating an H-BIM library begins with the 3D modeling of parametric objects through the integration of point clouds, photogrammetry, historical documentation, and Graphisoft Archicad software. File format and data exchange problems are fixed with the script GDL language included in this software. The simple or regular solid objects of the analyzed heritage are modeled using the simple primitives that are provided by the platform. On the other hand, the irregular shapes found from the analyzed heritage monuments are modeled in two parts. Primarily, a series of sections made on the point cloud are created to identify the profile of each object and the surfaces are subsequently converted to solid elements through NURBS, mesh, and Boolean operations (included in the GDL). The methodologies that are implemented in these approaches increases the speed of the parametric modeling of the analyzed heritage. However, they do not accurately develop the steps to segment the point clouds, generating confusion in the different conservators who try to implement this architectural modeling process. The above is also acknowledged in the article by López et al., 2017 [ 100 ], in which a three-step methodology is developed to create an H-BIM library of the Romanesque church of Santa María la Real de Mave, Palencia, Spain. The first step covers the collection of semantic and spatial information. In the second step, the obtained data are processed and organized for feeding into the BIM Autodesk Revit platform. In the third step, a design of multiple views, cuts, sections, and grids made on the point cloud are created, following the rules and the constructive patterns of the architectural period that the building belongs to. As in the previous case, the uniform and simple surfaces are modeled using the basic tools of BIM environments. On the other hand, irregular or complex surfaces are modeled in two stages. The first stage starts with the sketch of the current component profile on a 2D work plane. Subsequently, the reference planes, 2D profiles and modeling tools are integrated to create the solid elements in a 3D work environment. The H-BIM Library developed allows the maintenance, management and rehabilitation of historic buildings. In this approach, the semi-automatic implementation is time consuming and it represents a certain weakness. Such authors as Del Giudice & Osello, 2013 [ 101 ] and Biagini et al., 2016 [ 102 ], have also developed a process of virtual modeling in their methodologies based on the design of multiple sections, cuts, levels and grids made on the point cloud. However, they differ from the above-mentioned articles because they present a new approach to the temporal calculation in the Autodesk Revit platform. This approach is effective for the order and control of the architectural heritage restoration and management projects. These documents have not accurately developed the necessary steps to model and manage each parametric object, and neither have H-BIM libraries been developed, which represents a problem and a disadvantage for their implementation. There are other important works that could be mentioned in this category. Brumana et al., 2013 [ 103 ], Fai & Sydor, 2013 [ 104 ], and D’Auria et al., 2014 [ 105 ] have all used a similar workflow to link point clouds with the BIM Autodesk Revit platform. Their main topic is to define or to separate the components to be modeled, depending on their typology, hierarchy, and material. This separation Multimodal Technologies and Interact. 2018,2, 21 19 of 29 facilitates the exchange of data between the different virtual modeling software. The authors argue that the lack of flexible tools in BIM generates drawbacks for historic buildings modeling. Such authors as Ma et al., 2015 [ 106 ] Achille et al., 2015 [ 107 ], Cheng et al., 2015 [ 108 ], and Adami et al., 2016 [ 109 ], describe how the modeling of historical components with BIM platforms can help researchers to visualize a representative 3D model, so as to know the real information of each object, as well as its implementation in the maintenance, management, and restoration processes of the monument. These works have not developed a methodological process on virtual modeling, which impedes its implementation by other researchers to create effective workflows. These publications about BIM modeling for existing buildings, or about H-BIM, have shown that software tools have not yet been developed to automatically convert point clouds into BIM components. In addition, the lack of algorithms to automatically convert the complex shapes of the point clouds into BIM parametric objects is another bottleneck in the field of CH reconstruction. Another common limitation or difference in the comparison between the methodologies analyzed is that each one is often designed to highlight the innovation of a particular method over the others, in some cases, provoking gaps in the information that they want to transmit. 5.1.2. Second Category: BIM, Auxiliary Tools and OSS Methodologies Currently, BIM platforms are not able to solve all of the issues that come from the modeling management and the maintenance of the architectural heritage; therefore, the integration of other instruments or auxiliary tools is needed. In this category, a total of twelve documents have been analyzed. From the twelve documents, seven create H-BIM libraries and five do not. In turn, five papers adopted the commercial Autodesk Revit platform in combination with Rhinoceros and its plug-in Non-Uniform Rational Basis-Splines (NURBS); while, the other four adopted the same platform in combination with BIM Open Source Software (OSS), Autodesk AutoCAD, and 3DMax or Blender. On the other hand, two authors combined the commercial BIM platform, Graphisoft Archicad, with OSS, and the application-programming interface (API), while one author combined Autodesk Revit with its API programming interface. The use of external tools for the efficient and accurate modeling of the analyzed building is the differential factor between these categories. A workflow of the virtual modeling of the Four Courts in Dublin-Ireland, using the architectural historical documents, physical-constructive analysis, and point clouds, is proposed in Dore et al., 2015 [ 110 ]. Parametric objects that are created using the Graphisoft Archicad software and the GDL (3D “RULED”) function are part of an H-BIM library. This approach proposes two methodologies: The first consists of modeling the elements using the historical documents and the second is designed for the accurate and the efficient modeling of irregular elements. For the second methodology, a design of multiple sections, cuts, and levels that were made on the point cloud is created with the Graphisoft Archicad software. The sections that were made on the point cloud are diagrammed as closed, sized polygons using lines and arcs, and serve as a guide to the 3D “RULED” function to generate accurate BIM models from the point cloud. On the other hand, in Nieto et al., 2016 [ 111 ], an innovative processing, cataloging, analysis, and identification methodology of the information is proposed, which begins with the creation of a set of grids on the surface under analysis. For this reason, a set of instructions and algorithms that were written in the API of the Graphisoft Archicad software was created in Nieto et al., 2016 [112], so as to accelerate the automatic generation of the standardized vector grids. The resulting grids serve as a basis for the management, delineation, and recording of the information that can be used to develop an efficient, accurate, and parametric representation of the analyzed architectural heritage. This article is suitable for research focused on identifying and cataloging processes of elements. Other authors, such as Oreni et al., [ 112 – 114 ] and Barazzetti et al., [ 115 , 116 ], argue that BIM software presents limitations for modeling non-standard architectural objects, characteristic of architectural heritage. Therefore, the integration of the Rhinoceros software is proposed to model the architectural components of the analyzed building and to generate the H-BIM library. These authors Multimodal Technologies and Interact. 2018,2, 21 20 of 29 develop a solution that is based on performing profiles on the point cloud from the use of cuts and levels. These cuts and levels serve to interpret and to separate the different profiles extracted from the point cloud into regular or irregular surfaces. Regular surfaces are modeled with the Revit software tools and irregular ones are modeled thanks to the vector profiles that were made by NURBS curves, a number of algorithms used in the Boolean operations and the Rhinoceros software. The results that were obtained are exported to the Autodesk Revit platform to obtain parametric models that will be part of an H-BIM library. Another approach for accurately building modeling is presented in Quattrini et al., 2015 [ 117 ]. In this approach, a methodology that minimizes the number of steps and accelerates the modeling of the parametric elements through the integration of point clouds with the Autodesk Revit software is developed. In this document, point clouds are considered to be an excellent source of information, and therefore, cuts, sections, and levels are not performed on the point cloud: each component is modeled directly on the point cloud, thus maintaining the quality and accuracy of the obtained data and details. This approach classifies the point cloud into regular or irregular surfaces. Regular surfaces are modeled with the Autodesk Revit parametric element libraries and complex ones are created in Boundary Representation (B-Rep). Finally, the Open-Source plug-in Protégéis used to facilitate the integration of parametric data with each modeled element. Other works could also be mentioned in this category, such as Fregonese et al., 2015 [ 118 ] or Rodríguez-Moreno et al., 2016 [ 119 ]. In these approaches, the integration of point clouds and historical data with a series of specific software (AutoCAD, SketchUP, 3DStudio Max) and a set of Open-Source Software (OSS) (3DReshaper, BIM3DGS) are used to obtain historical virtual models. In addition, the models that were obtained are exported to the Autodesk Revit software to obtain parametric information, thus enabling the resulting model to help manage and conserve existing buildings. In addition, Fregonese et al., 2015 [ 118 ] uses the BIM3DSG software for the management and administration of the model. Another approach that describes the use of parameterization as a process for contributing to the general framework of “Smart heritage” is presented in Rua et al., 2014 [ 120 ]. A methodology is proposed consisting of five main phases: data collection, architectural study, data processing, digital modeling, and virtual modeling. Autodesk AutoCAD and ArGIS software are used to process technical and geographical data. On the other hand, Autodesk Revit tools are used to model, manipulate, and adapt families that are located in the BIM library to the project and Blender is the software used for the visualization and interaction between the virtual model and the general public. The resulting model is a database capable of being used for the management of the analyzed CH. Another author that emerges from the cultural heritage community is Garagnani, 2013 [ 121 ]. This author has developed a plug-in called GreenSpider in the Autodesk Revit software API. This plug-in is able to recognize and select the most determinant points of a point cloud and translate them to native reference points in the Revit modeling environment. In addition, GreenSpider has the ability to connect the points and interpolate the vertices through splines, in this way, allowing for explicit parametric representations of the actual captured surfaces to be generated. After its modeling, the components are fed, through IFC, with the semantic and topological metadata that was stored in a BIM file. The disadvantage of the approaches that were analyzed in this category is that the lack of intelligent algorithms capable of automatically converting point clouds into parametric objects makes the constructive process of irregular components a challenging and time-consuming process. In addition, the architectural elements are modeled on point clouds using intermediate software, which could result in information being lost when exporting the said elements, and therefore in the conception of the building’s general perspective. Multimodal Technologies and Interact. 2018,2, 21 21 of 29 5.1.3. Third Category: BIM, Auxiliary Tools, OSS and GIS Methodologies BIM platforms with geometric/semantic and GIS software are combined by five authors to create detailed historical models. All of the documents create H-BIM libraries. In addition, three documents that were adopted Autodesk Revit and Rhinoceros in combination with the GIS Autodesk InfraWorks software, while another paper adopted Autodesk Revit and Graphisoft Archicad in combination with the GIS (SIGEC and SICaR) software, and another combined Graphisoft Archicad with Sketch-up and their CityGML complement. Baik et al., [ 122 , 123 ] and Baik, 2017 [ 124 ] propose integrating point clouds, Islamic historical manuscripts, and the Hijazi architectural patterns with Autodesk Revit platform, Rhinoceros software, and the Autodesk InfraWorks GIS system, in order to achieve a detailed virtual reconstruction of the Jeddah Historic BIM (JHBIM) library. This library has been specifically designed to accelerate the modeling of Jeddah historical monuments. First, the point cloud is divided into main-parts and sub-parts. Then, the Autodesk Revit software is used to model the simple objects of the project. On the other hand, irregular surfaces are modeled using NURBS tools of Rhinoceros software. Finally, the BIM 3D model and the 3D GIS Autodesk InfraWorks system are integrated to obtain an accurate and detailed virtual model. The methodologies analyzed have some disadvantages: in particular, because the virtual modeling is a time-consuming manual process and the intervention is limited to Islamic architecture. Oreni, 2013 [ 125 ] proposes integrating metric and semantic information that was obtained from the GIS systems (SIGEC and SICaR) and point clouds, with GraphiSoft ArchiCAD and Autodesk Revit platforms, in order to create an H-BIM library that would provide the basis for the restoration, conservation and management of heritage buildings, and also to facilitate the interoperability with other interested conservators. Although GIS are today the most agile tools to collect, manipulate, and manage the different data on buildings, it should be noted that this article does not effectively develop the steps that are required to integrate GIS systems with BIM platforms, making it difficult for researchers to implement this methodology as a guide to obtain 3D virtual models. Dore & Murphy, 2012 [ 93 ] propose using the GraphiSoft ArchiCAD GDL scripting language to achieve the 3D virtual modeling of the parametric objects. Later, the objects that already exist in the internal library are combined with the modeled elements and a set structure is created that is incorporated into the design of an H-BIM library. Finally, the 3D model can be integrated into a GIS environment (ArcGIS) using Sketch-up, with its CityGML add-in. The resulting model serves as the basis for the analysis and the management of the information required for the maintenance of heritage buildings, as well as to accelerate the modeling process of other historical buildings with a similar architectural style. Although, in this category, the authors have demonstrated standardization in the performance analysis and development of the parametric elements, the ’receptor scenarios’ have shown that for our contribution, the gaps and variety of their implementation can generate disadvantages for modeling a particular building or monument. 5.1.4. Fourth Category: Methodologies without BIM Finally, BIM platforms are not used as a basis for historical heritage modeling, management, and maintenance by some authors, because they consider that the common BIM software is still unable to manage the huge quantities of data coming from laser scans or photogrammetric surveys, which makes the use of external free or open intermediate software tools (F/OSS) inevitable. In these documents, H-BIM libraries have not been developed. In this category, six documents have been analyzed; two adopted Autodesk AutoCAD software and some OSS software as auxiliary tools, while three other authors create their own tool to model the analyzed heritage. In addition, one document has adopted Rhinoceros in combination with the OSS software (BIM3DSG) and the API of the program. Fassi et al., 2015 [ 126 ] have developed a methodology for the historical 3D modeling, using the Rhinoceros NURBS in combination with an OSS (BIM3DSG) and a series of algorithms written in the Multimodal Technologies and Interact. 2018,2, 21 22 of 29 program API. In this approach, the main topic is to develop an (OSS) easy-to-use and easy-to-learn system, where 3D models can be easily visualized and manipulated using any common touch-screen device. The lack of a descriptive methodology about the use and implementation of the new system, as well as the necessity for continuous Internet connection, are the weakest points of this approach. On the other hand, Soler et al., 2017 [ 127 ], have developed software that is based on GIS systems called Agata. This software is capable of storing and managing all kinds of information associated with each modeled architectural heritage element. It uses (eXtensible Markup Language) XML as a data exchange format. In this approach, the main topic is of great interest for the implementation, but the proposed methodology does not accurately develop the operation and utilization of the new software, or their interoperability with other programs. In their article, Aguilera & Lahoz, 2010 [ 128 ] have developed a flexible and low-cost system for virtual 3D modeling of archaeological sites. In this document, triangulation algorithms that are based on the 2.5 D Delaunay Triangulation approach are used to convert the image into a polygonal mesh model and to automatically model the elements using polygonal boxes. Subsequently, the models are textured using the Z-buffer algorithm. The resulting models can be grouped and directed to the creation of prototypes to encapsulate and reuse any set of objects. The main drawback of this methodology is that it presents difficulties for the 3D modeling of irregular objects. The approach of San Jose et al., 2013 [ 129 ] develops a new software platform for the volumetric visualization of complex architectural objects and their application to the teaching, management, and conservation of architectural heritage. The proposed methodology intends to incorporate the knowledge of experts through an open-source platform that is based on GIS systems. Such authors, such as as Guidi & Russo, 2011 [ 130 ] or Micoli et al., 2013 [ 131 ], propose the integration of point clouds and historical documentation with AutoCAD 3D software and OSS tools to increase the real knowledge of a heritage building and support the historical interpretation. First, point clouds are used as a reference for CAD modeling and as a source of direct information. Later, a web application is used to allow for real-time navigation and achieve the access and management of data in a tridimensional context. The resulting model should serve as a 3D data repository. As in the previous cases, the lack of a detailed methodology to describe the modeling process of each component is a problem and a disadvantage when being used as a guide by other researchers. It is also worth noting that the use of OSS and API has grown significantly in recent years. However, there are no OSS platforms that are able to integrate all of the stages of the documentation and the modeling process of the heritage components. Another disadvantage of this category is that they fail to develop parametric models. Therefore, BIM software would be needed for the parametric modeling of the different architectural components. 6. Discussion and Conclusions In this work, a review of the documentation and accurate modeling of architectural heritage has been presented. The focus has been placed on presenting different alternatives to understand how to apply BIM platforms before starting an architectural heritage restoration project (rather than comparing the different BIM platforms). The planning and management of conservation and restoration projects could be improved by having access to the virtual model of a historical monument. 3D laser scanners and photogrammetry are used, along with historical bibliographical analysis, to capture the geometry and identity of the analyzed buildings. Unfortunately, the complexity and irregularity of the shapes characterizing historical buildings, and the lack of intelligent algorithms to fully automate the virtual modeling from point clouds, makes the constructive process of parametric components a significantly time-consuming process. However, the currently reviewed approaches demonstrate that combining BIM tools with GIS tools and auxiliary software are an effective solution for managing and modeling graphical (point clouds) and semantic (historical-constructive information) data, in a semi-automatic way. This is possible because these platforms and tools, through the common data structure IFC, allow the Multimodal Technologies and Interact. 2018,2, 21 23 of 29 interoperability of information and communication between the different actors that are involved in architectural heritage rehabilitation, reconstruction, or maintenance processes. Moreover, it is worth noting that the modeled architectural components will be part of the parametric H-BIM libraries, thanks to the proposed methodologies. The components of this H-BIM library may be adapted to other monuments belonging to the same period and architectural style, thanks to their flexibility. For this reason, the modeled components should have real information about the graphic documentation, the typology, and the main constructive characteristics of the construction period that the building belongs to. In addition, H-BIM virtual models could be used to automatically produce technical documentation that will serve to interpret the different construction elements, as well as the missing ones; these components could also be used to carry out structural, energetic, luminous, and temporal analyses. The increased use of H-BIM libraries has demonstrated their usefulness by facilitating the interdisciplinary exchange of semantic and geospatial objects/data between experts from different disciplines in the architectural heritage field. Nevertheless, the lack of international H-BIM libraries, the difference and diversity between different architectural periods, and insufficient international collaboration, have limited the potential use of H-BIM. This review has shown that there is still much to do in this domain, where more research and development should be done to address the ongoing progress of BIM platforms and their relationship to architectural heritage. Future research could focus, for example, on the development of useful plug-ins for creating different kinds of element arrays. To do this, either the corresponding software development kits (SDK) could be used to program the BIM API directly, or tools (such as Dynamo ® Autodesk open source software) that facilitate these process could be used, thus expanding the digital world where researchers or experts in the AEC context can interact concerning architectural heritage anytime, anywhere, and with any device. In addition, other realistic approaches to the future of architectural heritage would be the need to create shape recognition algorithms to automate the parametric reconstruction of entire buildings, directly from the use of point clouds and to avoid routine tasks that are often time-consuming processes. In this context, another important aspect would be the need to create a universal and free-access H-BIM library containing all the information that is useful for architects, designers, archaeologists, historians, engineers, and conservators of architectural heritage. Author Contributions: F.J.L. is the main contributor of the paper. He has collected information and has focused on the study and analysis of the different BIM and H-BIM approaches, drafting the paper. P.M.L. and J.L. have contributed to the study and analysis of the data capture and processing methodology. Finally, J.G.-G.-B. and E.Z. are the scientific directors of the work. They have leaded the research, they have made the conception and design of the work, and have made the critical revision of the paper, contributing to the analysis and discussion of the results. Acknowledgments: The authors acknowledge the “Heritage and Restoration” S.L.U. (Palencia, Spain) for its advice and support. This review has received funding from the EU’s H2020 Reflective framework program for research and innovation under grant agreement no. 665220.This work was also supported by the Ministry of Science and Innovation, fundamental research project ref. DPI2014-56500-R, and the Junta de Castilla y León ref. VA036U14. Conflicts of Interest: The authors declare no conflict of interest. The founding sponsors had no role in the design of the study; in the collection, analyses, or interpretation of data; in the writing of the manuscript, or in the decision to publish the results. References 1. Vecco, M. A definition of cultural heritage: From the tangible to the intangible. J. Cult. Heritage 2010 ,11, 321–324. [CrossRef] 2. Simeone, D.; Cursi, S.; Toldo, I.; Carrara, G. BIM and knowledge management for building heritage. In Proceedings of the 34th Annual Conference of the Association for Computer Aided Design in Architecture, Los Angeles, CA, USA, 23–25 October 2014. Multimodal Technologies and Interact. 2018,2, 21 24 of 29 3. Penttilä, H.; Rajala, M.; Freese, S. Building information modelling of modern historic buildings. In Proceedings of the 25th eCAADe Conference on Predicting the Future, Frankfurt am Main, Germany, 26–29 September 2007. 4. Tomaževiˇc, M.; Lutman, M. Heritage masonry buildings in urban settlements and the requirements of Eurocodes: Experience of Slovenia. Int. J. Archit. Heritage 2007,1, 108–130. [CrossRef] 5. Gursel, I.; Sariyildiz, S.; Akin, Ö.; Stouffs, R. Modeling and visualization of lifecycle building performance assessment. Adv. Eng. Inform. 2009,23, 396–417. [CrossRef] 6. Letellier, R.; Eppich, R. (Eds.) Recording, Documentation and Information Management for the Conservation of Heritage Places; Routledge: Abingdon, UK, 2015. 7. Johansson, M.; Roupé, M.; Bosch-Sijtsema, P. Real-time visualization of building information models (BIM). Autom. Constr. 2015,54, 69–82. [CrossRef] 8. Acierno, M.; Cursi, S.; Simeone, D.; Fiorani, D. Architectural heritage knowledge modelling: An ontology-based framework for conservation process. J. Cult. Heritage 2017,24, 124–133. [CrossRef] 9. Gómez-García-Bermejo, J.; Zalama, E.; Feliz, R. Automated registration of 3D scans using geometric features and normalized color data. Comput.-Aided Civ. Infrastruct. Eng. 2013,28, 98–111. [CrossRef] 10. Lerones, P.M.; Vélez, D.O.; Rojo, F.G.; Gómez-García-Bermejo, J.; Casanova, E.Z. Moisture detection in heritage buildings by 3D laser scanning. Stud. Conserv. 2016,61 (Suppl. 1), 46–54. [CrossRef] 11. Akbarnezhad, A.; Ong, K.C.G.; Chandra, L.R. Economic and environmental assessment of deconstruction strategies using building information modeling. Autom. Constr. 2014,37, 131–144. [CrossRef] 12. eBIM. Heritage BIM—eBIM [WWW Document]. 2015. Available online: http://ebim.co.uk/heritage-bim/ (accessed on 25 October 2016). 13. Bryde, D.; Broquetas, M.; Volm, J.M. The project benefits of building information modelling (BIM). Int. J. Proj. Manag. 2013,31, 971–980. [CrossRef] 14. Gray, M.; Gray, J.; Teo, M.; Chi, S.; Cheung, Y.K.F. Building information modelling: An international survey. In Proceedings of the World Building Congress, Brisbane, Queensland, 5–9 May 2013. 15. Murphy, M.; McGovern, E.; Pavia, S. Historic building information modelling (HBIM). Struct. Surv. 2009 ,27, 311–327. [CrossRef] 16. Volk, R.; Stengel, J.; Schultmann, F. Building information modeling (BIM) for existing buildings—Literature review and future needs. Autom. Constr. 2014,38, 109–127. [CrossRef] 17. McArthur, J.J. A building information management (BIM) framework and supporting case study for existing building operations, maintenance and sustainability. Procedia Eng. 2015,118, 1104–1111. [CrossRef] 18. Arayici, Y.; Counsell, J.; Mahdjoubi, L.; Nagy, G.A.; Dweidar, K.; Hawas, S. (Eds.) Heritage Building Information Modelling; Taylor & Francis: Abingdon, UK, 2017. 19. ISO Standard. ISO 16739:2013 Industry Foundation Classes (IFC) for Data Sharing in the Construction and Facility Management Industries. International Standard. 2013. Available online: https://www.iso.org/ standard/51622.html (accessed on 10 February 2018). 20. BuildingSMART International. IFC Overview Summary. 2012. Available online: http://www.buildingsmarttech.org/specifications/ifc-overview/ifc-overview-summary (accessed on 19 April 2018). 21. Eastman, C.M.; Teicholz, P.; Sacks, R.; Liston, K. BIM Handbook: A Guide to Building Information Modeling for Owners, Managers, Designers, Engineers and Contractors, 2nd ed.; John Wiley and Sons: Hoboken, NJ, USA, 2011. 22. Ochmann, S.; Vock, R.; Wessel, R.; Leander Evers, H.; Nergård, H.; Törlind, P. Documenting the Changing State of Built Architecture—Software Prototype v1; Durable Architectural Knowledge (DURAARK), 2014; pp. 20–23. Available online: http://duraark.eu/wp-content/uploads/2014/02/duraark_d4.4.1_final.pdf (accessed on 21 November 2016). 23. Akcamete, A.; Akinci, B.; Garrett, J.H. Potential utilization of building information models for planning maintenance activities. In Proceedings of the international Conference on Computing in Civil and Building Engineering, Nottingham, UK, 30 June–2 July 2010; pp. 151–158. 24. Cheng, J.C.P.; Ma, L.Y. A BIM-based system for demolition and renovation waste quantification and planning. In Proceedings of the 14th International Conference on Computing in Civil and Building Engineering (ICCCBE 2012), Moscow, Russia, 27–29 June 2012. 25. Wong, J.K.W.; Zhou, J. Enhancing environmental sustainability over building life cycles through green BIM: A review. Autom. Constr. 2015,57, 156–165. [CrossRef] Multimodal Technologies and Interact. 2018,2, 21 25 of 29 26. Heradio, R.; Perez-Morago, H.; Fernandez-Amoros, D.; Cabrerizo, F.J.; Herrera-Viedma, E. A bibliometric analysis of 20 years of research on software product lines. Inf. Softw. Technol. 2016,72, 1–15. [CrossRef] 27. Bruno, S.; De Fino, M.; Fatiguso, F. Historic Building Information Modelling: Performance assessment for diagnosis-aided information modelling and management. Autom. Constr. 2018,86, 256–276. [CrossRef] 28. El-Hakim, S.; Gonzo, L.; Voltolini, F.; Girardi, S.; Rrizzi, A.; Remondino, F.; Whiting, E. Detailed 3D Modelling of Castles. Int. J. Archit. Comput. 2007,5, 200–220. 29. Grussenmeyer, P.; Landes, T.; Voegtle, T.; Ringle, K. Comparison methods of terrestrial laser scanning, photogrammetry and tacheommetry data for recording of cultural heritage buildings. In Proceedings of the International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, Beijing, China, 3–11 July 2008; pp. 213–218. 30. Furukawa, Y.; Curless, B.; Seitz, S.M.; Szeliski, R. Reconstructing building interiors from images. In Proceedings of the IEEE 12th International Conference on Computer Vision, Kyoto, Japan, 29 September–2 October 2009; pp. 80–87. 31. Klein, L.; Li, N.; Becerik-Gerber, B. Imaged-based verification of as-built documentation of operational buildings. Autom. Constr. 2012,21, 161–171. [CrossRef] 32. Aicardi, I.; Chiabrando, F.; Lingua, A.M.; Noardo, F. Recent trends in cultural heritage 3D survey: The photogrammetric computer vision approach. J. Cult. Heritage 2018. [CrossRef] 33. Shishido, H.; Ito, Y.; Kawamura, Y.; Matsui, T.; Morishima, A.; Kitahara, I. Proactive preservation of world heritage by crowdsourcing and 3D reconstruction technology. In Proceedings of the 2017 IEEE International Conference on Big Data, Boston, MA, USA, 11–14 December 2017; p. 4426. 34. Tapponi, O.; Kassem, M.; Kelly, G.; Dawood, N.; White, B. Renovation of Heritage Assets using BIM: A Case Study of the Durham Cathedral. In Proceedings of the 32nd CIB W78 Conference, Eindhoven, The Netherlands, 27–29 October 2015. 35. Martín Lerones, P.; Llamas Fernández, J.; Melero Gil, A.; Gómez García-Bermejo, J.; Zalama Casanova, E. A Practical Approach to Making Accurate 3D Layouts of Interesting Cultural Heritage Sites through Digital Models. J. Cult. Heritage 2010,11, 1–9. [CrossRef] 36. Dore, C.; Murphy, M. Current State of the Art Historic Building Information Modelling. Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci. 2017,42, 185–192. [CrossRef] 37. Alsadik, B.; Gerke, M.; Vosselman, G. Automated camera network design for of cultural heritage objects. J. Cult. Heritage 2013,14, 515–526. [CrossRef] 38. Golparvar-Fard, M.; Bohn, J.; Teizer, J.; Savarese, S.; Peña-Mora, F. Evaluation of image-based modeling and laser scanning accuracy for emerging automated performance monitoring techniques. Autom. Constr. 2011, 20, 1143–1155. [CrossRef] 39. Baselga, S.; Garrigues, P.; Berné, J.L.; Anquela, A.B.; Martín, A. Deformation monitoring in historic buildings: A case study. Surv. Rev. 2011,43, 484–492. [CrossRef] 40. Mahdjoubi, L.; Moobela, C.; Laing, R. Providing real-estate services through the integration of 3D laser scanning and building information modelling. Comput. Ind. 2013,64, 1272–1281. [CrossRef] 41. Mukupa, W.; Roberts, G.W.; Hancock, C.M.; Al-Manasir, K. A review of the use of terrestrial laser scanning application for change detection and deformation monitoring of structures. Surv. Rev. 2017 ,49, 99–116. [CrossRef] 42. Besl, P.J.; McKay, N.D. A method for registration of 3-D shapes. IEEE Trans. Pattern Anal. Mach. Intell. 1992 , 14, 239–256. [CrossRef] 43. Innovmetric. PolyWorks Modeler TM. Available online: https://www.innovmetric.com/en/products/ polyworks-modeler (accessed on 19 April 2018). 44. Remondino, F.; El-Hakim, S.F. Image-Based 3D Modelling: A Review. Photogramm. Rec. J. 2006 ,21, 269–291. [CrossRef] 45. Cera, V.; Campi, M. Evaluating the Potential of Imaging Rover for Automatic Point Cloud Generation. Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci. 2017,XLII-2/W, 147–154. [CrossRef] 46. Pritchard, D.; Sperner, J.; Hoepner, S.; Tenschert, R. Terrestrial laser scanning for heritage conservation: The Cologne Cathedral documentation project. ISPRS Ann. Photogramm. Remote Sens. Spat. Inf. Sci. 2017,4, 213–220. [CrossRef] 47. Guidi, G.; Russo, M.; Angheleddu, D. 3D survey and virtual reconstruction of archeological sites. Digit. Appl. Archaeol. Cult. Heritage 2014,1, 55–69. [CrossRef]