Skip to main content
Log in

Photogrammetry and deep learning for energy production prediction and building-integrated photovoltaics decarbonization

  • Cover Article
  • Building Systems and Components
  • Published:
Building Simulation Aims and scope Submit manuscript

Abstract

Building-Integrated photovoltaics (BIPV) have emerged as a promising sustainable energy solution, relying on accurate energy production predictions and effective decarbonization strategies for efficient deployment. This paper presents a novel approach that combines photogrammetry and deep learning techniques to address the problem of BIPV decarbonization. The method is called BIM-AITIZATION referring to the integration of BIM data, AI techniques, and automation principles. It integrates photogrammetric data into practical BIM parameters. In addition, it enhances the precision and reliability of PV energy prediction by using artificial intelligence strategies. The primary aim of this approach is to offer advanced, data-driven energy forecasts and BIPV decarbonization while fully automating the underlying process. To achieve this, the first step is to capture point cloud data of the building through photogrammetric acquisition. This data undergoes preprocessing to identify and remove unwanted points, followed by plan segmentation to extract the plan facade. After that, a meteorological dataset is assembled, incorporating various attributes that influence energy production, including solar irradiance parameters as well as BIM parameters. Finally, machine and deep learning techniques are used for accurate photovoltaic energy predictions and the automation of the entire process. Extensive experiments are conducted, including multiple tests aimed at assessing the performance of diverse machine learning models. The objective is to identify the most suitable model for our specific application. Furthermore, a comparative analysis is undertaken, comparing the performance of the proposed model against that of various established BIPV software tools. The outcomes reveal that the proposed approach surpasses existing software solutions in both accuracy and precision. To extend its applicability, the approach is evaluated using a building case study, demonstrating its ability to generalize effectively to new building data.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

Abbreviations

AI:

artificial intelligence

ANN:

artificial neural network

BHI:

beam irradiation on horizontal plane at ground level (Wh/m2)

BIM SurfaceSUD Facade:

surface of the south facade (m2)

BIM X:

X coordinate (m)

BIM Y:

Y coordinate (m)

BIM Z:

Z coordinate (m)

CAMS:

Copernicus Atmosphere Monitoring Service

CNN:

convolutional neural network

DHI:

diffused horizontal irradiance (Wh/m2)

DNI:

diffused normal irradiance (Wh/m2)

EV:

explained variance

GHI:

global horizontal irradiance (Wh/m2)

KNN:

K-nearest neighbors

LaGC:

latitude, longitude, altitude geographical coordinates (DMS)

LR:

linear regression

MLESAC:

Maximum Likelihood Estimation SAmple Consensus

MSE:

mean squared error

NSRD:

National Solar Radiation Database

P :

pressure (mbar)

PV-24H:

pressure variation in 24 hours (mbar)

PVGIS:

photovoltaic geographic information system

PW:

precipitate water (cm)

RANSAC:

RANdom SAmple Consensus

ReLU:

rectified linear units

RF:

random forest

RH:

relative humidity (%)

SIM:

sunshine irradiance measured (kWh/m2)

SVR:

support vector regression

SZA:

solar zenith angle (degree)

T :

external air temperature (°C)

TOA:

irradiation on horizontal plane at the top of atmosphere (Wh/m2)

WD:

wind direction (degree)

References

  • Ahmed R, Sreeram V, Mishra Y, et al. (2020). A review and evaluation of the state-of-the-art in PV solar power forecasting: Techniques and optimization. Renewable and Sustainable Energy Reviews, 124: 109792.

    Article  Google Scholar 

  • Amini Toosi H, Lavagna M, Leonforte F, et al. (2022). Building decarbonization: Assessing the potential of building-integrated photovoltaics and thermal energy storage systems. Energy Reports, 8: 574–581.

    Article  Google Scholar 

  • Axaopoulos PJ, Fylladitakis ED, Gkarakis K (2014). Accuracy analysis of software for the estimation and planning of photovoltaic installations. International Journal of Energy and Environmental Engineering, 5: 1–8.

    Article  Google Scholar 

  • Byrne J, Taminiau J, Kurdgelashvili L, et al. (2015). A review of the solar city concept and methods to assess rooftop solar electric potential, with an illustrative application to the city of Seoul. Renewable and Sustainable Energy Reviews, 41: 830–844.

    Article  Google Scholar 

  • de Winter JCF, Gosling SD, Potter J (2016). Comparing the Pearson and Spearman correlation coefficients across distributions and sample sizes: A tutorial using simulations and empirical data. Psychological Methods, 21: 273–290.

    Article  Google Scholar 

  • Dourhmi M, Benlamine K, Abouelaziz I, et al. (2023). Improved hourly prediction of BIPV photovoltaic power building using artificial learning machine: A case study. In: Ben Ahmed M, Abdelhakim BA, Ane BK, Rosiyadi D (eds), Emerging Trends in Intelligent Systems & Network Security. Cham, Switzerland: Springer.

    Google Scholar 

  • Fathi S, Srinivasan R, Fenner A, et al. (2020). Machine learning applications in urban building energy performance forecasting: A systematic review. Renewable and Sustainable Energy Reviews, 133: 110287.

    Article  Google Scholar 

  • Fischler MA, Bolles RC (1981). Random sample consensus. Communications of the ACM, 24: 381–395.

    Article  MathSciNet  Google Scholar 

  • Fuentes JE, Moya FD, Montoya OD (2020). Method for estimating solar energy potential based on photogrammetry from unmanned aerial vehicles. Electronics, 9: 2144.

    Article  Google Scholar 

  • González-Peña D, García-Ruiz I, Díez-Mediavilla M, et al. (2021). Photovoltaic prediction software: evaluation with real data from northern Spain. Applied Sciences, 11: 5025.

    Article  Google Scholar 

  • He Z, Zhao C, Huang Y (2022). Multivariate time series deep spatiotemporal forecasting with graph neural network. Applied Sciences, 12: 5731.

    Article  Google Scholar 

  • IEA (2023). Tracking Clean Energy Progress 2023. Paris: International Energy Agency.

    Google Scholar 

  • Ike S, Kurokawa K (2005). Photogrammetric estimation of shading impacts on photovoltaic systems. In: Proceedings of Conference Record of the 31st IEEE Photovoltaic Specialists Conference, Lake Buena Vista, FL, USA.

  • Li W, Samuelson H (2020). A new method for visualizing and evaluating views in architectural design. Developments in the Built Environment, 1: 100005.

    Article  Google Scholar 

  • Li F, Liu J, Li W, et al. (2022). Potential assessment of rooftop photovoltaic power generation in wide areas. In: Proceedings of the 17th Annual Conference of China Electrotechnical Society.

  • Liu Z, Sun Y, Xing C, et al. (2022). Artificial intelligence powered large-scale renewable integrations in multi-energy systems for carbon neutrality transition: Challenges and future perspectives. Energy and AI, 10: 100195.

    Article  Google Scholar 

  • Markovics D, Mayer MJ (2022). Comparison of machine learning methods for photovoltaic power forecasting based on numerical weather prediction. Renewable and Sustainable Energy Reviews, 161: 112364.

    Article  Google Scholar 

  • Météo-France (2023). Observation data from major weather stations 2013–2023. Available at https://www.data.gouv.fr/fr/datasets/

  • Nair V, Hinton GE (2010). Rectified linear units improve restricted boltzmann machines. In: Proceedings of the 27th International Conference on International Conference on Machine Learning, Haifa, Israel.

  • Pan Y, Zhu M, Lv Y, et al. (2023). Building energy simulation and its application for building performance optimization: A review of methods, tools, and case studies. Advances in Applied Energy, 10: 100135.

    Article  Google Scholar 

  • Savvides A, Vassiliades C, Michael A, et al. (2019). Siting and building-massing considerations for the urban integration of active solar energy systems. Renewable Energy, 135: 963–974.

    Article  Google Scholar 

  • Soubki A, Fekri A, Maimouni S (2020). Forecasting solar energy in a complex urban environment Case study: Casablanca, Morocco. In: Proceedings of 2020 IEEE International conference of Moroccan Geomatics (Morgeo).

  • Szabó S, Enyedi P, Horváth M, et al. (2016). Automated registration of potential locations for solar energy production with Light Detection And Ranging (LiDAR) and small format photogrammetry. Journal of Cleaner Production, 112: 3820–3829.

    Article  Google Scholar 

  • Tien PW, Wei S, Darkwa J, et al. (2022). Machine learning and deep learning methods for enhancing building energy efficiency and indoor environmental quality—A review. Energy and AI, 10: 100198.

    Article  Google Scholar 

  • Torr PHS, Zisserman A (2000). MLESAC: A new robust estimator with application to estimating image geometry. Computer Vision and Image Understanding, 78: 138–156.

    Article  Google Scholar 

  • Vahdatikhaki F, Salimzadeh N, Hammad A (2022). Optimization of PV modules layout on high-rise building skins using a BIM-based generative design approach. Energy and Buildings, 258: 111787.

    Article  Google Scholar 

  • Valencia-Solares ME, Gijón-Rivera M, Rivera-Solorio CI (2023). Energy, economic, and environmental assessment of the integration of phase change materials and hybrid concentrated photovoltaic thermal collectors for reduced energy consumption of a school sports center. Energy and Buildings, 293: 113198.

    Article  Google Scholar 

  • Vassiliades C, Michael A, Savvides A, et al. (2017). Environmental assessment of the integration of active solar energy systems on building envelopes in southern Europe. In: Proceedings of International Conference on Sustainable Energy and Environmental Protection.

  • Zazoum B (2022). Solar photovoltaic power prediction using different machine learning methods. Energy Reports, 8: 19–25.

    Article  Google Scholar 

  • Zefri Y, ElKettani A, Sebari I, et al. (2018). Thermal infrared and visual inspection of photovoltaic installations by UAV photogrammetry—Application case: Morocco. Drones, 2: 41.

    Article  Google Scholar 

  • Zhang Q, Huang Y, Chng CB, et al. (2023). Investigations on machine learning-based control-oriented modeling using historical thermal data of buildings. Building and Environment, 243: 110595.

    Article  Google Scholar 

Download references

Acknowledgements

This work was supported by CESI EST and the GRAND EST region. The authors are very grateful to Mourad ZGHAL for fruitful discussions and Benoit DESTENAY (Teacher & responsible in charge of education at CESI school of engineering), Pierre BALLESTER, Cemal OCAKTAN, Oussama OUSSOUS and SOW Mame-Cheikh for technical assistance. The authors are grateful to GBAGUIDI HAORE Sevi (Teacher & responsible in charge of education at CESI school of engineering) and energy expert for his excellent technical support on the subject of the energy decarbonization of buildings. We would like to thank Ophéa-Eurométropole Habitat Strasbourg for allowing us to have the energy production data for these buildings.

Author information

Authors and Affiliations

Authors

Contributions

All authors contributed to the study conception and design. Material preparation, data collection and analysis were performed by Ilyass Abouelaziz and Youssef Jouane. The first draft of the manuscript was written by Youssef Jouane and all authors commented on previous versions of the manuscript. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Youssef Jouane.

Ethics declarations

The authors have no competing interests to declare that are relevant to the content of this article.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Abouelaziz, I., Jouane, Y. Photogrammetry and deep learning for energy production prediction and building-integrated photovoltaics decarbonization. Build. Simul. 17, 189–205 (2024). https://doi.org/10.1007/s12273-023-1089-y

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12273-023-1089-y

Keywords

Navigation