Electricity Demand Prediction by a Transformer-Based Model

  • Ahmed Mohammed Mahmood
  • Musaddak Maher Abdul Zahra
  • Waleed Hamed
  • Bashar S. Bashar
  • Alaa Hussein Abdulaal
  • Taif Alawsi
  • Ali Hussein Adhab
Keywords: power consumption, self-attention, machine learning, Electricity demand


The frighteningly high levels of power consumption at present are caused mainly by the expanding global population and the accessibility of energy-hungry smart technologies. So far, various simulation tools, engineering- and AI-based methodologies have been utilized to anticipate power consumption effectively. While engineering approaches forecast using dynamic equations, AI-based methods forecast using historical data. The modeling of nonlinear electrical demand patterns is still lacking for durable solutions, however, as the available approaches are only effective for resolving transient dependencies. Furthermore, because they are only based on historical data, the current methodologies are static in nature. In this research, we present a system based on deep learning to anticipate power consumption while accounting for long-term historical relationships. In our approach, a transformer-based model is used for the prediction of electricity demand on data collected from the regional facilities in Iraq. According to the conducted experiments, our approach claims competitive performance, achieving an error rate of 2.0 in predicting 1-day-ahead of electricity demand in the test samples.


[1] Saoud, Lyes Saad, Hasan Al-Marzouqi, and Ramy Hussein. "Household Energy Consumption Prediction Using the Stationary Wavelet Transform and Transformers." IEEE Access vol. 10, pp. 5171-5183, 2022.
[2] Sun, Lisha, and David Lubkeman. "Agent-based modeling of feeder-level electric vehicle diffusion for distribution planning." IEEE Transactions on Smart Grid, vol. 12, no. 1, pp. 751-760, 2020.
[3] L’Heureux, Alexandra, Katarina Grolinger, and Miriam AM Capretz. "Transformer-Based Model for Electrical Load Forecasting." Energies, vol. 15, no. 14, p. 4993, 2022.
[4] Al-Bahrani, Loau Tawfak, Mehdi Seyedmahmoudian, Ben Horan, and Alex Stojcevski. "Distribution transformer load behavior, burden, and characteristics of residential consumers: A case study of Baghdad City." Energy and buildings, vol. 210, p. 109693, 2020.
[5] Dong, Ming. "A data-driven long-term dynamic rating estimating method for power transformers." IEEE Transactions on Power Delivery, vol. 36, no. 2, pp. 686-697, 2020.
[6] Nourani, Vahid, Zahra Razzaghzadeh, Aida Hosseini Baghanam, and Amir Molajou. "ANN-based statistical downscaling of climatic parameters using decision tree predictor screening method." Theoretical and Applied Climatology, vol. 137, no. 3, pp. 1729-1746, 2019.
[7] Johannesen, Nils Jakob, Mohan Kolhe, and Morten Goodwin. "Relative evaluation of regression tools for urban area electrical energy demand forecasting." Journal of cleaner production, vol. 218, pp. 555-564, 2019.
[8] Hong, Shin-Ki, Sung Gu Lee, and Myungchin Kim. "Assessment and mitigation of electric vehicle charging demand impact to transformer aging for an apartment complex." Energies, vol. 13, no. 10, p. 2571, 2020.
[9] Cao, Jianwen, Bizhong Xia, and Jie Zhou. "An Active Equalization Method for Lithium-ion Batteries Based on Flyback Transformer and Variable Step Size Generalized Predictive Control." Energies, vol. 14, no. 1, p. 207, 2021.
[10] Gjelaj, Marjan, Nataly Bañol Arias, Chresten Traeholt, and Seyedmostafa Hashemi. "Multifunctional applications of batteries within fast‐charging stations based on EV demand‐prediction of the users’ behaviour." The Journal of Engineering vol. 2019, no. 18, pp. 4869-4873, 2019.
[11] Gao, Yuan, and Yingjun Ruan. "Interpretable deep learning model for building energy consumption prediction based on attention mechanism." Energy and Buildings, vol. 252, p. 111379, 2021.
[12] Pradhan, Pravakar, Iftekhar Ahmad, Daryoush Habibi, Ganesh Kothapalli, and Mohammad AS Masoum. "Reducing the impacts of electric vehicle charging on power distribution transformers." IEEE Access, vol. 8, pp. 210183-210193, 2020.
[13] Pouladi, Parsa, Abbas Afshar, Mohammad Hadi Afshar, Amir Molajou, and Hamid Farahmand. "Agent-based socio-hydrological modeling for restoration of Urmia Lake: Application of theory of planned behavior." Journal of hydrology, vol. 576, pp. 736-748, 2019.
[14] Van den Berg, M. A., I. Lampropoulos, and T. A. AlSkaif. "Impact of electric vehicles charging demand on distribution transformers in an office area and determination of flexibility potential." Sustainable Energy, Grids and Networks, vol. 26, pp. 100452, 2021.
[15] Tang, Binh, and David S. Matteson. "Probabilistic transformer for time series analysis." Advances in Neural Information Processing Systems, vol. 34, pp. 23592-23608, 2021.
[16] Lahooti Eshkevari, Alireza, Ali Mosallanejad, and Mohammadsadegh Sepasian. "In‐depth study of the application of solid‐state transformer in design of high‐power electric vehicle charging stations." IET Electrical Systems in Transportation, vol. 10, no. 3, pp. 310-319, 2020.
[17] Pradhan, Pravakar, Iftekhar Ahmad, Daryoush Habibi, Ganesh Kothapalli, and Mohammad AS Masoum. "Reducing the impacts of electric vehicle charging on power distribution transformers." IEEE Access, vol. 8, pp. 210183-210193, 2020.
[18] Tziovani, Lysandros, Lenos Hadjidemetriou, Charalampos Charalampous, Maria Tziakouri, Stelios Timotheou, and Elias Kyriakides. "Energy management and control of a flywheel storage system for peak shaving applications." IEEE Transactions on Smart Grid, vol. 12, no. 5, pp. 4195-4207, 2021.
[19] Ha, Sooji, Daniel J. Marchetto, Sameer Dharur, and Omar I. Asensio. "Topic classification of electric vehicle consumer experiences with transformer-based deep learning." Patterns, vol. 2, no. 2, p. 100195, 2021.
[20] Wu, Binrong, Lin Wang, and Yu-Rong Zeng. "Interpretable wind speed prediction with multivariate time series and temporal fusion transformers." Energy, vol. 252, p. 123990, 2022.
[21] Rocha, Oscar David Ariza, Kateryna Morozovska, Tor Laneryd, Ola Ivarsson, Claes Ahlrot, and Patrik Hilber. "Dynamic rating assists cost-effective expansion of wind farms by utilizing the hidden capacity of transformers." International Journal of Electrical Power & Energy Systems, vol. 123, p. 106188, 2020.
[22] Zhou, Feng, Peng Zhao, Min Lei, Changxi Yue, Jicheng Yu, and Siyuan Liang. "Capacitive voltage transformer measurement error prediction by improved long short-term memory neural network." Energy Report, vol. 8, pp. 1011-1021, 2022.
[23] Baroni, Bruno R., Wadaed Uturbey, André MG Costa, and Samuel P. Rocha. "Impact of photovoltaic generation on the allowed revenue of the utilities considering the lifespan of transformers: A Brazilian case study." Electric Power Systems Research, vol. 192, p. 106906, 2021.
[24] Brinkel, N. B. G., W. L. Schram, T. A. AlSkaif, I. Lampropoulos, and W. G. J. H. M. Van Sark. "Should we reinforce the grid? Cost and emission optimization of electric vehicle charging under different transformer limits." Applied Energy, vol. 276 , p. 115285, 2020.
[25] Choi, Eunjeong, Soohwan Cho, and Dong Keun Kim. "Power demand forecasting using long short-term memory (LSTM) deep-learning model for monitoring energy sustainability." Sustainability, vol. 12, no. 3, p. 1109, 2020.
[26] Zweistra, Marisca, Stan Janssen, and Frank Geerts. "Large scale smart charging of electric vehicles in practice." Energies, vol. 13, no. 2, p. 298, 2020.
[27] Wörner, Ralf, Inna Morozova, Danting Cao, Daniela Schneider, Martin Neuburger, Daniel Mayer, Christian Körner et al. "Analysis and prediction of electromobility and energy supply by the example of Stuttgart." World Electric Vehicle Journal, vol. 12, no. 2, p. 78, 2021.
Yan, Chun, Meixuan Li, and Wei Liu. "Transformer fault diagnosis based on BP-Adaboost and PNN series connection." Mathematical Problems in Engineering, vol. 10, no. 3, pp. 310-319, 2020.
[28] Jiang, Weiwei. "Deep learning based short‐term load forecasting incorporating calendar and weather information." Internet Technology Letters, vol. 5, no. 4, p. 383, 2022.
[29] Gómez, Andrea Molina, Kateryna Morozovska, Tor Laneryd, and Patrik Hilber. "Optimal sizing of the wind farm and wind farm transformer using MILP and dynamic transformer rating." International Journal of Electrical Power & Energy Systems, vol. 136 , p. 107645, 2022.
[30] Rodriguez-Rivero, Jacob, Javier Ramirez, Francisco Jesús Martínez-Murcia, Fermín Segovia, Andrés Ortiz, D. Salas, Diego Castillo-Barnes et al. "Granger causality-based information fusion applied to electrical measurements from power transformers." Information Fusion, vol. 57, pp. 59-70, 2020.
[31] Rutskov, Alexey L., Viktor L. Burkovsky, and Evgeny V. Sidorenko. "Optimization of electric power systems using fuzzy neural network algorithms." Journal of mechanics of continua and mathematical sciences, vol. 1, p. 264, 2020.
[32] Haupt, Sue Ellen, Mayte Garcia Casado, Michael Davidson, Jan Dobschinski, Pengwei Du, Matthias Lange, Timothy Miller et al. "The use of probabilistic forecasts: Applying them in theory and practice." IEEE Power and Energy Magazine, vol. 17, no. 6, pp. 46-57, 2019.
How to Cite
Mahmood, A. M., Abdul Zahra, M. M., Hamed, W., Bashar, B. S., Abdulaal, A. H., Alawsi, T., & Adhab, A. H. (2022). Electricity Demand Prediction by a Transformer-Based Model. Majlesi Journal of Electrical Engineering. Retrieved from http://mjee.iaumajlesi.ac.ir/index/index.php/ee/article/view/4883

Most read articles by the same author(s)