1. Introduction
One of the options to support the development of a cleaner and more sustainable world is to reduce polluting gases such as
that are emitted into the atmosphere. This gas strongly contributes to pollution that causes climate change, environmental crises, and global crises, causing great global concern [
1].
The transportation sector is associated with a country’s economic base, where they are responsible and contributors to
[
2] emissions. Allied to this, the current scenario of combustion transportation has been proliferating, increasing its contribution to climate change and energy crises [
3].
The focus is on more significant global incentives for policies that accelerate the adoption of electric vehicles (EVs) and reduce and encourage transport decarbonization [
4].
These new additions to EVs will cause a growing increase in power demand in distribution networks caused by the high and constant need to connect and charge their batteries. It is understood that this increase could generate serious problems for the electrical system [
5] since batteries require high load demands during charging, meaning that the current electrical grid is not capable, in some cases, of meeting the required demand [
6].
These new EV connections pose a significant challenge to the electrical power system, as EVs can be charged in private homes, buildings, companies, and private and public charging stations [
7].
In this context, ensuring projections and forecasts of electrical loads in the short term has become a timely and relevant topic for concessionaires, the electrical energy market, and academic research. Load forecasting is not easy, as loads correlate not only between hours, days, weeks, or months but also with human behavior and exogenous variables, such as humidity, temperature, and seasons [
8].
Introducing Artificial Neural Networks (ANNs) means that electrical charge prediction problems can be solved more efficiently and accurately, as this technique learns from past data, saving certain information for later use [
9], which has motivated us to use an ANN model in this research. Learning models with ANNs are currently widely used in this topic in charging demand forecasting and simultaneous VES charging problems, among others.
The present work aims to apply ANN based on the multilayer feedforward perceptron (MLP) [
10] architecture using hybrid supervised training backpropagation with Bayesian regularization [
11] to forecast the total demand generated by charging EVs plugged into homes. Forecasts were made for the next 24 hours of total aggregate demand in each year’s season for comparative purposes.
2. Uncoordinated Residential EV Charging and Impacts
In uncoordinated residential charging, EVs begin charging instantly when plugged into an outlet, and charging can happen at any time, 24 hours a day. These loads have a highly random profile and behavior. Currently, the electricity sector does not recommend it. It does not have much incentive for this type of charging, as they do not present the necessary usage information for scheduled or delayed managed charging, ensuring the optimization of EV charges. By delaying the start of charging, EVs are charged at off-peak times [
17].
This charging does not present information on energy prices and is without any control or strategy. EV users can plug and unplug at any time or even charge the battery altogether [
12].
The high integration of EVs into the electrical power system will present challenges due to the uncoordinated increase in EV connections in homes, particularly to the distribution system. These loads from residential charging combined with EVs can lead to a significant peak increase, creating a lack of power, grid congestion, voltage and frequency instability, and electrical component failures [
13].
Specifically, in this scenario, EV loads require a high connection for an extended period, coinciding with peak residential demand. As the current system is not designed for high EV penetration rates, the high rate of uncoordinated EV charging may negatively impact the electrical power system’s distribution, generation, and transmission infrastructure [
14,
15].
Generally, energy utilities represent demands through customer profiles for each behavior, using load curves over time [
17]. Each curve is represented by a different profile, which can be public, residential, commercial, or industrial [
16].
The impacts generated by EVs are significant due to the high power required in aggregate charging and the mass implementation of EVs that the electric mobility sector is going through [
18]. The charging of Plugable Electric Vehicles VEPs and Plugable Hybrid Electric Vehicles VEHP will affect the electrical energy system with the additional load on residential demand, generating a new total aggregate demand. These batteries are charged mainly in residential plugs with power levels 1 and 2 when the VEPs are parked in garages in the morning and evening [
19].
The high rates of connections by VEPs in the electrical distribution network lead to operation problems [
14]. The distribution systems were designed for conventional load traffic capacity, such as residential or commercial, based on the profiles of each consumer. When VEPs are connected, there is a significant change in these profiles and energy demand due to the high power delivered in a shorter space of time for residential charging, buildings, commercial locations, and public charging stations [
20].
3. EV Charging Demand Forecast
EV loads have specific characteristics distinct from residential loads, with different spatial and temporal distribution profiles. This charging requires high power due to its highly periodic and fluctuating behavior. EV charging curves show several power peaks, especially in small time intervals throughout the day [
21].
Traditionally, time series forecasts are made using historical data or modeling simulations. In this way, they play a decisive role in forecasting. However, predictions with EVs involve several uncertainties and volatility because they are new types of load with the characteristics previously described. Such load profiles have growth rules and non-stationary and stochastic characteristics. With this, it was observed that for time series data in which the output has a certain degree of correlation to time, ANNs are more appropriate, as models based on ANNs consider previous information in the past to make new future projections [
22].
The main difficulties in forecasting the total charging demand for VEPs can be cited as volatile loads, availability of public data, spatial and temporal distribution characteristics, different charging modes, varying penetration rates of EVs in the network, uncontrolled growth of charging, and demand spikes [
22]. With the increase in EV adoptions, EV charging is predicted to impact the power grid notably.
Furthermore, the need for a constant high power supply demonstrates a critical degree for charging EVs. The high power requirement for charging EVs causes enormous constraints on the grid. For this purpose, the need arose to accurately predict the charging load of EVs simultaneously with residential charging, and this will help grid operators to properly manage power distribution and make certain decisions [
23].
4. Multilayer Perceptron Artificial Neural Network
Multilayer perceptron (MLP) [
10] ANNs are fully connected layered architecture networks. Neurons in any network layer are always connected to all other neurons in the previous layer, which are interconnected directly in an input layer through weights. This type of network has layers in levels,
, an input layer containing one or more neurons, one or several hidden layers, and an output layer containing one or more neurons. Each layer has nodes, and each node is directly connected by weights with nodes in the next layer (
Figure 1), being
network input signals;
N neurons;
weights the synaptic weights of neuron
N;
output signals from
N neurons.
MLP transforms its linear inputs through a non-linear activation function (
1) [
9]:
where f is the activation function of the o-th neuron of the output layer; the output of the h-th hidden layer neuron; the interconnection between the h-th neuron of the hidden layer and the o-th neuron of the output layer, and H the size of the hidden layer.
The transfer function or also called activation defines the type of output of a neuron. The most common activation functions are the relay-type functions, the semi-linear function, the sigmoid function and the hyperbolic tangent [
24]. We can exemplify the hyperbolic tangent type sigmoid function (
2):
where is the slope of the curve.
5. Backpropagation Training with Bayesian Regularization
The
(BP) training algorithm with Bayesian regularization (BR) minimizes a combination of quadratic errors and weights and then determines the correct combination to produce training output with high generalization ability [
11].
This BR training aims to avoid training
overfittings and improve generalization capacity. This training adds a new coefficient to the optimization process, which penalizes the objective function
F by increasing the number of [
11] coefficients.
In [
11] regularization, the objective function
F is modified using the sum of the mean squared errors coming from backpropagation, called
, and, subsequently, the objective function is increased by the term additional
, which is the sum of the squared errors of the network weights
bias (
3):
with and being the regularization parameters of the objective function, these variables control the training emphasis. While training will focus on minimizing errors in the trained data. And while , training will prioritize minimizing the values of the weights generated by network errors.
The main training challenge is how the terms
and
are defined to control the objective function. In the Bayesian process, weights are treated as random variables. After obtaining the training data, the weight density function is updated by the
Bayes theorem (
4).
on what M is the network architecture used; D the training matrix; W the weight matrix; the prior density, representing knowledge of the weights before any data was collected; the likelihood function, which is the probability of a certain event occurring, considering the weights W; and the normalization factor, which guarantees that the total probability is 1.
If it is assumed that the data in the training set is of type
Gaussian and its prior distribution for the weights is
Gaussian, then probability densities can be written (
5) in the following way:
being e .
Replacing these probabilities in (
4), we can rewrite the calculation as follows (
6):
where is the normalization factor.
In this Bayesian step, the optimal weights maximize the posterior probability . Then, maximizing the posterior probability is equivalent to minimizing the regularized objective function .
5.0.1. Optimization of Regularization Parameters
In this step, the application of Bayes theorem is demonstrated to calculate the optimization of the parameters
and
of the objective function
F (
7):
According to the uniform prior density
for the regularization parameters
and
, then maximizing the posterior density is possible by calculating its likelihood function
. It is observed that this function is the normalization factor for (
4). Assuming that all probabilities have a Gaussian form, the form for the given posterior density (
4) is known. It was demonstrated in (
6) and it can be solved (
4) for the normalization factor (
8):
We can observe that the constants
and
calculated in (
5) are known. The only unknown constant is
. Caused by Taylor series expansion. One can expand
around the minimum point of the posterior density
, where the gradient calculation is null. Calculating the normalization constants:
where is a Hessian matrix of the objective function F.
With the result of the calculation in (
8) it is possible to calculate the optimal values for
and
at the minimum point. Taking the derivative with respect to each of the
log of (
8) and setting them equal to zero will result in (
10):
where called the effective number of parameters and N is the total number of parameters in the network. The parameter is a measure of how many neural network parameters are effectively used to minimize the error objective function. It can range from zero to N.
5.0.2. Calculation of the Gauss-Newton Approximation for the Hessian matrix
BR training requires calculating the Hessian matrix (H) of the objective function
for the minimum point
. This approximation can be calculated using the Levenberg-Marquardt optimization algorithm to find the minimum point [
25].
6. Materials and Methods
To apply the proposed method, the data set proposed is in reference [
19]. The data are from 200 private residences in the Midwest region of the United States (USA). The household composition included 502 individuals and 348 EVs. The load profiles were measured regarding electrical power in
Watts (W), with a resolution of 10 minutes over one year. VEPs with 60% load and Pluggable Hybrid Electric Vehicles (PHEV) with 40% load were considered, all charged with a level 1 plugged with a power of 1920
W.
6.0.3. Pre–Processing and Processing
As the original data has a resolution of 10 minutes in the very-short term, it was decided to group the measurements for a resolution of 1 hour in the short term. All home measurements and all EV charging were added together each hour, forming measurements from 00:00 to 23:00. The transformation was done by reducing 144 measurements (10-minute resolution) to 24 measurements (1-hour resolution) each day.
The data was separated into two demands: the first represented by residential demand and the second by EV demand. A single column containing all measurements was generated for each demand by adding the 200 homes and 348 vehicles, forming vectors of 8760×1, data from the two consumptions over one year. The total demand (11) was obtained by the sum of all respective loads every hour, day, and month between the two demands, residential and EVs (
Figure 2):
where is the total aggregate demand for forecasting; total residential demand; total EV demand.
6.1. Separation of Training and Testing Data Sets
When separating the training and testing data sets, total aggregate demand was used. The total set made up of 8760 measurements was divided into the 4 seasons of the year, for the purpose of comparisons and analysis of seasonality. In this way, 4 forecasts were proposed for the next 24 hours, one for each season of the year. The input and test matrices are composed of the variables:
Days: = day variables;
Weeks: = variables for the weeks from Monday to Sunday;
Months: = variables from the months of January to December;
Times: = variables in hours in the 24-hour period;
Loads : [total aggregate demand] = load variables referring to the hour in Watts.
The ANN output set is composed of the total aggregate demand variable, with representing the load measurements for the following hour , in Watts.
The dataset was separated into 83% for training and 17% for testing. The dimensions of the datasets are presented in
Table I.
6.2. Configuration and Architecture of the ANN
Initially, it was decided to divide the 1-year database into the year’s four seasons, as climate change has direct links to consumption patterns and profiles of EVs and homes. With this, predictions become more realistic and perform better. To obtain a better configuration for the ANN architecture, exhaustive tests were carried out by varying the number of hidden layers and the number of neurons in the hidden layers. The best configuration found was the one with six neurons in the first hidden layer, 2 in the second hidden layer, and 1 in the third hidden layer. The hyperbolic tangent activation function was used.
6.3. Prediction Performance Evaluation
The methodology used to evaluate forecast successes and errors was the mean absolute percentage error (MAPE) (
12) [
26].
where
is the total number of hours;
the actual value at time
h and
the value predicted by the network at time
h.
Figure 3.
24-hour winter demand forecast.
Figure 3.
24-hour winter demand forecast.
Figure 4.
24-hou r fall demand forecast.
Figure 4.
24-hou r fall demand forecast.
Figure 5.
24-hour spring demand forecast.
Figure 5.
24-hour spring demand forecast.
Figure 6.
24-hour summer demand forecast.
Figure 6.
24-hour summer demand forecast.
7. Results
The software used for modeling, training, and prediction was Matlab 2023b. In training, the data set is divided randomly by default; even when splitting the set into 83 %, the algorithm divides this value in random order to make the training process more robust without being associated with a single answer.
Tests were carried out on the configurations of the hidden layers and their number of neurons, and it was observed that the best configuration of the network is with three hidden layers. This configuration was the best performing due to the accuracy and stability of the training response. It was noted that, with fewer than three hidden layers, the network loses precision, demonstrating a limitation of the network in training, and with more than three layers, the network loses training stability. The architecture of the proposed model achieved a significant improvement in the learning process, finding the best configuration of the numbers of neurons and hidden layers.
Table II presents the MAPE results obtained for each season of the year.
8. Discussion
It was possible to observe that using only backpropagation training the response is not satisfactory, that is because a hybrid training with Bayesian Regularization is used. With the union of the two training sessions, the network obtained a significant improvement in results, as Bayesian regularization determines the probability of an event happening given the saved learning. With these improvements, the proposed architecture and technique increase its effectiveness.
In the spring forecast, the biggest errors were found during the night, between 7 pm and 9 pm, with average errors of . This is due to the peak generated by EVs during this period. It was also seen that in the morning, at precisely 9 am, the network showed an error of .
It was observed that the highest load peaks due to the penetration of EVs are found in the morning (between 7 am and 12 pm) and also at night (between 6 pm and 9 pm). With these peaks in residential demand, the maximum errors are found at these times. It was observed that between 1 pm and 6 pm the forecasts had low errors, caused by the low charge of the EVs.
The forecast for summer presented the biggest errors when compared to the other three seasons, with three very pronounced error times: in the morning with a error (largest error), in the lunch period with of error and at night with of error (between 9 and 10 pm).
For the winter period, the network obtained the lowest errors compared to the other seasons. However, it obtained a maximum error of in the morning peak hour and at this point the network was optimistic, that is, it overestimated the demand at the predicted time.
The fall forecast resulted in the MAPE being just above the winter forecast. At peak loading times the maximum error was .
It is also observed that due to the amount of trained data from the winter and summer seasons being greater than the others, this division generated greater maximum errors than the others, arround 15.934% in the winter and 20.228% in the summer.
The growth in the adoption of EVs in residential charging had a major impact on the electrical power system. The forecast of total loading demand presents itself as an important strategic tool in a scenario with a broad growth trend and with great openness for exploration and investigation.
The MLP network and the proposed training showed good generalization capacity, with satisfactory results and fast convergence, with training time between 5 and 15 seconds and 200 to 500 iterations. The use of three hidden layers was of great importance for the training generalization process, increasing the quality of the results. The proposed model showed an improvement in learning due to hybrid training, which resulted in more realistic responses, satisfying the need for reliable predictions with more precision and robustness.
9. Conclusions
Total demand forecasting presented itself as a promising option for future projections, having the ability to estimate new demands based on EV loads added to residential load, instead of just making forecasts in EVs. In this way, the ANN learned the behavior of residential loads, EVs and both being used simultaneously.
The proposed methodology presented promising answers to a topic in high and rapid expansion, relatively recent and with great potential for practical application in future research. The proposal, due to its efficiency and reliability in results, has the possibility of being implemented in order to assist in the development of a robust strategy, preparing the power system for new EV penetration rates. This work also has the potential to assist in the development of strategies for smart charging, optimizing the EV charging process.
Funding
The authors would like to thank the Coordination for the Improvement of Higher Education Personnel - Brazil (CAPES) - Funding code 001 and the CNPq (National Council for Scientific and Technological Development.
Data Availability Statement
All electrical power demand profiles used in this study, including residential energy demand and level 1 electric vehicle charging, are available for free download. “MDPI Research Data Policies” at
https://data.nrel.gov/submissions/69.
References
-
``International Energy Agency. Global EV Outlook.” (2021). https://www.iea.org/reports/global-evoutlook-2021.
-
EPA, “Multipollutant comparison.,” 2016. 05 December. 2020.
- Y. Fan, C. Guo, P. Hou, and Z. Tang, “Impact of electric vehicle charging on power load based on tou price,” Energy and Power Engineering, vol. 05, pp. 1347–1351, 01 2013. [CrossRef]
- H. Cui, D. Hall, and N. Lutsey, “Update on the global transition to electric vehicles through 2019,” tech. rep., Internacional Council on Clean Transportation, 07 2020. [CrossRef]
- A. Raskin and S. Saurin, “The emergence of hybrid vehicles,” tech. rep., Alliance Bernstein’s Research on Strategic Change, 2006.
- P. Papadopoulos, S. Skarvelis-Kazakos, I. Unda, L. Cipcigan, and N. Jenkins, “Electric vehicles’ impact on british distribution networks,” IET Electrical Systems in Transportation, vol. 2, pp. 91–102, 09 2012. [CrossRef]
- K. Clement-Nyns, E. Haesen, and J. Driesen, “The impact of charging plug-in hybrid electric vehicles on a residential distribution grid,” Power Systems, IEEE Transactions on, vol. 25, pp. 371 – 380, 03 2010. [CrossRef]
- H. Hippert, C. Pedreira, and R. Souza, “Neural networks for short-term load forecasting: A review and evaluation,” IEEE Transactions on Power Systems, vol. 16, pp. 44 – 55, 03 2001. [CrossRef]
- S. Haykin, Neural Networks: A Comprehensive Foundation. USA: Prentice Hall PTR, 2nd ed., 1998.
- M. Minsky and S. Papert, Perceptrons: An Introduction to Computational Geometry. Cambridge, MA, USA: MIT Press, 1969.
- D. J. C. MacKay, “A practical bayesian framework for backprop networks,” Neural Computation, vol. 4, pp. 448–472, 05 1992. [CrossRef]
- D. B. Richardson, “Electric vehicles and the electric grid: A review of modeling approaches, Impacts, and renewable energy integration,” Renewable and Sustainable Energy Reviews, vol. 19, pp. 247–254, 03 2013. [CrossRef]
- Légifrance., “Loi n° 2015-992 du 17 août 2015 relative à la transition énergétique pour la croissance verte.,” 2015. Acessado: 28 jan. 2021.
- J. A. P. Lopes, F. J. Soares, and P. M. R. Almeida, “Integration of electric vehicles in the electric power system,” Proceedings of the IEEE, vol. 99, pp. 168–183, 01 2011. [CrossRef]
- A. Schroeder, “Modeling storage and demand management in power distribution grids,” Applied Energy, vol. 88, no. 12, pp. 4700–4712, 2011. [CrossRef]
- H. L. Willis, Power Distribution Planning Reference Book. CRC Press, 2004.
- S. Shafiee, M. Fotuhi-Firuzabad, and M. Rastegar, “Investigating the impacts of plug-in hybrid electric vehicles on power distribution systems,” IEEE Transactions on Smart Grid, vol. 4, pp. 1351–1360, 09 2013. [CrossRef]
- G. Putrus, P. Suwanapingkarl, D. Johnston, E. Bentley, and M. Narayana, “Impact of electric vehicles on power distribution networks,” in 2009 IEEE Vehicle Power and Propulsion Conference, pp. 827 – 831, IEEE, 10 2009. [CrossRef]
- M. Muratori, “Impact of uncoordinated plug-in electric vehicle charging on residential power demand,” Nature Energy, vol. 3, pp. 193–201, 01 2018. [CrossRef]
- C. Roe, A. Meliopoulos, J. Meisel, and T. Overbye, “Power system level impacts of plug-in hybrid electric vehicles using simulation data,” in 2008 IEEE Energy 2030 Conference, pp. 1–6, IEEE, 11 2008. [CrossRef]
- J. Zhu, Z. Yang, J. Guo, Y.and Zhang, and H. Yang, “Short-term load forecasting for electric vehicle charging stations based on deep learning approaches,” Applied Sciences (Switzerland), vol. 9, p. 1723, 04 2019. [CrossRef]
- G. Chunlin, Q. Wenbo, W. Li, D. Hang, H. Pengxin, and X. Xiangning, “A method of electric vehicle charging load forecasting based on the number of vehicles,” in International Conference on Sustainable Power Generation and Supply (SUPERGEN), pp. 1–5, IET, 09 2012. [CrossRef]
- A. K. Karmaker, M. A. Hossain, H. R. Pota, A. Onen, and J. Jung, “Energy management system for hybrid renewable energy-based electric vehicle charging station,” IEEE Access, vol. 11, pp. 27793–27805, 2023. [CrossRef]
- B. Krose, P. van der Smagt, and Smagt, “An introduction to neural networks,” J Comput Sci, vol. 48, 01 1993.
- F. Foresee and M. Hagan, “Gauss-newton approximation to bayesian learning,” Proceedings of International Conference on Neural Networks (ICNN’97), vol. 3, pp. 1930–1935, 08 1997. [CrossRef]
- D. C. Park, M. A. El-Sharkawi, R. J. Marks, L. E. Atlas, and M. J. Damborg, “Electric load forecasting using an artificial neural network,” IEEE Transactions on Power Systems, vol. 6, no. 2, pp. 442–449, 1991. [CrossRef]
|
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2024 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).