In this section, the Markov model is developed and both exact and approximate methods to calculate the steady-state probabilities are proposed.
3.1. An Exact Approach
In this subsection, an exact method to calculate the steady-state probabilities as well as performance measures is proposed. As in Melikov et al (2023) [
12], let
be the number of
с-customers at time
and
be the inventory level at time
. So, the process
forms a two-dimensional continuous time Markov chain (2D CTMC) with state spac
where
is the subset of states in which inventory level is equal to
The transition rate from state
to state
is denoted by
. By taking into account the assumptions related to operating of the investigated QIS, we conclude that these transitions rates are calculated as follows
From relations (2) we conclude that each state of the constructed 2D CTMC can be reached from any other state through a finite number of transitions, i.e. considered chain is an irreducible one. In other words, for any positive values of the initial parameters, a stationary mode is existing. Let us denote by 𝑝(𝑛, 𝑚) the probability of the state (𝑛, 𝑚) ∈ 𝐸. These probabilities can be obtained by solving the system of balance equations (SBE) which is constructed by using relations (2).
Here and below, χ
denotes the indicator function of the event
. To SBE (3)-(6), a normalization condition should be added, i.e.
The constructed SBE (3)-(7) is a system of linear algebraic equations of dimension and it can be solved numerically by using well-known software in case the moderate values of the parameters and .
After calculating the steady-state probabilities, key performance measures of the QIS under study can be determined using a standard technique. The performance measures are divided into two groups: (1) inventory-related performance measures and (2) queuing-related performance measures. The first group of performance measures includes the average number of items in warehouse , the average order size and the average reorder rate .
The average number of items in warehouse (i.e. the average inventory level) is calculated as mathematical expectation of the appropriate random variable and is given by
Similar to (8), the average order size (i.e. the average size of replenished items from external source) is calculated as mathematical expectation of the appropriate random variable and is calculates as follows
An inventory order is placed in two cases: (1) when the inventory level drops to the reorder point
after completing customer service in states
, and (2) when catastrophes occur the in states
Therefore, the average reorder rate is calculated as follows
The second group of performance measures includes the average length of the queue and loss rate of c-customers .
The average length of the queue is calculated as mathematical expectation of the appropriate random variable and is given by
Losing c-customers occurs in three cases: (1) if at the time the c-customer arrives the waiting room is full (with probability 1), i.e. when the system are in one of the states
,
(2) if at the time the
c-customer arrives, the inventory level is zero and waiting room is not full (with probability
), i.e, when system are in one of the states
,
(3) when
n-customer arrived, it displaced one
c-customer. Therefore, the loss rate of
c-customers is calculated as follows
As it was mentioned above, the proposed exact approach can be used for investigation the QIS model with moderate state space. Computational difficulties arise for large-scale models, and an approximate method for calculating steady-state probabilities is then required. Below we develop an approximate method for solving this problem, which can be used in cases of rare catastrophes.
3.2. An Approximate Approach
In this subsection, we derive the closed-form approximate solution for steady-state probabilities of the investigated 2D CTMC, by using space merging approach, see [
24]. This approach is highly accurate for systems with rare catastrophes, i.e. we will assume that
Note that the last assumption is not extraordinary, since in the opposite case (i.e. when the level of catastrophes is close to the rate of c-customers, the speed of their service, the rate of n-customers) the QIS under consideration is generally not effective.
In the case where the above assumption is fulfilled, the basic requirement for an adequate application of space merging method is satisfied. In this case, transition rates between states in each subset
(see (1)) are much great than the transition rates between states from different subsets. So, in accordance to the space merging algorithm, each subset of states
in (1) is combined into one merged state
, and the following merging function is determined in the initial state space (1)
. The merged states form the set
The approximate values of steady-state probabilities,
are calculate as follows
where
denotes probability of state
within subset
and
denotes probability of merged state
.
From relations (2) we conclude that the steady-state probabilities
within a split model with the state space
coincide with the stationary distribution of a finite one-dimensional birth-death process in which birth rate is
while death rate is
. By the same way, from relations (2) we conclude that the steady-state probabilities
within a split model with the state space
are independent on
and coincide with the stationary distribution of a finite one-dimensional birth-death process in which birth rate is
while death rate is
. In other words, steady-state probabilities within split models are calculated as
where
Note 1. To simplify the notation, below the subscript for cases is omitted in state probabilities In cases and/or, all state probabilities for any and .
Let us denote the rate of transition from the merged state
to the merged state
by
. Then, taking into account relations (2) and (14), we obtain the following formulas for calculating the indicated rates (all other transition rates are zero):
In other words, merged model represents one-dimensional Markov chain with state space
where transition rates between states are calculated via formulas (15)-(17). Using the approach proposed in [
12], we obtain the following closed-form formulas for calculating the probabilities of merged states:
where
Eventually, taking into account formulas (13), (14), (18)-(20), we conclude that an approximate values of performance measures (8)-(12) can be calculated using the following explicit formulas
4.2. Behavior of Performance Measures Versus Reorder Point
Performance measures are computed and numerically illustrated for different sets of values for the input parameters. In all experiments the values of following parameters are fixed:
So,
Figure 1 shows the behavior of performance measures as a functions of reorder point
for the three different values of
. From these plots, we conclude that inventory-related performance measures are almost independent of the rate of c-customers, but significantly dependent on the reorder point, see
Figure 1, (a), (b) and (c). Note that all inventory-related performance measures are increasing functions versus reorder point. Measure
is an increasing function versus
, and this fact was expected, see
Figure 1 (a). At first glance, the increasing of
versus
seems unexpected, see
Figure 1 (b). However, this fact has the following explanation: as
increases, the reorder rate increases (see
Figure 1 (c)), and as a result, the average order size increases. The
is an increasing function with respect to
because as
increases, the probability that the inventory level is positive, also increases and hence
becomes an increasing function, see formula (10) as well. For the selected data the rate of its increase becomes very high at large (possible) values of the reorder point, see
Figure 1 (c). Opposite, the queuing-related performance measures are almost independent of the reorder point, see
Figure 1, (d) and (e). For selected initial data the average number of customers in queue
for all values of
are very close to buffer size (
), see
Figure 1 (d). Therefore, loss rate
is very close to
, see
Figure 1 (e).
The dependence of performance measures on
and
is shown in
Figure 2. It is interesting to note that here behavior, even absolute values of the inventory-related performance measures (see
Figure 2, (a)-(c)), are same as in
Figure 1 (a)-(c). From
Figure 2 (d) we conclude that
is almost independent of
and the rate of its decreasing versus
is very small, i.e., increasing
even by ten times leads to a change in the value of
in the second digit after the decimal point. Similarly, from
Figure 2 (e) we conclude that
is also almost independent of
, but here the rate of its decrease compared to
is noticeable.
The dependence of performance measures on
and
is shown in
Figure 3. An increase in
with respect to
is obvious, since an increase in
leads to an increase in the rate of filling the warehouse to its maximum size, see
Figure 3 (a); on the other hand,
is a decreasing function versus
because an increase in
results in an increase in the rate at which inventory is sold. Since
is a decreasing function with respect to
, therefore
is increasing with respect to
, see
Figure 3 (b); an increase in
leads to increasing the probability that the inventory level drops to zero due to catastrophes, i.e., average order size is also increasing function versus
. Measure
is an increasing function with respect to
, since increasing of
leads to increasing the probability that the stock level is greater than zero, i.e., the rate of replenishment of stocks due to catastrophes also increases, see
Figure 3(c); this measure is also an increasing function with respect to
, since an increase in
leads to increasing the probability that the inventory level drops to the re-order point
, i.e., the rate of replenishment increases (see formula (9) also). From
Figure 3(d) we conclude that
is an increasing function versus
and a decreasing function versus
. And for large values of
, i.e.,
the value of
is practically independent of
. These facts are expected. Measure
is decreasing function versus on both
and
, see
Figure 3 (e). The decrease of this function with respect to
is obvious, but its decrease relative to
is not evident at first glance. The last fact has the following explanation: an increase in
leads to increasing the probability that the inventory level is zero, i.e., the loss probability of arriving customers also increases and hence the measure
becomes increasing. However, the rate of increasing of
versus
is very small, i.e., increasing
even by three times leads to a change in the value of
in the second digit after the decimal point.
The dependence of performance measures on
and ν is shown in
Figure 4. Measure
is an increasing one with respect to both
and ν, see
Figure 4 (a). Indeed, an increase in
and ν leads to an increase in the rate of filling the warehouse to its maximum size. Measure
is increasing versus
, while it is decreasing function versus ν. Here
is decreasing versus ν, since
is a increasing function with respect to ν, see
Figure 4 (b); the increase in
with respect to
is explained as above, i.e., as s increases, the probability of inventory levels falling to zero due to catastrophes also increases, so the average order size is also an increasing function with respect to
. Measure
is an increasing one with respect to both
and ν, since an increase in both
and ν leads to increasing the probability that the stock level is greater than zero, hence the rate of replenishment of inventory due to catastrophes also increases, see
Figure 4(c). From
Figure 4 (d) we conclude that the
is almost constant (does not decrease) depending on
and ν; only for small values of
, i.e. s<10, we observe insignificant differences between the values of
for different values of ν. Measure
is a decreasing function with respect to both
and ν, see
Figure 4 (e). Such behavior of this measure is expected, since an increase in both
and ν leads to an increase in the average inventory level and, as a consequence, to a decrease in
.