1. Introduction
With the development of the international situation, as well as the emergence of new types of confrontation targets, it is urgent to re-examine the hydroacoustic confrontation to adapt to the needs of naval operations in the new situation [
1]. Hydroacoustic countermeasures are devoted to using hydroacoustic equipment and devices [
2], luring, interfering with the enemy acoustic guided torpedo detection and attack, to avoid enemy torpedo attacks, and thereby improving their own survival capability [
3,
4,
5,
6,
7]. Hydroacoustic countermeasures technology has been investigated for more than 60 years since the Second World War, which contributes to some representative systems such as the United States / Britain joint Surface Ship Torpedo Defence (SSTD) system, the France Systeme-de Lutte Anti-Torpille (SLAT) system, the Israel Torpedo Self Defence System (TSDS) system, the United States / United Kingdom joint Surface Ship Torpedo Defence (SSTD) system, the French system, the Israeli Torpedo Self Defence System (TSDS) system, the United States and United Kingdom joint Surface Ship Torpedo Defence (SSTD) system, the Defence System (TSDS) system of France, the Torpedo Self Defence System (TSDS) system of Israel, as well as the research of the USSR and its post-dissolution republics [
8]. Recently, there are popular researches on anti-submarine search mode abroad [
9], and a few researches on submarine countermeasures against torpedoes are reported on the countermeasure characteristics of individual countermeasures [
10,
11]. Based on the Mote-Carlo simulating method and the manoeuvre evasion strategy, some preliminary researches have been reported for the anti-torpedo scenarios [
12,
13].
Some researches have implemented the game theory to develop intelligent strategies of naval warfare. Levine [
14] studied aspects of naval warfare in the previous centuries using concepts from game theory. Since the powerful nations in the 18th and 19th centuries built warships with cannons positioned along their sides, neither fleet would gain from turning towards the enemy and neither would get ahead. Levine concluded that this strategy—forming a line of battle and sailing parallel to the other fleet—was each fleet’s best response, and thus represented a Nash equilibrium.
Maskery
et al. [
15] investigated the problem of deploying counter-measures against anti-ship missiles using a network-enabled operations framework, where multiple ships communicate and coordinate to defend against a missile threat. Here, the missile threats were modelled as a discrete Markov process, and the ships which are equipped with countermeasures were modelled as the players of a transient stochastic game, where the actions of the individual players include the use of countermeasures to maximize their own safety while cooperating with other players which are essentially aiming to achieve the same objective. The optimal strategy of this game-theoretic problem is a correlated equilibrium strategy and is shown to be achieved via an optimization problem with bilinear constraints. In [
16], Maskery
et al. considered the problem of network-centric force protection of a task group against anti-ship missiles. The decision-makers in this model are the ships equipped with hard-kill/soft-kill weapons (counter-measures) and these ships are also considered the players in the formulation of this problem in a game-theoretic setting. Here, the ships play a game with each other instead of with a missile. This approach naturally lends itself to decentralised solutions which may be implemented when full communication is not feasible. Moreover, this formulation leads to an interpretation of the problem as a stochastic shortest past game for which Nash Equilibrium solutions are known to exist.
Bachmann
et al. [
17] analyzed the interaction between radar and jammer using a noncooperative two-player zero-sum game. In their approach, the radar and jammer were considered ‘players’ with opposing goals: the radar tries to maximize the probability of detection of the target while the jammer attempts to minimize its detection by the radar by jamming it. This game-theoretic formulation was solved by optimizing these utility functions subject to constraints in the control variables (strategies), which for the jammer are jammer power and the spatial extent of jamming while for the radar the available strategies include the threshold parameter and reference window size. The resulting matrix-form games were solved for optimal strategies of both radar and jammer from which they identify conditions under which the radar and jammer are effective in achieving their individual goals.
Consider the scenario that a surface ship encounter with an enemy submarine, where the submarine would like to launch a torpedo attacking the ship. While the coming torpedo is alarmed by sonar equipments of the ship, the defensive crew of ship would take some countermeasure strategies to survive from the dangerous situation. For most cases, the enemy submarine would maintain silence for a long time to attack in a advantageous situation, and accordingly, this scenario of hydroacoustic confrontation is very emergent, due to the faster maneuvering speed and unknown attacking direction of the torpedo. Thus, it is of great help to improvement of its survival capability by predicting the attacking intention of the enemy torpedo. In this paper, we address it based on the theory of matrix game [
18,
19]. Taking the avoidance angle and the attacking advance angle as the antagonizing strategies of the defensive surface ship and the attacking torpedo, respectively, a matrix game model is constructed by discretizing them in their value ranges, taking the payoff as the probability of being captured by the torpedo. Then, the linear programming (LP) model for matrix game is proposed, and an improved initialization strategy of the simplex method to get the Nash equilibrium solution to the game model as soon as possible. In this way, a realtime antagonizing strategy can be generated to address the emergent scenario of Hydroacoustic countermeasure.
Rest of this paper is organized as follows.
Section 2 presents some preliminary introductions on the theory of matrix game and the simplex method for LP, and a matrix game model for the investrigated hydroacoustic countermeasure scenario is proposed in
Section 3. To efficiently put into practice the proposed game model,
Section 4 validate the construction of payoff matrix and an improved initialization method for the simplex method (SM) is put forward in
Section 5. Then, numerical simulation is implemented in
Section 6 to demonstrate the applicability of the proposed strategy, and
Section 7 presents conclusions and discussions.
2. Preliminaries
2.1. Introduction to the Game Theory
Pure vs. mixed strategies [
20]
A game typically consists of two or more players, a set of strategies available to these players, and a corresponding set of payoff values for each player. A pure strategy in a game provides a complete definition of how a player will play a game, and a mixed strategy is a combination of pure strategies where a particular probability p (where ) is associated with each of these pure strategies. Therefore, any pure strategy is actually a degenerate case of a mixed strategy, in which that particular strategy is selected with probability 1 and every other strategy is selected with probability 0.
The solution to a game model refers to the Nash equilibrium (solution). Let
be a game with
n players, where
is the strategy set of a given player
i. Thus, the stragety profile
S consisting of the strategy sets of all players would be
. Let
be the payoff function for strategy set
. Suppose
is the strategy of player
i and
is the strategy set of all players except player
i. Thus, when each player
chooses strategy
that would result in the strategy set
, giving a payoff of
to that particular player, which depends on both the strategy chosen by that player
and the strategies chosen by other players
. A strategy set
is in Nash equilibrium if no unilateral deviation in strategy by any single player would return a higher utility for that particular player. Formally put,
is in Nash equilibrium if and only if:
is called a pure/mixed-strategy Nash equilibrium when
is pure/mixed-strategy for any player
i,
.
Matrix (Two-person zero-sum) games [
20]
Zero-sum games are a class of competitive games where the total of the payoffs of all players is zero. In two-player games, this implies that one player’s loss in the payoff is equal to another player’s gain in the payoff. A maxtrix (two-player zero-sum) game can therefore be represented by a payoff matrix that shows only the payoffs of one player. The mini-max theorem [
21] states that in a zero-sum game there is a set of strategies that minimizes the maximum losses (or maximises the minimum payoff) of each player, which can be addressed by solving LP problems. Note that the linear programming problems given for both players are dual to each other. The optimal mixed strategies for both players can be found by solving only one of the linear programming problems because the optimal dual solution is an automatic by-product of the simplex method calculations to find the optimal primal solution. In general, you always can find optimal mixed strategies for both players by choosing just one of the models (either one) and then using the simplex method to solve for both an optimal solution and an optimal dual solution [
22].
2.2. The Simplex Method for LP Problems [23]
An LP problem with
variables and
r constraints takes the form
where
and
r are positive integers,
,
,
, and
. Let
be the set of variable indices and
be the set of constraint indices. The feasible region of an LP is denoted by
and the optimal solution of an LP is
such that
for all
.
One of the most popular algorithms to LP problems is the simplex method (SM) created by George Dantzig [
24]. Given an LP, the SM requires that all constraints be converted into linear equations by adding r slack variables. This new problem is called the canonical linear program (CLP) and is defined as
where
,
is
augmented with
r zeros, and
is
augmented with an
identity matrix. Let
be the variable indices and
be the feasible region of an CLP.
Initially, SM requires a starting basic feasible solution. Formally, is called a basis if and is nonsigular. The set of nonbasic indices is . The corresponding vasic and nonbasic variables are and , respectively. If , then is a feasible basis with and being the corresponding vasic feasible solution. Here, represents the columns of A restricted to the indices in , and is the x values of the indices in .
The input to SM is an CLP and a feasible basise that produces a feasible basis solution. The algorithm evaluates each nonbasis variable’s reduced cost, which is euql to for all . If all nonbasic reduced costs are nonnegative, then the corresponding vasic feasible solution represents an optimal solution of CLP. Furthermore, is said to be an optimal basis. If is not optimal, then there exists an entering variable with index such that its reduced cost is negative. In order to determine the leaving variable, define . If , then the problem is unbounded. If not, SM performs the ratio test and identifies such that for all . SM replaces the th element in with p. This process is referred to as a pivot. The algorithm continues pivoting until an optimal basis of CLP is identified or CLP is shown to be unbounded.
3. The Matrix Game Model for Hydroacoustic Countermeasure
Knowing that both sides of the hydroacoustic countermeasure would like to maximize their own profits, we construct a matrix game model to simulate the adversarial scenario, where the game strategies of the two opposing sides in the static game are their own sailing/attacking directions. Because the sailing speed of torpedo is much greater than that of the surface ship, we construct the payoff matrix by the maximum capturing probabilities corresponding to pairs of sailing directions. Since the capturing probability depend on relative positions of the opposite objects, we can get the functional relationship between the relative positions of the torpedo and the ship under each game situation as a function of time. Then, a component of the payoff matrix is obtained by taking the maximum capture probability for a pair of sailing settings. If the probability of capture is less than the given threshold, no evasion operation is carried out; otherwise, it is necessary to determine the evasion strategy of the red ship.
To model the scenario of hydroacoustic confrontation, we establish a planar rectangular coordinate system based on the relative positions of the torpedo and the ship. Assuming that the detected position of the torpedo and the location of surface ship obey the normal distribution, we always place the surface ship at the origin of the coordinate system. Then, the position of torpedo can be taken as a two-dimensional random vector obeying a normal distribution.
The hydroacoustic confrontation situations when the sonar system of the red ship detects the incoming torpedo are shown in
Figure 1, where the avoidance direction angle
of the red surface ship and the advance angle
of the blue torpedo attack are supposed to be regulated to perform the countermeasure game. For a strategy pair (
), the relative position of the mine-ship can be calculated as a function of time according to the sailing speed of the red ship and the attack advance angle and attack speed of the incoming torpedo. By incorporating a calculation method of capture probability, one can get the capture probability function of sailing time, and take its maximum value as the probability that an attacking torpedo captures the red ship.
Accordingly, the game model of hydroacoustic confrontation between red and blue parties can be constructed, and the game strategy pair is
. As illustrated in
Figure 1, let
,
. To construct a discrete matrix game model, intervals
and
are discretized as collections of finite feasible values, that is, we set
and
. Then, we get the
payoff matrix
, where the payoff
is the probability that a red ship is captured by a blue torpedo when the adversarial strategy pair is
(
).
A mixed/pure-strategy Nash equilibrium solution to this matrix game model can be obtained by solving the linear programming model [
22]
According to the optimal solution of model (1), the sum of components is the optimal payment corresponding to the mixed-strategy Nash equilibrium, and the probability distribution is the pure/mixed-strategy Nash equilibrium.
4. Calculation of the Payoff Corresponding to a Strategy Pair (,)
4.1. The Gaussian Model for Payoff of a Strategy Pair (,)
Figure 1 illustrates the confrontation posture at the time of alarm. We establish an inertial coordinate system where the surface ship’s position is set as the origin of the coordinate system, denoted by
O. The sailing direction of the ship is set as the positive direction of the
Y axis, labelled as the due north direction, and the due east direction is taken as the positive direction of the
X axis. Denote the sailing speed of the surface ship by
, and the deflection angle to avoid the attack of torpedo by
. For the acoustic self-guided torpedo, let
q and
be its relative bearing angle and the distance from the surface ship, respectively. While the torpedo attack with the speed
uniform linear search, the attacking direction can be computed by
where
is the favourable advance angle,
is the angle between the torpedo heading extension line and the
Y-axis angle.
Set
for the moment when the sonar equipment reports attack of the torpedo. We get the position
of the red warship at time t, where
Similarly, the torpedo’s position
can be identified by
The distance between the surface ship and the torpedo is
The lead angle is changing with time
t by
where
Since the positions of both surface ship and torpedo could not be precisely located, it is assumed that their coordinate positions obey the two-dimensional normal distribution:
In case that
and
are independent, we know
is a Gaussian random vector with
where
The probability density function (PDF) of
is
While the surface ship is located in the self-guided sector
S of the torpedo, it would be captured by the torpedo. Thus, the capture probability
can be computed by a double integral
where
is the sector illustrated in
Figure 2. Maximizing
for time t we can get the payoff (capture probability) corresponding to a strategy pair
4.2. Approximation of the Payoff Corresponding to a Strategy Pair
Since the integral included in (
15) cannot be analytically computed, we would like to get an analytical approximation of
to get the payoff corresponding to a strategy pair
.
Assuming that the position error in the
x-direction is uncorrelated to the position error in the
y-direction, we get a diagonal covariance matrix
For any time moment
t, denote
, and Equation (
15) implies
Denote the radius and the sector angle of
by
and
, respectively. As illustrated in
Figure 2, any
satisfies
Since the self-conducting sector of torpedo is usually a sector with a large radius
and a comparatively small angle
, we can approximate
by integrating the PDF in a rectangle
that is illustrated in
Figure 2 by dashed lines, which is confirmed by
Thus, Equations (
17) and (
18) implies that the probability can be approximated by
where
and
is the cumulative distribution function (CDF) of the standard normal distribution. In summary, the capture probability can be approximated by
5. The Generation Strategy of Initial Feasible Solution
To get real-time countermeasure strategy for the constructed matrix game model, an improved simplex method algorithm addressing the linear programming model (
2) is developed to get a (mixed/pure) Nash equilibrium solution of the game model.
The simplex method can address the canonical form of a linear programming problem
Starting with an initial basic feasible solution, the simplex method iterates successively to get the optimal solution of (
20). In this paper, we incorporate a tailored strategy included in Algorithm 1 to accelerate the iteration process of the simplex method. By resorting the decision variables according components of
C, problem (
20) is transformed to a reformed linear programming problem
and a promising basis feasible solution
is generated by the Gaussian elimination method with partial pivoting. Accordingly, the initial feasible basis can be obtained by picking up columns of
that correspond to its leading entries.
The proposed method generates an initial feasible solution with a promising objective value and tries to incorporate in it artificial variables as few as possible, which not only reduces the time complexity of each iteration, but also reduces the number of iterations before the optimal solution is achieved.
6. Numerical Simulation
In this section, we perform numerical simulation to validate the effectiveness of our proposed method.
Algorithm 1 Initialization for the Simplex Method |
- Input:
.
- Output:
.
- 1:
Sort the components of C in descending order to get the reformed problem
where , , , , ;
- 2:
Perform the Gaussian elimination method with partial pivoting on the linear system , obtaining a linear system , where is a reduced row echelon form of matrix ;
- 3:
Set .
|
6.1. Simulation Settings
Numerical simulation is carried out based on the settings presented as follows.
The torpedo attacks at a speed of
1. When the sonar equipment alarms its attack, it is
2 far away from the surface ship, and the outboard angle is
. The standard deviation of the reported position is
for both the
x-coordinate and the
y-coordinate. The maximum self-guiding distance of torpedo is
, and the self-guiding sector angle is
. The value of advance angle
of the torpedo ranges in
with a stepsize of
.
The sailing speed of surface ship is . The value of avoidance angle of the surface ship ranges in with a stepsize of .
6.2. Simulation Results
According to the discretization of
, we can maximize
for time
t to obtain the payoff (capture probability) corresponding to each pair of game strategy
, which contributes to a
payoff matrix. While numerical results demonstrate that when
is greater than
, the capture probabilities are very small, which is ignored and deleted from the payoff matrix. Accordingly, we get the payoff matrix presented in
Table 1.
The linear programming problem (
2) is addressed by the simplex method with an initialization method presented in Algorithm 1, and we get the Nash equilibrium solution, which demonstrates that the ship-side mixed strategy is
and the torpedo-side mixed strategy is
The corresponding equilibrium value is
.
The torpedo-side mixed strategy shows that the torpedo would attack the surface ship in the directions characterized the advanced angles , and , and the corresponding probabilities are , and , respectively. Meanwhile, the ship-side mixed strategy suggests that the preferred avoidance angles of surface ship are , , and , and the corresponding probabilities are , and , respectively. The Nash equilibrium solutions could lead to a preliminary decision for the hydroacoustic countermeasure scenario: the advance angle of attacking torpedo could range in , and the preferred avoidance strategy could be turning right for about , which could provide a suggestive action before the attacking direction of torpedo is addressed, and in turn improve the survival probabilities of surface ship for the emergent scenarios of hydroacoustic countermeasure.
7. Conclusions and Discussions
In order to improve the survival capability of surface ship in the scenarios of anti-torpedo hydroacoustic countermeasure, this paper proposes a game-based strategy to predict possible attacking directions of the hostile torpedoes. Based on the matrix game theory with the capture probabilities as payoffs, our method can output a real-time Nash equilibrium solution that reports the probabilities of all possible attacking directions. With this result, the defensive side can take actions before the sonar equipment identifies the attack intention of the hostile torpedoes. However, the predicting probability distribution does not given a definitive answer on what is the avoidance strategy of surface ship. Thus, our future work will investigate how a definitive countermeasure strategy is derived from the Nash equilibrium solution of the game model.
Author Contributions
Conceptualization, Y. Chen; formal analysis, Y. Chen; writing—original draft preparation, H. Zhao and H. Cheng; writing—review and editing, H. Cheng; funding acquisition, Y. Chen. All authors have read and agreed to the published version of the manuscript.
Funding
This work was supported by the Open Fund of the National Key Laboratory of Science and Technology on Underwater Acoustic Antagonizing (No. 2021-JCJQ-LB033-02).
Conflicts of Interest
The authors declare no conflict of interest.
References
- Liu, Haiyang.;Tang, Yubo.;Hu,Xiaofeng.;et al.Research on the assessment framework of joint combat programmes based on military chess projections.Journal of System Simulation.2018,30(11), 92–99.
- Cheng, Jian.; Zhang, Hui. Optimal model and model solving strategy of submarine torpedo defence using acoustic counter measure equipment. Command Control and Simulation.2019, 41(6),48–51.
- Lu, Wan.; Li, Zhao. Foreign anti-torpedo hydro-acoustic electronic warfare technology and its development trend. Shipboard Electronic Countermeasure. 2008,31(1), 50–53.
- Wang, Xinhua.; Gao, Honglin.;Mu Lianyun.; et al.Research on warship anti-torpedo technology.Ship Science and Technology. 2011, 33(9), 86–90.
- Gao, Xueqiang.; Song, Qiang.; Yang, Rijie. A review of key hard-kill techniques in acoustic warfare. Ship Science and Technology. 2007,29(2), 28–31.
- Li, Benchang.; Liu, Chunyue.; Zheng, Yuan. Development of modern acoustic countermeasure equipments and its effect on sea warfare.Torpedo Technology.2011,19(6), 468–472.
- George, J.; Sinchu, P.; Kumar, K. A.; et al. Towed acoustic countermeasures for defending acoustic homing torpedoes.Defence Science Journal.2019,69(6), 607–612. [CrossRef]
- Zhao, Lianfang. Anti-torpedo defense system and technology of surface and underwater warship.Intelligence Command Control and Simulation Techniques.2001,6(2), 1–14.
- Kierstead, D.; Delbalzo, D. A genetic algorithm applied search paths in complicated environments.Military Operations Research.2003,8(2), 45–59.
- Jia, Yue.; Song, Baowei.; Liang, Qingwei. Evadable optimization model and survival probability analysis of warship with rocket assist acoustic decoy countering torpedo.Acta Armamentar.2008,29(5), 637–640.
- Jia, Yue.; Song, Baowei.; Cui Shaobo. The mathematical and simulation model of countering the acoustic homing torpedo with the acoustic decoy.Journal of System Simulation.2008,20(2), 267–269.
- Li,Minghui.;Min,Shaorong.;Xie,Hongsheng.Derivative assessment of torpedo avoidance effectiveness of ships based on the Monte Carlo method.Ship Electronics Engineering.2014,34(2),136–140.
- Malinowski, M.; Gopakumar, K.; Rodriguz, J.; et al. A survey on cascaded multilevel inverters.IEEE Transactions on Industry Electronics.2010,57(7), 2197–2206. [CrossRef]
- Levine, A.J. The Pacific War: Japan versus the Allies; Greenwood Publishing Group: Westport, CT, USA, 1995; Volume 130.
- Maskery, M.; Krishnamurthy, V. Network-enabled missile deflection: Games and correlation equilibrium. IEEE Trans. Aerosp. Electron. Syst. 2007, 43, 843–863. [CrossRef]
- Maskery, M.; Krishnamurthy, V.; O’Regan, C. Decentralized algorithms for netcentric force protection against antiship missiles. IEEE Trans. Aerosp. Electron. Syst. 2007, 43, 1351–1372. [CrossRef]
- Bachmann, D.J.; Evans, R.J.; Moran, B. Game theoretic analysis of adaptive radar jamming. IEEE Trans. Aerosp. Electron. Syst. 2011, 47, 1081–1100. [CrossRef]
- Xia,Zhijun.;Zhang, Xinhua.;Xiao Jigang.;et al.Requirement Analysis of Hydroacoustic Countermeasures System for Ship Formation.Ship Science and Technology.2007,29(6),66–69.
- Ma, Fei.; Cao, Zeyang.; Liu, Hui. Construction and search of strategy space of target assignment based on game theory.Journal of Systems Engineering and Electronics. 2010,32(9), 1941–1945.
- Edwin Ho, Arvind Rajagopalan, Alex Skvortsov, Sanjeev Arulampalam and Mahendra Piraveenan. Game Theory in Defence Application: A Review. Sensors. 2022,22(3), 1032. [CrossRef]
- Kuhn, H.; Arrow, K.; Tucker, A. Contributions to the Theory of Games. Number v. 2 in Annals of Mathematics Studies; Princeton University Press: Princeton, NJ, USA, 1953.
- Hillier, F. S.;Lieberman, G. J.Introduction to operations research, 7rd ed.; McGraw-Hill: New York, USA, 2001; pp.726–741.
- Vitor, F., Easton, T. The double pivot simplex method. Mathematical Methods of Operations Research, 2017,87, 109–137. [CrossRef]
- Dantzig G. Maximization of a linear function of variables subject to linear inequalities. In: Koopmans TC (ed) Activity analysis of production and allocation, 1951. Wiley, New York, pp 339–347.
1 |
1 kn = 1n mile/h= 0.514 m/s. |
2 |
1cab=0.1 n mile=185.2m. |
|
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2023 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).