Fault-Tolerant Optimal Consensus Control for Heterogeneous Multi-agent System

Preprint

Article

Fault-Tolerant Optimal Consensus Control for Heterogeneous Multi-agent System

Altmetrics

Downloads

Views

Comments

A peer-reviewed article of this preprint also exists.

Yandong Li,

Yongan Liu^*,Ling Zhu,

Zehua Zhang

Yandong Li,

Yongan Liu^*,Ling Zhu,

Zehua Zhang

This version is not peer-reviewed

Submitted:

16 July 2024

Posted:

16 July 2024

You are already at the latest version

Alerts

Abstract

This study explores fault-tolerant consensus in leader-following heterogeneous multi-agent systems, focusing on actuator failures in uncrewed aerial vehicles (UAVs) and uncrewed ground vehicles (UGVs). An optimization-based fault-tolerant consensus algorithm is proposed. The algorithm utilizes the Euler-Lagrange formula to ensure system consistency under actuator failures, with the Lyapunov stability theory proving the asymptotic stability of the consistency error. The algorithm is applied to heterogeneous multi-agent systems of UAVs and UGVs to derive optimal fault-tolerant consensus control laws for each vehicle type. Simulation experiments give evidence for the feasibility of the proposed control strategy.

Keywords:

Subject: Computer Science and Mathematics - Applied Mathematics

1. Introduction

Due to rapid advancements in science, technology, and evolving societal needs, researchers have consistently prioritized collaborative control of multi-agent systems. Especially in recent years, rapid development has been seen. It has achieved a large number of application results in the field of engineering, such as UAV formation [1,2], intelligent city traffic [3], smart grid [4,5], etc. Consistency is the core issue of collaborative control, and corresponding control protocols are designed according to different controlled objects and working environments to achieve the convergence and stability of the controlled system states.

Multi-agent systems are primarily categorized into homogeneous and heterogeneous types. The consistency inquiry of homogeneous multi-agent systems has achieved fruitful results [6,7,8,9], During actual operation or use, most systems exhibit heterogeneous characteristics. Heterogeneous multi-agent systems are structurally constrained and mainly unable to achieve complete state consistency. Based on this, Scholars both domestically and internationally are increasingly concentrating on the study of consensus in heterogeneous multi-agent systems [10,11,12,13,14,15,16]. In conjunction with the increasing working time of intelligent agents and the complex and changeable actual environment, individual intelligent agents will inevitably encounter failures, and multi-agent systems cannot solve this problem through their attributes. Therefore, ensuring multi-agent systems achieve consistency during failures has become a subject of great concern. Reference [17] proposed an approach utilizing inner and outer loops to accomplish the control objective of multiple uncrewed aerial vehicles following a leader aircraft in the presence of actuator failures. The outer loop is responsible for designing position state control laws to uphold the formation flight, while the inner loop addresses actuator effects through adaptive control laws for UAV attitudes. Reference [18] implemented a distributed Sliding Mode Observer (SMO) for each trailing UAV, estimating necessary reference values through information exchange among neighboring UAVs. Adaptive neural Fault-Tolerant Control (FTC) units were subsequently devised for the UAV to converge toward the benchmark value produced by the distributed Sliding Mode Observer (SMO) in case of actuator failures. Reference [19] examined the coordination of drones in formation under conditions involving leader and actuator failures. The study applied boundary layer theory and devised a control protocol featuring adaptive mechanisms for compensating actuator deficiencies. Reference [20] devised a formation control law with adaptive mechanisms for multi-octocopter drone models, taking into account uncertainties and actuator failures. Reference [21] proposed a new adaptive backstepping method related to command filters to address model uncertainties and input saturation problems for multiple UAVs under input saturation, actuator failures, and external disturbances, designing a robust controller. The aforementioned studies focus exclusively on homogeneous multi-agent systems, with limited research outcomes on achieving fault-tolerant consistency in heterogeneous multi-agent systems. Reference [22] investigated a collaborative fault-tolerant output regulation control approach for linear heterogeneous multi-agent systems operating under directed network topologies. The objective is to ensure system stability despite actuator failures. Reference [23] examines fault-tolerant consistency in heterogeneous multi-agent systems. The study introduces a sliding mode observer aimed at achieving consistent system control in the presence of uncertainties and actuator faults. While both references explored fault-tolerant control in heterogeneous multi-agent systems, they primarily discussed generic models rather than specific physical implementations.

Building on the preceding analysis, this paper aims to investigate the consistency issues in leader-following heterogeneous UAV-UGV systems featuring faulty followers. Specifically, this paper designs a fault-tolerant consistency controller for leader-following heterogeneous multi-agent systems encountering partial actuator failures. The contributions of this study are outlined below:

Firstly, this paper introduces dynamic models for intelligent agent systems and formulates them using Kronecker products in state space. It then constructs the Laplacian matrix of the communication topology.

The paper proposes a fault-tolerant consistency controller for leader-following multi-agent systems in the presence of actuator failures, validated using Lyapunov stability theory. The algorithm shows robust fault tolerance to constant and time-varying actuator faults without needing to solve the Hamilton-Jacobi-Bellman equation.

Performance index functions are designed for each UAV and UGV, aiming to minimize the performance index of each UAV and UGV pair to achieve overall minimization for the entire heterogeneous multi-agent system. The fault-tolerant consistency controller obtained through this optimization process is considered the optimal controller, ensuring leader-following consistency under conditions of actuator failures in both UAVs and UGVs.

2. Preliminaries

This section primarily covers fundamental concepts related to UAVs and UGVs, discussing the application of graph theory to delineate system interrelationships and presenting the state-space equations for UAV and UGV systems.

2.1. Graph Theory

Based on the relevant theories of graph theory, describe the communication topology of multi-agent systems. The unoriented weighted graph

G = (V, E, A)

comprises

k + 1

vertices,

V = (v_{0}, v_{1}, v_{2}, \dots v_{k})

representing the complete set of vertices. Each vertex corresponds to an agent, which

v_{0}

denotes the leader. Let

E = {\begin{matrix} e_{i j} = (v_{i}, v_{j}) \end{matrix}}

denote the edges between vertices,

e_{i j} = (v_{i}, v_{j})

representing the edge from vertex

v_{i}

to vertex

v_{j}

. The connection between two vertices through an edge indicates the existence of information exchange between them. If bidirectional communication is allowed, the graph is undirected; or directed.

A = {[\begin{matrix} a_{i j} \end{matrix}]}_{n \times n}

stands for the adjacency matrix describing relationships between followers, where the

a_{i j}

is the edge

e_{i j} = (v_{i}, v_{j})

’s weight. If there is an edge

e_{i j} \in E

between vertices

i

and

j

, then

a_{ij} > 0

; otherwise,

a_{i j} = 0

N_{i}

denotes the neighbor set of the

i

-th agent, represented as

N_{i} = {V_{j} \in V, | e_{j i} \in E}, i = 1, 2, ..., k

In an unoriented graph, the degree of a node denotes its number of neighbors, specifically the count of connecting edges per node. Let

D = d i a g {d_{1}, d_{2}, \dots, d_{k}}

denote the degree matrix of the unoriented graph, defined as

d_{i} = \sum_{j = 1}^{n} a_{i j}

. The Laplacian matrix of the graph is defined as

L = D - A

, where

A

is the adjacency matrix.

ζ = d i a g (a_{01}, a_{02}, \dots, a_{0 k})

, It represents the Laplacian matrix, which describes the communication relationships between leaders and followers.

2.2. UGV Dynamics Model

A single UGV model be defined as equation (1):

{\begin{matrix} {\dot{p}}_{g i} = v_{g i} \\ {\dot{v}}_{g i} = u_{g i} \end{matrix}

(1)

where

p_{g i} = {[p_{g i}^{x}, p_{g i}^{y}]}^{T}

denotes the position in

X Y

space,

v_{g i} = {[v_{g i}^{x}, v_{g i}^{y}]}^{T}

denotes velocity, which corresponds to the speed of the UGV moving along the direction of

p_{g i}

and

u_{g i} = {[u_{g i}^{x}, u_{g i}^{y}]}^{T}

signifies the input of the agent

i

. For

m

UGVs, the formula is transformed into the following states:

{\dot{x}}_{G i} = A_{G} x_{G i} + B_{G} u_{G i}

(2)

where

x_{G i} = {(p_{i}, v_{i})}^{T}, p_{i} = (p_{i}^{x}, p_{i}^{y}), v_{i} = (v_{i}^{x}, v_{i}^{y}), u_{G i} = (u_{i}^{x}, u_{i}^{y}), i = 1, 2, \dots, m

A_{G} = [\begin{matrix} 0 & 1 \\ 0 & 0 \end{matrix}] \otimes I_{2}, B_{G} = [\begin{matrix} 0 \\ 1 \end{matrix}] \otimes I_{2} .

Considering the failure of actuators in uncrewed vehicles

u_{G i}^{f} = (u_{i x}^{f}, u_{i y}^{f})

represents the input after the actuator failure. The specific expression

u_{G i}^{f}

is as follows:

u_{G i}^{f} = (I_{2} - 𝒫_{G i}) u_{G i},

(3)

where the equation

𝒫_{G i} = d i a g (ρ_{i x}, ρ_{i y}) \in R^{2}

is central to our analysis. This paper primarily examines partial actuator failures within a multi-following uncrewed ground vehicle system, which

ρ_{i x}, ρ_{i y}

does not uniformly equal one across all instances. The dynamic model of each of the

m

UGVs in the system can be represented as:

{\dot{x}}_{G i} = A_{G} x_{i} + B_{G} u_{G i}^{f}, \begin{matrix}  \end{matrix} i = 1, 2, \dots, m

(4)

For the

m

UGVs actuator failure model described by equation (4), when the multi-uncrewed ground vehicle system achieves consensus, it means that all uncrewed ground vehicle states satisfy the following equation:

\lim_{t \to \infty} ‖ p_{i} (t) - p_{0} (t) ‖ = 0, \begin{matrix}  \end{matrix} \lim_{t \to \infty} ‖ v_{i} (t) - v_{0} (t) ‖ = 0

(5)

2.3. UAV Dynamics Model

A single UAV model be defined as equation (6):

\begin{array}{l} {\ddot{p}}^{x} = g θ \\ {\ddot{p}}^{y} = - g ϕ \\ {\ddot{p}}^{z} = f_{z} / m - g \\ g \ddot{ϕ} = M_{ϕ} / I_{x} \\ g θ = M_{θ} / I_{y} \\ \ddot{ψ} = M_{ψ} / I_{z} \end{array}

(6)

where

p^{x}, p^{y}, p^{z}

represents the UAV’s positions in the

X 、 Y 、 Z

axes;

ϕ, θ, a n d, ψ

corresponds to the rotation angle of the UAV along

X 、 Y

and

Z

axes respectively.

f_{z}

denotes the lift force in the

Z

axes;

M_{ϕ} / I_{x} ， M_{θ} / I_{y} ， M_{ψ} / I_{z}

represents the control input for rotating the drone around the three coordinate axes.

If there is one leader UAV and

n - m

follower UAVs, then the equation (6) above can be transformed into a state equation:

\begin{array}{l} {\dot{x}}_{A 0} = A_{A} x_{A 0} \\ {\dot{x}}_{A i} = A_{A} x_{A i} + B_{A} u_{A i} \end{array}

(7)

where

x_{A i} = {(p_{i}, v_{i}, Ω_{i}, {\dot{Ω}}_{i})}^{T}, p_{i} = {(p_{i}^{x}, p_{i}^{y}, p_{i}^{z})}^{T}, v_{i} = {(v_{i}^{x}, v_{i}^{y}, v_{i}^{z})}^{T}, u_{A i} = {(u_{i}^{x}, u_{i}^{y}, u_{i}^{z})}^{T},

Ω_{i} = {(g θ_{i}, - g ϕ_{i}, ψ)}^{T}, {\dot{Ω}}_{i} = {(g {\dot{θ}}_{i}, - g {\dot{ϕ}}_{i}, \dot{ψ})}^{T}, i = m, m + 1, \dots, n,

x_{A 0} = {(p_{0}, v_{0}, Ω_{0}, {\dot{Ω}}_{0})}^{T}, p_{0} = {(p_{0}^{x}, p_{0}^{y}, p_{0}^{z})}^{T}, v_{0} = {(v_{0}^{x}, v_{0}^{y}, v_{0}^{z})}^{T}

represents the leader UAV’s state.

A_{A} = [\begin{matrix} 0 & 1 & 0 & 0 \\ 0 & 0 & 1 & 0 \\ 0 & 0 & 0 & 1 \\ 0 & 0 & 0 & 0 \end{matrix}] \otimes I_{3}, B_{A} = [\begin{matrix} 0 \\ 0 \\ 0 \\ 1 \end{matrix}] \otimes I_{3} .

Considering the failure of actuators in uncrewed vehicles

u_{A i}^{f} = (u_{i x}^{f}, u_{i y}^{f}, u_{i z}^{f})

represents the input after the actuator failure. The specific expression

u_{A i}^{f}

is as follows:

u_{A i}^{f} = (I_{3} - 𝒫_{A i}) u_{A i},

(8)

where the equation

𝒫_{A i} = d i a g (ρ_{i x}, ρ_{i y}, ρ_{i z}) \in R^{3}

is central to our analysis. This paper primarily examines partial actuator failures within a multi-following uncrewed aerial vehicle system, which

ρ_{i x}, ρ_{i y}, ρ_{i z}

does not uniformly equal one across all instances. The dynamic model of each of the

n - m

UAVs in the system can be represented as:

{\dot{x}}_{A i} = A_{A} x_{A i} + B_{A} u_{A i}^{f}

(9)

For the

n - m

UAV actuator failure model described by equation (9), when the multi-uncrewed aerial vehicle system achieves consensus, this implies that all states of the UAVs satisfy the following equation:

\lim_{t \to \infty} ‖ X_{Ai} (t) - X_{A 0} (t) ‖ = 0

(10)

2.4. Heterogeneous Multi-Agent System

By establishing fault models for UAVs and UGVs using equations (4) and (9), the expression of the state variable for a heterogeneous multi-agent system can be constructed by merging state variables. The state variable model for heterogeneous systems is defined as follows:

\begin{array}{l} [\begin{matrix} {\dot{X}}_{G} \\ {\dot{X}}_{A} \end{matrix}] = [\begin{matrix} A_{G} & 0 \\ 0 & A_{A} \end{matrix}] [\begin{matrix} X_{G} \\ X_{A} \end{matrix}] + [\begin{matrix} B_{G} & 0 \\ 0 & B_{A} \end{matrix}] [\begin{matrix} U_{G} \\ U_{A} \end{matrix}] \\ \dot{X} = A X + B U \end{array}

(11)

where

X = {(X_{G}^{T}, X_{A}^{T})}^{T}, A = (\begin{matrix} A_{G} & 0 \\ 0 & A_{A} \end{matrix}), B = (\begin{matrix} B_{G} & 0 \\ 0 & B_{A} \end{matrix}), X_{G} = {(x_{G 1}, x_{G 2} \dots x_{G m})}^{T}

\begin{array}{l} X_{A} = {(x_{A (m + 1)}, x_{A (m + 2)} \dots x_{A n})}^{T}, a n d U = {(U_{G}^{T}, U_{A}^{T})}^{T}, \\ U_{G} = {(u_{G 1}^{f}, u_{G 2}^{f} \dots u_{G m}^{f})}^{T}, U_{A} = {(u_{A (m + 1)}^{f}, u_{A (m + 2)}^{f} \dots u_{A n}^{f})}^{T} . \end{array}

To better describe the communication relationship between heterogeneous systems, a simple linear transformation needs to be applied to the Laplacian matrix of the system. The system consists of

m

uncrewed ground vehicles and

n - m

uncrewed aerial vehicles, with a total of

n

agents.

L

is corresponding Laplacian matrix, is shown as follows:

L = [\begin{matrix} L_{A A} & L_{A G} \\ L_{G A} & L_{G G} \end{matrix}]

where

L_{A G} \begin{matrix}  \end{matrix} L_{G A}

represents information between heterogeneous agent systems. Regarding the actuator fault model of

n

heterogeneous agents system described by equation (11), When the heterogeneous multi-agent system reaches consensus, it implies that all agent states satisfy the following equation:

Assumption 1.

The communication graph between agent systems is firmly connected, and at least one follower is linked to a leader.

Assumption 2.

During the operation of the leader-follower multi-agent system, the leader agent will not experience failures.

3. Design and Analysis of Fault-Tolerant Consensus Controllers

This section addresses the problem described in equation (12) by designing and analyzing fault-tolerant consensus controllers of heterogeneous multi-agent fault models. The theoretical effectiveness of the proposed algorithm is subsequently demonstrated.

The following describes the performance index parameters for each follower agent:

j_{i} = \int_{0}^{C} [{(u_{i}^{f} (t))}^{T} H u_{i}^{f} (t) + \sum_{j \in N_{i}} {(a_{i j} (x_{i} - x_{j}) + a_{0 i} (x_{i} - x_{0}))}^{T} Q \sum_{j \in N_{i}} a_{i j} (x_{i} - x_{j}) + a_{0 i} (x_{i} - x_{0})] d t

(13)

where

i = 1, 2, \dots n

C

represents a constant greater than zero indicating the integral’s upper bound.

{(u_{i}^{f} (t))}^{T}

represents the transpose operation of a vector.

H

and

Q

both positive definite symmetric matrices.

Theorem 1.

Consider a leader-follower multi-agent system:

{\begin{matrix} {\dot{x}}_{0} = A x_{0} \\ {\dot{x}}_{i} = A x_{i} + B u_{i}^{f} \end{matrix} \begin{matrix} i = 1, 2, \dots, n \end{matrix}

(14)

Assuming that the leader-follower multi-agent system (14) satisfies Assumptions 1 and 2. For the leader-follower multi-agent system with actuator faults described by equation (14), the optimal controller

u_{i}^{*} (t)

, which minimizes the performance index parameters (13), can be represented:

u_{i}^{*} (t) = - \frac{| N_{i} |}{2} {(I - 𝒫_{i})}^{- 1} H^{- 1} B^{T} η_{i}^{*} (t)

(15)

where

| N_{i} |

denote the number of neighbor agents in the

i

-th agent’s neighbor set.

H^{- 1}

represents the positive definite symmetric matrix's inverse matrix in the performance index parameters. Under this optimal controller

u_{i}^{*} (t)

, the consensus error of the systems (14) can asymptotically converge to zero.

Proof of Theorem 1.

Define the consensus tracking error of the

i

-th agent is shown as follows:

e_{i} (t) = \sum_{j \in N_{i}} a_{i j} (x_{i} - x_{j}) + a_{0 i} (x_{i} - x_{0}), \begin{matrix}  \end{matrix} i = 1, 2, ..., n .

(16)

By utilizing the dynamic equation of the system (14), the time derivative of equation (16) will be obtained:

{\dot{e}}_{i} (t) = A e_{i} (t) + \sum_{j \in N_{i}} a_{i j} B (u_{i}^{f} (t) - u_{j}^{f} (t)) + a_{0 i} B u_{i}^{f} (t)

(17)

Furthermore, we assume that the controllers of all agents in

N_{i}

of the

i

-th agents are mutually independent.

Define the performance index function for the consensus error system described by equation (16) as:

J_{i} = \int_{0}^{T} [{(u_{i}^{f} (t))}^{T} H u_{i}^{f} (t) + e_{i}^{T} (t) Q e_{i} (t)] d t .

(18)

Define the Hamiltonian parameters:

\begin{array}{l} H_{i} (t, e_{i}, u_{i}^{f}, η_{i}) = e_{i}^{T} (t) Q e_{i} (t) + {(u_{i}^{f} (t))}^{T} H (t) u_{i}^{f} (t) \\ \begin{matrix} \begin{matrix} \begin{matrix} \begin{matrix}  \end{matrix} \end{matrix} \end{matrix} & \begin{matrix}  \end{matrix} \end{matrix} \begin{matrix}  \end{matrix} + η_{i}^{T} (t) (A e_{i} (t) + \sum_{i = 1}^{n} a_{i j} B (u_{i}^{f} (t) - u_{j}^{f} (t)) + a_{0 i} B u_{i}^{f} (t)) . \end{array}

(19)

where

λ_{i} \in R^{n}

is an auxiliary variable. Performing some mathematical transformations on the Hamiltonian function represented by equation (19), we can obtain the following expression:

\begin{array}{l} H_{i} (t, e_{i} (t), u_{i}^{f} (t), η_{i} (t)) = e_{i}^{T} (t) Q e_{i} (t) + {(u_{i}^{f} (t))}^{T} H u_{i}^{f} (t) \\ \begin{matrix} \begin{matrix} \begin{matrix}  \end{matrix} \end{matrix} \end{matrix} + η_{i}^{T} (t) (A e_{i} (t) + \sum_{j \in N_{i}} (B u_{i}^{f} (t) - B u_{j}^{f} (t))) \\ \begin{matrix} \begin{matrix} \begin{matrix}  \end{matrix} \end{matrix} \end{matrix} \begin{matrix}  \end{matrix} = \sum_{j \in N_{i}} x_{i}^{T} (t) Q x_{i} (t) - 2 \sum_{j \in N_{i}} x_{i}^{T} (t) Q x_{j} (t) + {(u_{i}^{f} (t))}^{T} H u_{i}^{f} (t) \\ \begin{matrix} \begin{matrix} \begin{matrix}  \end{matrix} \end{matrix} \end{matrix} + \sum_{j \in N_{i}} x_{j}^{T} (t) Q x_{j} (t) \\ \begin{matrix} \begin{matrix} \begin{matrix}  \end{matrix} \end{matrix} \end{matrix} + η_{i}^{T} (t) (A e_{i} (t) + \sum_{i = 1}^{N} a_{i j} B (u_{i}^{f} (t) - u_{j}^{f} (t)) + a_{0 i} B u_{i}^{f} (t)) . \end{array}

(20)

By computing the partial derivatives of

H_{i} (t, e_{i} (t), u_{i}^{f} (t), η_{i} (t))

concerning

u_{i}^{f} (t)

and

η_{i} (t)

respectively, we obtain:

\begin{array}{l} \frac{𝜕 H_{i} (t, e_{i} (t), u_{i}^{f} (t), η_{i} (t))}{𝜕 u_{i}^{f} (t)} = 2 H (I_{k} - 𝒫_{i}) u_{i} (t) + (a_{0 i} + | N_{i} |) B^{T} η_{i} (t) \\ \frac{𝜕 H_{i} (t, e_{i} (t), u_{i}^{f} (t), η_{i} (t))}{𝜕 e_{i} (t)} = \sum_{j \in N_{i}} 2 Q (x_{i} (t) - x_{j} (t) + a_{0 i} (x_{i} (t) - x_{0} (t))) + A^{T} η_{i} (t) . \end{array}

(21)

Therefore, the optimal fault-tolerant controller is obtained:

{\begin{array}{l} u_{i}^{*} (t) = - \frac{| N_{i} | + a_{0 i}}{2} {(I - 𝒫_{i})}^{- 1} H^{- 1} B^{T} η_{i}^{*} (t) \\ η_{i}^{*} (t) = - \sum_{j \in N_{i}} 2 Q (x_{i} (t) - x_{j} (t) + a_{0 i} (x_{i} (t) - x_{0} (t))) - A^{T} η_{i} (t) \end{array}, i = 1, 2, ..., n .

(22)

Next, the primary analysis focuses on whether the controller represented by equation (22) can achieve consensus for equation (14) under actuator faults. With the principles of optimal control theory, the controller equation (22) satisfies:

H_{i} (t, e_{i}^{*} (t), u_{i}^{*} (t), η_{i}^{*} (t)) = 0

(23)

where

e_{i}^{*} (t), η_{i}^{*} (t)

stand for the optimal consensus error and optimal coefficient of the

i

the agent under the optimal fault-tolerant control

u_{i}^{*} (t)

. For this purpose, the Lyapunov function for the defined equation (14) is as follows:

V_{i} (e_{i}^{*} (t)) = \frac{1}{2} {\int_{t}^{\infty} [(u_{i}^{*} (t))}^{T} H u_{i}^{*} (t) + {(e_{i}^{*} (t))}^{T} Q e_{i}^{*} (t)] d t, i = 1, 2, \dots, n

(24)

where

H \in R^{m \times m}, Q \in R^{n \times n}

are both symmetric positive definite matrices. According to the properties of positive definite matrices, equation (24) illustrates a positive definite function.

Based on reference [24], the optimal Hamiltonian function

H_{i} (t, e_{i}^{*} (t), u_{i}^{*} (t), η_{i}^{*} (t))

represented by equation (19) can be rewritten in the following form:

\begin{array}{l} H_{i} (t, e_{i}^{*} (t), u_{i}^{*} (t), η_{i}^{*} (t)) = {(e_{i}^{*} (t))}^{T} Q e_{i}^{*} (t) + {(u_{i}^{*} (t))}^{T} H u_{i}^{*} (t) \\ \begin{matrix}  \end{matrix} + \frac{𝜕 V_{i}^{T} (e_{i}^{*} (t))}{𝜕 e_{i}^{*} (t)} (A e_{i} (t) + \sum_{i = 1}^{n} a_{i j} B (u_{i}^{*} (t) - u_{j}^{*} (t)) + a_{0 i} B u_{i}^{*} (t)) \end{array}

(25)

Therefore, equation (23) will be transformed into:

\begin{array}{l} \frac{𝜕 V_{i}^{T} (e_{i}^{*} (t))}{𝜕 e_{i}^{*} (t)} (A e_{i} (t) + \sum_{i = 1}^{n} a_{i j} B (u_{i}^{*} (t) - u_{j}^{*} (t)) + a_{0 i} B u_{i}^{*} (t)) \\ = - ({(e_{i}^{*} (t))}^{T} Q e_{i}^{*} (t) + {(u_{i}^{*} (t))}^{T} H u_{i}^{*} (t)) . \end{array}

(26)

Furthermore, by differentiating the Lyapunov function defined by equation (24), we obtain:

{\dot{V}}_{i} (e_{i}^{*} (t)) = \frac{𝜕 V_{i}^{T} (e_{i}^{*} (t))}{𝜕 e_{i}^{*} (t)} (A e_{i} (t) + \sum_{i = 1}^{n} a_{i j} B (u_{i}^{*} (t) - u_{j}^{*} (t)) + a_{0 i} B u_{i}^{*} (t))

(27)

According to equation (26),

{\dot{V}}_{i} (e_{i}^{*} (t)) = - ({(e_{i}^{*} (t))}^{T} Q e_{i}^{*} (t) + {(u_{i}^{*} (t))}^{T} H u_{i}^{*} (t)) .

(28)

Since both matrix

Q

and matrix

H

are positive definite symmetric matrices,

{\dot{V}}_{i} (e_{i}^{*} (t))

is a negative definite function. According to the Lyapunov stability theory,

e_{i}^{*} (t)

will asymptotically converge to zero. □

From the performance index functions, it can be seen that if

J_{i}

reaches a minimum value, then the state error between the agents in the

i

-th agent's neighbor set

N_{i}

and the

i

-th agent also reaches a minimum value. Furthermore, according to Assumption 1, it can be obtained that if all

J_{i}

reach minimum values, the entire multi-agent system's state can achieve consensus. Therefore, from Theorem 1, it can be concluded that the controller

u_{i}^{*}

can achieve consensus on the state of the system (14).

According to Theorem 1, performance index functions are defined for each UAV and UGV as follows:

\begin{array}{l} J_{i} = \int_{0}^{\infty} [{(u_{G i}^{f} (t))}^{T} H_{G} u_{G i}^{f} (t) + e_{G i}^{T} Q_{G} e_{G i}] d t, \\ W_{i} = \int_{0}^{\infty} [{(u_{A i}^{f} (t))}^{T} H_{A} u_{A i}^{f} (t) + e_{A i}^{T} Q_{A} e_{A i}] d t, \end{array}

(29)

where when

i = 1, 2 \dots, m

is used, it represents UGV, and when

i = m + 1, m + 2, m + 3, ..., n

is used, it represents UAV.

H_{G}, Q_{G}, H_{A}, Q_{A}

are both positive definite symmetric matrices.

Due to the different dimensions of the state vectors of UAVs and UGVs, weight coefficient matrices are designed as follows:

\begin{array}{l} Q_{G} = 60 * I_{4}, H_{G} = 5 * I_{2} \\ Q_{A} = 60 * I_{12}, H_{A} = 5 * I_{3} \end{array}

According to Assumption 1, it can be inferred that if all

J_{i}

and

W_{i}

reach minimum values, the entire leader-following multi-agent system's state can achieve consensus. Therefore, from Theorem 1, it can be concluded that the controller

u_{i}^{*}

can achieve consensus on the multi-agent system's state. Obtain the optimal fault-tolerant consensus controllers for each UAV and UGV respectively:

For UGV:

{\begin{array}{l} u_{G i}^{*} (t) = - \frac{| N_{i} | + a_{0 i}}{2} {(I_{2} - 𝒫_{G i})}^{- 1} H_{G}^{- 1} B_{G}^{T} η_{i}^{*} (t) \\ η_{i}^{*} (t) = - Q_{G} e_{G} - A_{G}^{T} η_{i} (t) \end{array}, i = 1, 2, ..., m .

(30)

UGV control law:

u_{G i}^{*} (t) = - \frac{| N_{i} | + a_{0 i}}{2} {(I_{2} - 𝒫_{G i})}^{- 1} H_{G}^{- 1} B_{G}^{T} (x_{G i} (t) - x_{A 0} (t))

(31)

For UAV:

{\begin{array}{l} u_{A i}^{*} (t) = - \frac{| N_{i} | + a_{0 i}}{2} {(I_{3} - 𝒫_{A i})}^{- 1} H_{A}^{- 1} B_{A}^{T} η_{i}^{*} (t) \\ η_{i}^{*} (t) = - Q_{A} e_{A} - A_{A}^{T} η_{i} (t) \end{array} \begin{matrix}  \end{matrix} i = m + 1, \dots n

(32)

UAV control law:

u_{A i}^{*} (t) = - \frac{| N_{i} | + a_{0 i}}{2} {(I_{3} - 𝒫_{A i})}^{- 1} H_{A}^{- 1} B_{A}^{T} (x_{A i} (t) - x_{A 0} (t))

(33)

For any two agents

i

and

j

in the leader-following multi-agent system, there are two cases for an agent

j

: 1)

j \in N_{i}

, in which case, according to the above analysis,

e_{i}^{*} (t)

asymptotically converges to zero, thus indicating that agents

i

’s states and agents

j

’s states tend to be consistent; 2)

j \notin N_{i}

, According to Assumption 1, it is known that there is a path between any two agents, and by the transitivity of states, the states of agents

i

and

j

tend to be consistent. It can be inferred that the consistency error of the system (11) under actuator failure can asymptotically converge to zero at this time.

4. Simulations

In this section, simulations are performed to validate the effectiveness of the proposed algorithm (31)(33). The experiment involves a leader UAV, three follower UAVs, and three UGVs forming the system. MATLAB 2017a is used as the experimental platform.

The Laplacian matrix corresponding to the undirected communication topology is shown below：

L = [\begin{matrix} \underset{L_{A A}}{\underset{︸}{\begin{matrix} 3 & - 1 & - 1 \\ - 1 & 3 & - 1 \\ - 1 & - 1 & 3 \end{matrix}}} & \underset{L_{A G}}{\underset{︸}{\begin{matrix} 0 & 0 & - 1 \\ 0 & - 1 & 0 \\ - 1 & 0 & 0 \end{matrix}}} \\ \underset{L_{G A}}{\underset{︸}{\begin{matrix} 0 & 0 & - 1 \\ 0 & - 1 & 0 \\ - 1 & 0 & 0 \end{matrix}}} & \underset{L_{G G}}{\underset{︸}{\begin{matrix} 3 & - 1 & - 1 \\ - 1 & 3 & - 1 \\ - 1 & - 1 & 3 \end{matrix}}} \end{matrix}] \begin{matrix} ζ = [\begin{matrix} 1 & 0 & 0 & 0 & 0 & 0 \\ 0 & 0 & 0 & 0 & 0 & 0 \\ 0 & 0 & 0 & 0 & 0 & 0 \\ 0 & 0 & 0 & 1 & 0 & 0 \\ 0 & 0 & 0 & 0 & 0 & 0 \\ 0 & 0 & 0 & 0 & 0 & 0 \end{matrix}] \end{matrix}

Each UAV has a 12-dimensional state, while the state vector of the UGV is 4-dimensional. The correlation coefficient matrix of the system (11) is as previously designed.

The system primarily considers partial failure of actuators. Therefore, all followers' actuator failure coefficients must be set between 0 and 1 in the simulation. This experiment finds the following failure coefficient scenarios.

𝒫_{A 1} = [\begin{matrix} 0.5 & 0 & 0 \\ 0 & 0.3 & 0 \\ 0 & 0 & 0.6 \end{matrix}] ， 𝒫_{A 3} = [\begin{matrix} 0.5 \cos t & 0 & 0 \\ 0 & 0.8 & 0 \\ 0 & 0 & 0.2 \end{matrix}] ， 𝒫_{G 1} = [\begin{matrix} 0.1 & 0 \\ 0 & 0.8 \sin t \end{matrix}] ，

According to the above coefficient matrix and failure coefficient design, MATLAB simulation is employed to verify the control algorithm (31) and algorithm (33) proposed for the heterogeneous multi-agent system.

To further demonstrate the superior convergence speed of the proposed algorithm, this study compares the algorithm with the heterogeneous multi-agent system consistency algorithm presented in reference [25] under similar initial conditions. The comparison between the simulation results of reference [25] and the algorithm (31) (33) is shown in Figure 1, Figure 2, Figure 3, Figure 4, Figure 5, Figure 6, Figure 7, Figure 8, Figure 9, Figure 10, Figure 11 and Figure 12.

Figure 1 and Figure 2 illustrate that the method proposed in (31)(33) for addressing leader-following consistency outperforms the approach presented in reference [25], demonstrating superior performance. Figure 1 illustrates the stabilization of position consistency error in the X-direction between the UAV and UGV systems when using the optimal fault-tolerant consistency protocol

t = 10 s

. Figure 2 shows the position stabilization between the UAV and UGV systems in the X-direction.

35 \leq t \leq 45

when employing the consistency protocol from reference [25].

Figure 3. Consistency error in the Y-direction position between the following UAV, UGV, and the leader.

Figure 4. The position variables of UAV and UGV in the Y-direction are in reference [25]

Figure 3 shows that under the optimal fault-tolerant consistency protocol, the UAV and UGV systems stabilize regarding position consistency error in the Y-direction between

10 \leq t \leq 15

. Figure 4 demonstrates that using the consistency protocol proposed in reference [25], the UAV and UGV systems stabilize regarding the position in the Y-direction

40 \leq t \leq 45

Figure 5. Consistency error in the Z-direction position between the following UAV and the leader.

Figure 5 illustrates the stabilization of position consistency error in the Z-direction for the UAV system at t = 10s under the optimal fault-tolerant consistency algorithm. The consistency algorithm presented in reference [25] is designed only for the UAV and UGV systems in the XY plane, thus not considering the position state in the Z-direction.

Figure 6. Consistency error in velocity along the X-direction between the following UAV, UGV, and the leader.

Figure 7. The velocity variables of UAV and UGV in the X-direction are in reference [25].

Figure 6 illustrates that the UAV and UGV systems achieve stable velocity consistency errors in the X-direction

t = 10 s

under the optimal fault-tolerant consistency algorithm. Figure 7 demonstrates that using the consistency control algorithm from reference [25], the UAV and UGV systems achieve stable velocity states in the X-direction between

40 \leq t \leq 45

Figure 8. Consistency error in velocity along the Y-direction between the following UAV, UGV, and the leader.

Figure 9. The velocity variables of UAV and UGV in the Y-direction are in reference [25].

Figure 8 illustrates that the UAV and UGV systems achieve stable velocity consistency errors in the Y-direction

t = 10 s

under the optimal fault-tolerant consistency algorithm. Figure 9 shows that using the consistency control algorithm from reference [25], the UAV and UGV systems achieve stable velocity states in the Y-direction

40 \leq t \leq 45

Figure 10. Consistency error in velocity along the Z-direction between the following UAV and the leader.

Figure 10 displays the stabilization of position consistency error in the Z-direction for the UAV system

t = 10 s

under the optimal fault-tolerant consistency algorithm. The consistency algorithm presented in reference [25] is designed only for the UAV and UGV systems in the XY plane, thus not considering the velocity state in the Z-direction.

Figure 11. Consistency error in the attitude angles of the following UAV.

Figure 12. The state variables of the attitude angles of the UAV under the method proposed in reference [25].

Figure 11 and Figure 12 show that Figure 11 depicts the stabilization of the roll angle, yaw angle, pitch angle, and their corresponding angular velocities of the UAV system under the optimal fault-tolerant consistency protocol

5 \leq t \leq 10

. Figure 12 illustrates the stabilization of the roll angle, yaw angle, and their corresponding angular velocities of the UAV under the algorithm proposed in reference [25]

t = 20 s

. It also demonstrates the optimal fault-tolerant consistency algorithm’s superiority, considering actuator faults. This algorithm enables heterogeneous multi-agent systems to achieve quicker consistency in the presence of faults, reducing the time required to complete tasks.

Plot the state trajectory of all UAVs and UGVs in this leader-following heterogeneous multi-agent system, as shown in Figure 13. The experimental outcomes show that the states of all following UAVs and UGVs converge to the leader’s position and velocity. It further demonstrates the efficiency and feasibility of the algorithm (31)(33).

5. Conclusions

This paper analyzes the dynamic models of uncrewed aerial vehicles and uncrewed ground vehicles to establish a heterogeneous system. Firstly, building upon the communication topology of heterogeneous multi-agent systems. The fault-tolerant consensus control problem of the leader-follower multi-agent system under actuator partial failure is introduced. Based on the Euler-Lagrange equations, performance index functions are defined for each following UGV and UAV. Then, the optimal fault-tolerant consensus controller capable of handling actuator partial failure is obtained through optimization theory, and the proposed algorithm’s stability is demonstrated using Lyapunov stability theory. Finally, MATLAB simulation experiments further corroborate the efficacy of the proposed algorithm. The algorithm ensures that UAVs and UGVs eventually converge to the leader's position and velocity. In the next step, the research will focus on collaborative control of heterogeneous multi-agent systems, integrated with fault-tolerant mechanisms. and the theoretical results will be applied to engineering practice.

Author Contributions

Conceptualization, Y.L. and Y.L.; methodology, Y.L.; software, L.Z.; validation, Y.L., Y.L. and L.Z.; resources, Z.Z.; writing original draft preparation, Y.L.; writing review and editing, Y.L.; supervision, L.Z.; funding acquisition, Z.Z. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the National Natural Science Foundation of China (61872204), the Scientific Research Project of Heilongjiang Provincial Universities, China (Grant No.145309313).

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

The data that support the findings of this study are available from the corresponding author: Yongan Liu, upon reasonable request.

Acknowledgments

We appreciate all the authors for their contributions and the support of the foundation.

Conflicts of Interest

The authors declare no conflict of interest.

References

Zhao, W.; Liu, H.; Wan, Y. J. S.; Letters, C., Data-driven fault-tolerant formation control for nonlinear quadrotors under multiple simultaneous actuator faults. 2021, 158, 105063. [CrossRef]
Weiming, Z.; Yang, X.; Delin, L. J. B., Fixed-time formation control of quadrotor UAV swarm with unknown disturbances. 2023, 50, (5), 1702-1712. [CrossRef]
Yang, J.; Zhang, J.; Wang, H. J. I. T. o. I. T. S., Urban traffic control in software defined internet of things via a multi-agent deep reinforcement learning approach. 2020, 22, (6), 3742-3754. [CrossRef]
Ma, X.; Yang, P.; Dong, H.; Yang, J.; Zhao, Y. In Secondary control strategy of islanded micro-grid based on multi-agent consistency, 2017 IEEE Conference on Energy Internet and Energy System Integration (EI2), 2017; IEEE: 2017; pp 1-6.
Huang, M.; Ding, L.; Li, W.; Chen, C.-Y.; Liu, Z. J. I. T. o. C.; Papers, S. I. R., Distributed observer-based H∞ fault-tolerant control for DC microgrids with sensor fault. 2021, 68, (4), 1659-1670. [CrossRef]
Chen, T.-T.; Wang, F.-Y.; Xia, C.-Y.; Chen, Z.-Q. J. N., Leader-following consensus of second-order multi-agent systems with intermittent communication via persistent-hold control. 2022, 471, 183-193. [CrossRef]
Cong, Y.; Du, H.; Liu, B.; Zhang, P.; Li, X. J. I. S., Distributed constrained finite-time consensus algorithm for second-order multi-agent systems. 2023, 626, 773-786. [CrossRef]
Jiao, L.; Xin, W.; Hongchao, L. J. J. o. S. S.; Sciences, M., Observer-Based Consensus for Multi-Agent Systems Subject to Consecutive DoS Attacks. 42, (7), 1715.
Ma, Q.; Xu, S. J. I. T. o. C., Consensus switching of second-order multiagent systems with time delay. 2020, 52, (5), 3349-3353. [CrossRef]
Chu, H.; Gao, L.; Zhang, W. J. I. C. T.; Applications, Distributed adaptive containment control of heterogeneous linear multi-agent systems: an output regulation approach. 2016, 10, (1), 95-102. [CrossRef]
Cai, H.; Huang, J. J. A., Output based adaptive distributed output observer for leader–follower multiagent systems. 2021, 125, 109413. [CrossRef]
Yu, T.; Wu, Q.; Song, Z. In Finite-time Output Consensus for a Class of Heterogeneous Linear Multi-agent Systems via an Output Regulation Approach, 2021 33rd Chinese Control and Decision Conference (CCDC), 2021; IEEE: 2021; pp 6533-6538.
Lv, M.; Ahn, C. K.; Zhang, B.; Fu, A. J. I. T. o. A.; Systems, E., Fixed-time anti-saturation cooperative control for networked fixed-wing unmanned aerial vehicles considering actuator failures. 2023.
Sun, F.; Liu, P.; Li, H.; Zhu, W. J. I. J. o. S. S., Fixed-time consensus of heterogeneous multi-agent systems based on distributed observer. 2021, 52, (9), 1780-1789. [CrossRef]
Shi, X.; Xu, L.; Yang, T.; Lin, Z.; Wang, X. J. I. T. o. C.; Briefs, S. I. E., Distributed fixed-time resource allocation algorithm for the general linear multi-agent systems. 2022, 69, (6), 2867-2871. [CrossRef]
Zhang, H.; Duan, J.; Wang, Y.; Gao, Z. J. I. t. o. c., Bipartite fixed-time output consensus of heterogeneous linear multiagent systems. 2019, 51, (2), 548-557. [CrossRef]
Liu, Z.; Yu, X.; Yuan, C.; Zhang, Y. In Leader-follower formation control of unmanned aerial vehicles with fault tolerant and collision avoidance capabilities, 2015 International Conference on Unmanned Aircraft Systems (ICUAS), 2015; IEEE: 2015; pp 1025-1030.
Yu, Z.; Zhang, Y.; Qu, Y.; Su, C.-Y.; Zhang, Y.; Xing, Z. In Fault-tolerant adaptive neural control of multi-UAVs against actuator faults, 2019 International Conference on unmanned aircraft Systems (ICUAS), 2019; IEEE: 2019; pp 421-426.
Liu, W.; Zhang, K.; Jiang, B.; Yan, X. J. A. J. o. C., Adaptive fault-tolerant formation control for quadrotors with actuator faults. 2020, 22, (3), 1317-1326.
Liu, D.; Liu, H.; Xi, J. J. A. S.; Technology, Fully distributed adaptive fault-tolerant formation control for octorotors subject to multiple actuator faults. 2021, 108, 106366. [CrossRef]
Zheng, Z.; Qian, M.; Li, P.; Yi, H. J. I. A., Distributed adaptive control for UAV formation with input saturation and actuator fault. 2019, 7, 144638-144647. [CrossRef]
Deng, C. J. I. T. o. S., Man,; Systems, C., Cooperative fault-tolerant output regulation of linear heterogeneous multiagent systems under directed network topology. 2019, 51, (8), 4773-4781. [CrossRef]
Yang, P.; Ding, Y.; Hu, X.; Zhang, Z.; Wang, Z. J. T. o. t. I. o. M.; Control, Sliding mode fault-tolerant consensus control for heterogeneous multi-agent systems based on finite-time observer and controller. 2023, 45, (11), 2081-2090. [CrossRef]
Vamvoudakis, K. G.; Lewis, F. L.; Hudas, G. R. J. A., Multi-agent differential graphical games: Online adaptive learning solution for synchronization with optimality. 2012, 48, (8), 1598-1611. [CrossRef]
Zhao, J.; Dai, F.; Song, Y. In Consensus of heterogeneous mixed-order multi-agent systems including UGV and UAV, Proceedings of 2021 Chinese Intelligent Systems Conference: Volume III, 2022; Springer: 2022; pp 202-210.

Figure 1. Consistency error in the X-direction position between the following UAV, UGV, and the leader.

Figure 2. The position variables of UAV and UGV in the X-direction are in reference [25].

Figure 13. State trajectory plot of the leader-following heterogeneous multi-agent system.

Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

© 2024 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).

Copyright: This open access article is published under a Creative Commons CC BY 4.0 license, which permit the free download, distribution, and reuse, provided that the author and preprint are cited in any reuse.

MDPI Initiatives

Important Links

Choose an area of interest and we will send you notifications of new preprints at your preferred frequency.

Disclaimer

Fault-Tolerant Optimal Consensus Control for Heterogeneous Multi-agent System

Abstract

1. Introduction

2. Preliminaries

2.1. Graph Theory

2.2. UGV Dynamics Model

2.3. UAV Dynamics Model

2.4. Heterogeneous Multi-Agent System

3. Design and Analysis of Fault-Tolerant Consensus Controllers

4. Simulations

5. Conclusions

Author Contributions

Funding

Institutional Review Board Statement

Informed Consent Statement

Data Availability Statement

Acknowledgments

Conflicts of Interest

References

MDPI Initiatives

Important Links

Subscribe