The concept of skew symmetry underlies many structures of modern algebra and geometry. The following structures can serve as examples of such structures: Lie algebras, Grassmann algebras, algebras of differential forms on a manifold, Clifford algebras. In the case of a Lie algebra its Lie bracket is skew-symmetric with respect to a permutation of arguments of this bracket. A Grassmann algebra can be constructed by means of covariant skew-symmetric tensors of some finite dimensional vector space. In this case the skew symmetry of a tensor means that the rearrangement of any two subscripts leads to the change of the sign of a tensor, and the exterior multiplication of two such tensors is defined with the help of the alternation of the tensor product of these tensors. At the end of the last century and the beginning of this century, we witnessed the emergence of interest towards an n-ary generalization of Lie algebra, that is, a generalization in which a Lie bracket contains n arguments. The concept of skew symmetry can be easily extended to n-ary multiplications if we require that any inversion of two arguments in an n-ary product results in a change in sign. An n-ary bracket of n-Lie algebra is skew-symmetric precisely in this classical sense. However, when moving from a binary law of multiplication to an n-ary one, where n>2, we can pose an interesting question of possible analogues of the classical concept of skew symmetry. In order to formulate the concept of skew symmetry of an algebraic operation we use permutations of factors in the product. In the case of binary multiplication we have only one permutation of variables in this multiplication and, consequently, we have only one notion of skew-symmetric binary product. By requiring that an n-ary product of elements ($n\ge 2$) be equal to zero whenever any two elements in this product are equal, we obtain an equivalent form of the concept of skew symmetry (an n-ary product is assumed to be linear in each argument). This formulation of skew symmetry explains why the concept of skew symmetry plays an important role in theoretical physics. Recall the Pauli exclusion principle, which states that two fermions in a quantum system cannot co-exist if they have identically equal sets of quantum numbers. It follows then that a wave function of a quantum system containing identical sets of quantum numbers of two fermions must vanish. Now the skew-symmetry of a wave function with respect to permutation of quantum states of any two fermions follows from the linearity of a wave function.

If we consider a ternary multiplication then in a ternary product we have six possible permutations of arguments, where three of them are inversions (non-cyclic permutations), and three are cyclic.It is natural to use non-cyclic permutations to extend binary skew-symmetry to ternary multiplication laws, that is, we call a ternary multiplication totally skew-symmetric if it is skew-symmetric with respect to any pair of arguments. It is precisely this notion of skew symmetry that is used in 3-Lie algebras, that is, any non-cyclic permutation of arguments in a ternary Lie bracket of 3-Lie algebra changes a sign of this bracket. Equivalently, if among the three elements of a ternary Lie bracket there are two equal ones, then regardless of where in the bracket these equal elements appear, the ternary bracket is equal to zero. In this formulation we see a direct connection with the classical Pauli exclusion principle.

But in the case of ternary multiplication, unlike the binary one, we have three more cyclic permutations, and these permutations can be used to construct a ternary analogue of skew symmetry, different from the one indicated above. Let V be a finite dimensional vector space with a skew-symmetric binary law of multiplication $(u,v)\in V\times V\to u·v\in V$. Then the skew-symmetry can be expressed in two equivalent ways Let $(W,\tau )$ be a complex finite dimensional vector space equipped with a ternary trilinear law of multiplication Since we use cyclic permutations a ternary analog of (1) is It is natural to raise the question of what could serve as a ternary analogue of relation (). The answer to this question is the relations or their conjugate version where $q=exp(2i\pi /3)$ is the primitive 3rd order root of unity. It is important to note that there is a significant difference between binary relations (1), () and ternary relations (3),(4). In the binary case, the relations (1) and () are equivalent, one immediately follows from the other. This is not true in the case of a ternary law of multiplication. Relations (3) and (4) are not equivalent. Due to the well-known property of cubic roots of unity $1+q+\overline{q}=0$, the relations (3) follow from the relations (4), but not vice-versa. By other words (3) is a more general condition than (4).

Thus, an analogue of the notion of skew symmetry in the case of ternary multiplication can be one of the conditions (3), (4), (5) with (4), (5) being particular cases of (3). But in any case, no matter which of the conditions (3), (4), (5) we take as a ternary analogue of the concept of skew symmetry, for any $x\in W$ we will have $\tau (x,x,x)=0$, and generally $\tau (x,x,y)\ne 0$, where $x\ne y$. Consequently, a ternary analogue of skew symmetry defined either by (3) or (4) or (5) is significantly different from the classical concept of skew symmetry in the sense that in the case of classical skew symmetry, the presence of two equal elements in a product leads to zero, and in the case of ternary skew symmetry defined by one of the conditions (3), (4), (5) the presence of two equal elements in a ternary product in general does not imply that this product is equal to zero. But at the same time, if all three elements in a ternary product are equal, that is $x=y=z$, then the product is equal to zero $\tau (x,x,x)=0$.

An analogue of the Pauli exclusion principle, which is based on a ternary skew symmetry, defined by one of conditions (3)-(5), could be formulated as follows: Three particles cannot coexist in a quantum system if these three particles are in the same quantum state, but two such particles can. It is in this form that an analogue of the Pauli exclusion principle was proposed by Richard Kerner, who calls it a ternary generalization of the Pauli exclusion principle. Richard Kerner argues that the ternary generalization of the Pauli exclusion principle applies to quarks. In the quark model, quarks are considered as fermions, and three quarks or three anti-quarks form a baryon. The ternary generalization of the Pauli exclusion principle can in this case be formulated as: Three quarks in the same quantum state cannot form a stable configuration, observed as one of strongly interacting particles, but at the same time, the coexistence of two quarks with the same isospin value is possible.

Relations (3)-(5) can be used to construct an analogue of Grassmann algebra, that is, we can consider an algebra over the field of complex numbers generated by a system of generators that obey one of the relations (3)-(5). The properties, structure and possible applications of such algebras were studied in papers [1,4,13]. These algebras can be applied to construct a generalization of exterior calculus with exterior differential d satisfying $d^3=0$[2]. A generalization of the Dirac operator based on the mentioned above algebras and relation to a ternary generalization of Pauli exclusion principle can be found in [12,13,14,15] to In this article, the main object of study is the subspace of an algebra whose generators obey relations (3), spanned by the triple products of the generators. This subspace can be identified with the space of complex-valued covariant third-order tensors $T_{ijk}$ in three-dimensional space which have the following property If we impose an additional condition on the tensors of this space, which is i.e. the trace of a tensor over any pair of subscripts is equal to zero, we obtain the space of tensors known in the theory of representations of the rotation group [11]. More precisely, the space of tensors satisfying conditions (6), (7) is ten-dimensional and in this space we have a twofold irreducible tensor representation of the rotation group. Let us denote this ten-dimensional complex vector space by ${\mathcal{T}}^3$. A twofold irreducible tensor representation of the rotation group in ${\mathcal{T}}^3$ splits into two irreducible tensor representations if we decompose the ten-dimensional representation space ${\mathcal{T}}^3$ into a direct sum of two five-dimensional subspaces in a way invariant under the action of the rotation group. A decomposition into two subspaces can be made with the help of the relations (4), (5), that is, we define the subspace ${\mathcal{T}}_q^3\subset {\mathcal{T}}^3$ by imposing the additional condition It is easy to see that in this case the condition (6) follows from (8). Hence we have and analogously Then ${\mathcal{T}}^3={\mathcal{T}}_q^3\oplus {\mathcal{T}}_{\overline{q}}^3$ and in each of subspaces ${\mathcal{T}}_q^3,{\mathcal{T}}_{\overline{q}}^3$ we have an irreducible representation of the rotation group. It is known that every representation of the rotation group can be made unitary if we endow a representation space with an appropriate Hermitian metric. We endow the space ${\mathcal{T}}_q^3$ with the Hermitian metric and show that the irreducible representation of the rotation group in ${\mathcal{T}}_q^3$ is an inclusion $R:SO\left(3\right)\hookrightarrow SU\left(5\right)$. We find the orthonormal basis $E_A,1\le A\le 5$ (here $E_A$ are complex-valued 3rd order covariant tensors satisfying (7), (8)) for the Hermitian space ${\mathcal{T}}_q^3$ and identify the space ${\mathbb{C}}^5$ with the Hermitian vector space of tensors ${\mathcal{T}}_q^3$ by putting Then the irreducible representation R of the rotation group can be written in the form where $g=\left(g_{ij}\right)\in SO\left(3\right))$. We calculate all $SO\left(3\right)$-invariants of the representation R and this calculation shows that there are only two non-trivial independent invariants. Obviously one of them is the canonical Hermitian metric $h(z,\overline{z})={\sum }_A{z}^A{\overline{z}}^A$ and the other is the quadratic form We study the properties of the quadratic form $K(z,z)$. Particularly we show that the matrix $K_{AB}$ of the quadratic form $K(z,z)$ is symmetric, unitary and its determinant is the 6th order primitive root of unity $ϵ=exp(\pi i/3)$. These properties are invariant under action of the unitary group $U\left(5\right)$ in the five-dimensional complex space ${\mathcal{T}}_q^3$. Then we find the subgroup of the group $SU\left(5\right)$ which is a stabilizer of the quadratic from $K(z,z)$ in the five-dimensional complex vector space ${\mathcal{T}}_q^3$. In analogy with approach proposed in [9] and developed in [7] we define a $SO\left(3\right)$-irreducible geometric structure in complex dimension 5 and study its geometry.

The aim of this section is to describe an irreducible tensor representation of the rotation group. In what follows we consider complex-valued covariant tensors defined in 3-dimensional Euclidean space ${\mathbb{R}}^3$. Let $T=\left(T_{i_1{i}_2\dots i_p}\right)$ be a tensor of rank p. In what follows, we will use the Einstein convention of summation over repeated indices. Then the formula where $g=\left(g_{ij}\right)\in SO\left(3\right)$ is a rotation in ${\mathbb{R}}^3$, defines a linear transformation in a vector space of covariant tensors of rank p, i.e. it defines a representation of the rotation group, which is called a tensor representation. A linear transformation (14) will be denoted by $g·T$, that is, $\tilde{T}=g·T$. In this section we give an explicit description of an irreducible 5-dimensional tensor representation of the rotation group in the complex vector space of covariant tensors of rank 3.

Let ${\mathcal{T}}^3$ be the vector space of tensors of rank 3 which satisfy the following conditions:

It can be easily verified that the conditions $T_1,T_2$ are invariant under the action of the rotation group (14). Hence for any rotation $g\in SO\left(3\right)$ we have $R_g:{\mathcal{T}}^3\to {\mathcal{T}}^3$. It is shown in [11] that the vector space ${\mathcal{T}}^3\left({\mathbb{R}}^3\right)$ is 10-dimensional and the formula (14) defines a two-fold irreducible tensor representation of the rotation group in this vector space. If we split the 10-dimensional vector space ${\mathcal{T}}^3$ into a direct sum of two 5-dimensional subspaces in a way invariant with respect to the action of the rotation group (14) then in each 5-dimensional subspace of ${\mathcal{T}}^3$ we will have an irreducible tensor representation of the rotation group.

One can split the 10-dimensional vector space ${\mathcal{T}}^3$ into a direct sum of two 5-dimensional subspaces, which are invariant with respect to a tensor representation of the rotation group, by making use of a linear operator induced by a substitution. Let us denote by $\sigma$ the cyclic substitution of first three integers $\sigma \left(1\right)=2,\sigma \left(2\right)=3,\sigma \left(3\right)=1$. Then one can define the operator ${\mathsf{\Phi }}_{\sigma }:T\to \tilde{T}$ acting on the tensors of rank 3 as follows and extend it by linearity to the vector space of all tensors of rank three. Obviously ${\mathsf{\Phi }}_{\sigma }^3=\mathbf{1}$ and where $\mathbf{1}$ is the identity mapping. Thus the equation (15) can be written in the form Now it is easy to show that the vector space ${\mathcal{T}}^3$ is invariant under the action of the operator ${\mathsf{\Phi }}_{\sigma }$, that is, ${\mathsf{\Phi }}_{\sigma }:{\mathcal{T}}^3\to {\mathcal{T}}^3$. Assume that a tensor $T=\left(T_{ijk}\right)$ satisfies the condition $T_2$ or, equivalently, the equation (17). Denote $\tilde{T}={\mathsf{\Phi }}_{\sigma }\left(T\right)$. Then and $\tilde{T}$ also satisfies the equation (17). Similarly one can verify that the operator ${\mathsf{\Phi }}_{\sigma }$ preserves the condition $T_1$.

Generally the property of the linear operator ${\mathsf{\Phi }}_{\sigma }^3=\mathbf{1}$ implies that it has three eigenvalues $1,q,\overline{q}$ in the vector space of all tensors of rank 3. Here $q=exp(2i\pi /3)$ is the primitive third order root of unity and $\overline{q}$ is its complex conjugate. Another general formula is based on the property of the third order roots of unity $1+q+\overline{q}=0$. Indeed it is easy to see that due to the mentioned property of the third order roots of unity any tensor of rank 3 can be decomposed into the sum of three tensors where Obviously the tensors $T_1,T_q,T_{\overline{q}}$ are the eigenvectors of the linear operator ${\mathsf{\Phi }}_{\sigma }$ corresponding to the eigenvalues $1,q,\overline{q}$ respectively. Thus we have or, equivalently, It is worth to mention that the components $T_q$ and $T_{\overline{q}}$ of a tensors T satisfy the condition $T_2$. Restricting (18) to the vector space ${\mathcal{T}}^3$, we see that due to the condition $T_2$ the first term at the right-hand side vanishes, i.e. $T_1=0$ and (18) takes on the form $T=T_q+T_{\overline{q}}$, where $T_q,T_{\overline{q}}\in {\mathcal{T}}^3$. Hence we can decompose the vector space ${\mathcal{T}}^3$ into the direct sum of two subspaces, which will be denoted by ${\mathcal{T}}_q^3$ and ${\mathcal{T}}_{\overline{q}}^3$. Here ${\mathcal{T}}_q^3$ is the subspace of the eigenvectors of the linear operator ${\mathsf{\Phi }}_{\sigma }$ with eigenvalue q and ${\mathcal{T}}_{\overline{q}}^3$ is the subspace of the eigenvectors of the linear operator ${\mathsf{\Phi }}_{\sigma }$ with eigenvalue $\overline{q}$. Thus ${\mathcal{T}}^3={\mathcal{T}}_q^3\oplus {\mathcal{T}}_{\overline{q}}^3$.

The subspaces ${\mathcal{T}}_q^3,{\mathcal{T}}_{\overline{q}}^3$ play a basic role in what follows and it is useful to give here their exact description. ${\mathcal{T}}_q^3$ is a vector space of complex-valued tensors of rank 3 which satisfy the condition $T_1$ (trace over any pair of subscripts is zero) and they are eigenvectors of the linear operator ${\mathsf{\Phi }}_{\sigma }$ with eigenvalue q, that is, they satisfy ${\mathsf{\Phi }}_{\sigma }\left(T\right)=qT$ or $T_{ijk}=\overline{q}{T}_{jki}$. Similarly ${\mathcal{T}}_{\overline{q}}^3$ is a vector space of complex-valued tensors of rank 3 which satisfy $T_1$ and they are the eigenvectors of the linear operator ${\mathsf{\Phi }}_{\sigma }$ with eigenvalue $\overline{q}$, i.e. ${\mathsf{\Phi }}_{\sigma }\left(T\right)=\overline{q}T$ or $T_{ijk}=q{T}_{jki}$. Hence The important role of these subspaces is that they are spaces of a 5-dimensional irreducible representation of the rotation group.

A tensor of the third rank $T=\left(T_{ijk}\right)$ is a quantity with three subscripts $i,j,k$. Therefore, in what follows, it will be convenient for us to represent tensors of the third rank in the form of 3-dimensional matrices, which are also called hypermatrices. By a 3-dimensional matrix, we mean a 3-dimensional cube with components of a tensor $T_{ijk}$ located on the sections of this cube. Here by section we mean a section of a cube by plane perpendicular to its edges. We assume that a cube is located in space so that the first subscript i of a tensor $T_{ijk}$ enumerates sections of a cube parallel to the plane of this page and the numbering starts from the section closest to us ($i=1$) and then takes values 2,3 as the distance from us increases (see figure).

We will map a 3-dimensional matrix onto the plane of page of this paper by placing the numbered sections of a cube (which are the usual third-order matrices) from left to right, that is, on the left there will be the section with $i=1$, in the center with $i=2$ and on the right with $i=3$. Thus a 3-dimensional matrix of a third order tensor $T=\left(T_{ijk}\right)$ can be represented as follows where a number of a section i is indicated by red color. If a 3-dimensional matrix T is represented in the form (20) then we will say that $T=\left(T_{ijk}\right)$ is written in the direction i. Analogously we can define j-directional and k-directional representations of a 3-dimensional matrix.

Now we consider the 5-dimensional complex vector space ${\mathbb{C}}^5$ endowed with the canonical Hermitian metric h. The coordinates of this space will be denoted by $z^A$, where A runs from 1 to 5. Then $h(z,\overline{z})={\sum }_{A=1}^5{z}^A{\overline{z}}^A$. We will identify this 5-dimensional complex vector space with the complex vector space of the third-rank covariant tensors (or 3-dimensional matrices) ${\mathfrak{T}}_{\overline{q}}^3$ by identifying a point $\left(z^A\right)\in {\mathbb{C}}^5$ with the 3-dimensional matrix $T\left(z\right)$, i.e. where It is easy to verify that $T\left(z\right)$ satisfies the condition $T_1$, that is, the trace over any pair of subscripts is zero, and $T_{ijk}\left(z\right)=q{T}_{jki}\left(z\right).$ Thus, in what follows we will consider the 5-dimensional complex vector space whose points are identified with 3-dimensional complex matrices $T\left(z\right)$.

The formula (14) defines an action $T\to g·T$ of the rotation group $SO\left(3\right)$ on our 5-dimensional complex vector space and this action yields an irreducible tensor representation of the rotation group [11]. Now our aim is to find and study the invariants of this representation, which we will use to construct an irreducible special geometry.

In this paper, we use the classification of invariants of third-order tensors that transform according to formula (14), that is, under the action of the rotation group $SO\left(3\right)$. If we do not assume that a tensor $T=\left(T_{ijk}\right)$ has any symmetries, then there is only one linear invariant where ${ϵ}_{ijk}$ is the Levi-Civita tensor in 3-dimensional Euclidean space. Since we consider the space of tensors that satisfy the property $T_2$, that is, the sum of the components obtained by cyclic permutations of subscripts is equal to zero, the linear invariant $I_1$ vanishes.

The complete set of quadratic $SO\left(3\right)$-invariants of a third-order real-valued tensor T (no symmetries) includes eleven invariants. Six of eleven invariants contain the trace of a tensor T with respect to some pair of subscripts, and, due to property $T_1$, these invariants vanish when restricted to the space ${\mathfrak{T}}_{\overline{q}}^3$. This leaves us with five $SO\left(3\right)$-invariants of a real-valued tensor, and these invariants are on the left side of the table shown below. Due to the fact that we are considering complex-valued tensors, this list of five invariants should be extended by supplementing it with additional invariants. These additional invariants are constructed from those in the left side of the table by replacing one of the factors in a product of tensor components with the complex conjugate and the additional invariants are shown in the right side of the table. Direct calculation leads to the following table of invariants The table of invariants shows that we have two independent quadratic invariants $I_1^{*},I_2$ , where the first one $I_1^{*}$ is the canonical Hermitian metric of the complex five-dimensional space ${\mathbb{C}}^5$. Hence each rotation of the 3-dimensional space ${\mathbb{R}}^3$ induces a unitary transformation of the complex five-dimensional Hermitian space ${\mathbb{C}}^5$, that is, we have a representation $R:g\in SO\left(3\right)\to R_g\in U\left(5\right)$. Obviously the homomorphism R from the rotation group into the group of unitary matrices of order 5 is injective. At the infinitesimal level, the representation R generates the representation of the Lie algebra of the rotation group $\varrho :\tau \in \mathfrak{so}\left(3\right)\to {\varrho }_{\tau }\in \mathfrak{u}\left(5\right)$. Our next goal is to find an explicit form of this representation using the basis of the 5-dimensional complex Hermitian space of 3-dimensional matrices (21). By other words, given a skew-symmetric third-order matrix $\tau =\left({\tau }_{ij}\right)\in \mathfrak{so}\left(3\right)$ we will calculate a fifth-order skew-Hermitian traceless matrix ${\varrho }_{\tau }=\left({\left({\varrho }_{\tau }\right)}_B^A\right)\in \mathfrak{u}\left(5\right)$. We will see that the form of a skew-Hermitian matrix ${\varrho }_{\tau }$ is determined by the second invariant $I_2$, and this matrix is surprisingly similar to the matrix used in the Georgie-Glashow model for unification of elementary particles.

In order to calculate the infinitesimal part of the representation $R:SO\left(3\right)\to U\left(5\right)$, we use the exponential map from the Lie algebra $\mathfrak{so}\left(3\right)$ to the rotation group $SO\left(3\right)$, taking only the linear part of the corresponding expansion $g_{ij}={\delta }_{ij}+{\tau }_{ij}+\dots$, where $\tau =\left({\tau }_{ij}\right)$ is a skew-symmetric matrix. We can write Hence the infinitesimal part of the action $T\to g·T$ (up to the terms of the second order and higher) defines the linear operator ${\varrho }_{\tau }:{\mathbb{C}}^5\to {\mathbb{C}}^5$, where It will be convenient for us to pass to a parameterization of matrix $\tau =\left({\tau }_{ij}\right)$ with the help of parameters containing one index. Let us define ${\tau }_i=-\frac{1}{2}{ϵ}_{ijk}{\tau }_{jk}$. Then Now we can calculate a matrix of this operator (we will use the same notation ${\varrho }_{\tau }$ for the matrix of the operator) by means of the following basis in 5-dimensional complex space of 3-dimensional matrices (21) Let us enumerate the 3-dimensional matrices of this basis (starting from the left in the first row and moving from left to right and then from top to bottom) as follows $E_A$, where $A=1,2,\dots ,5$. By straightforward calculation we find Hence the matrix of the operator ${\varrho }_{\tau }$ has the form Due to the fact that the irreducible representation of the rotation group in the complex space of three-dimensional matrices (21) is unitary (as we mentioned above one of the invariants of this representation is the Hermitian metric of the 5-dimensional complex space), the matrix of the representation of the Lie algebra of the rotation group ${\varrho }_{\tau }$ must be skew-Hermitian, and this is indeed the case, because the matrix ${\varrho }_{\tau }$ satisfies the relation ${\varrho }_{\tau }+{\varrho }_{\tau }^{†}=0$, where ${\varrho }_{\tau }^{†}={\overline{\varrho }}_{\tau }^{\mathtt{t}}$. It is easy to see that ${\rho }_{\tau }$ is a traceless matrix. Hence ${\rho }_{\tau }$ belongs to the Lie algebra of the group $SU\left(5\right)$, that is, ${\rho }_{\tau }\in \mathfrak{su}\left(5\right)$. Hence we can express this matrix in terms of generators of $\mathfrak{su}\left(5\right)$ denoted in physics papers by $L_i$, where $i=1,2,\dots ,24$, and $L_i$ are Hermitian traceless matrices of 5th order normalized by $Tr\left(L_i{L}_j\right)=\frac{1}{2}{\delta }_{ij}$. In this paper we use the following numbering of the generators of $\mathfrak{su}\left(5\right)$:

Then the matrix ${\rho }_{\tau }$ can be written in the terms of $\mathfrak{su}\left(5\right)$-generators $L_i$ as follows It should be noted here that the matrix ${\rho }_{\tau }$ is not only skew-Hermitian and traceless, it also satisfies some additional conditions that follow from the fact that the irreducible representation of the rotation group has one more quadratic invariant $I_2$ (22). We will denote the quadratic form in the 5-dimensional complex vector space induced by this invariant as follows The matrix of this quadratic form can be considered as a covariant second-order tensor in the 5-dimensional complex vector space and the properties of this tensor will be studied in the next section. Here we only note that the matrix $K=\left(K_{AB}\right)$ is symmetric and unitary, i.e. where $E=\left({\delta }_{AB}\right)$ is the identity matrix.

The infinitesimal action (28) generates the following vector fields in 5-dimensional complex space These vector fields span the Lie algebra $[{\mathtt{X}}_1,{\mathtt{X}}_2]={\mathtt{X}}_3,[{\mathtt{X}}_2,{\mathtt{X}}_3]={\mathtt{X}}_1,[{\mathtt{X}}_3,{\mathtt{X}}_1]={\mathtt{X}}_2$ isomorphic to the Lie algebra of matrices (29). Due to the fact that the Hermitian metric $h(z,\overline{z})$ and the quadratic form $K\left(z\right)$ are invariants of the irreducible representation of the rotation group $g\in SO\left(3\right)\to R_g\in U\left(5\right)$, the vector fields ${\mathtt{X}}_1,{\mathtt{X}}_2,{\mathtt{X}}_3$ vanish on the Hermitian form $h(z,\overline{z})$ and the quadratic form $K\left(z\right)$.

Now our goal is to show that, in fact, the irreducible representation of the rotation group $g\in SO\left(3\right)\to R_g\in U\left(5\right)$ has the form $g\in SO\left(3\right)\to R_g\in SU\left(5\right)$, that is, each rotation generates a special (with determinant equal to 1) unitary transformation in the 5-dimensional complex vector space. For this purpose, we will find a parameterization of the irreducible representation using Euler angles. Let us consider two one-parameter subgroups of the rotation group The one-parameter subgroups of unitary transformations in 5-dimensional complex vector space generated by the irreducible representation of $g_1\left(t\right)$ and $g_2\left(t\right)$ have the following form respectively Direct calculation shows that the determinants of these matrices are equal to 1. Since any rotation can be written as a composition $g_1\left(\varphi \right)g_2\left(\theta \right)g_1\left(\psi \right)$, where $\varphi ,\theta ,\psi$ are Euler angles, we conclude that each rotation generates a unitary transformation with determinant 1, that is, the irreducible representation has the form of inclusion $R:SO\left(3\right)\hookrightarrow SU\left(5\right)$ and we will denote the image of the rotation group with respect to this inclusion by ${\mathfrak{G}}_3$. Hence ${\mathfrak{G}}_3\subset SU\left(5\right)$.

The purpose of this section is to study the properties of the quadratic form which is invariant under the irreducible representation R of the rotation group, where $R:SO\left(3\right)\hookrightarrow SU\left(5\right)$. In the previous section we denoted the image of this inclusion by ${\mathfrak{G}}_3$ and, according to the formulas (34), (), any element of the group ${\mathfrak{G}}_3$ can be written as a product $R_1\left(t\right)R_2\left(s\right)R_1\left(v\right)$, where $t,s,v$ are real parameters. Hence ${\mathfrak{G}}_3$ is a stabilizer of the quadratic form $K(z,z)$ in $SU\left(5\right)$. Assume that $z^A=U_B^A{\tilde{z}}^B$, where $U=\left(U_B^A\right)$ is a regular complex $5\times 5$-matrix, is a linear transformation in the five-dimensional complex space ${\mathbb{C}}^5$. Then the matrix of the quadratic form $K(z,z)$ transforms under this transformation as follows or in the matrix form where $K=\left(K_{AB}\right),\tilde{K}=\left({\tilde{K}}_{AB}\right)$ are matrices of the form $K(z,z)$ in different bases of the Hermitian space ${\mathbb{C}}^5$ and $U^{\mathtt{T}}$ is the transposed matrix of U. The set of all matrices $\tilde{K}$ obtained with the help of (39) will be referred to as an orbit of the quadratic form $K(z,z)$ with an indication of a group of transformations. For example, the set of all matrices $\tilde{K}$ obtained by means of unitary transformations will be referred to as a $U\left(5\right)$-orbit of $K(z,z)$. Obviously, we can consider the matrix $K=\left(K_{AB}\right)$ as a second-order covariant tensor in a five-dimensional vector space and in this case we will talk about the $U\left(5\right)$-orbit of the tensor $K=\left(K_{AB}\right)$. Our aim in this section is to find properties of the quadratic form $K(z,z)$ (or of the corresponding tensor $K=\left(K_{AB}\right)$) such that they will uniquely determine the orbit of this quadratic form.