2.1. Definition of Vector Fields
The set of VFs for augmenting image features with SPs shapes can be characterized with the help of weighted Laurent polynomials [
13], which distinguish 16 kinds (shapes) of SPs. Another way to describe the VFs is through the Eigenvalues of their Jacobian [
1,
14,
15]. This approach defines 7 different kinds (shapes) of SPs. In our studies we adopted the latter classification and distinguish 7 different SPs shapes which we embed into images. Three of the SPs shapes are: springing, sinking and saddle. They correspond to the real Eigenvalues of the Jacobian of the gradient VFs (GVFs). The shapes of the three kinds of SPs are described in [
1,
11], and are illustrated in
Figure 1.
The remaining four SPs shapes are those corresponding to the complex Eigenvalues of the Jacobian of the VFs
,
and
. The SPs shapes are formed according to the directions of the vectors oriented toward the directions of the Eigenvectors and resemble attracting (in) and repealing (out) spirals, as well as clockwise and counterclockwise orbits [
3]. The SPs with complex shapes are usually located in homogeneous regions. Examples of SPs with spiral out (repealing) and clockwise orbit shapes are presented in
Figure 2.
To generate the seven kinds of SPs shapes described above, we have developed three GVFs with real Eigenvalues [
1,
11] and three non GVFs with real and complex Eigenvalues [
3]. The six VFs are defined with the help of the solution
of the Poisson Image equation [
1,
3,
11], where
denotes the image frame and
the image function:
The developed GVFs are defined with the following equations [
1,
11]:
and they generate the sinking, springing and saddle shaped SPs. In Eqs.
2 the function
The next three VFs are non-GVF and are developed by replacing the summations in Eqs. 2 with subtractions [
3]:
The VFs defined with Eq.
4 generate the above three real shaped SPs and the following four complex shaped SPs, named attracting (in) and repealing (out) spirals, as well as clockwise and counterclockwise orbits (known also as centers) [
14,
15].
The ELPAC software was initially introduced in [
12] with the capability of embedding
to evolve an active contour. The tools to embed
, and
were incorporated to conduct the study in [
1], while [
3] extended ELPAC with tools to embed
and most recently we added a tool to embed
. Hence ELPAC embeds in an image any of the six VFs , as shown in
Figure 4,
Figure 6,
Figure 7. Further, if we remove the objects from the image with embedded VF, we receive an image of the VF generated from the original image (
Figure 4 parts (b), (d), (f), (h), (j), (l)). Thus, an image containing only the VF, generated on the original image, we call "imprint of the image in the VF". The imprints of the image from
Figure 3, in the six VFs, are shown in
Figure 4. Further, we define the notion "imprint of an image database in a VF" as the set of imprints of the images from the original database in the VF.
2.2. Vector Fields SPs for Image Features Augmentation
In the present section we describe the SPs shapes created by each of the six VFs and list approximately where, according to the image objects, the SPs are located. Also, we determine the mappings between the SPs shapes if different VFs are separately embedded into an image. It helps define the similarities and differences between VFs components like SPs, separatrices [
1] and architectures (skeletons [
21] if embeded into the same image. This comparison facilitates the choice of the VF most appropriate for embedding into an image database to enhance ML and improve classification.
Recall that each of the VFs introduced, in sub
Section 2.1, is defined with the solution
of Eq.
1, which we solve on every image
of an image database. This implies that, in every image, we can embed VF features like SPs shapes, edges of SPs shapes, trajectories of vectors, and separatrices [
1]. The last entity is created by SPs shapes and trajectories that connect them. A SP edge is a shape composed by a string of SPs shapes generated in very close vicinity of an object’s edge, as shown in
Figure 5 (c) and (d). Here one may observe a string of sinking vectors, and in (d) a string of shrinking vectors. Note, the listed VF features are generated from the image geometric features, and the former set is a natural augmentation to the second set.
In [
1,
11] we proved that
generates sinking and saddle SPs, while
and
generate sinking, saddle, and springing SPs. It follows that
possess less variety and smaller number of SPs if compared with the other two VFs. Further, we showed in [
1] that
and
have same number of SPs such that the springing SPs of
are mapped into the sinking SPs of the
VF and vice versa. At the same time the saddle SPs do not change shape, but their vectors have opposite directions in the two VFs. Furthermore, the saddle SPs may appear only in homogeneous regions, while the springing and sinking SPs are located on the boundary. Also, the trajectories and the separatrices of the two VFs have similar architectures, but their vectors have opposite directions [
1]. The above-described SPs properties and mappings of the VFs
,
and
can be observed in
Figure 5.
Figure 5.
(a) Synthetic object. In the upper row are shown zooms of the lower branch, of the object in (a), with embedded VF; (b) ; (c) ; (d) . In the lower row are shown zooms of the core part, of the object in (a), with embedded VF: (e) ; (f) ; (g) .
Figure 5.
(a) Synthetic object. In the upper row are shown zooms of the lower branch, of the object in (a), with embedded VF; (b) ; (c) ; (d) . In the lower row are shown zooms of the core part, of the object in (a), with embedded VF: (e) ; (f) ; (g) .
Figure 6.
Overal view of the object in
Figure 5 (a) with embedded VF:
(a) ;
(b) ;
(c) .
Figure 6.
Overal view of the object in
Figure 5 (a) with embedded VF:
(a) ;
(b) ;
(c) .
Figure 5 (b) and
Figure 6 (a) show that the GVF
generates no SPs at convexity vertices, edges and external concavities but has sinking SPs at concavity corners
Figure 5 (e). Further,
generates sinking SPs on the boundary convexity vertices and edges as shown in
Figure 5 (c) and
Figure 6 (b) and no SP at the boundary concavities’ corners (see
Figure 5 (f)). Next,
generates sprinking SPs on the boundary convexity vertices and edges as shown in
Figure 5 (d) and
Figure 6 (c) and no SP at the boundary concavities’ corners (
Figure 5 (g)). Further,
creates only saddle SP in the object’s core homogeneous regions (see
Figure 5 (e)), while
generates springing SPs at the saddle SPs locations of
, and a saddle SP between the springing (
Figure 5 (f)). Also, the VF
generates saddle SPs at external concavities (
Figure 6 (b)). The VF
preserves the saddle SPs of
, swithing the vectors’ directions, while replaces the springing with sinking SP (
Figure 5 (f) and (g),
Figure 6 (b) and (c)).
Note,
Figure 6 provides an overall view of the 4-ray star from
Figure 5 (a), where the three GVFs, with real shaped SPs, are embedded. One may observe that the objects’ external concavity regions in
Figure 6 (b) and (c) contain saddle SPs, but the vectors that create their transversal and hyperbolic trajectories have opposite directions. Once again one may observe that the objects with embedded VF
create edges of sinking SP, while
generates edges of springing SPs. The latter kind of SPs edges are better visually exhibited than the former edges of SPs.
We continue here after with the description of the properties and the locations of the SPs generated by the VFs with real and complex Eigenvalues. Recall that these VFs contain seven kinds of SPs: sinking, springing, saddle, spiral in (attracting), spiral out (repealing), and orbits with clockwise and counterclockwise directions. Examples of their shapes are shown in
Figure 1,
Figure 2,
Figure 5,
Figure 7.
In [
3] we proved that the CPs of the function
, which are the solution of Eq.
1, may map to any of the 7 kinds of SP shapes of
. Further, in the same paper we proved that the CP of
and
map to the saddle SPs
. Recently, we validated that the same holds for the CPs of
and the SPs of
. Also, we validated that the SPs of
map to the SPs of
such that: springing SP maps to a sinking one and vice versa; saddle SPs do not change shape; spiral in map to spiral out and vice versa; and the clockwise orbits map to counterclockwise orbits and vice versa. These mappings imply that the VFs
and
possess same number of SPs and trajectory architectures, but the vectors that compose the two kinds of VFs architectures have opposite directions. Moreover, the positions of the SPs generated by the two VFs are in a close vicinity to each other, if projected on one and the same plane. Further, we note that the SPs edges of the VFs
and
are like each other as structures, but the vectors of these structures are opposite to each other. One may observe in
Figure 7 parts (b), (c) that
possesses sinking SPs edges while
has springing SPs edges. Further
has saddle SPs points with coming in vertical transversals, while the horizontal are coming out as shown in part (e). On the other hand, the transversal of the saddle SPs of
at the same positions are build up by vectors with opposite directions as
Figure 7 (f) shows.
Figure 7.
The object in
Figure 5 (a) with embedded VF:
in the left column, parts
(a),
(d) and
(g);
in the middle column, parts
(b),
(e) and
(h);
in the right column, parts
(c),
(f) and
(i) .
Figure 7.
The object in
Figure 5 (a) with embedded VF:
in the left column, parts
(a),
(d) and
(g);
in the middle column, parts
(b),
(e) and
(h);
in the right column, parts
(c),
(f) and
(i) .
Next, one may observe that the images with embedded VF
show no SPs located on the object exterior nor on its boundary. Hence,
does not create SPs edges, nor are SPs present at: objects boundary; on external concavities; inner convexities; nor at convexity vertices. However, any of the seven SPs may show up in the core part of the object. The above statements are validated in
Figure 7 (a), (d), where we present a zoomed in portion of the lower ray and the core part of the four rays star from
Figure 5 (a) with embedded VF
. Note, that part (d) exhibits spiral out (the upper left SP), spiral in (the upper right SP), and an springing SP (the lower one). An overall view of the same object and VF is shown in (g) where the SPs are present only in the object core.
VF
generates spiral in SPs on the exterior concavities of the object (
Figure 7 (h)). Also, saddle SPs are located at the convex vertices of the boundary as shown in part (b). Moreover,
generates edges of sinking SPs (
Figure 7 (b)) and springing SPs (see the horizontal rays in part (h)). Further, the core interior of the object may contain several SP shapes from the entire set of seven kinds of SPs. As one may observe from
Figure 7 (e), the core of the 4-ray star contains three saddle SPs, and a springing and sinking SPs between them. The upper two saddle SPs have outgoing transversal trajectories which go to the sinking SPs, while the incoming transversal of the lower saddle SP comes from the springing SP.
The last VF to consider is
. Recall that, if embedded into an object, it has same number of SPs shapes and similar architecture, of its trajectories, as
does. Note, the vectors that build up the
trajectories and SPs have opposite directions to the vectors of
. This could be observed in part
Figure 7 (c) where at the convex vertex is located a saddle SP whose vectors are opposite to those of the saddle SP in part (b). Also, the four spiral out SPs in the external concavities of the star in part (i) are created with vectors whose directions are opposite to the directions of the vectors which created the spiral out SPs in the external concavities
Figure 7 (h). Further, part (f) shows that the VF
generates five SPs in the core of the 4-rays star, as
does it in part (e). In (f) there are again three saddle SPs, but they have opposite vectors if compared with the saddle SPs in (e). The remaining two SP, in between the three saddles, are springing and sinking, but they switched positions, such that the sinking is below the springing as shown in part (f), while the former is above the latter in part (e) of
Figure 7.
Following the above reasoning and observations we develop the diagram in
Figure 8 to describe the mappings between the CPs of the functions
,
,
and the SPs of the six VFs if they are separately embedded in one and the same image. Note, the VFs having one to one correspondence have the same trajectory architectures, but vectors with opposite directions, as we described in the above paragraphs. Also, with the notion "partial" we denote that only part of the SPs of
map to the SPs of
, because
has sinking SPs (
has maxima as proven in [
1]) at concavity vertices (see
Figure 5 (e)) while
does not have SPs at concavity vertices (see part (f)). Also,
has sinking SPs (
has maxima as proven in [
1])) at convexity vertices (see
Figure 5 (c)), while
does not (see part (b)).
Table 1 shows the distribution of the SPs of a VF across an image if the VF is embedded into the image. It is a guide designed to help the user select the VF to be embedded into an image database in order to provide the highest classification statistics. Also, sink denotes sinking SP(s), spring denotes springing SP(s), core denotes "core of an object", branches denote branches of objects, and edges denote "boundary edges".