Article
Version 1
Preserved in Portico This version is not peer-reviewed
(GAAN)Graph Adaptive Attention Network with Cross Entropy
Version 1
: Received: 13 June 2024 / Approved: 13 June 2024 / Online: 14 June 2024 (02:47:40 CEST)
A peer-reviewed article of this Preprint also exists.
Chen, Z. Graph Adaptive Attention Network with Cross-Entropy. Entropy 2024, 26, 576. Chen, Z. Graph Adaptive Attention Network with Cross-Entropy. Entropy 2024, 26, 576.
Abstract
:Non-Euclidean data, such as social networks, and citation relationships between documents, has node information and structural information. Graph Convolutional Network(GCN) can automatically learn node features and association information between nodes. The core ideology of the graph convolutional network is to aggregate node information by using edge information, thereby generating a new node feature. In the process of updating node features, there are two core influencing factors. One is the number of neighboring nodes of the central node, the other is the contribution of the neighboring nodes to the central node. Due to the previous GCN methods not simultaneously considering the numbers and different contributions of neighboring nodes to the central node, we design the Adaptive Attention Mechanism(AAM). To further enhance the representational capability of the model, we utilize Multi-Head Graph Convolution(MHGC). Finally, we adopt cross-entropy(CE) loss function to describe the difference between the predicted results of node categories and the ground truth (GT). Combined with backpropagation, this ultimately achieves accurate node classification. Based on AAM, MHGC and CE, we contrive the novel Graph Adaptive Attention Network (GAAN). Experiments show that the classification accuracy has achieved outstanding performances on Cora, Citeseer and Pubmed datasets.
Keywords
Non-Euclidean; GCN; Adaptive Attention Mechanism; Multi-Head Graph Convolution; Cross Entropy
Subject
Computer Science and Mathematics, Artificial Intelligence and Machine Learning
Copyright: This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
Comments (0)
We encourage comments and feedback from a broad range of readers. See criteria for comments and our Diversity statement.
Leave a public commentSend a private comment to the author(s)
* All users must log in before leaving a comment