Preprint Article Version 1 Preserved in Portico This version is not peer-reviewed

(GAAN)Graph Adaptive Attention Network with Cross Entropy

Version 1 : Received: 13 June 2024 / Approved: 13 June 2024 / Online: 14 June 2024 (02:47:40 CEST)

A peer-reviewed article of this Preprint also exists.

Chen, Z. Graph Adaptive Attention Network with Cross-Entropy. Entropy 2024, 26, 576. Chen, Z. Graph Adaptive Attention Network with Cross-Entropy. Entropy 2024, 26, 576.

Abstract

:Non-Euclidean data, such as social networks, and citation relationships between documents, has node information and structural information. Graph Convolutional Network(GCN) can automatically learn node features and association information between nodes. The core ideology of the graph convolutional network is to aggregate node information by using edge information, thereby generating a new node feature. In the process of updating node features, there are two core influencing factors. One is the number of neighboring nodes of the central node, the other is the contribution of the neighboring nodes to the central node. Due to the previous GCN methods not simultaneously considering the numbers and different contributions of neighboring nodes to the central node, we design the Adaptive Attention Mechanism(AAM). To further enhance the representational capability of the model, we utilize Multi-Head Graph Convolution(MHGC). Finally, we adopt cross-entropy(CE) loss function to describe the difference between the predicted results of node categories and the ground truth (GT). Combined with backpropagation, this ultimately achieves accurate node classification. Based on AAM, MHGC and CE, we contrive the novel Graph Adaptive Attention Network (GAAN). Experiments show that the classification accuracy has achieved outstanding performances on Cora, Citeseer and Pubmed datasets.

Keywords

Non-Euclidean; GCN; Adaptive Attention Mechanism; Multi-Head Graph Convolution; Cross Entropy

Subject

Computer Science and Mathematics, Artificial Intelligence and Machine Learning

Comments (0)

We encourage comments and feedback from a broad range of readers. See criteria for comments and our Diversity statement.

Leave a public comment
Send a private comment to the author(s)
* All users must log in before leaving a comment
Views 0
Downloads 0
Comments 0


×
Alerts
Notify me about updates to this article or when a peer-reviewed version is published.
We use cookies on our website to ensure you get the best experience.
Read more about our cookies here.