Heterogeneous Graph Attention Network

Графовая нейронная сеть с механизмом внимания для неоднородных графов
Philip S. Yu, Peng Cui, Chuan Shi, Xiao Wang, Houye Ji, Bai Wang, Yanfang Ye
2019-05-13

heterogeneous graph attention networkhierarchical attentionmeta-path based neighborsnode embeddingsemantic-level attention
Graph neural network, as a powerful graph representation technique based on deep learning, has shown superior performance and attracted considerable research interest. However, it has not been fully considered in graph neural network for heterogeneous graph which contains different types of nodes and links. The heterogeneity and rich semantic information bring great challenges for designing a graph neural network for heterogeneous graph. Recently, one of the most exciting advancements in deep learning is the attention mechanism, whose great potential has been well demonstrated in various areas. In this paper, we first propose a novel heterogeneous graph neural network based on the hierarchical attention, including node-level and semantic-level attentions. Specifically, the node-level attention aims to learn the importance between a node and its meta-path based neighbors, while the semantic-level attention is able to learn the importance of different meta-paths. With the learned importance from both node-level and semantic-level attention, the importance of node and meta-path can be fully considered. Then the proposed model can generate node embedding by aggregating features from meta-path based neighbors in a hierarchical manner. Extensive experimental results on three real-world heterogeneous graphs not only show the superior performance of our proposed model over the state-of-the-arts, but also demonstrate its potentially good interpretability for graph analysis.
1
Experiments on three real-world heterogeneous graphs show superior performance over state-of-the-art methods and indicate potentially strong interpretability for graph analysis.
2
Introduces a heterogeneous graph neural network using hierarchical attention with separate node-level and semantic-level attention mechanisms.
3
Node-level attention learns the importance of individual meta-path-based neighbors relative to a target node.
4
Semantic-level attention learns the relative importance of different meta-paths, enabling semantic information to influence aggregation.
5
The model generates node embeddings by hierarchically aggregating features from meta-path-based neighbors using both learned importance weights.

Heterogeneous graphs with different node and link types and meta-path-based neighborhoods

Hierarchical attention-based representation learning, including node-level and semantic-level importance of neighbors and meta-paths for node embedding and interpretable graph analysis

Publication Details
Publication Date
2019-05-13
Journal
Publisher
ISSN
Access Type
Author Information
Authors
Philip S. Yu
Peng Cui
Chuan Shi
Xiao Wang
Houye Ji
Bai Wang
Yanfang Ye
Explore further
Open the scid.ai AI chat with a ready-made request: it will find papers on a similar topic and help build a literature review.
Find similar papers in the chat
Make a presentation
100%