Professional Documents
Culture Documents
Heterogeneous Graph Attention Network
Heterogeneous Graph Attention Network
Heterogeneous Graph Attention Network
Xiao Wang1, Houye Ji1, Chuan Shi1, Bai Wang1, Peng Cui2, P. Yu2, Yanfang Ye3
1Beijing University of Posts and Telecommunications
2Tsinghua University
1 Background
2 HAN
3 Experiments
4 Conclusions
CONTENTS
1 Background
2 HAN
3 Experiments
4 Conclusions
1 Background Graph-structured Data
Graph-structured Data
n Graph-structured data are ubiquitous.
n Graph-structured data are flexible to model complex interactions.
1 Background Graph Neural network
TARGET NODE B
Receive neighbor’s message B C
A
A
C B
A C
F E
D F
E
Apply neural network D
INPUT GRAPH A
1 Background Heterogeneous Graph
Heterogeneous Graph
uMultiple types of nodes or links
1 Background
2 HAN
3 Experiments
4 Conclusions
2 HAN Overall Framework
n Type-Specific Transformation
n Semantic-Level Attention
n Importance of Meta-path
n Semantic-Level Aggregating
Semantic weight
2 HAN Prediction
n Semi-supervised Loss
Parameter of classifier
Labeled data
Prediction
CONTENTS
1 Background
2 Proposed Method
3 Experiments
4 Conclusions
3 Experiments Datasets & Baselines & Tasks
Baselines Tasks
u Deepwalk u GCN u Node Classification
u Esim u GAT u Node Clustering
u Metapath2vec u HANnd u Analysis of Attention Mechanism
u HERec u HANsem u Visualization
3 Experiments Node Classification
3 Experiments Node Clustering & Visualization
3 Experiments Attention Analysis
n Semantic-Level Attention
APCPA > APA > APTPA
1Xintao Wu, et al. Screening and Interpreting Multi-item Associations Based on Log-linear Modeling. KDD 2003
CONTENTS
1 Background
2 Proposed Method
3 Experiments
4 Conclusions
4 Conclusions