Learning over sets, subgraphs, and streams: How to accurately incorporate graph context
82MSR AI Distinguished Talk Series: Learning over sets, subgraphs, and streams: How to accurately incorporate graph context in network models
Although deep learning methods have been successfully applied in structured domains comprised of images and natural language, it is still difficult to apply the methods directly to graph and network domains due to issues of heterogeneity and long range dependence. In this talk, I will discuss some of our recent work developing neural network methods for complex network domains, including node classification, motif prediction, and knowledge graph inference. The key insights include incorporating dependencies from graph context into both the input features and the model architectures, employing randomization to learn permutation invariant functions over sets, and using graph-aware attention mechanisms to offset noise when incorporating higher-order patterns. Experiments on real work social network data shows that our methods produce significant gains compared to other state-of-the-art methods, but only when we think carefully about how to integrate relational inductive biases into the process.
See more at https://www.microsoft.com/en-us/research/video/learning-over-sets-subgraphs-and-streams-how-to-accurately-incorporate-graph-context/