simplifying graph convolutional networks
play

Simplifying Graph Convolutional Networks Amauri Holanda Felix Wu* - PowerPoint PPT Presentation

Nov 04, 2023 •615 likes •847 views

Cornell University Simplifying Graph Convolutional Networks Amauri Holanda Felix Wu* Tianyi Zhang* Christopher Fifty Tao Yu Kilian Q. Weinberger de Souza Jnior* *: Equal contribution Cornell University Graph Convolutional Networks

  1. Cornell University Simplifying Graph Convolutional Networks Amauri Holanda Felix Wu* Tianyi Zhang* Christopher Fifty Tao Yu Kilian Q. Weinberger de Souza Júnior* *: Equal contribution

  2. Cornell University Graph Convolutional Networks Applications (Kipf and Welling, ICLR 2017) • Social Networks & Citation Networks • Applied Chemistry • Natural Language Processing • Computer Vision • … Image source: https://tkipf.github.io/graph-convolutional-networks/images/karate.png

  3. Cornell University Node Classification Input Graph Feature Value: Class +1: Class -1: Feature Vector: -1 0 +1

  4. Cornell University Node Classification Input Graph x 6 x 5 x 7 x 4 x 2 x 3 x 1 X = [ x 1 , …, x n ] ⊤ Features: Feature Value: Class +1: Class -1: Feature Vector: -1 0 +1

  5. Cornell University Node Classification Input Graph x 6 x 5 x 7 x 4 x 2 x 3 x 1 X = [ x 1 , …, x n ] ⊤ Features: (Partially labelled) Feature Value: Class +1: Class -1: Feature Vector: -1 0 +1

  6. Cornell University Node Classification Input Graph x 6 x 5 x 7 x 4 x 2 x 3 x 1 X = [ x 1 , …, x n ] ⊤ Features: (Partially labelled) Feature Value: Class +1: Class -1: Feature Vector: -1 0 +1

  7. Cornell University <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> Graph Convolutional Network (GCN) Input Graph x 6 x 5 x 4 x 7 x 1 x 2 x 3 H (0) = X = [ x 1 , . . . , x n ] > Feature Value: Class +1: Class -1: Feature Vector: -1 0 +1

  8. Cornell University <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> Graph Convolutional Network (GCN) Input Graph x 6 x 5 x 4 x 7 x 1 x 2 x 3 H (0) = X = [ x 1 , . . . , x n ] > Feature Propagation H ( k ) ← SH ( k − 1) ¯ Feature Value: Class +1: Class -1: Feature Vector: -1 0 +1

  9. Cornell University <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> <latexit sha1_base64="(nul)">(nul)</latexit> Graph Convolutional Network (GCN) Input Graph x 6 x 5 x 4 x 7 x 1 x 2 x 3 H (0) = X = [ x 1 , . . . , x n ] > Linear Transformation Feature Propagation H ( k ) ← SH ( k − 1) ¯ H ( k ) Θ ( k ) H ( k ) ← ¯ ¯ Feature Value: Class +1: Class -1: Feature Vector: -1 0 +1

Download Presentation
Download Policy: The content available on the website is offered to you 'AS IS' for your personal information and use only. It cannot be commercialized, licensed, or distributed on other websites without prior consent from the author. To download a presentation, simply click this link. If you encounter any difficulties during the download process, it's possible that the publisher has removed the file from their server.

Recommend

On the Experimental transferability of Spectral Graph Convolutional Networks Masters project

On the Experimental transferability of Spectral Graph Convolutional Networks Masters project

On the Experimental transferability of Spectral Graph Convolutional Networks Masters project presentation 6/ 7/ 2020 Axel Nilsson Outline 1. Introduction - Spectral graph convolutional networks - ChebNet 2. Benchmarking -

317 views • 18 slides
EMNLP 2017 Copenhagen Contributions } Syntactic Graph Convolutional Networks }

EMNLP 2017 Copenhagen Contributions } Syntactic Graph Convolutional Networks }

Encoding Sentences with Graph Convolutional Networks for Semantic Role Labeling Diego Marcheggiani and Ivan Titov University of Amsterdam University of Edinburgh EMNLP 2017 Copenhagen Contributions } Syntactic Graph Convolutional

865 views • 55 slides
Graph Convolutional Networks

Graph Convolutional Networks

Graph_Convolutional_Networks slides 12/11/19, 8(56 AM Thanks for joining me for a presentation on ... Graph Convolutional Networks http://127.0.0.1(8000/Graph_Convolutional_Networks.slides.html?print-pdf#/ Page 1 of 30

676 views • 30 slides
Convolutional Kernel Networks for Graph-Structured Data Dexiong Chen 1 Laurent Jacob 2 Julien

Convolutional Kernel Networks for Graph-Structured Data Dexiong Chen 1 Laurent Jacob 2 Julien

Convolutional Kernel Networks for Graph-Structured Data Dexiong Chen 1 Laurent Jacob 2 Julien Mairal 1 1 Inria Grenoble 2 CNRS/LBBE Lyon ICML 2020 Dexiong Chen Graph Convolutional Kernel Networks 1 / 15 Graph-structured data are ubiquitous (a)

865 views • 28 slides
Cluster-GCN: An Efficient Algorithm for Training Deep and Large Graph Convolutional Networks

Cluster-GCN: An Efficient Algorithm for Training Deep and Large Graph Convolutional Networks

Cluster-GCN: An Efficient Algorithm for Training Deep and Large Graph Convolutional Networks Wei-Lin Chiang 1 , Xuanqing Liu 2 , Si Si 3 , Yang Li 3 , Samy Bengio 3 , Cho-Jui Hsieh 23 1 National Taiwan University, 2 UCLA, 3 Google Research Graph

614 views • 23 slides
When Does Self-Supervision Help Graph Convolutional Networks? Yuning You * , Tianlong Chen * ,

When Does Self-Supervision Help Graph Convolutional Networks? Yuning You * , Tianlong Chen * ,

When Does Self-Supervision Help Graph Convolutional Networks? Yuning You * , Tianlong Chen * , Zhangyang Wang, Yang Shen Texas A&amp;M University * Equal Contribution Department of Electrical and Computer Engineering 1 This work was presented

462 views • 10 slides
Graph Representation Learning with Graph Convolutional Networks Jure Leskovec Networks: Common

Graph Representation Learning with Graph Convolutional Networks Jure Leskovec Networks: Common

Graph Representation Learning with Graph Convolutional Networks Jure Leskovec Networks: Common Language Movie 1 friend Actor 2 co-worker Actor 1 Mary Peter Actor 4 Movie 3 Tom Movie 2 friend brothers Actor 3 Albert Protein 2

752 views • 57 slides
Guardian : Evaluating Trust in Online Social Networks with Graph Convolutional Networks Wanyu Lin

Guardian : Evaluating Trust in Online Social Networks with Graph Convolutional Networks Wanyu Lin

Guardian : Evaluating Trust in Online Social Networks with Graph Convolutional Networks Wanyu Lin , Zhaolin Gao, Baochun Li University of Toronto Almost 4.57 billion people were active internet users as of April 2020. Statista Social trust

733 views • 35 slides
Inference Networks, Graph Convolutional Networks Greg Mori School of Computing Science Simon

Inference Networks, Graph Convolutional Networks Greg Mori School of Computing Science Simon

Inference Networks, Graph Convolutional Networks Greg Mori School of Computing Science Simon Fraser University Outline Scene Image annotation with label hierarchies outdoor outdoor indoor man-made natural house sports man-made

682 views • 47 slides
L 2 -GCN: Layer-Wise and Learned Efficient Training of Graph Convolutional Networks Yuning You * ,

L 2 -GCN: Layer-Wise and Learned Efficient Training of Graph Convolutional Networks Yuning You * ,

L 2 -GCN: Layer-Wise and Learned Efficient Training of Graph Convolutional Networks Yuning You * , Tianlong Chen * , Zhangyang Wang, Yang Shen Texas A&amp;M University * Equal Contribution Department of Electrical and Computer Engineering 1

215 views • 8 slides
Extracting and Modeling Relations with Graph Convolutional Networks Ivan Titov with Diego

Extracting and Modeling Relations with Graph Convolutional Networks Ivan Titov with Diego

Extracting and Modeling Relations with Graph Convolutional Networks Ivan Titov with Diego Marcheggiani, Michael Schlichtkrull, Thomas Kipf, Max Welling, Rianne van den Berg and Peter Bloem 1 Inferring missing facts in knowledge bases: link

827 views • 66 slides
High Performance Graph Convolutional Networks with Applications in Testability Analysis Yuzhe Ma 1

High Performance Graph Convolutional Networks with Applications in Testability Analysis Yuzhe Ma 1

High Performance Graph Convolutional Networks with Applications in Testability Analysis Yuzhe Ma 1 , Haoxing Ren 2 , Brucek Khailany 2 , Harbinder Sikka 2 , Lijuan Luo 2 , Karthikeyan Natarajan 2 , Bei Yu 1 1 The Chinese University of Hong Kong 2

532 views • 18 slides
Batched Sparse Matrix Multiplication for Accelerating Graph Convolutional Networks Yusuke Nagasaka

Batched Sparse Matrix Multiplication for Accelerating Graph Convolutional Networks Yusuke Nagasaka

Batched Sparse Matrix Multiplication for Accelerating Graph Convolutional Networks Yusuke Nagasaka , Akira Nukada , Kojima Ryosuke , Satoshi Matsuoka , Tokyo Institute of Technology Kyoto University RIKEN Center for

624 views • 26 slides
Kipf, T., Welling, M.: Semi-Supervised Classification with Graph Convolutional Networks Radim

Kipf, T., Welling, M.: Semi-Supervised Classification with Graph Convolutional Networks Radim

Kipf, T., Welling, M.: Semi-Supervised Classification with Graph Convolutional Networks Radim petlk Czech Technical University in Prague 2 Overview - Kipf and Welling - use first order approximation in Fourier-domain to obtain an efficient

664 views • 27 slides
Convolutional Neural Networks ---- Off the shelf top notch performances Convolutional Neural

Convolutional Neural Networks ---- Off the shelf top notch performances Convolutional Neural

Transfer Learning with Convolutional Neural Networks ---- Off the shelf top notch performances Convolutional Neural Networks A breakthough Convolutional Neural Networks VGG-16 example Layers of Convolutional filters Bottleneck

625 views • 23 slides
Semi-supervised Geolocation via Graph Convolutional Networks Afshin Rahimi, Trevor Cohn and Tim

Semi-supervised Geolocation via Graph Convolutional Networks Afshin Rahimi, Trevor Cohn and Tim

Semi-supervised Geolocation via Graph Convolutional Networks Afshin Rahimi, Trevor Cohn and Tim Baldwin July 16, 2018 1 / 25 Location Lost in Translation impacts impacts Social Media Society 2 / 25 Applications: Public Health Monitoring

710 views • 25 slides
DeepWalk: Online Learning of Social Representations ACM SIG-KDD August 26, 2014 Bryan Perozzi ,

DeepWalk: Online Learning of Social Representations ACM SIG-KDD August 26, 2014 Bryan Perozzi ,

DeepWalk: Online Learning of Social Representations ACM SIG-KDD August 26, 2014 Bryan Perozzi , Rami Al-Rfou, Steven Skiena Stony Brook University Outline Introduction: Graphs as Features Language Modeling DeepWalk

523 views • 35 slides
Social and Technological Networks Rik Sarkar Social Networks Network of friends Node:

Social and Technological Networks Rik Sarkar Social Networks Network of friends Node:

Social and Technological Networks Rik Sarkar Social Networks Network of friends Node: Person Edge: Friendship Edge ab implies that a and b are friends E.g. Karate club network Definition of networks A network or

320 views • 31 slides
Recommender Systems Instructor: Ekpe Okorafor 1. Accenture Big Data Academy 2. Computer

Recommender Systems Instructor: Ekpe Okorafor 1. Accenture Big Data Academy 2. Computer

Recommender Systems Instructor: Ekpe Okorafor 1. Accenture Big Data Academy 2. Computer Science African University of Science &amp; Technology Objectives Objectives What is the difference between content based and collaborative

666 views • 49 slides
CMU 15-251 Graphs: Basics Teachers: Anil Ada Ariel Procaccia (this time) Zachary Karate Club

CMU 15-251 Graphs: Basics Teachers: Anil Ada Ariel Procaccia (this time) Zachary Karate Club

CMU 15-251 Graphs: Basics Teachers: Anil Ada Ariel Procaccia (this time) Zachary Karate Club 2 Zachary Karate Club CLUB networkkarate.tumblr.com 3 Facebook 4 Facebook = 10 9 = 10 12 5 6 Donor 2 Exchange Patient 2 Kidney

520 views • 32 slides
Graph Sampling and Sparsification Lecture 19 CSCI 4974/6971 7 Nov 2016 1 / 10 Todays Biz 1.

Graph Sampling and Sparsification Lecture 19 CSCI 4974/6971 7 Nov 2016 1 / 10 Todays Biz 1.

Graph Sampling and Sparsification Lecture 19 CSCI 4974/6971 7 Nov 2016 1 / 10 Todays Biz 1. Reminders 2. Review 3. Graph Sampling/Sparsification 2 / 10 Reminders Assignment 4: due date November 10th Setting up and running on CCI

1.39k views • 105 slides
Understanding the Worldview Techniques to help you break through the firmament. Business Analysis

Understanding the Worldview Techniques to help you break through the firmament. Business Analysis

Understanding the Worldview Techniques to help you break through the firmament. Business Analysis Karate - Workshop Dojo Practice BA Techniques Learn from your peers Add tools to your BA toolkit Simulated exercise - No

396 views • 11 slides
Edge-based graph partitioning Outline Introduction 2D Medium-grain Rob H. Bisseling

Edge-based graph partitioning Outline Introduction 2D Medium-grain Rob H. Bisseling

Edge-based graph partitioning Outline Introduction 2D Medium-grain Rob H. Bisseling Medium-grain method Results Mathematical Institute, Utrecht University Optimal B&amp;B method Results Pretty pictures Conclusion and Joint work with

327 views • 31 slides
L ECTURE 35: N ETWORKS 2 T EACHER : G IANNI A. D I C ARO I MPORTANCE / P OWER IN NETWORKS Certain

L ECTURE 35: N ETWORKS 2 T EACHER : G IANNI A. D I C ARO I MPORTANCE / P OWER IN NETWORKS Certain

15-382 C OLLECTIVE I NTELLIGENCE S19 L ECTURE 35: N ETWORKS 2 T EACHER : G IANNI A. D I C ARO I MPORTANCE / P OWER IN NETWORKS Certain positions within the network give nodes more impor portanc nce / / pow power o Directly affect/influence

639 views • 42 slides

More recommend