Scribd
Upload
9 views55 pages

GNNV4

The document discusses Geometric Deep Learning and its application through Pytorch Geometric tutorials by Antonio Longa and Gabriele Santin, aimed at researchers, students, and engineers. It covers the basics of GDL models, graph representation, and the challenges faced in deep learning with graphs. Additionally, it introduces Graph Neural Networks and their computation graphs, emphasizing the importance of ordering invariance and aggregation in the learning process.

Uploaded by

Mohammed Hassan
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
9 views55 pages

GNNV4

The document discusses Geometric Deep Learning and its application through Pytorch Geometric tutorials by Antonio Longa and Gabriele Santin, aimed at researchers, students, and engineers. It covers the basics of GDL models, graph representation, and the challenges faced in deep learning with graphs. Additionally, it introduces Graph Neural Networks and their computation graphs, emphasizing the importance of ordering invariance and aggregation in the learning process.

Uploaded by

Mohammed Hassan
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 55

What is Geometric Deep Learning?

Pytorch Geometric tutorials


● Antonio Longa and Gabriele Santin
● Open source project

● Learn how to use Geometric Deep Learning


● Pytorch Geometric
Pytorch Geometric tutorials
● Antonio Longa and Gabriele Santin
● Open source project

● Learn how to use Geometric Deep Learning


● Pytorch Geometric

How it works
● Brief introduction to a GDL model
● Practice!
● Feel free to join, ask and present
Pytorch Geometric tutorials
● Antonio Longa and Gabriele Santin
● Open source project

● Learn how to use Geometric Deep Learning


● Pytorch Geometric

How it works
● Brief introduction to a GDL model
● Practice!
● Feel free to join, ask and present

Who are you?


● Researchers
● Students
● Engineers
● ...
Deep Learning

01
and
Other fields ?

Graphs
and
Graphs representation
02
TABLE OF 04 Definitions
Deep Learning
and
Deep Learning: problems
03 CONTENTS
05 Graph Neural Networks

06 Conclusions and
future works
01 Deep Learning

IMAGES

SPEECH
MEDICAL image processing
01 Other fields ? NETWORK Science

BIOLOGY

RECOMMENDER SYSTEMS
MANIFOLD
01 Other fields ?
DIFFERENCE BETWEEN:

● Images and manifold?


● Speech and molecules?
● RX images and graphs?
01 Other fields ?
DIFFERENCE BETWEEN:

● Images and manifold?


● Speech and molecules?
● RX images and graphs?

NON-EUCLIDEAN DOMAINS
02 Graphs
03 Graph representation
GRAPH ADJ MATRIX
03 Deep learning
GRAPH ADJ MATRIX

Neural network
03 Deep learning
GRAPH ADJ MATRIX

Neural network Convolution Neural network


03 Deep learning

PROBLEMS:

■
■
03 Deep learning: problems
Different sizes
03 Deep learning: problems
NOT invariant to node ordering

𝙂 𝙂

𝙂
03 Deep learning: problems
NOT invariant to node ordering

𝙂 𝙂

𝙂 𝙂 𝙂≠ 𝙂

𝙂 𝙂
04 Definitions

X∈ℛ

A 𝙂
05 Graph neural networks

● Define a computation graph


● Use the computation graph
05 Graph neural networks
COMPUTATION GRAPH
The neighbour of a node define its computation graph

INPUT GRAPH
05 Graph neural networks
COMPUTATION GRAPH
The neighbour of a node define its computation graph

INPUT GRAPH COMPUTATION GRAPH


05 Graph neural networks
COMPUTATION GRAPH
The neighbour of a node define its computation graph

INPUT GRAPH COMPUTATION GRAPH


05 Graph neural networks
COMPUTATION GRAPH
The neighbour of a node define its computation graph

INPUT GRAPH COMPUTATION GRAPH


05 Graph neural networks
XA

XB

XE
05 Graph neural networks
XA

XB

XE

Neural Networks
05 Graph neural networks
XA

XB

XE

Neural Networks
Ordering invariant
Aggregation
05 Graph neural networks
computation graph
05 Graph neural networks
computation graph
05 Graph neural networks
computation graph
05 Graph neural networks
computation graph
05 Graph neural networks
computation graph
05 Graph neural networks
computation graph
05 Graph neural networks
redundancy?
05 Graph neural networks
redundancy?
05 Graph neural networks
05 Graph neural networks
unroll
05 Graph neural networks
unroll
05 Graph neural networks
unroll
05 Graph neural networks
unroll
05 Graph neural networks
Math
05 Graph neural networks
Math
05 Graph neural networks
Math
05 Graph neural networks
05 Graph neural networks
05 Graph neural networks
05 Graph neural networks

u = N(v)
05 Graph neural networks

u = N(v)
05 Graph neural networks

u = N(v)
ReLU
05 Graph neural networks
Shared Parameters
06 Graph SAGE
06 Graph SAGE
06 Graph SAGE
06 Graph SAGE
06 Graph SAGE

AGG:
● AGG → POOL
● AGG → LSTM
07 Practice

You might also like