Let the Flows Tell: Solving Graph Combinatorial

Optimization Problems with GFlowNets

Dinghuai Zhang, Mila Hanjun Dai 1 , Nikolay Malkin, Aaron Courville,

Google DeepMind 1 , Mila 2

May 31, 2024

Kaidi Wan (Author) Let the Flows Tell: Solving Graph Combinatorial Optimization
May Problems
31, 2024 with GFlowNets
1 / 16
Graph combinatorial optimization problems

G = (V, E), V S
Maximum independent set: ,
Maximum clique : ,
Minimum dominating set: S ,
Maximum cut : S, V-S,

Kaidi Wan (Author) Let the Flows Tell: Solving Graph Combinatorial Optimization
May Problems
31, 2024 with GFlowNets
2 / 16
Maximum clique

Kaidi Wan (Author) Let the Flows Tell: Solving Graph Combinatorial Optimization
May Problems
31, 2024 with GFlowNets
3 / 16
Maximum cut

Kaidi Wan (Author) Let the Flows Tell: Solving Graph Combinatorial Optimization
May Problems
31, 2024 with GFlowNets
4 / 16
The goal of reinforcement learning

Kaidi Wan (Author) Let the Flows Tell: Solving Graph Combinatorial Optimization
May Problems
31, 2024 with GFlowNets
5 / 16
GFlowNet training algorithm

Kaidi Wan (Author) Let the Flows Tell: Solving Graph Combinatorial Optimization
May Problems
31, 2024 with GFlowNets
6 / 16
GFlowNets MDP

Kaidi Wan (Author) Let the Flows Tell: Solving Graph Combinatorial Optimization
May Problems
31, 2024 with GFlowNets
7 / 16
GFlowNets sample

Kaidi Wan (Author) Let the Flows Tell: Solving Graph Combinatorial Optimization
May Problems
31, 2024 with GFlowNets
8 / 16
GFlowNets loss

, GFlowNets ,

Kaidi Wan (Author) Let the Flows Tell: Solving Graph Combinatorial Optimization
May Problems
31, 2024 with GFlowNets
9 / 16
Experiment: MIS

Kaidi Wan (Author) Let the Flows Tell: Solving Graph Combinatorial Optimization
May Problems
31, 2024 with GFlowNets
10 / 16
Experiment: small graph

Kaidi Wan (Author) Let the Flows Tell: Solving Graph Combinatorial Optimization
May Problems
31, 2024 with GFlowNets
11 / 16
Experiment: large graph

Kaidi Wan (Author) Let the Flows Tell: Solving Graph Combinatorial Optimization
May Problems
31, 2024 with GFlowNets
12 / 16
Experiment: ER graph

Kaidi Wan (Author) Let the Flows Tell: Solving Graph Combinatorial Optimization
May Problems
31, 2024 with GFlowNets
13 / 16
Ablation study

baseline A,B A B
ablation study
1 baseline A
2 baseline B
3 baseline AB
1 2 3 AB

1 3
B
A

Kaidi Wan (Author) Let the Flows Tell: Solving Graph Combinatorial Optimization
May Problems
31, 2024 with GFlowNets
14 / 16
Ablation study

Kaidi Wan (Author) Let the Flows Tell: Solving Graph Combinatorial Optimization
May Problems
31, 2024 with GFlowNets
15 / 16
Weekly Report

https://2023-sat-smt-ws-
2c712c94679645571d54754944fb4a5e30eabb8189c40fe.gitlab.io

Kaidi Wan (Author) Let the Flows Tell: Solving Graph Combinatorial Optimization
May Problems
31, 2024 with GFlowNets
16 / 16