CSE 703: Deep Learning on Graphs (Fall 23)

Course Description

Graphs are everywhere. Their scale, rate of change, and the irregular nature pose many new challenges. Deep learning has been shown to be successful in a number of domains, ranging from images to natural language processing. However, applying deep learning to the ubiquitous graph data is non-trivial because of the unique characteristics. This seminar course covers recent papers in the last few years about deep learning on graphs. We will consider graph embeddings, knowledge graphs, graph kernels, graph neural networks, graph convolutional networks, graph adversarial methods. Students will learn the literature on deep learning on graphs, understand the state-of-the-art algorithms on various problems, and be familiar with the recent trends.

Prerequisites

It is assumed that students have a solid background on discrete mathematics and algorithms. Basic research skills like paper reading, critical thinking, problem solving, report writing, communication, and presentation are important as well.

Grading Policy (Same for 1, 2, or 3 credits)

• Serving as an explainer (one time): 34 pts
• Serving as a listener (11 times) : 11*6 = 66 pts

The final grade is S/U and 80 pts score is needed for an S.

Paper presentation & questions

Explainer role: Each week there will be 1 or 2 explainers. Those students are responsible for presenting the paper and answering the student questions on Piazza. At the beginning of the class, the instructor will pick the presenter among those explainers. All explainers must be ready to present. Assignment of the explainers to the papers will be done by the instructor.

Listener role: Each week all the students are supposed to read the paper of the week. All students, except explainers, serve as listeners and will ask a unique question (one question, not less, not more) on Piazza. Those questions will be answered by the explainers on Piazza and some questions will be selected by them for discussion in class. Questions should be open-ended and provide ground for class discussions, i.e., 'can you explain alg 1?' is not that kind of question. Questions should be posted to Piazza by Monday night, 11.59 pm EST.

Piazza page

Schedule

• Aug 30:
  Course overview by instructor [pdf]
  
  
• Sep 6:
  Machine Learning on Graphs: A Model and Comprehensive Taxonomy Journal of Machine Learning Research 23 (2022) 1-64 by Jason
  
  
• Sep 13:
  DeepWalk: Online Learning of Social Representations SIGKDD 2014 by Sumanth and Darryl
  
  
• Sep 20:
  Revisiting Semi-Supervised Learning with Graph Embeddings ICML 2016 by Jasleen and Michael
  
  
• Sep 27:
  Network Embedding as Matrix Factorization: Unifying DeepWalk, LINE, PTE, and node2vec WSDM 2018 by Yadvender and Atul
  
  
• Oct 4:
  MILE: A Multi-Level Framework for Scalable Graph Embedding ICWSM 2021 by Aviral and Vrashi
  
  
• Oct 11:
  Efficient and Effective Edge-wise Graph Representation Learning SIGKDD 2023 by Avinash
  
  
• Oct 18:
  Semi-supervised Classification with Graph Convolutional Networks ICLR 2017 by Rohith and Haritha
  
  
• Oct 25:
  Inductive Representation Learning on Large Graphs NIPS 2017 by Sai and Priyanka
  
  
• Nov 1:
  Graph Attention Networks ICLR 2018 by Debasmit and Shubham
  
  
• Nov 8:
  Deep Graph Infomax ICLR 2019 by Swaminathan
  
  
• Nov 15:
  Weisfeiler and Leman Go Neural: Higher-order Graph Neural Networks AAAI 2019 by Chris
  
  
• Nov 29:
  Beyond Homophily in Graph Neural Networks: Current Limitations and Effective Designs NeurIPS 2020 by Ram and Chirun
  
  
• Dec 6:
  Combining Label Propagation and Simple Models Out-performs Graph Neural Networks ICLR 2021 by Lakshya