• Stars
    star
    1,046
  • Rank 42,528 (Top 0.9 %)
  • Language
  • License
    Creative Commons ...
  • Created over 2 years ago
  • Updated over 1 year ago

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

๐ŸŸ  A study guide to learn about Graph Neural Networks (GNNs)

Graph Neural Networks (GNNs) Study Guide

Graph neural networks (GNNs) are rapidly advancing progress in ML for complex graph data applications. I've composed this concise recipe (i.e., studysheet) dedicated to students who are lookin to learn and keep up-to-date with GNNs. It's non-exhaustive but it aims to get students familiar with the topic.

โญ Gentle Introduction to GNNs

There are several introductory content to learn about GNNs. The following are some useful ones:

๐Ÿ”— Foundations of GNNs (by Petar Veliฤkoviฤ‡)

๐Ÿ”— Gentle Introduction to GNNs (by Distill)

๐Ÿ”— Understanding Convolutions on Graphs (by Distill)

๐Ÿ”— Math Behind Graph Neural Networks (by Rishabh Anand)

๐Ÿ”— Graph Convolutional Networks (by Thomas Kipf)

๐Ÿ”—Graph Neural Networks for Geometric Graphs - Chaitanya K. Joshi, Simon V. Mathis

๐Ÿ“˜ Survey Papers on GNNs

Here are two fantastic survey papers on the topic to get a broader and concise picture of GNNs and recent progress:

๐Ÿ”— Graph Neural Networks: A Review of Methods and Applications (Jie Zhou, Ganqu Cui, Shengding Hu, Zhengyan Zhang, Cheng Yang, Zhiyuan Liu, Lifeng Wang, Changcheng Li, Maosong Sun)

๐Ÿ”— Graph Neural Networks: Methods, Applications, and Opportunities (Lilapati Waikhom, Ripon Patgiri)

๐Ÿ”— A Comprehensive Survey on Graph Neural Networks (Zonghan Wu, Shirui Pan, Fengwen Chen, Guodong Long, Chengqi Zhang, Philip S. Yu)

๐Ÿ‘ฉโ€๐Ÿ’ป Diving Deep into GNNs

After going through quick high-level introductory content, here are some great material to go deep:

๐Ÿ”— Geometric Deep Learning (by Michael M. Bronstein, Joan Bruna, Taco Cohen, Petar Veliฤkoviฤ‡)

๐Ÿ”— Graph Representation Learning Book (by William Hamilton)

๐Ÿ”— CS224W: ML with Graphs (by Jure Leskovec)

๐Ÿ“š GNN Papers and Implementations

If you want to keep up-to-date with popular recent methods and paper implementations for GNNs, the Papers with Code community maintains this useful collection:

๐Ÿ™ Graph Models by Papers with Code

๐Ÿ“ˆ Benchmarks and Datasets

If you are interested in benchmarks/leaderboards and graph datasets that evaluate GNNs, the Papers with Code community also maintains such content here:

๐Ÿ”— Datasets by Papers with Code

๐Ÿ”— Graph Benchmarks by Papers with Code

:octocat: Tools

Here are a few useful tools to get started with GNNs:

๐Ÿ”ฅ PyTorch Geometric

๐Ÿ”— Deep Graph Library

๐Ÿฆ’ jraph

๐ŸŸ  Spektral

๐ŸŽ Tutorials

I will be posting several tutorials on GNNs, here is the first of the series. More coming soon!

Introduction to GNNs with PyTorch Geometric

To get regular updates on new ML and NLP resources, follow me on Twitter.

More Repositories

1

Prompt-Engineering-Guide

๐Ÿ™ Guides, papers, lecture, notebooks and resources for prompt engineering
MDX
42,643
star
2

ML-YouTube-Courses

๐Ÿ“บ Discover the latest machine learning / AI courses on YouTube.
14,210
star
3

ml-visuals

๐ŸŽจ ML Visuals contains figures and templates which you can reuse and customize to improve your scientific writing.
11,353
star
4

ML-Papers-of-the-Week

๐Ÿ”ฅHighlighting the top ML papers every week.
8,525
star
5

ML-Papers-Explained

Explanation to key concepts in ML
6,643
star
6

ML-Course-Notes

๐ŸŽ“ Sharing machine learning course / lecture notes.
5,857
star
7

Mathematics-for-ML

๐Ÿงฎ A collection of resources to learn mathematics for machine learning
4,127
star
8

ML-Notebooks

๐Ÿ”ฅ Machine Learning Notebooks
Jupyter Notebook
3,202
star
9

Transformers-Recipe

๐Ÿง  A study guide to learn about Transformers
1,488
star
10

nlp_paper_summaries

โœ๏ธ A carefully curated list of NLP paper summaries
1,468
star
11

MLOPs-Primer

A collection of resources to learn about MLOPs.
923
star
12

AI-Product-Index

A curated index to track AI-powered products.
744
star
13

d2l-study-group

๐Ÿง  Material for the Deep Learning Study Group
387
star
14

nlp_fundamentals

๐Ÿ“˜ Contains a series of hands-on notebooks for learning the fundamentals of NLP
Jupyter Notebook
362
star
15

nlp_newsletter

๐Ÿ“ฐNatural language processing (NLP) newsletter
300
star
16

awesome-ML-projects-guide

A guide to building awesome machine learning projects.
237
star
17

dair-ai.github.io

Home of DAIR.AI
HTML
189
star
18

emotion_dataset

๐Ÿ˜„ Dataset for Emotion Recognition Research
185
star
19

awesome-research-proposals-guide

A guide to improve your research proposals.
175
star
20

ml-nlp-paper-discussions

๐Ÿ“„ A repo containing notes and discussions for our weekly NLP/ML paper discussions.
151
star
21

keep-learning-ml

A club to keep learning about ML
89
star
22

notebooks

๐Ÿ”ฌ Sharing your data science notebooks with the community has never been this easy.
Jupyter Notebook
37
star
23

covid_19_search_application

Text Similarity Search Application using Modern NLP and Elasticsearch
Jupyter Notebook
30
star
24

odsc_2020_nlp

Repository for ODSC talk related to Deep Learning NLP
24
star
25

research_emotion_analysis

๐Ÿ˜„ Multilingual emotion analysis research
Python
18
star
26

data_science_writing_primer

Writing Primer for Data Scientists
Jupyter Notebook
17
star
27

maven-pe-for-llms-4

Prompt Engineering for Large Language Models - Notebooks, Demos, Exercises, and Projects
Jupyter Notebook
16
star
28

arxiv_analysis

A project to help explore research papers and fuel new discovery
Jupyter Notebook
16
star
29

pe-for-llms

Jupyter Notebook
14
star
30

llm-evaluator

Example for Logging LLM Evaluator Prompt Responses
Jupyter Notebook
14
star
31

paper_implementations

A project for implementing ML and NLP papers
14
star
32

maven-pe-for-llms

Jupyter Notebook
12
star
33

nlp-roadmap

A comprehensive roadmap to get informed of the NLP landscape.
9
star
34

ml-discussions

Discussing ML research, engineering, papers, resources, learning paths, best practices, and much more.
8
star
35

maven-pe-for-llms-6

Materials for the Prompt Engineering for LLMs (Cohort 6)
Jupyter Notebook
7
star
36

paper_presentations

All paper presentation material will be added here
6
star
37

maven-pe-for-llms-7

Code, Demos, and Exercises for Prompt Engineering for LLMs Course
Jupyter Notebook
5
star
38

nlp_research_highlights

Contains all issues of the NLP Research Highlights series
5
star
39

maven-pe-for-llms-8

Materials for the Prompt Engineering for LLMs (Cohort 8)
Jupyter Notebook
5
star
40

deep_affective_layer

๐Ÿ˜„ Building a deep learning based affective computing platform
4
star
41

maven-pe-for-llms-2

Jupyter Notebook
3
star
42

.github

2
star
43

meetups

Material for dair.ai meetups
2
star
44

tensorflow_notebooks

A repository containing Deep Learning and Machine Learning related TensorFlow notebooks.
1
star