• Stars
    star
    387
  • Rank 107,436 (Top 3 %)
  • Language
  • License
    MIT License
  • Created almost 4 years ago
  • Updated about 2 years ago

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

๐Ÿง  Material for the Deep Learning Study Group

Deep Learning Study Group

About

In this free online study program, we will be studying the "Dive into Deep Learning" book by Aston Zhang, Zack C. Lipton, Mu Li, and Alex J. Smola.

All study sessions will be free and fully-remote. All sessions will be recorded and uploaded to YouTube.

Unlike other study groups, the format (tentative) will be as follows:

  • Chapters will be presented with slides, which will be followed by code walkthroughs
  • For every session, there will be a segment for discussion and Q&A
  • After every session, we will assign take-home exercises corresponding to the material covered in that session. We will ask you to upload programming solutions either through GitHub or Google Colab. Find the instructions for each assignment in the full schedule below.
  • Before every session, we will provide a list of extra reading material, ahead of time, that will be helpful for the upcoming session.
  • We plan to have guest lectures and presentations to provide additional practical value to students (TBA)
  • There will be one final project which will be done in groups. The groups have to present their work towards the end of the program. (More information coming soon!)

Instructions

  • Make sure to join our Slack group(channel: #d2l-study-group) for the latest schedule, updates and announcements. Feel free to reach out to me on Twitter for an invite to our Slack group.
  • You will be eligible to receive a Certificate of Completion if you complete more than 80% of the exercises. In addition, you must complete and present your final project to be eligible for the certificate. We won't use any kind of grading system and we will just mark the assignments as either complete or incomplete. We hope that all submissions of the exercises are true attempts to complete them. We will provide feedback on all submissions to help with completion when needed.
  • You are free to audit the sessions as well.

Schedule and Registration

To fully register for this program:

  • Ensure that you have joined our Slack group for more updates on the program. You will also find a spreadsheet there to officially enroll in the program and signup to be considered for the Certificate of Completion.

All dates below are tentative and subject to change.

Chapter Suggested Readings Exercises Live Session Date/Time Slides/Notebook Recording
Session 1 - Introduction to Deep Learning Find readings here Complete the list here Zoom (requires registration), YouTube Live August 1, 2020, 15:00 - 17:00 CEST PDF YouTube
Session 2 - Preliminaries Find readings here NA Zoom (Check Slack group for password), YouTube Live August 15, 2020, 15:00 - 17:00 CEST Preliminaries, Hacking Guide to Neural Networks - Draft YouTube
Session 3 - Linear Neural Networks Find suggested readings here Assignment 2 Zoom (Check Slack group for password) September 05, 2020, 15:00 - 17:00 CEST Slides, Notebook YouTube
Session 4 - Multilayer Perceptrons TBA Assignment 3 Zoom (Check Slack group for password), YouTube Live September 12, 2020, 15:00 - 17:00 CEST Notebook, Slides YouTube
Session 5 - Deep Learning Computation TBA - - September 24, 2020, 15:00 - 17:00 CEST Notebook YouTube
Session 6 - Convolutional Neural Networks - TBA Zoom - check Slack channel for password, YouTube Live September 26, 2020, 15:00 - 17:00 CEST Slides YouTube
Session 7 - Modern Convolutional Neural Networks - Assignment 4 Zoom (check Slack channel for password), YouTube Live October 3, 2020, 15:00 - 17:00 CEST Slides YouTube
Session 8 - Recurrent Neural Networks TBA TBA TBA TBA TBA TBA
Session 9 - Modern Recurrent Neural Networks TBA TBA TBA TBA TBA TBA
Session 10 - Attention Mechanism TBA TBA TBA TBA TBA TBA
Session 11 - Optimization Algorithms TBA TBA TBA TBA TBA TBA
Session 12 - Computational Performance TBA TBA TBA TBA TBA TBA
Session 13 - Computer Vision TBA TBA TBA TBA TBA TBA
Session 14 (Part 1) - Natural Language Processing: Pretraining TBA TBA TBA TBA TBA TBA
Session 14 (Part 2) - Project Announcement TBA TBA TBA TBA TBA TBA
Session 15 - Natural Language Processing: Applications TBA TBA TBA TBA TBA TBA
Session 16 - Generative Adversarial Networks TBA TBA TBA TBA TBA TBA
Session 17 - Recommender Systems TBA TBA TBA TBA TBA TBA
Session 18 - Final Projects Presentation TBA TBA TBA TBA TBA TBA

How to Contribute

If you are interested to deliver chapters from the book, help as a TA, or deliver a special lecture, please reach out to me directly at [email protected].


Frequently Asked Questions

Q: How do I register to be considered for the certificate of completion?

A: You will need to join our Slack group and then enroll officially to be consided for the certificate of completion by adding your name to the spreadsheet shared in the #d2l-study-group channel. Look for the pinned message in the channel.


Q: How do I qualify for the certificate of completion?

A: The first step is to enroll in the program as stated above. Then you will need to complete at least 80% of the exercises assigned throughout the program. You will also need to complete the final project which will be done as a group work and presented towards the end of the program. Failure to complete at least 80% of the assignments or engaging in plagiarism will automatically disqualify from being awarded a certificate of completion.


Q: How are the assignments graded?

A: We don't pass or fail assignments. You will be given either a complete or incomplete status for each assignment. If your assignment is incomplete, we will provide you feedback and will allow you to resubmit but it has to be resubmitted in the period of 48 hours after the original deadline. If you submit the assignments after the deadline they will be labeled as incomplete and we won't provide you feedback for these cases.


Q: Can I audit the sessions of the program?

A: You are free to audit the sessions without the need to complete the exercises. All sessions will be streamed publicly on both Zoom and YouTube. Schedule information will be provided here and on our Meetup page.


Q: Where do I go for the latest information regarding the program?

A: All the latest information regarding the program such as schedule, upcoming sessions, and video recodings will be maintained in this repository. If you have any other questions, you can open an issue here or submit your questions in the Slack channel.


More Repositories

1

Prompt-Engineering-Guide

๐Ÿ™ Guides, papers, lecture, notebooks and resources for prompt engineering
MDX
42,643
star
2

ML-YouTube-Courses

๐Ÿ“บ Discover the latest machine learning / AI courses on YouTube.
14,210
star
3

ml-visuals

๐ŸŽจ ML Visuals contains figures and templates which you can reuse and customize to improve your scientific writing.
11,353
star
4

ML-Papers-of-the-Week

๐Ÿ”ฅHighlighting the top ML papers every week.
8,525
star
5

ML-Papers-Explained

Explanation to key concepts in ML
6,643
star
6

ML-Course-Notes

๐ŸŽ“ Sharing machine learning course / lecture notes.
5,857
star
7

Mathematics-for-ML

๐Ÿงฎ A collection of resources to learn mathematics for machine learning
4,127
star
8

ML-Notebooks

๐Ÿ”ฅ Machine Learning Notebooks
Jupyter Notebook
3,202
star
9

Transformers-Recipe

๐Ÿง  A study guide to learn about Transformers
1,488
star
10

nlp_paper_summaries

โœ๏ธ A carefully curated list of NLP paper summaries
1,468
star
11

GNNs-Recipe

๐ŸŸ  A study guide to learn about Graph Neural Networks (GNNs)
1,046
star
12

MLOPs-Primer

A collection of resources to learn about MLOPs.
923
star
13

AI-Product-Index

A curated index to track AI-powered products.
744
star
14

nlp_fundamentals

๐Ÿ“˜ Contains a series of hands-on notebooks for learning the fundamentals of NLP
Jupyter Notebook
362
star
15

nlp_newsletter

๐Ÿ“ฐNatural language processing (NLP) newsletter
300
star
16

awesome-ML-projects-guide

A guide to building awesome machine learning projects.
237
star
17

dair-ai.github.io

Home of DAIR.AI
HTML
189
star
18

emotion_dataset

๐Ÿ˜„ Dataset for Emotion Recognition Research
185
star
19

awesome-research-proposals-guide

A guide to improve your research proposals.
175
star
20

ml-nlp-paper-discussions

๐Ÿ“„ A repo containing notes and discussions for our weekly NLP/ML paper discussions.
151
star
21

keep-learning-ml

A club to keep learning about ML
89
star
22

notebooks

๐Ÿ”ฌ Sharing your data science notebooks with the community has never been this easy.
Jupyter Notebook
37
star
23

covid_19_search_application

Text Similarity Search Application using Modern NLP and Elasticsearch
Jupyter Notebook
30
star
24

odsc_2020_nlp

Repository for ODSC talk related to Deep Learning NLP
24
star
25

research_emotion_analysis

๐Ÿ˜„ Multilingual emotion analysis research
Python
18
star
26

data_science_writing_primer

Writing Primer for Data Scientists
Jupyter Notebook
17
star
27

maven-pe-for-llms-4

Prompt Engineering for Large Language Models - Notebooks, Demos, Exercises, and Projects
Jupyter Notebook
16
star
28

arxiv_analysis

A project to help explore research papers and fuel new discovery
Jupyter Notebook
16
star
29

pe-for-llms

Jupyter Notebook
14
star
30

llm-evaluator

Example for Logging LLM Evaluator Prompt Responses
Jupyter Notebook
14
star
31

paper_implementations

A project for implementing ML and NLP papers
14
star
32

maven-pe-for-llms

Jupyter Notebook
12
star
33

nlp-roadmap

A comprehensive roadmap to get informed of the NLP landscape.
9
star
34

ml-discussions

Discussing ML research, engineering, papers, resources, learning paths, best practices, and much more.
8
star
35

maven-pe-for-llms-6

Materials for the Prompt Engineering for LLMs (Cohort 6)
Jupyter Notebook
7
star
36

paper_presentations

All paper presentation material will be added here
6
star
37

maven-pe-for-llms-7

Code, Demos, and Exercises for Prompt Engineering for LLMs Course
Jupyter Notebook
5
star
38

nlp_research_highlights

Contains all issues of the NLP Research Highlights series
5
star
39

maven-pe-for-llms-8

Materials for the Prompt Engineering for LLMs (Cohort 8)
Jupyter Notebook
5
star
40

deep_affective_layer

๐Ÿ˜„ Building a deep learning based affective computing platform
4
star
41

maven-pe-for-llms-2

Jupyter Notebook
3
star
42

.github

2
star
43

meetups

Material for dair.ai meetups
2
star
44

tensorflow_notebooks

A repository containing Deep Learning and Machine Learning related TensorFlow notebooks.
1
star