Deep Tutorials for PyTorch
This is a series of in-depth tutorials I'm writing for implementing cool deep learning models on your own with the amazing PyTorch library.
Basic knowledge of PyTorch and neural networks is assumed.
If you're new to PyTorch, first read Deep Learning with PyTorch: A 60 Minute Blitz and Learning PyTorch with Examples.
24 Apr 2023: I've just completed the Super-Resolution and Machine Translation tutorials.
In each tutorial, we will focus on a specific application or area of interest by implementing a model from a research paper.
| Application | Paper | Tutorial | Also Learn About | Status |
|---|---|---|---|---|
| Image Captioning | Show, Attend, and Tell | a PyTorch Tutorial to Image Captioning | • encoder-decoder architecture • attention • transfer learning • beam search |
complete |
| Sequence Labeling | Empower Sequence Labeling with Task-Aware Neural Language Model | a PyTorch Tutorial to Sequence Labeling | • language models • character RNNs • multi-task learning • conditional random fields • Viterbi decoding • highway networks |
complete |
| Object Detection | SSD: Single Shot MultiBox Detector | a PyTorch Tutorial to Object Detection | • single-shot detection • multiscale feature maps • priors • multibox • hard negative mining • non-maximum suppression |
complete |
| Text Classification | Hierarchical Attention Networks for Document Classification | a PyTorch Tutorial to Text Classification | • hierarchical attention | code complete |
| Super-Resolution | Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network | a PyTorch Tutorial to Super-Resolution | • GANs — this is also a GAN tutorial • residual connections • sub-pixel convolution • perceptual loss |
complete |
| Machine Translation | Attention Is All You Need | a PyTorch Tutorial to Machine Translation | • transformers — this is also a transformer tutorial • multi-head attention • positional embeddings • encoder-decoder architecture • byte pair encoding • beam search |
complete |
| Semantic Segmentation | SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformers | a PyTorch Tutorial to Semantic Segmentation | N/A | planned |