• Stars
    star
    818
  • Rank 53,613 (Top 2 %)
  • Language
    Jupyter Notebook
  • License
    MIT License
  • Created over 2 years ago
  • Updated over 1 year ago

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

πŸ’ Awesome Treasure of Transformers Models for Natural Language processing contains papers, videos, blogs, official repo along with colab Notebooks. πŸ›«β˜‘οΈ

Awesome Treasure of Transformers Models Collection

fw.jpg


πŸ§‘β€πŸ’»πŸ‘©β€πŸ’»Collection of All NLP Deep learning algorithm list with Code πŸ§‘β€πŸ’»πŸ‘©β€πŸ’»Jupyter Notebook


Sr No Algorithm Name Year Blog Video Official Repo Code
1 GPT-Neo 2021 Youtube Open In Colab
2 Transformer 2017 Youtube Open In Colab
3 BERT 2018 Youtube Open In Colab
4 GPT 2018 Youtube Open In Colab
5 Universal Transformer 2018 Youtube Open In Colab
6 T-D 2018 Youtube Open In Colab
7 GPT-2 2019 Youtube Open In Colab
8 T5 2019 Youtube Open In Colab
9 BART 2019 Youtube Open In Colab
10 XLNet 2019 Youtube Open In Colab
11 ALBERT 2019 Youtube Open In Colab
12 Distil-BERT 2019 Youtube Open In Colab
13 Transformer-XL 2019 Youtube Open In Colab
14 XLM 2019 Youtube Open In Colab
15 ViLBERT 2019 Youtube Open In Colab
16 Sparse Transformer 2019 Youtube Open In Colab
17 Levenshtein Transformer 2019 Youtube Open In Colab
18 CTRL 2019 Youtube Open In Colab
19 VideoBERT 2019 Youtube Open In Colab
20 Compressive Transformer 2019 Youtube Open In Colab
21 CuBERT 2019 Youtube Open In Colab
22 BP-Transformer 2019 Youtube Open In Colab
23 Adaptively Sparse Transformer 2019 Youtube Open In Colab
24 Sandwich Transformer 2019 Youtube Open In Colab
25 FSMT 2019 Youtube Open In Colab
26 LXMERT 2019 Youtube Open In Colab
27 VisualBERT 2019 Youtube Open In Colab
28 GPT-3 2020 Youtube Open In Colab
29 ELECTRA 2020 Youtube Open In Colab
30 Electric 2020 Youtube Open In Colab
31 LongFormer 2020 Youtube Open In Colab
32 mBART 2020 Youtube Open In Colab
33 Performer 2020 Youtube Open In Colab
34 ETC 2020 Youtube Open In Colab
35 CodeBERT 2020 Youtube Open In Colab
36 mT5 2020 Youtube Open In Colab
37 Reformer 2020 Youtube Open In Colab
38 DeBERTa & DeBERTa-v2 2020 Youtube Open In Colab
39 Linformer 2020 Youtube Open In Colab
40 RAG 2020 Youtube Open In Colab
41 ProphetNet 2020 Youtube Open In Colab
42 BigBird 2020 Youtube Open In Colab
43 PLATO-2 2020 Youtube Open In Colab
44 Routing Transformer 2020 Youtube Open In Colab
45 DeeBERT 2020 Youtube Open In Colab
46 DynaBERT 2020 Youtube Open In Colab
47 TernaryBERT 2020 Youtube Open In Colab
48 MobileBERT 2020 Youtube Open In Colab
49 Bort 2020 Youtube Open In Colab
50 DeLighT 2020 Youtube Open In Colab
51 PAR Transformer 2020 Youtube Open In Colab
52 ConvBERT 2020 Youtube Open In Colab
53 IB-BERT 2020 Youtube Open In Colab
54 MacBERT 2020 Youtube Open In Colab
55 RealFormer 2020 Youtube Open In Colab
56 Sinkhorn Transformer 2020 Youtube Open In Colab
57 SongNet 2020 Youtube Open In Colab
58 Funnel Transformer 2020 Youtube Open In Colab
59 SC-GPT 2020 Youtube Open In Colab
60 SMITH 2020 Youtube Open In Colab
61 BinaryBERT 2020 Youtube Open In Colab
62 SqueezeBERT 2020 Youtube Open In Colab
63 Feedback Transformer 2020 Youtube Open In Colab
64 CamemBERT 2020 Youtube Open In Colab
65 CPM 2020 Youtube Open In Colab
66 DialoGPT 2020 Youtube Open In Colab
67 DPR 2020 Youtube Open In Colab
68 FlauBERT 2020 Youtube Open In Colab
69 HerBERT 2020 Youtube Open In Colab
70 LayoutLM 2020 Youtube Open In Colab
71 LED 2020 Youtube Open In Colab
72 LUKE 2020 Youtube Open In Colab
73 M2M100 2020 Youtube Open In Colab
74 MBart and MBart-50 2020 Youtube Open In Colab
75 MegatronBERT 2020 Youtube Open In Colab
76 MegatronGPT2 2020 Youtube Open In Colab
77 MPNet 2020 Youtube Open In Colab
78 Pegasus 2020 Youtube Open In Colab
79 PhoBERT 2020 Youtube Open In Colab
80 QDQBERT 2020 Youtube Open In Colab
81 RemBERT 2020 Youtube Open In Colab
82 RetriBERT 2020 Youtube Open In Colab
83 Speech2Text 2020 Youtube Open In Colab
84 T5v1.1 2020 Youtube Open In Colab
85 TAPAS 2020 Youtube Open In Colab
86 Wav2Vec2 2020 Youtube Open In Colab
87 XLM-ProphetNet 2020 Youtube Open In Colab
88 XLM-RoBERTa 2020 Youtube Open In Colab
89 XLSR-Wav2Vec2 2020 Youtube Open In Colab
90 Switch Transformer 2021 Youtube Open In Colab
91 TNT 2021 Youtube Open In Colab
92 Adaptive Span Transformer 2021 Youtube Open In Colab
93 Primer 2021 Youtube Open In Colab
94 Charformer 2021 Youtube Open In Colab
95 MATE 2021 Youtube Open In Colab
96 Nystromformer 2021 Youtube Open In Colab
97 Subformer 2021 Youtube Open In Colab
98 ESACL 2021 Youtube Open In Colab
99 PermuteFormer 2021 Youtube Open In Colab
100 NormFormer 2021 Youtube Open In Colab
101 Fastformer 2021 Youtube Open In Colab
102 AutoTinyBERT 2021 Youtube Open In Colab
103 EGT 2021 Youtube Open In Colab
104 Chinese Pre-trained Unbalanced Transformer 2021 Youtube Open In Colab
105 GANFormer 2021 Youtube Open In Colab
106 ClipBERT 2021 Youtube Open In Colab
107 CodeT5 2021 Youtube Open In Colab
108 I-BERT 2021 Youtube Open In Colab
109 ByT5 2021 Youtube Open In Colab
110 CANINE 2021 Youtube Open In Colab
111 FNet 2021 Youtube Open In Colab
112 LayoutLMV2 2021 Youtube Open In Colab
113 LayoutXLM 2021 Youtube Open In Colab
114 GPT-J 2021 Youtube Open In Colab
115 Hubert 2021 Youtube Open In Colab
116 Perceiver 2021 Youtube Open In Colab
117 RoFormer 2021 Youtube Open In Colab
118 SegFormer 2021 Youtube Open In Colab
119 SEW 2021 Youtube Open In Colab
120 SEW-D 2021 Youtube Open In Colab
121 Speech2Text2 2021 Youtube Open In Colab
122 Splinter 2021 Youtube Open In Colab
123 TrOCR 2021 Youtube Open In Colab
124 UniSpeech 2021 Youtube Open In Colab
125 UniSpeech-SAT 2021 Youtube Open In Colab
126 MarianMT - Open In Colab

Instruction

  • All blogs have links and some links contains different languages blog such as Chinese, Korean etc. for this Please use Google Tranlater Page Convert.

How to Contribute


if you want to contribute on this project please send us email: [email protected] .

πŸ™πŸ™Special Thanks to Komal Lamba for contributing.


Copyright for source code belongs to the original author(s). However, under fair use you are encouraged to fork and contribute minor corrections and updates for the benefit of the reader(s).


Thanks for Reading ...!!!


More Repositories

1

500-AI-Machine-learning-Deep-learning-Computer-vision-NLP-Projects-with-code

500 AI Machine learning Deep learning Computer vision NLP Projects with code
12,358
star
2

Tools-to-Design-or-Visualize-Architecture-of-Neural-Network

Tools to Design or Visualize Architecture of Neural Network
3,304
star
3

Andrew-NG-Notes

This is Andrew NG Coursera Handwritten Notes.
Jupyter Notebook
1,687
star
4

Amazing-Feature-Engineering

Feature engineering is the process of using domain knowledge to extract features from raw data via data mining techniques. These features can be used to improve the performance of machine learning algorithms. Feature engineering can be considered as applied machine learning itself.
Jupyter Notebook
418
star
5

ResourceBank_CV_NLP_MLOPS_2022

This repository offers a goldmine of materials for students of computer vision, natural language processing, and machine learning operations.
Jupyter Notebook
412
star
6

365-Days-Computer-Vision-Learning-Linkedin-Post

365 Days Computer Vision Learning Linkedin Post
387
star
7

Real-time-ML-Project

A curated list of applied machine learning and data science notebooks and libraries across different industries.
377
star
8

Tensorflow-in-practise-Specialization

Four Courses Specialization Tensorflow in practise Specialization
Jupyter Notebook
254
star
9

Vision-Transformer-Keras-Tensorflow-Pytorch-Examples

Tensorflow implementation of the Vision Transformer (An Image is Worth 16x16 Words: Transformer
Jupyter Notebook
90
star
10

Predictive_Maintenance_using_Machine-Learning_Microsoft_Casestudy

Predictive_Maintenance_using_Machine-Learning_Microsoft_Casestudy
Jupyter Notebook
87
star
11

Last-Minute-Notes-of-Machine-learning-and-Deep-learning

Last Minute Note of Machine learning and Deep learning by Jason Brownlee
82
star
12

Best-Audio-Classification-Resources-with-Deep-learning

List of articles related to deep learning applied to music
TeX
81
star
13

satellite-Image-Semantic-Segmentation-Unet-Tensorflow-keras

Collection of different Unet Variant suchas VggUnet, ResUnet, DenseUnet, Unet. AttUnet, MobileNetUnet, NestedUNet, R2AttUNet, R2UNet, SEUnet, scSEUnet, Unet_Xception_ResNetBlock
Jupyter Notebook
64
star
14

TensorFlow-Advanced-Techniques-Specialization

Tensorflow Advanced Technique Specialization
Jupyter Notebook
62
star
15

datascienv

datascienv is package that helps you to setup your environment in single line of code with all dependency and it is also include pyforest that provide single line of import all required ml libraries
Python
56
star
16

14-days-Beginner-Practical-Guide-of-Machine-Learning

14 days Beginner Practical Guide of Machine Learning
55
star
17

Computer-Vision-Industry-Use-Cases

Computer Vision Industry Use Cases
Jupyter Notebook
52
star
18

Market-Basket-Analysis

Association rule mining is a technique to identify underlying relations between different items.
Jupyter Notebook
51
star
19

tcn-keras-Examples

This repository contains example of keras-tcn on easy way.
Jupyter Notebook
49
star
20

Coursera-Guided-Projects-2021

Coursera Guided Projects 2021
Jupyter Notebook
46
star
21

Yolov5-King-of-object-Detection

Yolov5 : You Look Only Once v5 Learning Resources and Collection
43
star
22

Amazing-Collection-Vehicle-Routing-Problem

Amazing Collection Vehicle Routing Problem
41
star
23

ML-Notes-in-Markdown

Machine learning notes that make your reading easy
Jupyter Notebook
39
star
24

Data-Science-Tutorial-By-Lambda-School

Jupyter Notebook
32
star
25

Introduction-to-Time-Series-forecasting

Time Series Analysis of Internation Air Passengers
Jupyter Notebook
32
star
26

ashishpatel26

ashishpatel26
31
star
27

Titanic-Machine-Learning-from-Disaster

Start here if... You're new to data science and machine learning, or looking for a simple intro to the Kaggle prediction competitions. Competition Description The sinking of the RMS Titanic is one of the most infamous shipwrecks in history. On April 15, 1912, during her maiden voyage, the Titanic sank after colliding with an iceberg, killing 1502 out of 2224 passengers and crew. This sensational tragedy shocked the international community and led to better safety regulations for ships. One of the reasons that the shipwreck led to such loss of life was that there were not enough lifeboats for the passengers and crew. Although there was some element of luck involved in surviving the sinking, some groups of people were more likely to survive than others, such as women, children, and the upper-class. In this challenge, we ask you to complete the analysis of what sorts of people were likely to survive. In particular, we ask you to apply the tools of machine learning to predict which passengers survived the tragedy. Practice Skills Binary classification Python and R basics
Jupyter Notebook
30
star
28

Awesome-Machine-learning-Deep-learning-Deployment

Awesome Machine learning Deep learning Deployment
29
star
29

Best-Data-Science-Learning-Resources

My Study Collection data science courses, Article etc.
28
star
30

Facial-Expression-Recognization-using-JAFFE

Facial Expression Recognization using JAFFE
Jupyter Notebook
27
star
31

Awesome-MLOps-Course-Outline

Awesome MLOps Course Outline
27
star
32

Meta-Learning-

Meta learning is a subfield of machine learning where automatic learning algorithms are applied on metadata about machine learning experiments.
26
star
33

Browser-based-Models-with-TensorFlowjs

You may think that machine learning models can only be trained with supercomputers and big data. This first course shows you how you can train and run machine learning models in any browser using TensorFlow.js. You’ll learn techniques for handling data in the browser, and at the end you’ll build a computer vision project that recognizes and classifies objects from a webcam. deeplearning.ai certificate : https://www.coursera.org/account/accomplishments/records/BURZEBYF8K3A
Jupyter Notebook
26
star
34

Awesome-Pytorch-Tutorials

Awesome Pytorch Tutorials
Jupyter Notebook
24
star
35

Data-Science-Machine-Learning-Cheat-Sheet

Data Science Cheat Sheet is help to remind code with in minute and also useful to recall the code.Collecting at one place so everyone can access easily and learn.In this we have collected all cheat sheet from the web which is contain basic learning for python and R with Machine Learning and Data Science.
23
star
36

Most-used-ML-Packages

Here my amazing tutorial collection contain amazing notebook must read. It's contain pytorch, Advance pandas, Ensemble learning, Tensorflow, Genetic Algorithms, Dask, Word Embedding
Jupyter Notebook
20
star
37

Skin-Lesions-Detection-Deep-learning

Transfer Learning with DCNNs (DenseNet, Inception V3, Inception-ResNet V2, VGG16) for skin lesions classification on HAM10000 dataset largescale data.
Jupyter Notebook
20
star
38

Ganpat-University-Data-Science

This is repository of Crash Course of data science at Ganpat University
Jupyter Notebook
20
star
39

NYSE-STOCK_MARKET-ANALYSIS-USING-LSTM

Stock market data can be interesting to analyze and as a further incentive, strong predictive models can have large financial payoff. The amount of financial data on the web is seemingly endless. A large and well structured dataset on a wide array of companies can be hard to come by. Here I provide a dataset with historical stock prices (last 5 years) for all companies currently found on the S&P 500 index.
Jupyter Notebook
19
star
40

Kubeflow-installation-on-windows-10

Kubeflow installation on windows 10/11
17
star
41

Nice-object-detection-Collection

Awesome Object Detection based on handong1587 github: https://handong1587.github.io/deep_learning/2015/10/09/object-detection.html
17
star
42

Computer-Vision-Papers-of-the-week

Computer Vision Papers of the week
16
star
43

PSO-TF2

PSO On neural Network and LSTM
Jupyter Notebook
14
star
44

Audio-Classification-Resources

Best Collection of Articles and code for Audio Classification
14
star
45

Tensorflow_object_detection_api_install_in_single_line

Tensorflow object detection api in single line
Jupyter Notebook
13
star
46

Advanced-Machine-Learning-and-Signal-Processing-IBM

Advanced Machine Learning and Signal Processing IBM
Jupyter Notebook
13
star
47

MLflow_End_to_End_Example

MLflow is Open source platform for the machine learning lifecycle so here you can learn MLflow End to End Example with Prediction.
Jupyter Notebook
13
star
48

regressionmetrics

Regression Metrics Calculation Made easy for tensorflow2 and scikit-learn
Python
12
star
49

Machine-Learning-140-Formula

Formula of Machine Learning
11
star
50

tpu_tf2

TPU use in single line in colab using tf2 package.
Jupyter Notebook
11
star
51

PyTorch_Lightning_Tutorials

Build and train Pytorch models and connect them to the ML lifecycle using Lightning App templates, without handling DIY infrastructure, cost management, scaling, and other headaches.
Jupyter Notebook
10
star
52

Facebook-AI-DEtection-TRansformer-DETR-Object-Detection

End-to-End Object Detection with Transformers
Jupyter Notebook
10
star
53

Audio-Masking-Methods

Audio Masking Methods
Python
10
star
54

LeetCode_Solution

LeetCode Solution
Jupyter Notebook
10
star
55

Rapidsai_Machine_learning_on_GPU

Rapidsai_Machine_learnring_on_GPU
Jupyter Notebook
9
star
56

tensorflow-installation-on-windows10-CUDA-and-cudnn

TensorFlow installation on windows10 CUDA and cudnn
Python
9
star
57

Applied-AI-with-Deep-learning-By-IBM-Coursera

Jupyter Notebook
9
star
58

Docker-For-Python-Machine-learning

Docker For Python Machine learning
9
star
59

pyMetaheuristic

A python library for the following Metaheuristics: Adaptive Random Search, Ant Lion Optimizer, Arithmetic Optimization Algorithm, Artificial Bee Colony Optimization, Artificial Fish Swarm Algorithm, Bat Algorithm, Biogeography Based Optimization, Cross-Entropy Method, Crow Search Algorithm, Cuckoo Search, Differential Evolution
Python
9
star
60

MLFlow-End-to-End-Workshop-at-Chandigarh-University

MLFlow End to End Workshop at Chandigarh University
HTML
8
star
61

Cuda-installation-on-WSL2-Ubuntu-20.04-and-Windows11

Cuda installation on WSL2 Ubuntu 20.04 and Windows11
8
star
62

SRCNN_SRGAN_ESRGAN_ON_BRAIN_MRI

SRCNN_SRGAN_ESRGAN_ON_BRAIN_MRI
Jupyter Notebook
8
star
63

G613-Double-Typing-issue-resolved

AutoHotkey
8
star
64

Easy-ML-and-DL

Easy ML and DL all repository of learning at one place
Jupyter Notebook
7
star
65

sklearn-ranking

Sklearn-ranking is ranking algorithm used for recommendation system algorithm. RANKSVM, RANKBOOST, RANKNET is included in this package
Python
7
star
66

The-Industrialization-of-NLP-to-Large-Language-Model-Engineering

From Research to Production: The Industrialization of NLP to Large Language Model Engineering
7
star
67

100-Days-of-Algorithms

100 days of algorithms
Jupyter Notebook
6
star
68

SRGAN_Keras_Tensorflow2

Easy way to run SRGAN Keras Tensorflow
Jupyter Notebook
6
star
69

OpenCV2_Learning

OpenCV2 Learning for computer vision
Jupyter Notebook
6
star
70

Audio-Feature-Extraction-Frameworks

This is collection of Feature Extraction for Audio. Please Create the pull request if you find more framework like this please add.
6
star
71

Ganpat-STTP-on-Data-Analytics-with-Python

Ganpat STTP on Data Analytics with Python
Jupyter Notebook
6
star
72

Kaggle-dataset-download-colab

How to download kaggle dataset for colab
Jupyter Notebook
6
star
73

IBM-Quantum-Machine-Learning-2021

Lab work of IBM Quantum Machine Learning 2021
Jupyter Notebook
6
star
74

DataAnalysisworkshop_Lady-Shri-Ram-College-For-Women-Department-of-Statistics

LADY SHRI RAM COLLEGE FOR WOMEN DEPARTMENT OF STATISTICS PRESENTED TWO DAY PYTHON FOR DATA ANALYSIS WORKSHOP Date 22-23 January, 2022
Jupyter Notebook
6
star
75

Image-Search-Engine

Image Search Engine with HuggingFace Sentence Transformer
Jupyter Notebook
5
star
76

GenerativeAI_with_PALM

GenerativeAI_with_PALM
Jupyter Notebook
5
star
77

Tensorflow-Keras-Custom-Data-Generator

Tensorflow2 Keras Custom Data Generator
Jupyter Notebook
5
star
78

Best-Pytorch-Beginner-Guide

Best Beginner tutorial for All who want to be a master of pytorch.
Jupyter Notebook
5
star
79

IBM-Quantum-Challenge-Africa-2021

IBM-Quantum-Challenge-Africa-2021
Jupyter Notebook
5
star
80

Streamlit_ML_DL

Streamlit_ML_DL
Jupyter Notebook
5
star
81

Semantic-Segmentation-Keras-Tensorflow-Example

Semantic Segmentation Example
Jupyter Notebook
5
star
82

Python-guide-for-Easy-to-complex-problem

Python Guide for Easy to Complex problem for Data Scientist
Jupyter Notebook
5
star
83

ashishpatelcv

My CV details
5
star
84

Ml-Lessons

Deep Learning for medical imaging
Jupyter Notebook
5
star
85

Pytorch-Learning

This Pytorch Learning Series Contains Basic to Advance tutorials with Simple Explaination
Jupyter Notebook
4
star
86

Chainlit_Tutorials

Chainlit_Tutorials
Python
4
star
87

Data-Cleaning-with-python

Data Cleaning is major part of Data Science Cycle. It will take 80% time.
Jupyter Notebook
4
star
88

Sampling-Method-with-Code

Sampling Method with Code
Jupyter Notebook
4
star
89

Self-Supervised-Learning

Self-Supervised-Learning with Lightly for Learning Purpose
Jupyter Notebook
4
star
90

Python-for-Data-Science-101

This is step by step guide to make u master in DataScience Code
Jupyter Notebook
4
star
91

Useful-deep-Learning-Resources

4
star
92

Pytorch-Foundation-Project-with-real-world-dataset

Pytorch Foundation Project with real world dataset
Jupyter Notebook
4
star
93

DataStructure_For_DataScientist

This Course Notes Practise Notebook Course Link : https://www.udemy.com/course/python-data-structures-a-to-z/
Jupyter Notebook
4
star
94

Baby-Steps-of-Keras-Deep-Learning

Jupyter Notebook
4
star
95

Shapelet-time-Series-Classification

Shapelet time Series Classification with tslearn
Jupyter Notebook
4
star
96

GRADCAM-Tensorflow2-Visual-Explainable-AI

Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localization
Python
4
star
97

Anomaly-or-Outlier-Detection

Anomaly or Outlier Detection Research Paper and Code
3
star
98

Predictive-Maintenance-for-Air-Quality

Air Quality Index Predict the weather is good or bad
Jupyter Notebook
3
star
99

Covid19-tweet-sentimental-Analysis

Covid19 tweet sentimental Analysis
Jupyter Notebook
3
star
100

NLP_in_TensorFlow

Jupyter Notebook
3
star