Machine Learning Engineering for Production (MLOps) Specialization on Coursera (offered by deeplearning.ai)

Programming assignments from all courses in the Coursera Machine Learning Engineering for Production (MLOps) Specialization offered by deeplearning.ai.

Courses

The GAN Specialization on Coursera contains three courses:

1. Course 1: Introduction to Machine Learning in Production

2. Course 2: Machine Learning Data Lifecycle in Production

3. Course 3: Machine Learning Modeling Pipelines in Production

4. Course 4: Deploying Machine Learning Models in Production

Why this Specialization?

• Become a Machine Learning expert. Productionize your machine learning knowledge and expand your production engineering capabilities.

• Skills: Managing Machine Learning Production Systems, Deployment Pipelines, Model Pipelines, Data Pipelines, Machine Learning Engineering for Production, Human-level Performance (HLP), Concept Drift, Model Baseline, Project Scoping and Design, ML Deployment Challenges, ML Metadata, Convolutional Neural Network

• Level: Advanced

  • Some knowledge of AI / deep learning
  • Intermediate skills in Python
  • Experience with any deep learning framework (PyTorch, Keras, or TensorFlow)

About this Specialization

• Understanding machine learning and deep learning concepts is essential, but if you’re looking to build an effective AI career, you need production engineering capabilities as well.

• Effectively deploying machine learning models requires competencies more commonly found in technical fields such as software engineering and DevOps. Machine learning engineering for production combines the foundational concepts of machine learning with the functional expertise of modern software development and engineering roles.

• The Machine Learning Engineering for Production (MLOps) Specialization covers how to conceptualize, build, and maintain integrated systems that continuously operate in production. In striking contrast with standard machine learning modeling, production systems need to handle relentless evolving data. Moreover, the production system must run non-stop at the minimum cost while producing the maximum performance. In this Specialization, you will learn how to use well-established tools and methodologies for doing all of this effectively and efficiently.

• In this Specialization, you will become familiar with the capabilities, challenges, and consequences of machine learning engineering in production. By the end, you will be ready to employ your new production-ready skills to participate in the development of leading-edge AI technology to solve real-world problems.

Applied Learning Project

By the end, you'll be ready to:

• Design an ML production system end-to-end: project scoping, data needs, modeling strategies, and deployment requirements
• Establish a model baseline, address concept drift, and prototype how to develop, deploy, and continuously improve a productionized ML application
• Build data pipelines by gathering, cleaning, and validating datasets
• Implement feature engineering, transformation, and selection with TensorFlow Extended
• Establish data lifecycle by leveraging data lineage and provenance metadata tools and follow data evolution with enterprise data schemas
• Apply techniques to manage modeling resources and best serve offline/online inference requests
• Use analytics to address model fairness, explainability issues, and mitigate bottlenecks
• Deliver deployment pipelines for model serving that require different infrastructures
• Apply best practices and progressive delivery techniques to maintain a continuously operating production system

Programming Assignments

Course 1: Introduction to Machine Learning in Production

Week 1

• Ungraded Quiz:
  • The Machine Learning Project Lifecycle
• Graded Quiz:
  • Deployment

Week 2

• Graded Quizzes:
  • Selecting and Training a Model
  • Modeling challenges
• Lab:
  • A journey through Data

Week 3

• Graded Quiz:
  • Data Definition and Baseline
• Lab:
  • Data Labeling, PDF

Course 2: Machine Learning Data Lifecycle in Production

Week 1

• Lab:
  • TFDV Exercise, PDF
• Assignment:
  • Data Validation, PDF

Week 2

• Labs:
  • Simple Feature Engineering, PDF
  • Feature Engineering Pipeline, PDF
  • Feature Selection, PDF
• Assignment:
  • Feature Engineering

Week 3

• Labs:
  • ML Metadata, PDF
  • Iterative Schema, PDF
• Assignment:
  • Data Pipeline Components for Production ML

Week 4

• Labs:
  • Feature Engineering with Weather Data
  • Feature Engineering with Accelerometer Data, PDF
  • Feature Engineering with Images, PDF

Course 3: Machine Learning Modeling Pipelines in Production

Week 1

• Graded Quiz:
  • Hyperparameter Tuning and Neural Architecture Search
  • AutoML
• Ungraded Labs:
  • Intro to Keras Tuner
  • Hyperparameter tuning and model training with TFX

Week 2

• Graded Quiz
  • Dimensionality Reduction
  • Quantization and Purning
• Ungraded Labs
  • Manual Dimensionality
  • Algorithmic_Dimensionality
  • Quantization and Pruning

Week 3

• Labs
  • Distributed Strategies with TF and Keras
  • Knowledge Distillation
• Quiz
  • High-Performance Modeling
  • Knowledge Distillation

Week 4

• Labs
  • TensorFlow Model Analysis
  • Model Analysis with TFX Evaluator
  • Fairness Indicators
• Quiz
  • Model Analysis
  • Model Analysis and Debugging
  • Continuous Evaluation and Monitoring

Week 5

• Labs

  • Shapley Values
  • Permutation Feature Importance

• Quiz

  • Explainable AI
  • Interpretability
  • Understanding Model Predictions

Course 4: Welcome to Deploying Machine Learning Models in Production

Week 1

• Labs -Intro to Docker and installation -First look at Tensorflow Serving with Docker -Serve a model with TensorFlow Serving
• Quiz -Introduction to Model Serving -Introduction to Model Serving Infrastructure -TensorFlow Serving

Week 2

• Graded Quizes
  • Model serving architecture
  • Scaling Infrastructure
  • Online Inference
  • Data Preprocessing
  • Batch inference scenarios
  • Batch Processing with ETL
• Ungraded: Lab tasks
  • FastAPI Docker
  • Intro to Kubernetes
  • Latency Test Compose
  • ETL Beam

Week 3

• Ungraded: Lab tasks
  • Intro to KFP
  • TFX Custom Components
  • TFS Model Versioning
  • Github Actions
• Graded Quizes
  • ML Experiments Management and Workflow Automation
  • MLOps Methodology.
  • Model Management and Deployment Infrastructure

Week 4

• Graded Quiz
  • Model Monitoring and Logging
  • Model Decay
  • GDPR and Privacy

Disclaimer

I recognize the hard time people spend on building intuition, understanding new concepts and debugging assignments. The solutions uploaded here are only for reference. They are meant to unblock you if you get stuck somewhere. Please do not copy any part of the code as-is (the programming assignments are fairly easy if you read the instructions carefully). Similarly, try out the quizzes yourself before you refer to the quiz solutions.