• Stars
    star
    26,413
  • Rank 711 (Top 0.02 %)
  • Language
    Jupyter Notebook
  • License
    MIT License
  • Created about 3 years ago
  • Updated 29 days ago

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

10 Weeks, 20 Lessons, Data Science for All!

Data Science for Beginners - A Curriculum

Open in GitHub Codespaces

GitHub license GitHub contributors GitHub issues GitHub pull-requests PRs Welcome

GitHub watchers GitHub forks GitHub stars

Azure Cloud Advocates at Microsoft are pleased to offer a 10-week, 20-lesson curriculum all about Data Science. Each lesson includes pre-lesson and post-lesson quizzes, written instructions to complete the lesson, a solution, and an assignment. Our project-based pedagogy allows you to learn while building, a proven way for new skills to 'stick'.

Hearty thanks to our authors: Jasmine Greenaway, Dmitry Soshnikov, Nitya Narasimhan, Jalen McGee, Jen Looper, Maud Levy, Tiffany Souterre, Christopher Harrison.

๐Ÿ™ Special thanks ๐Ÿ™ to our Microsoft Student Ambassador authors, reviewers and content contributors, notably Aaryan Arora, Aditya Garg, Alondra Sanchez, Ankita Singh, Anupam Mishra, Arpita Das, ChhailBihari Dubey, Dibri Nsofor, Dishita Bhasin, Majd Safi, Max Blum, Miguel Correa, Mohamma Iftekher (Iftu) Ebne Jalal, Nawrin Tabassum, Raymond Wangsa Putra, Rohit Yadav, Samridhi Sharma, Sanya Sinha, Sheena Narula, Tauqeer Ahmad, Yogendrasingh Pawar , Vidushi Gupta, Jasleen Sondhi

 Sketchnote by (@sketchthedocs)
Data Science For Beginners - Sketchnote by @nitya

Are you a student?

Get started with the following resources:

  • Student Hub page In this page, you will find beginner resources, Student packs and even ways to get a free cert voucher. This is one page you want to bookmark and check from time to time as we switch out content at least monthly.
  • Microsoft Learn Student Ambassadors Join a global community of student ambassadors, this could be your way into Microsoft

Getting Started

Teachers: we have included some suggestions on how to use this curriculum. We'd love your feedback in our discussion forum!

Students: to use this curriculum on your own, fork the entire repo and complete the exercises on your own, starting with a pre-lecture quiz. Then read the lecture and complete the rest of the activities. Try to create the projects by comprehending the lessons rather than copying the solution code; however, that code is available in the /solutions folders in each project-oriented lesson. Another idea would be to form a study group with friends and go through the content together. For further study, we recommend Microsoft Learn.

Meet the Team

Promo video

Gif by Mohit Jaisal

๐ŸŽฅ Click the image above for a video about the project the folks who created it!

Pedagogy

We have chosen two pedagogical tenets while building this curriculum: ensuring that it is project-based and that it includes frequent quizzes. By the end of this series, students will have learned basic principles of data science, including ethical concepts, data preparation, different ways of working with data, data visualization, data analysis, real-world use cases of data science, and more.

In addition, a low-stakes quiz before a class sets the intention of the student towards learning a topic, while a second quiz after class ensures further retention. This curriculum was designed to be flexible and fun and can be taken in whole or in part. The projects start small and become increasingly complex by the end of the 10 week cycle.

Find our Code of Conduct, Contributing, Translation guidelines. We welcome your constructive feedback!

Each lesson includes:

  • Optional sketchnote
  • Optional supplemental video
  • Pre-lesson warmup quiz
  • Written lesson
  • For project-based lessons, step-by-step guides on how to build the project
  • Knowledge checks
  • A challenge
  • Supplemental reading
  • Assignment
  • Post-lesson quiz

A note about quizzes: All quizzes are contained in this app, for 40 total quizzes of three questions each. They are linked from within the lessons, but the quiz app can be run locally; follow the instruction in the quiz-app folder. They are gradually being localized.

Lessons

 Sketchnote by (@sketchthedocs)
Data Science For Beginners: Roadmap - Sketchnote by @nitya
Lesson Number Topic Lesson Grouping Learning Objectives Linked Lesson Author
01 Defining Data Science Introduction Learn the basic concepts behind data science and how itโ€™s related to artificial intelligence, machine learning, and big data. lesson video Dmitry
02 Data Science Ethics Introduction Data Ethics Concepts, Challenges & Frameworks. lesson Nitya
03 Defining Data Introduction How data is classified and its common sources. lesson Jasmine
04 Introduction to Statistics & Probability Introduction The mathematical techniques of probability and statistics to understand data. lesson video Dmitry
05 Working with Relational Data Working With Data Introduction to relational data and the basics of exploring and analyzing relational data with the Structured Query Language, also known as SQL (pronounced โ€œsee-quellโ€). lesson Christopher
06 Working with NoSQL Data Working With Data Introduction to non-relational data, its various types and the basics of exploring and analyzing document databases. lesson Jasmine
07 Working with Python Working With Data Basics of using Python for data exploration with libraries such as Pandas. Foundational understanding of Python programming is recommended. lesson video Dmitry
08 Data Preparation Working With Data Topics on data techniques for cleaning and transforming the data to handle challenges of missing, inaccurate, or incomplete data. lesson Jasmine
09 Visualizing Quantities Data Visualization Learn how to use Matplotlib to visualize bird data ๐Ÿฆ† lesson Jen
10 Visualizing Distributions of Data Data Visualization Visualizing observations and trends within an interval. lesson Jen
11 Visualizing Proportions Data Visualization Visualizing discrete and grouped percentages. lesson Jen
12 Visualizing Relationships Data Visualization Visualizing connections and correlations between sets of data and their variables. lesson Jen
13 Meaningful Visualizations Data Visualization Techniques and guidance for making your visualizations valuable for effective problem solving and insights. lesson Jen
14 Introduction to the Data Science lifecycle Lifecycle Introduction to the data science lifecycle and its first step of acquiring and extracting data. lesson Jasmine
15 Analyzing Lifecycle This phase of the data science lifecycle focuses on techniques to analyze data. lesson Jasmine
16 Communication Lifecycle This phase of the data science lifecycle focuses on presenting the insights from the data in a way that makes it easier for decision makers to understand. lesson Jalen
17 Data Science in the Cloud Cloud Data This series of lessons introduces data science in the cloud and its benefits. lesson Tiffany and Maud
18 Data Science in the Cloud Cloud Data Training models using Low Code tools. lesson Tiffany and Maud
19 Data Science in the Cloud Cloud Data Deploying models with Azure Machine Learning Studio. lesson Tiffany and Maud
20 Data Science in the Wild In the Wild Data science driven projects in the real world. lesson Nitya

GitHub Codespaces

Follow these steps to open this sample in a Codespace:

  1. Click the Code drop-down menu and select the Open with Codespaces option.
  2. Select + New codespace at the bottom on the pane. For more info, check out the GitHub documentation.

VSCode Remote - Containers

Follow these steps to open this repo in a container using your local machine and VSCode using the VS Code Remote - Containers extension:

  1. If this is your first time using a development container, please ensure your system meets the pre-reqs (i.e. have Docker installed) in the getting started documentation.

To use this repository, you can either open the repository in an isolated Docker volume:

Note: Under the hood, this will use the Remote-Containers: Clone Repository in Container Volume... command to clone the source code in a Docker volume instead of the local filesystem. Volumes are the preferred mechanism for persisting container data.

Or open a locally cloned or downloaded version of the repository:

  • Clone this repository to your local filesystem.
  • Press F1 and select the Remote-Containers: Open Folder in Container... command.
  • Select the cloned copy of this folder, wait for the container to start, and try things out.

Offline access

You can run this documentation offline by using Docsify. Fork this repo, install Docsify on your local machine, then in the root folder of this repo, type docsify serve. The website will be served on port 3000 on your localhost: localhost:3000.

Note, notebooks will not be rendered via Docsify, so when you need to run a notebook, do that separately in VS Code running a Python kernel.

Help Wanted!

If you would like to translate all or part of the curriculum, please follow our Translations guide

Other Curricula

Our team produces other curricula! Check out:

More Repositories

1

vscode

Visual Studio Code
TypeScript
157,226
star
2

PowerToys

Windows system utilities to maximize productivity
C#
104,001
star
3

TypeScript

TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
TypeScript
96,979
star
4

terminal

The new Windows Terminal and the original Windows console host, all in the same place!
C++
93,068
star
5

Web-Dev-For-Beginners

24 Lessons, 12 Weeks, Get Started as a Web Developer
JavaScript
81,438
star
6

ML-For-Beginners

12 weeks, 26 lessons, 52 quizzes, classic Machine Learning for all
HTML
66,844
star
7

playwright

Playwright is a framework for Web Testing and Automation. It allows testing Chromium, Firefox and WebKit with a single API.
TypeScript
61,636
star
8

generative-ai-for-beginners

18 Lessons, Get Started Building with Generative AI ๐Ÿ”— https://microsoft.github.io/generative-ai-for-beginners/
Jupyter Notebook
42,344
star
9

monaco-editor

A browser based code editor
JavaScript
35,437
star
10

AI-For-Beginners

12 Weeks, 24 Lessons, AI for All!
Jupyter Notebook
31,046
star
11

calculator

Windows Calculator: A simple yet powerful calculator that ships with Windows
C++
27,371
star
12

DeepSpeed

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
Python
26,923
star
13

autogen

A programming framework for agentic AI. Discord: https://aka.ms/autogen-dc. Roadmap: https://aka.ms/autogen-roadmap
Jupyter Notebook
25,056
star
14

cascadia-code

This is a fun, new monospaced font that includes programming ligatures and is designed to enhance the modern look and feel of the Windows Terminal.
Python
24,118
star
15

JARVIS

JARVIS, a system to connect LLMs with ML community. Paper: https://arxiv.org/pdf/2303.17580.pdf
Python
22,801
star
16

api-guidelines

Microsoft REST API Guidelines
22,345
star
17

winget-cli

WinGet is the Windows Package Manager. This project includes a CLI (Command Line Interface), PowerShell modules, and a COM (Component Object Model) API (Application Programming Interface).
C++
20,495
star
18

vcpkg

C++ Library Manager for Windows, Linux, and MacOS
CMake
19,600
star
19

semantic-kernel

Integrate cutting-edge LLM technology quickly and easily into your apps
C#
17,792
star
20

fluentui

Fluent UI web represents a collection of utilities, React components, and web components for building web applications.
TypeScript
17,674
star
21

CNTK

Microsoft Cognitive Toolkit (CNTK), an open source deep-learning toolkit
C++
17,412
star
22

MS-DOS

The original sources of MS-DOS 1.25 and 2.0, for reference purposes
Assembly
17,220
star
23

unilm

Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities
Python
17,032
star
24

WSL

Issues found on WSL
PowerShell
16,562
star
25

recommenders

Best Practices on Recommendation Systems
Python
16,075
star
26

react-native-windows

A framework for building native Windows apps with React.
C++
15,939
star
27

LightGBM

A fast, distributed, high performance gradient boosting (GBT, GBDT, GBRT, GBM or MART) framework based on decision tree algorithms, used for ranking, classification and many other machine learning tasks.
C++
15,890
star
28

AirSim

Open source simulator for autonomous vehicles built on Unreal Engine / Unity, from Microsoft AI & Research
C++
15,836
star
29

IoT-For-Beginners

12 Weeks, 24 Lessons, IoT for All!
C++
14,693
star
30

Bringing-Old-Photos-Back-to-Life

Bringing Old Photo Back to Life (CVPR 2020 oral)
Python
14,132
star
31

qlib

Qlib is an AI-oriented quantitative investment platform that aims to realize the potential, empower research, and create value using AI technologies in quantitative investment, from exploring ideas to implementing productions. Qlib supports diverse machine learning modeling paradigms. including supervised learning, market dynamics modeling, and RL.
Python
14,124
star
32

dotnet

This repo is the official home of .NET on GitHub. It's a great starting point to find many .NET OSS projects from Microsoft and the community, including many that are part of the .NET Foundation.
HTML
14,026
star
33

nni

An open source AutoML toolkit for automate machine learning lifecycle, including feature engineering, neural architecture search, model compression and hyper-parameter tuning.
Python
13,084
star
34

ai-edu

AI education materials for Chinese students, teachers and IT professionals.
HTML
13,046
star
35

pyright

Static Type Checker for Python
Python
11,969
star
36

guidance

A guidance language for controlling large language models.
Jupyter Notebook
11,777
star
37

TypeScript-Node-Starter

A reference example for TypeScript and Node with a detailed README describing how to use the two together.
SCSS
11,258
star
38

Swin-Transformer

This is an official implementation for "Swin Transformer: Hierarchical Vision Transformer using Shifted Windows".
Python
11,187
star
39

TypeScript-React-Starter

A starter template for TypeScript and React with a detailed README describing how to use the two together.
TypeScript
11,081
star
40

frontend-bootcamp

Frontend Workshop from HTML/CSS/JS to TypeScript/React/Redux
TypeScript
10,797
star
41

language-server-protocol

Defines a common protocol for language servers.
HTML
10,093
star
42

onnxruntime

ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator
C++
9,837
star
43

windows-rs

Rust for Windows
Rust
9,820
star
44

wslg

Enabling the Windows Subsystem for Linux to include support for Wayland and X server related scenarios
C++
9,626
star
45

sql-server-samples

Azure Data SQL Samples - Official Microsoft GitHub Repository containing code samples for SQL Server, Azure SQL, Azure Synapse, and Azure SQL Edge
9,434
star
46

computervision-recipes

Best Practices, code samples, and documentation for Computer Vision.
Jupyter Notebook
9,264
star
47

napajs

Napa.js: a multi-threaded JavaScript runtime
C++
9,256
star
48

Windows-universal-samples

API samples for the Universal Windows Platform.
JavaScript
9,253
star
49

mimalloc

mimalloc is a compact general purpose allocator with excellent performance.
C
9,165
star
50

vscode-tips-and-tricks

Collection of helpful tips and tricks for VS Code.
9,038
star
51

fast

The adaptive interface system for modern web experiences.
TypeScript
9,006
star
52

playwright-python

Python version of the Playwright testing and automation library.
Python
8,990
star
53

STL

MSVC's implementation of the C++ Standard Library.
C++
8,978
star
54

LoRA

Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"
Python
8,785
star
55

fluentui-emoji

A collection of familiar, friendly, and modern emoji from Microsoft
Python
8,678
star
56

react-native-code-push

React Native module for CodePush
C
8,643
star
57

reactxp

Library for cross-platform app development.
TypeScript
8,298
star
58

vscode-extension-samples

Sample code illustrating the VS Code extension API.
TypeScript
8,063
star
59

inshellisense

IDE style command line auto complete
TypeScript
8,034
star
60

reverse-proxy

A toolkit for developing high-performance HTTP reverse proxy applications.
C#
7,702
star
61

c9-python-getting-started

Sample code for Channel 9 Python for Beginners course
Jupyter Notebook
7,642
star
62

ailab

Experience, Learn and Code the latest breakthrough innovations with Microsoft AI
C#
7,623
star
63

cpprestsdk

The C++ REST SDK is a Microsoft project for cloud-based client-server communication in native code using a modern asynchronous C++ API design. This project aims to help C++ developers connect to and interact with services.
C++
7,573
star
64

WSL2-Linux-Kernel

The source for the Linux kernel used in Windows Subsystem for Linux 2 (WSL2)
C
7,527
star
65

botframework-sdk

Bot Framework provides the most comprehensive experience for building conversation applications.
JavaScript
7,334
star
66

azuredatastudio

Azure Data Studio is a data management and development tool with connectivity to popular cloud and on-premises databases. Azure Data Studio supports Windows, macOS, and Linux, with immediate capability to connect to Azure SQL and SQL Server. Browse the extension library for more database support options including MySQL, PostreSQL, and MongoDB.
TypeScript
7,182
star
67

winget-pkgs

The Microsoft community Windows Package Manager manifest repository
6,981
star
68

Windows-driver-samples

This repo contains driver samples prepared for use with Microsoft Visual Studio and the Windows Driver Kit (WDK). It contains both Universal Windows Driver and desktop-only driver samples.
C
6,603
star
69

winfile

Original Windows File Manager (winfile) with enhancements
C
6,437
star
70

nlp-recipes

Natural Language Processing Best Practices & Examples
Python
6,320
star
71

WinObjC

Objective-C for Windows
C
6,229
star
72

SandDance

Visually explore, understand, and present your data.
TypeScript
6,091
star
73

MixedRealityToolkit-Unity

This repository is for the legacy Mixed Reality Toolkit (MRTK) v2. For the latest version of the MRTK please visit https://github.com/MixedRealityToolkit/MixedRealityToolkit-Unity
C#
5,943
star
74

vscode-go

An extension for VS Code which provides support for the Go language. We have moved to https://github.com/golang/vscode-go
TypeScript
5,931
star
75

VFSForGit

Virtual File System for Git: Enable Git at Enterprise Scale
C#
5,918
star
76

microsoft-ui-xaml

Windows UI Library: the latest Windows 10 native controls and Fluent styles for your applications
5,861
star
77

GSL

Guidelines Support Library
C++
5,850
star
78

vscode-recipes

JavaScript
5,802
star
79

MMdnn

MMdnn is a set of tools to help users inter-operate among different deep learning frameworks. E.g. model conversion and visualization. Convert models between Caffe, Keras, MXNet, Tensorflow, CNTK, PyTorch Onnx and CoreML.
Python
5,780
star
80

ethr

Ethr is a Comprehensive Network Measurement Tool for TCP, UDP & ICMP.
Go
5,642
star
81

FASTER

Fast persistent recoverable log and key-value store + cache, in C# and C++.
C#
5,630
star
82

rushstack

Monorepo for tools developed by the Rush Stack community
TypeScript
5,576
star
83

fluentui-system-icons

Fluent System Icons are a collection of familiar, friendly and modern icons from Microsoft.
HTML
5,445
star
84

vscode-docs

Public documentation for Visual Studio Code
Markdown
5,443
star
85

DirectX-Graphics-Samples

This repo contains the DirectX Graphics samples that demonstrate how to build graphics intensive applications on Windows.
C++
5,440
star
86

vscode-cpptools

Official repository for the Microsoft C/C++ extension for VS Code.
TypeScript
5,339
star
87

BosqueLanguage

The Bosque programming language is an experiment in regularized design for a machine assisted rapid and reliable software development lifecycle.
TypeScript
5,282
star
88

DeepSpeedExamples

Example models using DeepSpeed
Python
5,092
star
89

promptbase

All things prompt engineering
Python
5,012
star
90

TypeScript-Handbook

Deprecated, please use the TypeScript-Website repo instead
JavaScript
4,881
star
91

Windows-classic-samples

This repo contains samples that demonstrate the API used in Windows classic desktop applications.
4,824
star
92

Detours

Detours is a software package for monitoring and instrumenting API calls on Windows. It is distributed in source code form.
C++
4,811
star
93

tsyringe

Lightweight dependency injection container for JavaScript/TypeScript
TypeScript
4,700
star
94

TaskWeaver

A code-first agent framework for seamlessly planning and executing data analytics tasks.
Python
4,679
star
95

vscode-dev-containers

NOTE: Most of the contents of this repository have been migrated to the new devcontainers GitHub org (https://github.com/devcontainers). See https://github.com/devcontainers/template-starter and https://github.com/devcontainers/feature-starter for information on creating your own!
Shell
4,665
star
96

tsdoc

A doc comment standard for TypeScript
TypeScript
4,617
star
97

FluidFramework

Library for building distributed, real-time collaborative web applications
TypeScript
4,611
star
98

SPTAG

A distributed approximate nearest neighborhood search (ANN) library which provides a high quality vector index build, search and distributed online serving toolkits for large scale vector search scenario.
C++
4,603
star
99

WPF-Samples

Repository for WPF related samples
C#
4,545
star
100

TypeScript-Vue-Starter

A starter template for TypeScript and Vue with a detailed README describing how to use the two together.
JavaScript
4,458
star