• Stars
    star
    176
  • Rank 209,872 (Top 5 %)
  • Language
    TypeScript
  • License
    Apache License 2.0
  • Created over 3 years ago
  • Updated about 2 months ago

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

Machine learning experiment tracking and data versioning with DVC extension for VS Code

banner

DVC Extension for Visual Studio Code

Version Installs Downloads Rating

Continuous Integration Maintainability Test Coverage

Quick start β€’ What you get β€’ Commands β€’ Configuration β€’ Debugging β€’ Contributing β€’ Telemetry

Run, compare, visualize, and track machine learning experiments right in VS Code. This extension uses DVC, an open-source data versioning and ML experiment management tool. No additional services or databases are required.

Extension Overview

  • Experiment tracking: Record training data, parameters, and metrics on top of Git. Navigate your experiments, compare their results, and find the best ML models.
  • Visualization: Plot performance data in a customizable dashboard including one or more overlaid experiments.
  • Live tracking: Capture and see metrics changing in real time.
  • Reproducibility: Make sure that anyone can recover or confirm previous experiments, and run new experiments based on their results.
  • Data Management: Handle and version large datasets, files, and models effectively right from VS Code.

Note: We always welcome feedback! Feel free to reach out via Discord or open issues in GitHub.

Why prefer this extension?

  • Enjoy the best developer experience with the first experiment tracking interface for an IDE.
  • No external servers, databases, subscriptions, etc. Data stays fully under your control and your existing Git hosting is used to share and collaborate.
  • Go beyond a simple metrics dashboard with complete ML experiments that include metrics, code, and data. Powered by DVC experiment versioning.
  • Implement data versioning on top of your favorite cloud storage, such as Amazon S3, Azure Blob Storage, Google Cloud Storage, NFS, etc.

Quick start

  1. Install this extension in VS Code.
  2. Follow the steps set out on the Setup page!

πŸ’‘ Feel free to try our example DVC project first! Opening it with Github Codespaces will include this extension automatically.

Learn more about DVC (Data Version Control)

See the DVC documentation to Get Started with Experiments or Data Management. For deeper learning, try our free course! More resources.

What you get

This extension augments VS Code in the following ways:

  • Adds a brand-new new DVC View (DVC logo icon in the Activity Bar) with panels to visualize and manage DVC Experiments.
  • Provides special Editors to manage Experiments and display Plots in IDE Tabs.
  • Adds a DVC Tracked panel to the Explorer view. This shows a tree of the data files and directories tracked by DVC, including their state, and options to synchronize them (from/to remote storage).
  • Adds a DVC panel to the Source Control view to display the workspace status. You can restore or reset project versions (based on the current Git HEAD commit) as well as manage new and existing data from here.
  • Registers several Commands in the Command Palette (see next section).
  • Includes a DVC channel for the Output panel (useful for debugging).

Useful commands

Open the Command Palette (F1 or β‡§βŒƒP on Windows/Linux or β‡§βŒ˜P on macOS) and type in one of the following commands:

Command Description
DVC: Show Setup Show the extension's setup page. Which can be used to setup the DVC project, view the walkthrough and more.
View: Show DVC Open the extension's view container.
DVC: Show Experiments Show an interactive version of DVC's exp show command.
DVC: Show Plots Show an interactive version of DVC's plots diff command.

Learn more about the extension's commands.

Configuration

These are the VS Code settings available for the Extension:

Option Description
dvc.dvcPath Path or shell command to the DVC binary. Required unless Microsoft's Python extension is installed and the dvc package found in its environment.
dvc.pythonPath Path to the desired Python interpreter to use with DVC. Should only be utilized when using a virtual environment without Microsoft's Python extension.
dvc.experimentsTableHeadMaxHeight Maximum height of experiment table head rows.
dvc.focusedProjects A subset of paths to the workspace's available DVC projects. Using this option will override project auto-discovery.
dvc.doNotInformMaxExperimentsPlotted Do not inform when plotting more experiments is blocked (maximum number selected).
dvc.doNotShowSetupAfterInstall Do not prompt to show the setup page after installing. Useful for pre-configured development environments.
dvc.doNotRecommendAddStudioToken Do not prompt to add a studio.token to the global DVC config, which enables automatic sharing of experiments to Studio.
dvc.doNotRecommendRedHatExtension Do not prompt to install the Red Hat YAML extension, which helps with DVC YAML schema validation (dvc.yaml and .dvc files).
dvc.doNotShowCliUnavailable Do not warn when the workspace contains a DVC project but the DVC binary is unavailable.

Note that the Setup The Workspace command helps you set up the basic ones at the Workspace level (saved to .vscode/setting.json).

Python

This extension is integrated with Microsoft's Python extension. When possible, the Python extension's selected interpreter will be used to locate DVC. The PYTHONPATH environment variable identified via the python.envFile config setting is also respected.

Studio

Studio is a collaboration platform for Machine Learning teams. The extension will help you to connect to Studio by providing guidance and managing the required DVC config options. See the Studio section of the Setup page for more information.

Debugging

The DVC Extension

Please see the DVC channel in the IDE's Output panel to see the underlying DVC commands being run, as well as their error output. Feel free to share this with us via Discord or use it to report issues in GitHub.

Your DVC project

Due to the way DVC pipelines run scripts of any language from the command line, users must debug pipeline scripts (e.g. train.py) standalone in whatever way debuggers are run on the base language - this is standard for debugging DVC pipelines, and most scripts are capable of running outside of DVC.

Contributing

See the development and contributing guidelines in CONTRIBUTING.md.

GitHub Contributors Image

Data and telemetry

The DVC Extension for Visual Studio Code collects usage data and sends it to Azure to help improve our products and services. This extension respects the telemetry.enableTelemetry setting which you can learn more about at https://code.visualstudio.com/docs/supporting/faq#_how-to-disable-telemetry-reporting.

More Repositories

1

dvc

πŸ¦‰ ML Experiments and Data Management with Git
Python
13,036
star
2

cml

♾️ CML - Continuous Machine Learning | CI/CD for ML
JavaScript
3,907
star
3

mlem

🐢 A tool to package, serve, and deploy any ML model on any platform. Archived to be resurrected one day🀞
Python
713
star
4

PyDrive2

Google Drive API Python wrapper library. Maintained fork of PyDrive.
Python
516
star
5

shtab

↔️ Automagic shell tab completion for Python CLI applications
Python
328
star
6

dvc.org

πŸ“– DVC website and documentation
TypeScript
320
star
7

terraform-provider-iterative

☁️ Terraform plugin for machine learning workloads: spot instance recovery & auto-termination | AWS, GCP, Azure, Kubernetes
Go
287
star
8

example-get-started

Get started DVC project
Python
167
star
9

dvclive

πŸ“ˆ Log and track ML metrics, parameters, models with Git and/or DVC
Python
150
star
10

gto

🏷️ Git Tag Ops. Turn your Git repository into Artifact Registry or Model Registry.
Python
134
star
11

awesome-iterative-projects

A list of projects relying on Iterative.AI tools to achieve awesomeness
63
star
12

dataset-registry

Dataset registry DVC project
60
star
13

magnetic-tiles-defect

Demo Computer Vision Project
Jupyter Notebook
55
star
14

course-ds-base

Jupyter Notebook
39
star
15

example-get-started-experiments

Get started DVC project
Python
39
star
16

demo-bank-customer-churn

Demo DVC project training a classification model on tabular data
Jupyter Notebook
38
star
17

aita_dataset

AITA dataset based on r/AmItheAsshole/
Python
32
star
18

setup-dvc

DVC GitHub action
JavaScript
29
star
19

example_cml

Python
28
star
20

workshop-uncool-mlops

Accompanies the uncool MLOps workshop
Python
26
star
21

ldb-resources

Python
26
star
22

mlem.ai

✨ Landing page for MLEM
TypeScript
26
star
23

setup-cml

GitHub Action for CML setup
TypeScript
21
star
24

cml_base_case

Python
21
star
25

example-repos-dev

Source code and generator scripts for example DVC projects
Python
21
star
26

cml_cloud_case

Python
20
star
27

dvc-bench

Benchmarks for DVC
Python
20
star
28

scmrepo

SCM wrapper and fsspec filesystem for Git for use in DVC.
Python
19
star
29

cml_dvc_case

Python
18
star
30

intellij-dvc

DVC integration plugin for Intellij IDEs including PyCharm, IntelliJ IDEA and CLion
Java
17
star
31

dvc-data

DVC's data management subsystem
Python
17
star
32

studio-support

❓ DVC Studio Issues, Question, and Discussions
15
star
33

studio-selfhosted

This repository contains auxiliary installation code for self-hosting Studio
Shell
15
star
34

VSCode-DVC-Workshop

Workshop about DVC VSCode Extension
Jupyter Notebook
14
star
35

example-dvc-experiments

DVC Get Started Project with a focus on `dvc experiment` features.
HTML
13
star
36

pytest-servers

Create temporary directories on the various filesystems for testing
Python
12
star
37

py-template

Hypermodern Python Cookiecutter
Python
12
star
38

cml.dev

πŸ”— CML website and documentation
TypeScript
12
star
39

dvc-objects

dvc objects - contains filesystem and object-db level abstractions to use in dvc and dvc-data
Python
10
star
40

dvcyaml-schema

Schema for dvc.yaml
Python
10
star
41

example-versioning

Data sets and ML models versioning example from DVC get started
Python
9
star
42

dvc-streamlit-components

Streamlit components for DVC
Python
9
star
43

blog

πŸ“– DVC blog engine
TypeScript
8
star
44

cml_tensorboard_case

Python
8
star
45

priority-list

⛏️ Make a dent in GitHub issue & PR backlogs across repositories
Python
7
star
46

dvc-task

Celery task queue used in DVC
Python
7
star
47

tpi

Python wrapper for terraform-provider-iterative
Python
7
star
48

example-gto

Get Started GTO Project
7
star
49

example-pokemon-classifier

Example project with a CNN to train a PokΓ©mon type classifier.
Python
7
star
50

dvc-render

Library for rendering DVC plots
Python
6
star
51

example-mlem-get-started

Get Started MLEM project
Python
6
star
52

dvc-studio-client

Client to interact with DVC Studio
Python
6
star
53

workshop-uncool-mlops-solution

Python
6
star
54

pytest-test-utils

Python
6
star
55

features

A collection of development container 'features' for machine learning and data science
Shell
6
star
56

dvc-s3

AWS S3 plugin for dvc
Python
6
star
57

gatsby-theme-iterative

A Gatsby theme for shared logic between all the websites from iterative.ai
JavaScript
6
star
58

stale-model-example

This is the repo for the Preventing Stale Models in Production blog post.
Jupyter Notebook
6
star
59

gto-action

βš™οΈ GTO Github Action
Shell
6
star
60

morefs

A collection of self-contained fsspec-based filesystems
Python
6
star
61

llm-demo

Demo of using DVC with LangChain
Python
6
star
62

course-checkpoints-project

This is the project we use for the DVC educational course to demonstrate how checkpoints work.
HTML
6
star
63

dvc-checkpoints-mnist

Example of checkpoints in a DVC project training a simple convolutional neural net to classify MNIST data
Python
5
star
64

dvc-s3-repo

Maintain deb and rpm repositories on s3
Python
5
star
65

enhancement-proposals

5
star
66

evidently-dvc

Tutorial: Automate Data Validation and Model Monitoring Pipelines with DVC and Evidently
HTML
5
star
67

dvc-gs

Google Storage plugin for dvc
Python
4
star
68

link-check

A Node-based tool to verify if links are alive. Built to be used anywhere!
TypeScript
4
star
69

dvc-snap

dvc snap package
Shell
4
star
70

cml-runner-base-case

Python
4
star
71

pretrained-model-demo

Python
4
star
72

homebrew-dvc

Automatic updates for dvc homebrew package
Shell
4
star
73

sqltrie

SQL-based prefix tree implementation inspired by pygtrie and python-diskcache
Python
3
star
74

vscode-dvc-demo

Python
3
star
75

example_model_export_cml

Example on how to use CML to provision an AWS EC2 runner, train a model, and export the resulting model.
Python
3
star
76

cnn_tutorial

CNN tutorial for DVC
Python
3
star
77

cml-playground

Shell
3
star
78

dvc-learn-project

This is the project used in the DVC Learn Meetups and videos.
HTML
3
star
79

telemetry-python

Common library to send usage telemetry
Python
3
star
80

checkpoints-tutorial

This is the code used in the checkpoints tutorial.
Python
3
star
81

ldb

Python
3
star
82

chocolatey-dvc

Chocolatey package for dvc
PowerShell
3
star
83

blog-tpi-jupyter

Terraform Provider Iterative + Jupyter + TensorBoard + AWS/Azure/GCP/K8s
Jupyter Notebook
3
star
84

example-get-started-ssh-private-fixture

Frozen copy of the Get Started DVC project. Used in Studio tests to test SSH remote credentials.
Python
2
star
85

link-check.action

A GitHub Action driver for link-check, deployed via submodules.
JavaScript
2
star
86

dvc-gdrive

Google Drive plugin for DVC
Python
2
star
87

example-get-started-s3

Example get started (metrics and plots in S3)
Python
2
star
88

example-mlem

Example of using MLEM with DVC Pipeline
Python
2
star
89

katacoda-scenarios

Interactive Katacoda Scenarios
Shell
2
star
90

dvc-exe

Private repository for building and signing dvc for windows
Inno Setup
2
star
91

dvc-azure

Azure plugin for dvc
Python
2
star
92

dvc_action_example

Python
2
star
93

dvc-oss

Alibaba OSS plugin for dvc
Python
2
star
94

sagemaker-pipeline

An example project, showcasing a DVC pipeline using SageMaker SDK for data preparation and model training
Python
2
star
95

dvc-test

Integration tests for dvc
Python
2
star
96

vscode-dvc-pack

2
star
97

get-started-pipelines

DVC Get Started project with a focus on creating pipelines with `dvc stage`
Python
2
star
98

cookiecutter-dvc-plugin

A Cookiecutter template for dvc plugins
Python
2
star
99

testing-ldb

Aug 10th Hackathon
Python
2
star
100

gha-required-workflows

Repository containing Iterative Required workflows for GitHub Actions
1
star