• Stars
    star
    474
  • Rank 92,640 (Top 2 %)
  • Language
    Python
  • License
    MIT License
  • Created almost 4 years ago
  • Updated over 2 years ago

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

Cockpit: A Practical Debugging Tool for Training Deep Neural Networks

Logo

A Practical Debugging Tool for Training Deep Neural Networks

A better status screen for deep learning.

Installation • Docs • Experiments • License • Citation

CI Lint Doc Coverage License: MIT Code style: black arXiv


pip install cockpit-for-pytorch

Cockpit is a visual and statistical debugger specifically designed for deep learning. Training a deep neural network is often a pain! Successfully training such a network usually requires either years of intuition or expensive parameter searches involving lots of trial and error. Traditional debuggers provide only limited help: They can find syntactical errors but not training bugs such as ill-chosen learning rates. Cockpit offers a closer, more meaningful look into the training process with multiple well-chosen instruments.


CockpitAnimation

Installation

To install Cockpit simply run

pip install cockpit-for-pytorch
Conda environment For convenience, we also provide a conda environment, which can be installed via the conda yml file. It includes all the necessary requirements to build the docs, execute the tests and run the examples.

Documentation

The documentation provides a full tutorial on how to get started using Cockpit as well as a detailed documentation of its API.

Experiments

To showcase the capabilities of Cockpit we performed several experiments illustrating the usefulness of our debugging tool. The code for the experiments can be found in a separate repository. For a discussion of those experiments please refer to our paper.

License

Distributed under the MIT License. See LICENSE for more information.

Citation

If you use Cockpit, please consider citing:

Frank Schneider, Felix Dangel, Philipp Hennig
Cockpit: A Practical Debugging Tool for Training Deep Neural Networks
arXiv 2102.06604

@misc{schneider2021cockpit,
   title={{Cockpit: A Practical Debugging Tool for Training Deep Neural Networks}},
   author={Frank Schneider and Felix Dangel and Philipp Hennig},
   year={2021},
   eprint={2102.06604},
   archivePrefix={arXiv},
   primaryClass={cs.LG}
}

More Repositories

1

backpack

BackPACK - a backpropagation package built on top of PyTorch which efficiently computes quantities other than the gradient.
Python
555
star
2

unfoldNd

(N=1,2,3)-dimensional unfold (im2col) and fold (col2im) in PyTorch
Python
83
star
3

hbp

Hessian backpropagation (HBP): PyTorch extension of backpropagation for block-diagonal curvature matrix approximations
Python
20
star
4

phd-thesis

Source code for my PhD thesis: Backpropagation Beyond the Gradient
TeX
20
star
5

singd

[ICML 2024] SINGD: KFAC-like Structured Inverse-Free Natural Gradient Descent (http://arxiv.org/abs/2312.05705)
Python
19
star
6

curvlinops

scipy linear operators for the Hessian, Fisher/GGN, and more in PyTorch
Python
17
star
7

vivit

[TMLR 2022] Curvature access through the generalized Gauss-Newton's low-rank structure: Eigenvalues, eigenvectors, directional derivatives & Newton steps
Python
17
star
8

einconv

Convolutions and more as einsum for PyTorch
Python
12
star
9

sirfshampoo

[ICML 2024] SIRFShampoo: Structured inverse- and root-free Shampoo in PyTorch (https://arxiv.org/abs/2402.03496)
Python
10
star
10

phd-thesis-template

LaTeX template for my PhD thesis at the University of Tuebingen
TeX
9
star
11

backobs

Use DeepOBS with BackPACK
Python
2
star
12

org-export-setup

My org-export settings
TeX
2
star
13

python-utilities

Python utility functions I often use
Python
2
star
14

wandb_preempt

Code and tutorial on integrating wandb sweeps with Slurm pre-emption
Python
1
star
15

vivit-experiments

Experiments for the TMLR 2023 paper "ViViT: Curvature Access Through the Generalized Gauss-Newton’s Low-rank Structure"
Python
1
star