• Stars
    star
    1
  • Language
    Python
  • License
    MIT License
  • Created 3 months ago
  • Updated about 2 months ago

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

Code and tutorial on integrating wandb sweeps with Slurm pre-emption

More Repositories

1

backpack

BackPACK - a backpropagation package built on top of PyTorch which efficiently computes quantities other than the gradient.
Python
555
star
2

cockpit

Cockpit: A Practical Debugging Tool for Training Deep Neural Networks
Python
474
star
3

unfoldNd

(N=1,2,3)-dimensional unfold (im2col) and fold (col2im) in PyTorch
Python
83
star
4

hbp

Hessian backpropagation (HBP): PyTorch extension of backpropagation for block-diagonal curvature matrix approximations
Python
20
star
5

phd-thesis

Source code for my PhD thesis: Backpropagation Beyond the Gradient
TeX
20
star
6

singd

[ICML 2024] SINGD: KFAC-like Structured Inverse-Free Natural Gradient Descent (http://arxiv.org/abs/2312.05705)
Python
19
star
7

curvlinops

scipy linear operators for the Hessian, Fisher/GGN, and more in PyTorch
Python
17
star
8

vivit

[TMLR 2022] Curvature access through the generalized Gauss-Newton's low-rank structure: Eigenvalues, eigenvectors, directional derivatives & Newton steps
Python
17
star
9

einconv

Convolutions and more as einsum for PyTorch
Python
12
star
10

sirfshampoo

[ICML 2024] SIRFShampoo: Structured inverse- and root-free Shampoo in PyTorch (https://arxiv.org/abs/2402.03496)
Python
10
star
11

phd-thesis-template

LaTeX template for my PhD thesis at the University of Tuebingen
TeX
9
star
12

backobs

Use DeepOBS with BackPACK
Python
2
star
13

org-export-setup

My org-export settings
TeX
2
star
14

python-utilities

Python utility functions I often use
Python
2
star
15

vivit-experiments

Experiments for the TMLR 2023 paper "ViViT: Curvature Access Through the Generalized Gauss-Newtonโ€™s Low-rank Structure"
Python
1
star