There are no reviews yet. Be the first to send feedback to the community and the maintainers!
backpack
BackPACK - a backpropagation package built on top of PyTorch which efficiently computes quantities other than the gradient.cockpit
Cockpit: A Practical Debugging Tool for Training Deep Neural NetworksunfoldNd
(N=1,2,3)-dimensional unfold (im2col) and fold (col2im) in PyTorchhbp
Hessian backpropagation (HBP): PyTorch extension of backpropagation for block-diagonal curvature matrix approximationsphd-thesis
Source code for my PhD thesis: Backpropagation Beyond the Gradientsingd
[ICML 2024] SINGD: KFAC-like Structured Inverse-Free Natural Gradient Descent (http://arxiv.org/abs/2312.05705)curvlinops
scipy linear operators for the Hessian, Fisher/GGN, and more in PyTorchvivit
[TMLR 2022] Curvature access through the generalized Gauss-Newton's low-rank structure: Eigenvalues, eigenvectors, directional derivatives & Newton stepseinconv
Convolutions and more as einsum for PyTorchsirfshampoo
[ICML 2024] SIRFShampoo: Structured inverse- and root-free Shampoo in PyTorch (https://arxiv.org/abs/2402.03496)phd-thesis-template
LaTeX template for my PhD thesis at the University of Tuebingenbackobs
Use DeepOBS with BackPACKpython-utilities
Python utility functions I often usewandb_preempt
Code and tutorial on integrating wandb sweeps with Slurm pre-emptionvivit-experiments
Experiments for the TMLR 2023 paper "ViViT: Curvature Access Through the Generalized Gauss-Newtonโs Low-rank Structure"Love Open Source and this site? Check out how you can help us