eth-cscs/PythonHPC

Stars
110
Rank 316,770 (Top 7 %)
Language
Jupyter Notebook
License
BSD 3-Clause "New...
Created about 5 years ago
Updated over 1 year ago

eth-cscs/PythonHPC

eth-cscs

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

PythonHPC

This repository contains the material used for the course [High-Performance Computing with Python], organized at CSCS on 21-23 June 2023

The course covers the following topics:

Vectorization with NumPy and the SciPy stack
Profiling python code
Extending python with cython, cffi and f2py
Just-in-time compilation with numba
Distributed-memory parallel programming with python
Interfaces to GPUs

Course Instructors:

Dr. Rafael Sarmiento (Computational Scientist, CSCS)
Dr. Theofilos Manitaras (Computational Scientist, CSCS)

COSMA

Distributed Communication-Optimal Matrix-Matrix Multiplication Algorithm

ImplicitGlobalGrid.jl

Almost trivial distributed parallelization of stencil-based GPU and CPU applications on a regular staggered grid

sarus

OCI-compatible engine to deploy Linux containers on HPC environments.

abcpy

DLA-Future

production

General interest repository for CSCS users

SpFFT

Sparse 3D FFT library with MPI, OpenMP, CUDA and ROCm support

firecrest

SummerSchool2021

spla

Specialized Parallel Linear Algebra, providing distributed GEMM functionality for specific matrix distributions with optional GPU acceleration.

SummerSchool2020

Jupyter Notebook

SummerSchool2019

CSCS HPC Summer School 2019

Jupyter Notebook

spack-batteries-included

Installing spack without system dependencies

examples_cpp

Examples of designs using C++11/14

SummerUniversity2022

SummerUniversity2024

Tiled-MM

Matrix multiplication on GPUs for matrices stored on a CPU. Similar to cublasXt, but ported to both NVIDIA and AMD GPUs.

stackinator

sshservice-cli

pytorch-training

PyTorch training at CSCS

Jupyter Notebook

manta

Another CLI for Alps

pascal-training

Teaching materials, slides and exercises, for the GPU & CUDA training in 2017

cpp-course-2023

conflux

Distributed Communication-Optimal LU-factorization Algorithm

tensorflow-training

Multi-GPU training with TensorFlow on Piz Daint

Jupyter Notebook

abcpy-models

COSTA

Distributed Communication-Optimal Shuffle and Transpose Algorithm

ext_mpi_collectives

ext_mpi_collectives

SummerSchool2016

pyfirecrest

Python wrappers for the FirecREST API

SummerUniversity2023

gpu-training

SummerSchool2018

CSCS HPC Summer School 2018

cmake-recipes

Repository for collecting, curating and maintaining up to date CMake scripts.

uenv

https://eth-cscs.github.io/uenv/

squashfs-mount

Setuid instead of FUSE for mounting squashfs files.

cscs-reframe-tests

The CSCS ReFrame test suite

openstack

alps-uenv

Recipes for software stacks on Alps vClusters.

UserLabDay

CSCS User Lab Day – Meet the Swiss National Supercomputing Centre

Jupyter Notebook

slurm-container

alps-cluster-config

cscs_beamer_style

ContainerHackathon

Jupyter Notebook

slurm-replay

Replay job submissions for Slurm

node-burn

SummerSchool2015

Repository for summer school information that will be provided to students

SummerSchool2017

interactive

Interactive Computing with Jupyter on Piz Daint, using Python, ParaView and Julia

Jupyter Notebook

slurm-uenv-mount

DLA-Future-Fortran

Fortran interface for DLA-Future

py2spack

Automatic conversion of standard Python packages to Spack package recipes.

hpctools

Debugging and Performance Tools examples

tools

CSCS tools including R, python, netcdf, etc...

ipcluster_magic

Magic commands to support running MPI python code as well as multi-node Dask workloads on Jupyter notebooks.

async-encfs-dvc

Data version control in privacy-preserving HPC workflows using DVC, EncFS, SLURM and Openstack Swift on https://castor.cscs.ch

Jupyter Notebook

SDSC-user-onboarding

Materials for the onboarding workshop for data scientists at SDSC

Jupyter Notebook

whip

whip is a small C++ abstraction layer for CUDA and HIP

PASC_inference

compression

DLA-interface

Interface for Distributed Linear Algebra

squashfs-run

Mount directories directly under `/` without sudo, using bwrap (and without overlayfs)

mchquickstart

Introduction for new MCH users

TensorFlow

containers-hands-on

Material for tutorials and hands-on about containers

dynamic-resource-provisioning

Ansible-powered Dynamic Storage Resource Provisioning (DSRP)

mesa

firecrest-training-2023

DataWeaver.jl

spack-stack

fast spack builds on slow filesystem

cineca-cuda

teaching materials for the CUDA @ CINECA Feb. 2016

irpf90

IRPF90 is a Fortran90 preprocessor written in Python for programming using the Implicit Reference to Parameters (IRP) method. It simplifies the development of large fortran codes in the field of scientific high performance computing.

uenv2

benchmark-resources

benchmark_resources: input files

cpp-course-2024

Slides for an internal C++ course at CSCS

SoftwareManagementCourse2019

Exercises and slides for the Software Management Course 2019 held at CSCS

firecrestspawner

A JupyterHub spawner to launch notebooks servers via FirecREST.

alps-gh200-reproducers

Reproducers for issues found on GH200 nodes on Alps