eth-cscs/ipcluster_magic eth-cscs/ipcluster_magic

  • Stars
    star
    4
  • Rank 3,304,323 (Top 66 %)
  • Language
    Python
  • Created about 5 years ago
  • Updated almost 2 years ago
Twitter logo Share LinkedIn logo Share Facebook logo Share
eth-cscs/ipcluster_magic
github

eth-cscs

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

Magic commands to support running MPI python code as well as multi-node Dask workloads on Jupyter notebooks.

More Repositories

1

COSMA

Distributed Communication-Optimal Matrix-Matrix Multiplication Algorithm
C++
192
star
2

ImplicitGlobalGrid.jl

Almost trivial distributed parallelization of stencil-based GPU and CPU applications on a regular staggered grid
Julia
162
star
3

sarus

OCI-compatible engine to deploy Linux containers on HPC environments.
C++
129
star
4

abcpy

ABCpy package
Python
113
star
5

PythonHPC

PythonHPC
Jupyter Notebook
110
star
6

DLA-Future

DLA-Future
C++
64
star
7

production

General interest repository for CSCS users
Python
49
star
8

SpFFT

Sparse 3D FFT library with MPI, OpenMP, CUDA and ROCm support
C++
48
star
9

firecrest

Python
33
star
10

SummerSchool2021

PostScript
32
star
11

spla

Specialized Parallel Linear Algebra, providing distributed GEMM functionality for specific matrix distributions with optional GPU acceleration.
C++
27
star
12

SummerSchool2020

Jupyter Notebook
26
star
13

SummerSchool2019

CSCS HPC Summer School 2019
Jupyter Notebook
25
star
14

spack-batteries-included

Installing spack without system dependencies
C
25
star
15

examples_cpp

Examples of designs using C++11/14
C++
25
star
16

SummerUniversity2022

PostScript
25
star
17

SummerUniversity2024

C++
24
star
18

Tiled-MM

Matrix multiplication on GPUs for matrices stored on a CPU. Similar to cublasXt, but ported to both NVIDIA and AMD GPUs.
C++
22
star
19

stackinator

Python
18
star
20

sshservice-cli

Shell
17
star
21

pytorch-training

PyTorch training at CSCS
Jupyter Notebook
15
star
22

manta

Another CLI for Alps
Rust
14
star
23

pascal-training

Teaching materials, slides and exercises, for the GPU & CUDA training in 2017
Cuda
13
star
24

cpp-course-2023

C++
13
star
25

conflux

Distributed Communication-Optimal LU-factorization Algorithm
C++
12
star
26

tensorflow-training

Multi-GPU training with TensorFlow on Piz Daint
Jupyter Notebook
12
star
27

abcpy-models

Python
11
star
28

COSTA

Distributed Communication-Optimal Shuffle and Transpose Algorithm
C++
11
star
29

ext_mpi_collectives

ext_mpi_collectives
C
10
star
30

SummerSchool2016

C++
10
star
31

pyfirecrest

Python wrappers for the FirecREST API
Python
10
star
32

SummerUniversity2023

C++
10
star
33

gpu-training

C++
10
star
34

SummerSchool2018

CSCS HPC Summer School 2018
C++
10
star
35

cmake-recipes

Repository for collecting, curating and maintaining up to date CMake scripts.
CMake
9
star
36

uenv

https://eth-cscs.github.io/uenv/
Python
9
star
37

squashfs-mount

Setuid instead of FUSE for mounting squashfs files.
C
9
star
38

cscs-reframe-tests

The CSCS ReFrame test suite
Python
8
star
39

openstack

Shell
8
star
40

alps-uenv

Recipes for software stacks on Alps vClusters.
Python
8
star
41

UserLabDay

CSCS User Lab Day – Meet the Swiss National Supercomputing Centre
Jupyter Notebook
8
star
42

slurm-container

Shell
7
star
43

alps-cluster-config

Python
7
star
44

cscs_beamer_style

TeX
6
star
45

ContainerHackathon

Jupyter Notebook
6
star
46

slurm-replay

Replay job submissions for Slurm
C
6
star
47

node-burn

C++
6
star
48

SummerSchool2015

Repository for summer school information that will be provided to students
C++
6
star
49

SummerSchool2017

C++
5
star
50

interactive

Interactive Computing with Jupyter on Piz Daint, using Python, ParaView and Julia
Jupyter Notebook
5
star
51

slurm-uenv-mount

C++
5
star
52

DLA-Future-Fortran

Fortran interface for DLA-Future
Fortran
5
star
53

py2spack

Automatic conversion of standard Python packages to Spack package recipes.
Python
4
star
54

hpctools

Debugging and Performance Tools examples
Python
4
star
55

tools

CSCS tools including R, python, netcdf, etc...
Python
4
star
56

async-encfs-dvc

Data version control in privacy-preserving HPC workflows using DVC, EncFS, SLURM and Openstack Swift on https://castor.cscs.ch
Jupyter Notebook
4
star
57

SDSC-user-onboarding

Materials for the onboarding workshop for data scientists at SDSC
Jupyter Notebook
4
star
58

whip

whip is a small C++ abstraction layer for CUDA and HIP
CMake
4
star
59

PASC_inference

MATLAB
4
star
60

compression

C++
4
star
61

DLA-interface

Interface for Distributed Linear Algebra
C++
3
star
62

squashfs-run

Mount directories directly under `/` without sudo, using bwrap (and without overlayfs)
C
3
star
63

mchquickstart

Introduction for new MCH users
C
3
star
64

TensorFlow

Python
3
star
65

containers-hands-on

Material for tutorials and hands-on about containers
Dockerfile
3
star
66

dynamic-resource-provisioning

Ansible-powered Dynamic Storage Resource Provisioning (DSRP)
Go
2
star
67

mesa

CSM library
Rust
2
star
68

firecrest-training-2023

Python
2
star
69

DataWeaver.jl

Julia
2
star
70

spack-stack

fast spack builds on slow filesystem
Python
2
star
71

cineca-cuda

teaching materials for the CUDA @ CINECA Feb. 2016
Cuda
2
star
72

irpf90

IRPF90 is a Fortran90 preprocessor written in Python for programming using the Implicit Reference to Parameters (IRP) method. It simplifies the development of large fortran codes in the field of scientific high performance computing.
Python
2
star
73

uenv2

C++
1
star
74

benchmark-resources

benchmark_resources: input files
1
star
75

cpp-course-2024

Slides for an internal C++ course at CSCS
HTML
1
star
76

SoftwareManagementCourse2019

Exercises and slides for the Software Management Course 2019 held at CSCS
CMake
1
star
77

firecrestspawner

A JupyterHub spawner to launch notebooks servers via FirecREST.
Python
1
star
78

alps-gh200-reproducers

Reproducers for issues found on GH200 nodes on Alps
C++
1
star