Discover sara-nl/mpi-examples Open Source project

3D VQ-VAE-2 for high-resolution CT scan synthesis

3D-VQ-VAE-2

This is a PyTorch implementation of the paper: "Processing Megapixel Images with Deep Attention-Sampling Models".

attention-sampling-pytorch

multi-scale-tools

2D Vector-Quantized Auto-Encoder for compression of Whole-Slide Images in Histopathology

2D-VQ-AE-2

Scripts and templates related to Ethernet OAM

eth-oam

Distributed Deep Learning Benchmark Suite

DDLBench

Parallel-and-GPU-programming-in-Python

2D Jacobi solver paralleled with MPI and OpenMP (template for the PRACE course)

prace_jacobi

C++

BeeHub

SURFsara's BeeHub File Sharing Service

saraGAN

SURFsara GAN library

Study materials (code, slides) for the PRACE High Performance Machine Learning Workshop 2021

PraceHPML2021

Course material to teach the integration of RDM and compute workflows.

iRODS-RDM-Compute-training

Contains the material for the Machine Learning on HPC systems course on 16-05-2023

data-exchange

Scala

MLonHPC_May2023

Covid19-HPML

MPI topologies, METIS decomposition, unbalanced workload (template for the PRACE course)

prace_topologies

C++

SURF-segmentation

Material for the ELIXIR Excelerate Deep Learning for Life Sciences workshop

elixir-dl

PraceHPML2020

Course materials for the UvA ML introduction course

UvA_ML_2021

Notebooks for the big data group

jupyter-bigdata-notebooks

Client software and configuration for the Hathi Hadoop cluster

hathi-client

Cook book for using several performance analysis and measurement packages on Cartesius (Dutch National Supercomputer Center)

PRACE-MPI-OpenMP

Fortran

Performance-Analysis-Framework-guide

Roff

Packed-Data-Formats

Beneath the SURFace: An MRI-like View into the Life of a 21st Centry Datacenter

SURFace

Dockerfiles for notebook environments

jupyter-bigdata-docker

Tools and tutorials for quantum computing

QuantumComputing

Material for the course Introduction to HPC

IntroHPC_CBM

course-module-snellius-fs

Course module materials for Snellius filesystems

griddocs

Intro-to-HPC

PRACE-advanced-dl

clouddocs

HPC Cloud documentation

Beginner's course on Singularity containers

singularity-course

surfsara-dmf-irods-client

Training material for the VU HPC course

VU_HPC

automl

GridScripts

Course material for Prace Course "Introduction to High Performance Machine learning"

PraceHPML2022

Slides for the "MPI and OpenMP in Scientific Software Development" course given by SURF

prace_advanced_mpi_openmp

ISC-2024-EAR-tutorial

Energy Management and Optimization with EAR

Cuda

dmp_feature_matrix

Data Management platform features and evaluation criterion

matlabmpi

PRACE-intro-dl

Contains all course materials from the HPML group

jupyter

Jupyter documentation

irods-ansible

Deploy iRODS

HPML-course-materials

3D template matching in tomographic data

Omnimatch

SpiderScripts

Welcome! These are a few scripts that we use at SURFsara to work with Spider.

research-data-exchange

Training material for energy efficent computing

energy-efficient-computing

Cuda

computer-aided-retrosynthesis

This repository contains code belonging to the work done on computer aided retrosynthesis within the SURF HPML team.

Contains the material for the TU/e Deep Learning on HPC course on 16-17 April 2024.

Tue_HPDL_2024

Here you find documentation about dCache at SURFsara

dCachedocs

researchdrivedocs

Running SPPARKS (Stochastic Parallel Particle Kinetic Simulator) on HPC system

spparks_hpc

Official repository for the SURF Spider platform user documentation

spiderdocs

color-information

Course about basic iRODS icommands in a data processing pipelines

iRODS-RDM-HPC-course

Documentation for the Data Repository of SURF

sdrdocs

CSS

QuantizedGAN

AngleGAN quantization

Documentation and issue reporting for the OSSC test phase

PRACE-GPU-Portability

OSSC_test

workshop-template

SURF workshop template adapted from the Carpentries

Data Services Documentation

dsdocs

picas-profile

Some scripts to back up systems with Duplicity.

HTML

backupscripts

Swift and S3 documentation

objectstoredocs

HTML

surfsara-json-parser-cpp

JSON parser, path expression and object update in C++

C++

swiftdocs

Here you find documentation about the SWIFT data storage service

Whole Slide Image Caption Generation from Pre-trained CLIP latents for the ExaMode project.

WSI_Captioning

A Topos client library in Perl

PerlTopos

Perl

GoodPracticesML

SKA processing on the SURFsara Grid as part of the AENEAS project

ska2grid

parallel-image-classification

Example interface for operating the OpenNaaS REST interface.

opennaas-dc-gui

A place to put SURFsara company wide shell scripts. For questions or access please contact onnozweers.

shell-scripts

ML_Erasmus

dcgmi_top

Research Data Management training for data supporters

rdm-training-datasupporters-april-2024

Contains the material for the 2-day High Performance Deep Learning course on 05-09-2023 & 06-09-2023

MLonHPC_2day_Okt2023

[deprecated] Jupyter notebook environment for the big data workshops

jupyter-bigdata

SURFBoard

Large-scale HPC infrastructures are enablers for scientific research in many domains. The recent advances in machine learning (ML)have led to an ever-increasing demand for computation power, as well as the design of complex operational workflows. Understanding the performance and efficiency of these workflows is key to productivity, knowledge and model sharing, and energy efficiency. We propose the design of a container-based framework for reproducible performance analysis.