moutai/sparkonda

Stars
10
Rank 1,773,858 (Top 36 %)
Language
Python
License
ISC License
Created over 8 years ago
Updated over 1 year ago

moutai/sparkonda

moutai

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Minimalistic utility library to manage conda environments for pyspark jobs on yarn clusters

eucalyptus-utils

tdml-example

Companion exercise to my WIP book "Clean Machine Learning Code"

hpc-medley

This project hosts two publicly available hpc benchmarks: NPB (NAS) and the HPL part of the HPCC challenge. It is used to determine the performance of clustered computing resources. For the up to date releases please see the respective websites.

project1

hpcfy

This is a puppet project to create an mpi or hadoop-ready cluster out of virtual machines. The utilities are geared more specifically towards using an eucalyptus private cloud account. The puppet part of this project can be used for any virtual machine, be it private or public cloud. It provide basic capabilities for creating a shared nfs filesystem, user home directories, password-less key setup and basic HPC packages management (gcc, mpi,...).