dask/dask

Distributed Computing Graph

Stars
11,979
Rank 2,569 (Top 0.06 %)
Language
Python
License
BSD 3-Clause "New...
Created over 9 years ago
Updated 10 days ago

dask/dask

dask

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Parallel computing with task scheduling

Dask

Dask is a flexible parallel computing library for analytics. See documentation for more information.

LICENSE

New BSD. See License File.

dask-tutorial

Jupyter Notebook

distributed

A distributed task scheduler for Dask

dask-ml

Scalable Machine Learning with Dask

dask-examples

Easy-to-run example notebooks for Dask

Jupyter Notebook

dask-kubernetes

Native Kubernetes integration for Dask

dask-labextension

JupyterLab extension for Dask

dask-searchcv

dask-searchcv is now part of dask-ml: https://github.com/dask/dask-ml

dask-jobqueue

Deploy Dask on job schedulers like PBS, SLURM, and SGE

dask-docker

Docker images for dask

Jupyter Notebook

dask-image

Distributed image processing

dask-xgboost

hdfs3

A wrapper for libhdfs3 to interact with HDFS from Python

cachey

Caching based on computation time and storage space

dask-cloudprovider

Cloud provider cluster managers for Dask. Supports AWS, Google Cloud Azure and more...

dask-gateway

A multi-tenant server for securely deploying and managing Dask clusters.

dask-ec2

Start a cluster in EC2 for dask.distributed

partd

Concurrent appendable key-value storage

dask-tensorflow

helm-chart

Helm charts for Dask

dask-lightgbm

dask-glm

dask-expr

dask-yarn

Deploy dask on YARN clusters

zict

Useful Mutable Mappings

dask-gke

kubernetes setup to bootstrap distributed on google container engine

old-dask-examples

Collection of dask example notebooks

Jupyter Notebook

knit

Deprecated, please use https://github.com/jcrist/skein or https://github.com/dask/dask-yarn instead

dask-mpi

Deploy Dask using MPI4Py

dask-drmaa

Deploy Dask on DRMAA clusters

dask-stories

dask-blog

Dask development blog

crick

Streaming and approximate algorithms. WIP, use at own risk.

community

For general discussion and community planning. Discussion issues welcome.

dask-benchmarks

asv benchmarks for dask projects

pandas-streaming

mtprof

Thread-aware Python profiler hack

dask-tutorial-infrastructure

Cluster for the Dask Tutorial.

old-dask-yarn

Deprecated, please use https://github.com/jcrist/skein or https://github.com/dask/dask-yarn instead

governance

The governance process and model for Dask

dask-sphinx-theme

Sphinx theme for Dask documentation

dask-ml-benchmarks

dask.github.io

scipy-tutorials-2018

design-docs

Experimental repo for proposals of future work

.github

dask-org

General dask resources that aren't code

Jupyter Notebook

marketing

Resources and guidelines for marketing Dask

dask-gateway-helm-repo

Repository holding published dask-gateway helm charts

parquet-integration

Integration tests for various parquet readers and writers