Discover dask/dask-jobqueue Open Source project by @dask

1

dask

Parallel computing with task scheduling

Python

12,531

2

dask-tutorial

Dask tutorial

Jupyter Notebook

1,832

3

distributed

A distributed task scheduler for Dask

Python

1,576

4

dask-ml

Scalable Machine Learning with Dask

Python

898

5

dask-examples

Easy-to-run example notebooks for Dask

Jupyter Notebook

373

6

dask-kubernetes

Native Kubernetes integration for Dask

Python

311

7

dask-labextension

JupyterLab extension for Dask

TypeScript

311

8

dask-searchcv

dask-searchcv is now part of dask-ml: https://github.com/dask/dask-ml

Python

240

9

dask-docker

Docker images for dask

Jupyter Notebook

231

10

dask-image

Distributed image processing

Python

210

11

dask-xgboost

Python

162

12

cachey

Caching based on computation time and storage space

Python

137

13

hdfs3

A wrapper for libhdfs3 to interact with HDFS from Python

Python

136

14

dask-gateway

A multi-tenant server for securely deploying and managing Dask clusters.

Python

136

15

dask-cloudprovider

Cloud provider cluster managers for Dask. Supports AWS, Google Cloud Azure and more...

Python

134

16

dask-ec2

Start a cluster in EC2 for dask.distributed

Python

106

17

partd

Concurrent appendable key-value storage

Python

105

18

dask-tensorflow

Python

93

19

helm-chart

Helm charts for Dask

YAML

91

20

dask-expr

Python

86

21

dask-lightgbm

Python

79

22

dask-glm

Python

76

23

zict

Useful Mutable Mappings

Python

69

24

dask-yarn

Deploy dask on YARN clusters

Python

69

25

dask-gke

kubernetes setup to bootstrap distributed on google container engine

Python

67

26

old-dask-examples

Collection of dask example notebooks

Jupyter Notebook

57

27

knit

Deprecated, please use https://github.com/jcrist/skein or https://github.com/dask/dask-yarn instead

Python

53

28

dask-mpi

Deploy Dask using MPI4Py

Python

52

29

dask-stories

Python

40

30

dask-drmaa

Deploy Dask on DRMAA clusters

Python

40

31

dask-blog

Dask development blog

HTML

30

32

crick

Streaming and approximate algorithms. WIP, use at own risk.

Python

24

33

community

For general discussion and community planning. Discussion issues welcome.

20

34

mtprof

Thread-aware Python profiler hack

Python

17

35

dask-benchmarks

asv benchmarks for dask projects

Python

17

36

pandas-streaming

Python

16

37

dask-tutorial-infrastructure

Cluster for the Dask Tutorial.

Dockerfile

11

38

old-dask-yarn

Deprecated, please use https://github.com/jcrist/skein or https://github.com/dask/dask-yarn instead

Python

7

39

governance

The governance process and model for Dask

7

40

dask-sphinx-theme

Sphinx theme for Dask documentation

Python

6

41

dask-ml-benchmarks

Python

5

42

dask.github.io

Dask Website

HTML

5

43

scipy-tutorials-2018

5

44

design-docs

Experimental repo for proposals of future work

2

45

.github

2

46

dask-org

General dask resources that aren't code

Jupyter Notebook

2

47

marketing

Resources and guidelines for marketing Dask

Python

1

48

dask-gateway-helm-repo

Repository holding published dask-gateway helm charts

1

49

parquet-integration

Integration tests for various parquet readers and writers

Python

1

dask/dask-jobqueue

dask

Reviews

Repository Details

Deploy Dask on Job Queueing systems

LICENSE

More Repositories