• Stars
    star
    1,450
  • Rank 32,436 (Top 0.7 %)
  • Language
    Python
  • License
    MIT License
  • Created almost 9 years ago
  • Updated about 2 months ago

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

An implementation of chunked, compressed, N-dimensional arrays for Python.

Zarr

Latest Release latest release
latest release
Package Status status
License license
Build Status build status
Pre-commit Status pre-commit status
Coverage coverage
Downloads pypi downloads
Gitter
Citation DOI

What is it?

Zarr is a Python package providing an implementation of compressed, chunked, N-dimensional arrays, designed for use in parallel computing. See the documentation for more information.

Main Features

  • Create N-dimensional arrays with any NumPy dtype.
  • Chunk arrays along any dimension.
  • Compress and/or filter chunks using any NumCodecs codec.
  • Store arrays in memory, on disk, inside a zip file, on S3, etc...
  • Read an array concurrently from multiple threads or processes.
  • Write to an array concurrently from multiple threads or processes.
  • Organize arrays into hierarchies via groups.

Where to get it

Zarr can be installed from PyPI using pip:

pip install zarr

or via conda:

conda install -c conda-forge zarr

For more details, including how to install from source, see the installation documentation.

More Repositories

1

numcodecs

A Python package providing buffer compression and transformation codecs for use in data storage and communication applications.
Python
124
star
2

VirtualiZarr

Create virtual Zarr stores from archival data files using xarray syntax
Python
100
star
3

zarr-specs

Zarr core protocol for storage and retrieval of N-dimensional typed arrays
86
star
4

zarr_implementations

Python
39
star
5

tutorials

Notebooks and other content for Zarr tutorials
Jupyter Notebook
38
star
6

zarr-illustrations-falk-2022

Illustrations created by Henning Falk for the Zarr community
Shell
29
star
7

community

An open community with an interest in developing and using new technologies for tensor data storage.
19
star
8

zeps

Zarr Enhancement Proposals
Ruby
12
star
9

beautiful-zarr

Showcase for beautiful data, code and usecases for Zarr
8
star
10

zarr-java

Java implementation of the Zarr Specification
Java
5
star
11

governance

The governance process and model for zarr-developers
4
star
12

zarr-developers.github.io

Zarr Homepage
JavaScript
3
star
13

cookiecutter-zarr-store

Cookiecutter for Zarr store implementations
Python
2
star
14

community-calls

Zarr Community Calls Website
Ruby
2
star
15

perfcapture

Capture the performance of a computer system whilst running a set of benchmark workloads.
Python
2
star
16

outreachy

Outreachy - Zarr
1
star
17

zarr-paper

Repository for developing an initial article describing Zarr for peer-reviewed publication
1
star
18

gsoc

Google Summer of Code - Zarr
1
star
19

zarr-logo

Official logos for the Zarr project
1
star
20

zarr-benchmark

Benchmarking the performance of various Zarr implementations, using our perfcapture framework.
Jupyter Notebook
1
star