• Stars
    star
    112
  • Rank 312,240 (Top 7 %)
  • Language
    Python
  • License
    Other
  • Created over 11 years ago
  • Updated about 1 year ago

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

Python wrapper for SciDB queries

SciDB-Py: Python Interface to SciDB

Version Information

The major and minor version numbers of SciDB-Py track the major and minor version of SciDB they are compatible with. For example SciDB-Py 16.9.1, 16.9.2 or 16.9.10 are all compatible with SciDB 16.9.x.

During SciDB 16.9, Shim (HTTP service for SciDB) transitioned from query authentication to session authentication. SciDB-Py has been updated to be compatible with the new Shim. Below is the compatibility matrix between SciDB-Py and Shim:

SciDB-Py Shim
16.9.1 query authentication (old Shim)
16.9.2 query authentication (old Shim)
16.9.10 session authentication (new Shim)

From 16.9.10 onwards only Shim with session authentication is supported.

Since SciDB-Py Release 16.9.1 (released in September 2017) the library has been rewritten entirely from scratch. 16.9.1 and newer versions are not compatible with the previous versions of the library. The documentation for the previous versions is available at SciDB-Py documentation (legacy). GitHub pull requests are still accepted for the previous versions, but the code is not actively maintained.

Requirements

SciDB 19.11 or newer with Shim

Python 3.5.x, 3.6.x, 3.7.x, 3.8.x, 3.9.x, or 3.10.x

Required Python packages:

backports.weakref
enum34
numpy
pandas (see version requirements in setup.py)
pyarrow (see version requirements in setup.py)
requests
six

CentOS 6 and Red Hat Enterprise Linux 6

CentOS 6 and Red Hat Enterprise Linux 6 come with Python 2.6. SciDB-Py requires Python 2.7 or newer (see above). The default Python cannot be upgraded on these operating systems. Instead a different Python version can be installed in parallel using Software Collections. For example, here are the instructions to install Python 2.7 using Software Collections.

Installation

Install latest release:

pip install scidb-py

Install development version from GitHub:

pip install git+http://github.com/paradigm4/scidb-py.git

Documentation

See SciDB-Py Documentation.

More Repositories

1

SciDBR

R package for SciDB
R
52
star
2

shim

HTTP service for SciDB http://paradigm4.github.io/shim/help.html
JavaScript
23
star
3

SciDB_legacy_issues

Public issue tracking system for SciDB
22
star
4

stream

Prototype Hadoop streaming-like SciDB API
C++
11
star
5

orderbook-example

Create an example order book from ARCA sample financial market data
C++
7
star
6

accelerated_io_tools

Prototype SciDB plugins for faster ingest and export of data.
C++
6
star
7

superfunpack

Miscellaneous scalar functions for SciDB that are super fun.
C++
5
star
8

scidb.dplyr

A SciDB backend for dplyr
R
5
star
9

SciDB-Julia

Julia package for SciDB
Julia
5
star
10

r_exec

Run R programs within SciDB queries
C++
4
star
11

bridge

SciDB input/output using external storage
Python
4
star
12

scripts

Miscellaneous SciDB scripts and utilities
Shell
4
star
13

equi_join

Relational-style Equi-Join of SciDB Arrays by Attributes or Dimensions
C++
4
star
14

finance

DEPRECATED - Basic financial time-series SciDB examples
3
star
15

dev_tools

Tools for installing SciDB plugins from GitHub
C++
3
star
16

extra-scidb-libs

Shell
3
star
17

quotes

An OPRA options nbbo/book consolidation example
Shell
3
star
18

knn

Basic k nearest neighbor operator
C++
2
star
19

revealcore

R package for core functionality for various REVEAL applications
R
2
star
20

grouped_aggregate

Prototype grouped aggregation in SciDB
C++
2
star
21

wearable_prototypes

SciDB examples on a sample wearable timeseries dataset
Jupyter Notebook
1
star
22

scidb-tornado

SciDB RESTful api via tornado
Python
1
star
23

chunk_unique

DEPRECATED -- Filter out repeated string values within each chunk of an array.
C++
1
star
24

summarize

Quickly compute array size statistics
C++
1
star
25

saltstack-scidb-cluster

saltstack state and template files for installing and maintaining a scidb cluster
Python
1
star
26

pkgdown

Forked R pkgdown library
R
1
star
27

collate

Map muti-attribute 1-d arrays into matrices
C++
1
star
28

load_tools

DEPRECATED - Tools for efficient and error-tolerant loading of data into SciDB
1
star
29

cluster_tools

Tools and notes for AWS and EC2
Shell
1
star