• Stars
    star
    123
  • Rank 290,145 (Top 6 %)
  • Language HCL
  • License
    BSD 3-Clause "New...
  • Created over 4 years ago
  • Updated over 2 years ago

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

QHub deployment tool

Nebari logo mark - text will be black in light color mode and white in dark color mode.

Your open source data science platform. Built for scale, designed for collaboration.


Information Links
Project License Nebari documentation PyPI conda version
Community GH discussions Open an issue Community guidelines
CI Kubernetes Tests Tests Test Nebari Provider

Table of contents

⚠️ Warning ⚠️ The project has recently been renamed from QHub to Nebari. If your deployment is still managed by qhub, performing an in place upgrade will IRREVOCABLY BREAK your deployment. This will cause you to lose any data stored on the platform, including but not limited to, NFS (file system) data, conda-store environments, Keycloak users and groups, etc. Make sure to back up your data before attempting an upgrade.

Automated data science platform. From JupyterHub to Cloud environments with Dask Gateway.

Nebari is an open source data platform that enables users to build and maintain cost-effective and scalable compute platforms on HPC or Kubernetes with minimal DevOps overhead.

This repository details the Nebari (Kubernetes) version.

Not sure what to choose? Check out our documentation on choosing a deployment platform

Nebari

The Kubernetes version of Nebari uses Terraform, Helm, and GitHub Actions.

  • Terraform handles the build, change, and versioning of the infrastructure.
  • Helm helps to define, install, and manage Kubernetes resources.
  • GitHub Actions is used to automatically create commits when the configuration file (nebari-config.yaml) is rendered, as well as to kick off the deployment action.

Nebari aims to abstract all these complexities for its users. Hence, it is not necessary to know any of the technologies mentioned above to have your project successfully deployed.

TLDR: If you know GitHub and feel comfortable generating and using API keys, you should have all it takes to deploy and maintain your system without the need for a dedicated DevOps team. No need to learn Kubernetes, Terraform, or Helm.

Cloud Providers ☁️

Nebari offers out-of-the-box support for the major public cloud providers: Digital Ocean, Amazon AWS, GCP, and Microsoft Azure. High-level illustration of Nebari architecture

Installation πŸ’»

Pre-requisites

  • Operating System: Currently, Nebari supports development on macOS and Linux operating systems. Windows is NOT supported. However, we would welcome contributions that add and improve support for Windows.
  • You need Python >= 3.7 on your local machine or virtual environment to work on Nebari.
  • Adopting virtual environments (conda, pipenv or venv) is also encouraged.

Install Nebari

To install Nebari type the following commands in your command line:

  • Install using conda:

    conda install -c conda-forge nebari
    
    # if you prefer using mamba
    mamba install -c conda-forge nebari
  • Install using pip:

    pip install nebari

Once finished, you can check Nebari's version (and additional CLI arguments) by typing:

nebari --help

If successful, the CLI output will be similar to the following:

usage: nebari [-h] [-v] {deploy,destroy,render,init,validate} ...

Nebari command line

positional arguments:
  {deploy,destroy,render,init,validate}
                        Nebari

optional arguments:
  -h, --help            show this help message and exit
  -v, --version         Nebari version

Usage πŸš€

Nebari requires setting multiple environment variables to automate the deployments fully. For details on obtaining those variables, check the Nebari Get started documentation.

Once all the necessary credentials are gathered and set as UNIX environment variables, Nebari can be deployed in minutes.

For detailed step-by-step instructions on how to deploy Nebari, check the Nebari documentation.

Nebari HPC

An HPC version of Nebari is currently not available. There is one under development for Nebaris precursor QHub. Curious? Check out the QHub HPC repository.

Contributing to Nebari πŸ‘©πŸ»β€πŸ’»

Thinking about contributing? Check out our Contribution Guidelines to get started.

Installing the Development version of Nebari βš™οΈ

To install the latest developer version (unstable) use:

pip install git+https://github.com/nebari-dev/nebari.git

Questions? πŸ€”

Have a look at our Frequently Asked Questions (FAQ) to see if your query has been answered.

Getting help:

  • GitHub Discussions is our user forum. It can be used to raise discussions about a subject, such as: "What is the recommended way to do X with Nebari?"
  • Issues for queries, bug reporting, feature requests, documentation, etc.

We work around the clock to make Nebari better, but sometimes your query might take a while to get a reply. We apologize in advance and ask you to please, be patient πŸ™.

Code of Conduct πŸ“–

To guarantee a welcoming and friendly community, we require all community members to follow our Code of Conduct.

Ongoing Support

The v0.4.0 release introduced many changes that will irrevocably break your deployment if you attempt an in-place upgrade; for details, see our RELEASE notes. To focus on the future direction of the project, we have decided as a team that we will provide limited support for older versions. Any new user is encouraged to use v0.4.0 or greater.

If you're using an older version of Nebari and would like professional support, please get in touch with the Nebari development team.

License

Nebari is BSD3 licensed.

More Repositories

1

ragna

RAG orchestration framework ⛡️
Python
179
star
2

pnumpy

Parallel NumPy seamlessly speeds up NumPy for large arrays (64K+ elements) with no change required to existing code.
C++
57
star
3

pytest-pytorch

pytest plugin for a better developer experience when working with the PyTorch test suite
Python
43
star
4

ibis-vega-transform

@vega transforms with @ibis-project expressions
Python
29
star
5

scipy-2022-swag

attempt at swag design for scipy 2022
Jupyter Notebook
27
star
6

qhub-hpc

Python
23
star
7

Quansight-website

πŸ’» Source code for Quansight Labs website
TypeScript
21
star
8

scipy-2019-rapids-tutorial

Materials for the SciPy 2019 RAPIDS tutorial
Jupyter Notebook
21
star
9

ragna-presentations

Material for Ragna-related presentations
Jupyter Notebook
16
star
10

panel_desktop_app

Turn a panel app into a desktop app
Python
13
star
11

conferences

Contains conference presentations and public links.
11
star
12

jhub-client

Automation of JupyterHub operations and testing
Python
11
star
13

open-gpu-server

The Open GPU Server for CI purpose.
Shell
10
star
14

torch-build

Collection of scripts to build PyTorch and the domain libraries from source.
Shell
8
star
15

terraform-jupyterhub

Provision and manage a cost effective and scalable compute environment for teams
8
star
16

lsst_dashboard

LSST Dashboard https://quansight.github.io/lsst_dashboard/
Jupyter Notebook
8
star
17

qhub-ops

A tool for initialising and maintaining the state of QHub deployments on Digital Ocean, Amazon Web Services, and Google Cloud Platform
Python
8
star
18

scipy2020_spatial_algorithms_at_scale

Repo for the Scipy 2020 Spatial Algorithms at Scale Presentation
Jupyter Notebook
7
star
19

qhub-jupyterhub-theme

Python
7
star
20

Practical-RL

Taking the original authors' TD3, converting items to notebooks, and modifying from there.
Jupyter Notebook
6
star
21

pseudocode

Python
6
star
22

pearu-sandbox

Pearu's sandbox
Jupyter Notebook
5
star
23

Quansight.github.io

Quansight Github Website
HTML
5
star
24

qhub-terraform-modules

QHub Terraform Modules
HCL
5
star
25

SimpleWebAssemblyCalculator

WebAssembly and JavaScript Calculator
JavaScript
5
star
26

qpub

deathbeds generalized automation framework
Python
4
star
27

.github

Common GitHub community health files for Quansight
Python
4
star
28

torchdynamo_native

A native JIT compiler for `torchdynamo`
Python
4
star
29

bitemporal-h5

A generic bitemporal model built on HDF5 (h5py)
Python
4
star
30

omnisci-examples

Examples demonstrating different tools for interacting with the OmniSci server
Jupyter Notebook
4
star
31

omnisci

Explorations on using MapD and Jupyter together.
Jupyter Notebook
4
star
32

pyleo

Prototype implementing Pyleoclim_util as a pandas extension array
Python
3
star
33

omnisci-datascience-installer

Installer configuration for OmniSci stack
Shell
3
star
34

vega-falcon

A Vega transform for Falcon.
Makefile
3
star
35

decorator_tutorial

Jupyter Notebook
3
star
36

scipy-2022-pragmatic-panel

scipy-2022-pragmatic-panel
Jupyter Notebook
3
star
37

jupyter-jaeger

@jupyter integration for @jaegertracing
TypeScript
3
star
38

jupyterlab-kernel-usage

Kernel usage monitor extension for JupyterLab
TypeScript
3
star
39

project-releases

Code and CI workflow for finding which pydata-ecosystem packages have had recent releases.
Python
2
star
40

conda-pytorch

Making it easy to get started with PyTorch development
Python
2
star
41

panel-chat-gpt

Python
2
star
42

ibis-mssql

Python
2
star
43

writers-workshop

the quansight writers workshop enrichment program
Python
2
star
44

nb_conda_store_kernels

Python
2
star
45

straight-forward-git

Simple git actions with notebooks.
Makefile
2
star
46

demo-dashboards

A collection of dashboard and visualization demos containing fully reproducible demos with publicly available datasets
Jupyter Notebook
2
star
47

memverge-usecases

Demos of MemVerge usage
Jupyter Notebook
2
star
48

jaeger-browser

Submit @jaegertracing traces from your browser using this Python API and JS library.
Python
2
star
49

numba-smartjit

Python
2
star
50

panel-deploy

Generic deployment scripts for Panel projects
Python
2
star
51

intake-omnisci

Intake-OmniSci: OmniSci Plugin for Intake
Python
2
star
52

docker-images

Shell
1
star
53

pyflyby-old

Python
1
star
54

diff-tar

create differential tarball of conda repository
Python
1
star
55

qurated-theme

A jupyterlab theme from quansight.
CSS
1
star
56

cybera-training-2022

Jupyter Notebook
1
star
57

qhub-home

QHub web content
Jupyter Notebook
1
star
58

cookiecutter-basic-conda

Cookiecutter for creating a basic conda package
Python
1
star
59

terraform-aws-vpc-with-subnets

A terraform module to create a vpc with dynamic subnets.
HCL
1
star
60

open-source-directions

Podcast feed for Open Source Directions
1
star
61

mapd-data

MapD redux state data
Jupyter Notebook
1
star
62

jupyterlab-immerse

Jupyter server and lab extensions for deploying OmniSci immerse side-by-side with the notebook server and JupyterLab
Python
1
star
63

ibis-benchmark

Python
1
star
64

annodize

Web forward annotations in interactive python
Jupyter Notebook
1
star