• Stars
    star
    3,380
  • Rank 12,685 (Top 0.3 %)
  • Language
    Python
  • License
    Apache License 2.0
  • Created over 4 years ago
  • Updated 30 days ago

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

The fastest ⚡️ way to build data pipelines. Develop iteratively, deploy anywhere. ☁️

CI Linux CI macOS CI Windows Documentation Status PyPI Conda (channel only) Conda Coverage Twitter Downloads

Tip

Deploy AI apps for free on Ploomber Cloud!

Join our community | Newsletter | Contact us | Docs | Blog | Website | YouTube

Ploomber is the fastest way to build data pipelines ⚡️. Use your favorite editor (Jupyter, VSCode, PyCharm) to develop interactively and deploy ☁️ without code changes (Kubernetes, Airflow, AWS Batch, and SLURM). Do you have legacy notebooks? Refactor them into modular pipelines with a single command.

Installation

Compatible with Python 3.7 and higher.

Install with pip:

pip install ploomber

Or with conda:

conda install ploomber -c conda-forge

Getting started

Try the tutorial:

Community

Main Features

⚡️ Get started quickly

A simple YAML API to get started quickly, a powerful Python API for total flexibility.

get-started.mp4

⏱ Shorter development cycles

Automatically cache your pipeline’s previous results and only re-compute tasks that have changed since your last execution.

shorter-cycles.mp4

☁️ Deploy anywhere

Run as a shell script in a single machine or distributively in Kubernetes, Airflow, AWS Batch, or SLURM.

deploy.mp4

📙 Automated migration from legacy notebooks

Bring your old monolithic notebooks, and we’ll automatically convert them into maintainable, modular pipelines.

refactor.mp4

I want to migrate my notebook.

Show me a demo.

Resources

About Ploomber

Ploomber is a big community of data enthusiasts pushing the boundaries of Data Science and Machine Learning tooling.

Whatever your skillset is, you can contribute to our mission. So whether you're a beginner or an experienced professional, you're welcome to join us on this journey!

Click here to know how you can contribute to Ploomber.

More Repositories

1

sklearn-evaluation

Machine learning model evaluation made easy: plots, tables, HTML reports, experiment tracking and Jupyter notebook analysis.
Python
447
star
2

projects

Sample projects using Ploomber.
Jupyter Notebook
77
star
3

soorgeon

Convert monolithic Jupyter notebooks 📙 into maintainable Ploomber pipelines. 📊
Python
75
star
4

ploomber-engine

A toolbox 🧰 for Jupyter notebooks 📙: testing, experiment tracking, debugging, profiling, and more!
Python
59
star
5

soopervisor

☁️ Export Ploomber pipelines to Kubernetes (Argo), Airflow, AWS Batch, SLURM, and Kubeflow.
Python
42
star
6

nbsnapshot

Automated Jupyter notebook testing. 📙
Python
41
star
7

jupyai

JupyAI adds AI capabilities to JupyterLab.
Python
29
star
8

jupyblog

Execute code snippets in markdown files.
Python
22
star
9

posts

Complementary code for blog posts
Jupyter Notebook
22
star
10

doc

Documentation for Ploomber Cloud
Jupyter Notebook
17
star
11

sql

Jupyter Notebook
17
star
12

jupysql-plugin

TypeScript
15
star
13

notebooks-academy

📙 Notebooks Academy: Write Production-Ready Code From Jupyter.
Jupyter Notebook
12
star
14

pkgmt

A toolkit for managing Python packages. 📦🐍
Python
10
star
15

binder-env

Binder environment
Python
6
star
16

k2s

Bootstrap Python environments and Jupyter kernels.
Python
5
star
17

scaffold

Minimal structure for bootstrapping Data Science projects
Python
4
star
18

contributing

Learn how to contribute to Ploomber 👥
Jupyter Notebook
4
star
19

notebooks-ci

Example project using nbsnapshot for Continuous Integration of Jupyter notebooks.
Jupyter Notebook
3
star
20

core

Core module shared across projects.
Python
2
star
21

latam-ai

Contents for LATAM AI Workshop
Jupyter Notebook
2
star
22

pydata-nyc-22

Jupyter Notebook
2
star
23

hacktoberfest-2023-project

Init template for data pipeline project
Python
2
star
24

ci-notebooks

Contains Jupyter notebooks that Soorgeon CI is using.
Python
1
star