datarootsio/skeleton-pyspark

Stars
9
Rank 1,939,727 (Top 39 %)
Language
Python
License
MIT License
Created over 3 years ago
Updated over 1 year ago

datarootsio/skeleton-pyspark

datarootsio

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

A best-practices first project template that allows you to get started on a new pyspark project

ml-skeleton-py

A best-practices first project template that allows you to get started on a new machine learning project.

cheek

cheek: a pico-sized declarative job scheduler

databooks

A CLI tool to reduce the friction between data scientists by reducing git conflicts removing notebook metadata and gracefully resolving git conflicts.

artyfarty

ggplot2 theme + palette presets

tf-profile

CLI tool to profile Terraform runs, written in Go

tutorial-face-mask-detection

In this project, we develop a pipeline to detect unmasked faces in images. This can, for example, be used to alert people that do not wear a mask when entering a building.

Jupyter Notebook

terraform-aws-ecs-airflow

A terraform module that creates an airflow instance in AWS ECS.

fresh-coffee-listener

Using a raspberry pi, we listen to the coffee machine and count the number of coffee consumption

prefect-dbt-flow

prefect integration for running dbt

tutorial-great-expectations

A tutorial for the Great Expectations library.

Jupyter Notebook

terraform-module-azure-datalake

Terraform module for an Azure Data Lake

tutorial-streamlit-demo

tutorial-mlops

MLOps exercise material.

Jupyter Notebook

bikefitting

Graduation project of the rootsacademy: A bikefitting application consisting of a website where users can upload a short video of themselves on a bike trainer and will receive a recommendation to either move the bike saddle up or down.

terraform-module-kubeflow

Kubeflow deployment purely in Terraform

expiring-lru-cache

LRU caching with expiration period.

terraform-aws-ecs-dagster

A terraform module that deploys Dagster to AWS, using ECS.

terraform-module-kubernetes-application

Terraform module for a kubernetes application

.github

🚀 Get started in our repos

python-minimal-boilerplate

Some minimal Python boilerplate.

github-stats-card

⭐️ a minimal but inclusive github stats badge ⭐️

dbt-fabric

terraform-provider-kubeflowpipelines

Terraform provider for Kubeflow pipelines API

deploy-spark-streaming-ml

notion-dbs-data-quality

Using Great Expectations and Notion's API, this repo aims to provide data quality for our databases in Notion.

anomalib-demo

Jupyter Notebook

OsConfig

Bash scrips for Data professionals OS configuration

knowledgebase_guardian

A minimal example to demonstrate how LLM's can assist in detecting contradictions in documents.

phonehome

KISS telemetry for FOSS packages

workshop-image-segmentation-style-transfer

Jupyter Notebook

terraform-module-azure-snowflake

mlflow-emissions-sdk

This package logs the carbon emissions of machine learning models 🌿

rootsstyle

A dataroots inspired style for Matplotlib. Works with any visualization tools that builds upon Matplotlib (seaborn, pandas).

snowflake-ml

Toy use case on how to use Snowflake as a full ML platform.

rootscamp2019-session4

session 4 - building an API assets

terraform-azurerm-aci-dagster

A terraform module that deploys Dagster to Azure.

dbt-fabric-demo

Demo project for dbt-fabric

tutorial-hyperparameter-optimization

Tutorial for Rootlabs@Lunch: Practical Hyperparameter Optimisation

Jupyter Notebook

transforming-tabular-data

Comparing Pandas v. Polars v. PyArrow v. DuckDB 🐼🐻‍❄️🏹🦆

Jupyter Notebook

homebrew-tf-profile

This is a homebrew formulae for tf-profile.