datarootsio/skeleton-pyspark datarootsio/skeleton-pyspark

  • Stars
    star
    9
  • Rank 1,939,727 (Top 39 %)
  • Language
    Python
  • License
    MIT License
  • Created over 3 years ago
  • Updated over 1 year ago
Twitter logo Share LinkedIn logo Share Facebook logo Share
datarootsio/skeleton-pyspark
github

datarootsio

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

A best-practices first project template that allows you to get started on a new pyspark project

More Repositories

1

ml-skeleton-py

A best-practices first project template that allows you to get started on a new machine learning project.
Python
142
star
2

cheek

cheek: a pico-sized declarative job scheduler
Go
135
star
3

databooks

A CLI tool to reduce the friction between data scientists by reducing git conflicts removing notebook metadata and gracefully resolving git conflicts.
Python
108
star
4

artyfarty

ggplot2 theme + palette presets
R
96
star
5

tf-profile

CLI tool to profile Terraform runs, written in Go
Go
94
star
6

tutorial-face-mask-detection

In this project, we develop a pipeline to detect unmasked faces in images. This can, for example, be used to alert people that do not wear a mask when entering a building.
Jupyter Notebook
86
star
7

terraform-aws-ecs-airflow

A terraform module that creates an airflow instance in AWS ECS.
HCL
53
star
8

fresh-coffee-listener

Using a raspberry pi, we listen to the coffee machine and count the number of coffee consumption
Python
51
star
9

prefect-dbt-flow

prefect integration for running dbt
Python
46
star
10

tutorial-great-expectations

A tutorial for the Great Expectations library.
Jupyter Notebook
39
star
11

terraform-module-azure-datalake

Terraform module for an Azure Data Lake
HCL
29
star
12

tutorial-streamlit-demo

Python
29
star
13

tutorial-mlops

MLOps exercise material.
Jupyter Notebook
24
star
14

bikefitting

Graduation project of the rootsacademy: A bikefitting application consisting of a website where users can upload a short video of themselves on a bike trainer and will receive a recommendation to either move the bike saddle up or down.
Python
20
star
15

terraform-module-kubeflow

Kubeflow deployment purely in Terraform
HCL
19
star
16

expiring-lru-cache

LRU caching with expiration period.
Python
17
star
17

terraform-aws-ecs-dagster

A terraform module that deploys Dagster to AWS, using ECS.
HCL
16
star
18

terraform-module-kubernetes-application

Terraform module for a kubernetes application
HCL
15
star
19

.github

🚀 Get started in our repos
Python
12
star
20

python-minimal-boilerplate

Some minimal Python boilerplate.
Python
11
star
21

github-stats-card

⭐️ a minimal but inclusive github stats badge ⭐️
TypeScript
11
star
22

dbt-fabric

Python
10
star
23

terraform-provider-kubeflowpipelines

Terraform provider for Kubeflow pipelines API
Go
8
star
24

deploy-spark-streaming-ml

8
star
25

notion-dbs-data-quality

Using Great Expectations and Notion's API, this repo aims to provide data quality for our databases in Notion.
Python
8
star
26

anomalib-demo

Jupyter Notebook
6
star
27

OsConfig

Bash scrips for Data professionals OS configuration
Shell
4
star
28

knowledgebase_guardian

A minimal example to demonstrate how LLM's can assist in detecting contradictions in documents.
Python
3
star
29

phonehome

KISS telemetry for FOSS packages
Go
3
star
30

workshop-image-segmentation-style-transfer

Jupyter Notebook
2
star
31

terraform-module-azure-snowflake

HCL
2
star
32

mlflow-emissions-sdk

This package logs the carbon emissions of machine learning models 🌿
Python
2
star
33

rootsstyle

A dataroots inspired style for Matplotlib. Works with any visualization tools that builds upon Matplotlib (seaborn, pandas).
Python
2
star
34

snowflake-ml

Toy use case on how to use Snowflake as a full ML platform.
Python
2
star
35

rootscamp2019-session4

session 4 - building an API assets
Python
1
star
36

terraform-azurerm-aci-dagster

A terraform module that deploys Dagster to Azure.
HCL
1
star
37

dbt-fabric-demo

Demo project for dbt-fabric
1
star
38

tutorial-hyperparameter-optimization

Tutorial for Rootlabs@Lunch: Practical Hyperparameter Optimisation
Jupyter Notebook
1
star
39

transforming-tabular-data

Comparing Pandas v. Polars v. PyArrow v. DuckDB 🐼🐻‍❄️🏹🦆
Jupyter Notebook
1
star
40

homebrew-tf-profile

This is a homebrew formulae for tf-profile.
Ruby
1
star