GabrielAmazonas/pyspark-emr-s3-datalake

Stars
1
Language
Python
Created over 4 years ago
Updated over 4 years ago

GabrielAmazonas/pyspark-emr-s3-datalake

GabrielAmazonas

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

hudi-on-glue-quick-start

AWS Glue PySpark - Apache Hudi Quick Start Guide

airflow-pyspark-emr

This project demonstrate how to process data stored in a data lake fashion, transforming it into an OLAP optimized structure by using PySpark. The PySpark Job runs on AWS EMR, and the Data Pipeline is orchestrated by Apache Airflow, including the infrastructure creation and the EMR cluster termination.

datasprints-open-spaces

Repository for the code demoed in the talk

Jupyter Notebook

flame

Flame 🔥 Opinionated Flask & MongoDB backend boilerplate.

delta-lake-on-glue-quickstart

This is a quick start guide for the Delta Lake (delta.io) Python Spark connector, running on AWS Glue.

aws-cft-samples

Sample Cloud Formation Template YAML configurations

code-pipeline-python-test

teamme

Team.me Chat App - Proof of Concept app writen in Kotlin

data-modeling-postgresql

Data Modeling and ETL with PostgreSQL and Python

Jupyter Notebook