nialloriordan/data-lake-spark-aws-s3

Stars
1
Language
Python
Created over 3 years ago
Updated over 3 years ago

nialloriordan/data-lake-spark-aws-s3

nialloriordan

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Data Lake on AWS S3 and spark job for ETL scripts

airbyte-airflow-scraper

Pipeline to scrape data from Linkedin using Airbyte and Airflow

airflow-redshift-pipeline

Process data in Redshift and orchestrate pipeline with Airflow

airflow-docker

Dockerised Airflow 2.0

dbt-athena-airflow

Schedule and orchestrate dbt for Athena with Airflow

terraform-redshift-cluster

Create a simple redshift cluster using terraform to access S3 buckets