andresmaopal/aws-etl-orchestrator-v2 andresmaopal/aws-etl-orchestrator-v2

  • Stars
    star
    4
  • Rank 3,293,598 (Top 66 %)
  • Language
    Python
  • License
    MIT No Attribution
  • Created almost 5 years ago
  • Updated almost 5 years ago
Twitter logo Share LinkedIn logo Share Facebook logo Share
andresmaopal/aws-etl-orchestrator-v2
github

andresmaopal

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

A serverless architecture for orchestrating ETL jobs in arbitrarily-complex workflows using AWS Step Functions and AWS Lambda. Version 2 Allow Glue Spark and Python shell Jobs

More Repositories

1

data-lake-staging-engine

S3 event-based engine to process files (microbatches), transform them (parquet) and sync the source to Glue Data Catalog - (Multicountry support)
Python
6
star
2

hudi_palacan_demos

Hudi on AWS Notebook
Jupyter Notebook
1
star
3

Excel_to_LakeFormation_permissions

Lambda to Grant and Revoke permissions in bulk to Lake Formation using an user-friendly Excel template
Python
1
star