elt_with_scalable_data_warehouse

A project that creates a scalable and robust ELT data pipeline leveraging PostgreSQL , DBT, Orchestration using airflow and data visualization with Redash

image-annotation-pipeline-with-AWS

This project implements an image annotation pipeline using AWS, Apache Kafka and airflow, featuring a Flask web application for labeling images. The annotated images are automatically uploaded to an S3 bucket, ensuring efficient and scalable data processing.

Migrate_traffic_data

AWS-FOR-DATA-ENGINEERING