Serge-Ntumba/Daily_automated_ETL

Stars
1
Language
Python
Created 11 months ago
Updated 11 months ago

Serge-Ntumba/Daily_automated_ETL

Serge-Ntumba

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

This project focuses on the seamless integration of data from a CSV file into a PostgreSQL database using Python. Additionally, Airflow is employed to perform a daily extraction of this data, transferring it to an S3 Bucket for further analysis and storage.

NextJS-Supabase

NFT_Marketplace_mobile_app

CRUD-REACT-TUTORIAL

How to create, read , update and delete in React

Spring-Animation

ReactContribution

uber

Transactions-Explorer-Etherium

introjs

introjs with hooks

Task-Tracker

GROW-POS

Scope-tutorial

styled-components

dok95-t

T-work

scorosTaskl

Expenses-Tracker

Portfolio-Website

MERN-PROJECT

Serge-Ntumba

VIDEO-CHAT-APP

Video chap app with Node, Express, Socket.io and React

jackpot_panel

Roadmap-Data-Science

self-directed educational materials for Data Science! As I embark on my own Data Science journey, I've curated this repository for personal use. However, if you find it beneficial, don't hesitate to give it a star!

data-streaming-in-realtime

Orchestrating data with airflow to kafka, kafka produces the data to spark and then spark stream the received data to cassandra

TS-CRACH-COURSE

ReactUsersSpentTimeCalendar

stream_data_with_kafka_docker_airflow_spark

A complete data pipeline, from data extraction to storage, using a combination of tools for specific purposes: Python for data retrieval from API, Airflow for scheduling task, Kafka for data streaming, Spark for data processing, and Cassandra for data storage.