weather_data_pipeline

This is a PySpark-based data pipeline that fetches weather data for a few cities, performs some basic processing and transformation on the data, and then writes the processed data to a Google Cloud Storage bucket and a BigQuery table.The data is then viewed in a looker dashboard

python_etl

Using python-sql to create ETL between mysql and postgresql and windows scheduler to automate the job.

event-driven-microservices

This project demonstrates an event-driven microservices architecture using Apache Kafka for event streaming and webhook integration with external services

python_tel_chatbot

python telegram chatbot using telegram API

python-kafka_distributed_task_queue

a simple implementation of a distributed task queue